2024-09-14T11:03:56.434 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T11:03:56.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:03:56.546 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172 branch: main description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904172' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLh3wyQkiACyCkcVFiaeyunGp7P8WIyesZYKhWlnfMBupFUTT0Tn5hSaV7QzCBGVOlN94fpGrUBNzOkc5g6bl7k= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJj5L4CIpdoFJ8/7h67Ih9gGSmMDiOsGtMz95V5PZrZ3qYT8papP3kpDMbIC1Dg5dqIUpoUU3hhCw0ZCTw30zJ8= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T11:03:56.546 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T11:03:56.547 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T11:03:56.547 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T11:03:56.549 INFO:teuthology.task.internal:Checking packages... 2024-09-14T11:03:56.575 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T11:03:56.575 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T11:03:56.575 INFO:teuthology.packaging:ref: None 2024-09-14T11:03:56.575 INFO:teuthology.packaging:tag: None 2024-09-14T11:03:56.575 INFO:teuthology.packaging:branch: main 2024-09-14T11:03:56.575 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:03:56.576 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T11:03:56.799 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T11:03:56.801 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T11:03:56.808 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T11:03:56.808 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T11:03:56.832 INFO:teuthology.task.internal:Saving configuration 2024-09-14T11:03:56.854 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T11:03:56.860 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T11:03:56.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:58:43.472577', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLh3wyQkiACyCkcVFiaeyunGp7P8WIyesZYKhWlnfMBupFUTT0Tn5hSaV7QzCBGVOlN94fpGrUBNzOkc5g6bl7k='} 2024-09-14T11:03:56.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:58:43.470597', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJj5L4CIpdoFJ8/7h67Ih9gGSmMDiOsGtMz95V5PZrZ3qYT8papP3kpDMbIC1Dg5dqIUpoUU3hhCw0ZCTw30zJ8='} 2024-09-14T11:03:56.908 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T11:03:56.914 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:03:56.914 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:03:56.914 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T11:03:56.986 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb57aa13be0>, signals=[15]) 2024-09-14T11:03:56.986 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T11:03:56.992 INFO:teuthology.task.internal:Opening connections... 2024-09-14T11:03:56.992 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T11:03:56.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:57.072 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T11:03:57.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:57.152 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T11:03:57.159 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-14T11:03:57.178 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-14T11:03:57.178 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-14T11:03:57.235 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:03:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:03:57.237 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:03:57.237 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:03:57.237 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:03:57.238 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-14T11:03:57.258 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-14T11:03:57.276 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-14T11:03:57.277 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-14T11:03:57.334 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-14T11:03:57.334 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-14T11:03:57.334 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-14T11:03:57.334 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:03:57.334 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-14T11:03:57.334 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:03:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:03:57.335 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-14T11:03:57.358 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T11:03:57.366 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T11:03:57.371 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T11:03:57.371 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:03:57.374 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:03:57.391 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T11:03:57.396 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T11:03:57.397 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:03:57.431 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:03:57.459 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T11:03:57.512 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T11:03:57.527 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T11:03:57.527 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T11:03:57.528 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:03:57.528 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:03:57.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:57.545 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-14T11:03:57.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:57.546 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-14T11:03:57.604 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:03:57.604 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.14.0-503.el9.x86_64 2024-09-14T11:03:57.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2024-09-14T11:03:57.606 INFO:teuthology.orchestra.run.smithi189.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:03:57.606 INFO:teuthology.task.kernel:Running kernel on smithi189: 5.14.0-503.el9.x86_64 2024-09-14T11:03:57.607 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum install -y kernel 2024-09-14T11:03:59.805 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-14T11:04:01.765 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-14T11:04:02.059 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-14T11:04:03.785 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-14T11:04:06.899 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-14T11:04:08.586 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-14T11:04:09.191 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-14T11:04:10.220 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 19 kB 00:00 2024-09-14T11:04:10.287 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-14T11:04:11.099 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-14T11:04:15.793 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-14T11:04:16.671 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-14T11:04:17.840 INFO:teuthology.orchestra.run.smithi189.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:04:17.841 INFO:teuthology.orchestra.run.smithi189.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:04:17.935 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-14T11:04:17.940 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-09-14T11:04:17.940 INFO:teuthology.orchestra.run.smithi189.stdout: Package Architecture Version Repository Size 2024-09-14T11:04:17.940 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-09-14T11:04:17.940 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout:================================================================================ 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout:Install 4 Packages 2024-09-14T11:04:17.941 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:04:17.942 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 79 M 2024-09-14T11:04:17.942 INFO:teuthology.orchestra.run.smithi189.stdout:Installed size: 126 M 2024-09-14T11:04:17.942 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-14T11:04:18.194 INFO:teuthology.orchestra.run.smithi189.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 190 kB/s | 23 kB 00:00 2024-09-14T11:04:18.794 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:04:18.794 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:04:18.892 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-14T11:04:18.907 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-14T11:04:18.907 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-09-14T11:04:18.907 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-14T11:04:18.907 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-14T11:04:18.907 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout:Install 4 Packages 2024-09-14T11:04:18.908 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:04:18.909 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 79 M 2024-09-14T11:04:18.909 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 126 M 2024-09-14T11:04:18.909 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-14T11:04:19.233 INFO:teuthology.orchestra.run.smithi007.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 288 kB/s | 23 kB 00:00 2024-09-14T11:04:19.600 INFO:teuthology.orchestra.run.smithi007.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-14T11:04:20.008 INFO:teuthology.orchestra.run.smithi007.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 40 MB/s | 35 MB 00:00 2024-09-14T11:04:20.342 INFO:teuthology.orchestra.run.smithi007.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-14T11:04:20.343 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:04:20.343 INFO:teuthology.orchestra.run.smithi007.stdout:Total 55 MB/s | 79 MB 00:01 2024-09-14T11:04:21.048 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-14T11:04:21.414 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-14T11:04:21.414 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-14T11:04:22.398 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-14T11:04:22.398 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-14T11:04:24.802 INFO:teuthology.orchestra.run.smithi189.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:06 2024-09-14T11:04:24.966 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-14T11:04:25.652 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:04:25.784 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:28.570 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:28.710 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:31.059 INFO:teuthology.orchestra.run.smithi189.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.2 MB/s | 29 MB 00:12 2024-09-14T11:04:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:04:34.260 INFO:teuthology.orchestra.run.smithi189.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-14T11:04:34.260 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:04:34.260 INFO:teuthology.orchestra.run.smithi189.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-14T11:04:34.938 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-14T11:04:35.305 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-14T11:04:35.305 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-14T11:04:36.253 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-14T11:04:36.254 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-14T11:04:38.701 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-14T11:04:39.014 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:04:39.528 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:04:39.610 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:42.421 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:42.556 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:47.381 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:47.489 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:04:52.332 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:18.341 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:18.381 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:18.779 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:18.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:05:18.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:05:18.779 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:05:19.628 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-14T11:05:19.956 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:20.088 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:20.088 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:20.088 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:05:20.088 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:05:20.089 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:05:20.089 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T11:05:20.089 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:05:20.089 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:20.147 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:20.147 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:20.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-09-14T11:05:20.184 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-09-14T11:05:20.184 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-09-14T11:05:20.184 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 82.el9 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8274670 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-09-14T11:05:20.185 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:05:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:05:20.187 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:05:20.187 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:05:20.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:05:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-14T11:05:22.185 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:05:22.225 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-14T11:05:22.227 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-14T11:05:22.242 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.bkqZFbXyGN 2024-09-14T11:05:22.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bkqZFbXyGN 2024-09-14T11:05:22.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.bkqZFbXyGN 2024-09-14T11:05:22.447 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.bkqZFbXyGN is 6KB 2024-09-14T11:05:22.495 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.bkqZFbXyGN 2024-09-14T11:05:22.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:05:22.579 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:05:22.580 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:05:22.580 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:05:22.580 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:05:22.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:05:22.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-14T11:05:30.437 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:30.477 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:30.821 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:30.821 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:05:30.822 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:05:30.822 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:05:31.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:05:31.663 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-14T11:05:32.039 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:32.119 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:32.119 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:32.119 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:05:32.119 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:05:32.120 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:05:32.120 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T11:05:32.120 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi189.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:05:32.120 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:32.178 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:32.178 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:32.178 DEBUG:teuthology.orchestra.run.smithi189:> sudo rpm -qi grub2-tools 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Name : grub2-tools 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Epoch : 1 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Version : 2.06 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Release : 82.el9 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: x86_64 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Group : Unspecified 2024-09-14T11:05:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:Size : 8274670 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:License : GPLv3+ 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Packager : builder@centos.org 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Vendor : CentOS 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Summary : Support tools for GRUB. 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:Description : 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:05:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:05:32.212 INFO:teuthology.orchestra.run.smithi189.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:05:32.212 INFO:teuthology.orchestra.run.smithi189.stdout:hardware devices. 2024-09-14T11:05:32.212 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:05:32.212 INFO:teuthology.orchestra.run.smithi189.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:05:32.213 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:05:32.213 INFO:teuthology.task.kernel:Updating grub on smithi189 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:05:32.213 DEBUG:teuthology.orchestra.run.smithi189:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:05:32.897 INFO:teuthology.orchestra.run.smithi189.stderr:Generating grub configuration file ... 2024-09-14T11:05:34.243 INFO:teuthology.orchestra.run.smithi189.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:05:34.270 INFO:teuthology.orchestra.run.smithi189.stderr:done 2024-09-14T11:05:34.272 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-14T11:05:34.288 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.ToRxyCs7Qd 2024-09-14T11:05:34.288 DEBUG:teuthology.orchestra.run.smithi189:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ToRxyCs7Qd 2024-09-14T11:05:34.355 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.ToRxyCs7Qd 2024-09-14T11:05:34.488 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.ToRxyCs7Qd is 6KB 2024-09-14T11:05:34.509 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.ToRxyCs7Qd 2024-09-14T11:05:34.525 DEBUG:teuthology.orchestra.run.smithi189:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:05:34.588 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:05:34.588 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:05:34.588 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:05:34.588 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:05:34.590 DEBUG:teuthology.orchestra.run.smithi189:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:05:34.749 DEBUG:teuthology.orchestra.run.smithi189:> sudo shutdown -r now 2024-09-14T11:05:52.761 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T11:05:52.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-14T11:05:52.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:04.758 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T11:06:04.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-14T11:06:04.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:11.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-14T11:06:20.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-14T11:06:20.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:23.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-14T11:06:35.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-14T11:06:35.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:39.297 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-14T11:06:48.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-14T11:06:48.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:07:07.078 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-14T11:07:07.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-14T11:07:07.442 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:07:07.442 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-14T11:07:07.457 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:07:07.534 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:07:07.534 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:07:07.535 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:07:08.535 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T11:07:08.536 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:07:08.649 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2024-09-14T11:07:08.662 DEBUG:teuthology.parallel:result is None 2024-09-14T11:07:48.310 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T11:08:00.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-14T11:08:00.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:08:00.797 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-14T11:08:01.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-14T11:08:01.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:08:01.159 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-14T11:08:01.176 INFO:teuthology.orchestra.run.smithi189.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:08:01.176 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:08:01.177 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:08:01.177 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:08:02.178 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T11:08:02.178 DEBUG:teuthology.orchestra.run.smithi189:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:08:02.277 INFO:teuthology.orchestra.run.smithi189.stdout:ttyS1 2024-09-14T11:08:02.298 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:02.298 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T11:08:02.306 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T11:08:02.306 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:08:02.309 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:08:02.328 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T11:08:02.336 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T11:08:02.382 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T11:08:02.383 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:08:02.385 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:08:02.417 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T11:08:02.426 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T11:08:02.426 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:08:02.453 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:08:02.500 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:08:02.501 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:08:02.511 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:08:02.514 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:08:02.516 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T11:08:02.524 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T11:08:02.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:08:02.527 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:08:02.555 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T11:08:02.564 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T11:08:02.565 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:08:02.597 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:08:02.613 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:08:02.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:08:02.750 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:08:02.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:08:02.877 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:08:02.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:08:02.946 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:08:02.996 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:08:03.044 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:08:03.130 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:08:03.173 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:08:03.173 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:08:03.241 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-14T11:08:03.244 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-14T11:08:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:08:03.335 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:08:03.743 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T11:08:03.750 INFO:teuthology.task.internal:Starting timer... 2024-09-14T11:08:03.750 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T11:08:03.761 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T11:08:03.771 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-09-14T11:08:03.823 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-09-14T11:08:03.825 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-14T11:08:03.880 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-14T11:08:03.882 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T11:08:03.883 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-09-14T11:08:03.916 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-09-14T11:08:03.917 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-14T11:08:03.937 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-14T11:08:03.937 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-09-14T11:08:03.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:08:03.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:03.988 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:08:04.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:04.016 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T11:08:04.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:08:04.063 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:08:04.107 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T11:08:04.115 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T11:08:04.118 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T11:08:04.226 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T11:08:04.240 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T11:08:04.241 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:11:53.534 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-14T11:11:53.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-14T11:11:53.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:11:53.618 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-14T11:11:53.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-14T11:11:53.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-14T11:11:53.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:11:53.779 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-14T11:11:53.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-14T11:11:53.866 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:11:53.876 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:11:53.876 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:11:53.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:11:53.879 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:11:53.879 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:11:53.911 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:11:53.928 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:11:53.939 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:11:53.955 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:11:53.955 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-09-14T11:11:53.968 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-09-14T11:11:53.981 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-14T11:11:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:11:53.992 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-14T11:11:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:11:54.007 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:11:54.021 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:11:54.059 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:11:54.064 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:11:54.064 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-14T11:11:54.064 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.064 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.064 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.064 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.086 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:11:54.090 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:11:54.090 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-14T11:11:54.090 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.090 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.090 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.090 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:11:54.090 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:11:54.098 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:11:54.098 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:11:54.099 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:11:54.099 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:11:54.104 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:11:54.104 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:11:54.105 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:11:54.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:11:54.107 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:11:54.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:11:54.253 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:11:54.253 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:11:54.259 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:11:54.259 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:11:54.365 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:11:54.365 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:11:54.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:11:54.377 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:11:54.377 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:11:54.377 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:11:54.393 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:11:54.393 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:11:54.403 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:11:54.403 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:11:54.461 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:11:54.469 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:11:54.539 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:11:54.545 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:11:54.605 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-09-14T11:11:54.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-09-14T11:11:54.610 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-14T11:11:54.611 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-14T11:11:54.837 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-14T11:11:54.852 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-09-14T11:11:54.864 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:11:54.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:11:55.429 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-14T11:11:55.457 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-14T11:11:55.722 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T11:11:55.758 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-14T11:11:55.991 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-14T11:11:56.042 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-14T11:11:56.458 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-14T11:11:57.876 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-14T11:11:58.375 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-14T11:11:59.869 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-14T11:12:02.860 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-14T11:12:04.311 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-14T11:12:04.377 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 19 kB 00:00 2024-09-14T11:12:05.248 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-14T11:12:05.779 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-14T11:12:06.608 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-14T11:12:10.712 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T11:12:12.222 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T11:12:13.139 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:12:13.140 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:12:13.232 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================================== 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================================== 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:12:13.263 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:12:13.264 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-14T11:12:13.265 INFO:teuthology.orchestra.run.smithi189.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:12:13.266 INFO:teuthology.orchestra.run.smithi189.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:12:13.267 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:12:13.268 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:12:13.269 INFO:teuthology.orchestra.run.smithi189.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:12:13.270 INFO:teuthology.orchestra.run.smithi189.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:12:13.271 INFO:teuthology.orchestra.run.smithi189.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:12:13.272 INFO:teuthology.orchestra.run.smithi189.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:12:13.273 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:12:13.274 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:12:13.275 INFO:teuthology.orchestra.run.smithi189.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:12:13.276 INFO:teuthology.orchestra.run.smithi189.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:12:13.277 INFO:teuthology.orchestra.run.smithi189.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:12:13.278 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:12:13.279 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:12:13.280 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:12:13.281 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:12:13.282 INFO:teuthology.orchestra.run.smithi189.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:12:13.283 INFO:teuthology.orchestra.run.smithi189.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:12:13.284 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================================== 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout:Install 284 Packages 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 2 Packages 2024-09-14T11:12:13.285 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:12:13.286 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 327 M 2024-09-14T11:12:13.286 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-14T11:12:13.788 INFO:teuthology.orchestra.run.smithi189.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-14T11:12:14.005 INFO:teuthology.orchestra.run.smithi189.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 4.1 MB/s | 900 kB 00:00 2024-09-14T11:12:14.080 INFO:teuthology.orchestra.run.smithi189.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.9 MB/s | 145 kB 00:00 2024-09-14T11:12:14.239 INFO:teuthology.orchestra.run.smithi189.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 9.3 MB/s | 5.5 MB 00:00 2024-09-14T11:12:14.356 INFO:teuthology.orchestra.run.smithi189.stdout:(5/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 13 MB/s | 1.5 MB 00:00 2024-09-14T11:12:14.423 INFO:teuthology.orchestra.run.smithi189.stdout:(6/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 7.0 MB/s | 2.4 MB 00:00 2024-09-14T11:12:14.631 INFO:teuthology.orchestra.run.smithi189.stdout:(7/286): ceph-common-19.3.0-4907.ga2782315.el9. 22 MB/s | 22 MB 00:00 2024-09-14T11:12:14.649 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:12:14.650 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:12:14.723 INFO:teuthology.orchestra.run.smithi189.stdout:(8/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-14T11:12:14.746 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-14T11:12:14.773 INFO:teuthology.orchestra.run.smithi189.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 504 kB/s | 25 kB 00:00 2024-09-14T11:12:14.775 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================== 2024-09-14T11:12:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-09-14T11:12:14.775 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================== 2024-09-14T11:12:14.775 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-14T11:12:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:12:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:12:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:12:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:12:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:12:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:12:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:12:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:12:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:12:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:12:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:12:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:12:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:12:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:12:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:12:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:12:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:12:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:12:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:12:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:12:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:12:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:12:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:12:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:12:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:12:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:12:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:12:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:12:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:12:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:12:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:12:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:12:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:12:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:12:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:12:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:12:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:12:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:12:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:12:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:12:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:12:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:12:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:12:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:12:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:12:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:12:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:12:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:12:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:12:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:12:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:12:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:12:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:12:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:12:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:12:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:12:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:12:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:12:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:12:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:12:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:12:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:12:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:12:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:12:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:12:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:12:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:12:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:12:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:12:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:12:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:12:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:12:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:12:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:12:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:12:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:12:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:12:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:12:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:12:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:12:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:12:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:12:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:12:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:12:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:12:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:12:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:12:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:12:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:12:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:12:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:12:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:12:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:12:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:12:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:12:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:12:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:12:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:12:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:12:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:12:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:12:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:12:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:12:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:12:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:12:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:12:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:12:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:12:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:12:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:12:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:12:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:12:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:12:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:12:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:12:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:12:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:12:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:12:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:12:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================================== 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout:Install 284 Packages 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 2 Packages 2024-09-14T11:12:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:12:14.810 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 327 M 2024-09-14T11:12:14.810 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-14T11:12:15.074 INFO:teuthology.orchestra.run.smithi189.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 25 MB/s | 11 MB 00:00 2024-09-14T11:12:15.132 INFO:teuthology.orchestra.run.smithi189.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 546 kB/s | 32 kB 00:00 2024-09-14T11:12:15.224 INFO:teuthology.orchestra.run.smithi189.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 8.1 MB/s | 756 kB 00:00 2024-09-14T11:12:15.273 INFO:teuthology.orchestra.run.smithi007.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-09-14T11:12:15.316 INFO:teuthology.orchestra.run.smithi189.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 1.7 MB/s | 161 kB 00:00 2024-09-14T11:12:15.399 INFO:teuthology.orchestra.run.smithi189.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.5 MB/s | 127 kB 00:00 2024-09-14T11:12:15.500 INFO:teuthology.orchestra.run.smithi189.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 5.0 MB/s | 508 kB 00:00 2024-09-14T11:12:15.857 INFO:teuthology.orchestra.run.smithi007.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 1.5 MB/s | 900 kB 00:00 2024-09-14T11:12:15.908 INFO:teuthology.orchestra.run.smithi189.stdout:(16/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 17 MB 00:01 2024-09-14T11:12:15.924 INFO:teuthology.orchestra.run.smithi007.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 2.1 MB/s | 145 kB 00:00 2024-09-14T11:12:16.000 INFO:teuthology.orchestra.run.smithi189.stdout:(17/286): librgw2-19.3.0-4907.ga2782315.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-14T11:12:16.025 INFO:teuthology.orchestra.run.smithi189.stdout:(18/286): python3-ceph-argparse-19.3.0-4907.ga2 387 kB/s | 45 kB 00:00 2024-09-14T11:12:16.051 INFO:teuthology.orchestra.run.smithi189.stdout:(19/286): python3-ceph-common-19.3.0-4907.ga278 2.8 MB/s | 143 kB 00:00 2024-09-14T11:12:16.076 INFO:teuthology.orchestra.run.smithi189.stdout:(20/286): python3-cephfs-19.3.0-4907.ga2782315. 3.1 MB/s | 161 kB 00:00 2024-09-14T11:12:16.110 INFO:teuthology.orchestra.run.smithi189.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 5.3 MB/s | 320 kB 00:00 2024-09-14T11:12:16.135 INFO:teuthology.orchestra.run.smithi189.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 5.1 MB/s | 305 kB 00:00 2024-09-14T11:12:16.160 INFO:teuthology.orchestra.run.smithi189.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.9 MB/s | 99 kB 00:00 2024-09-14T11:12:16.185 INFO:teuthology.orchestra.run.smithi189.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T11:12:16.244 INFO:teuthology.orchestra.run.smithi189.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-14T11:12:16.307 INFO:teuthology.orchestra.run.smithi007.stdout:(4/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 6.2 MB/s | 2.4 MB 00:00 2024-09-14T11:12:16.319 INFO:teuthology.orchestra.run.smithi189.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 457 kB/s | 34 kB 00:00 2024-09-14T11:12:16.378 INFO:teuthology.orchestra.run.smithi189.stdout:(27/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 15 MB/s | 3.2 MB 00:00 2024-09-14T11:12:16.403 INFO:teuthology.orchestra.run.smithi189.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 1.8 MB/s | 154 kB 00:00 2024-09-14T11:12:16.683 INFO:teuthology.orchestra.run.smithi007.stdout:(5/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 4.1 MB/s | 1.5 MB 00:00 2024-09-14T11:12:16.983 INFO:teuthology.orchestra.run.smithi007.stdout:(6/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 2.9 MB/s | 5.5 MB 00:01 2024-09-14T11:12:17.321 INFO:teuthology.orchestra.run.smithi189.stdout:(29/286): ceph-test-19.3.0-4907.ga2782315.el9.x 20 MB/s | 50 MB 00:02 2024-09-14T11:12:17.412 INFO:teuthology.orchestra.run.smithi189.stdout:(30/286): ceph-mgr-diskprediction-local-19.3.0- 7.3 MB/s | 7.4 MB 00:01 2024-09-14T11:12:17.438 INFO:teuthology.orchestra.run.smithi189.stdout:(31/286): ceph-mgr-modules-core-19.3.0-4907.ga2 2.4 MB/s | 291 kB 00:00 2024-09-14T11:12:17.463 INFO:teuthology.orchestra.run.smithi189.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 990 kB/s | 49 kB 00:00 2024-09-14T11:12:17.488 INFO:teuthology.orchestra.run.smithi189.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 328 kB/s | 16 kB 00:00 2024-09-14T11:12:17.513 INFO:teuthology.orchestra.run.smithi189.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.6 MB/s | 285 kB 00:00 2024-09-14T11:12:17.564 INFO:teuthology.orchestra.run.smithi189.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 10 MB/s | 784 kB 00:00 2024-09-14T11:12:17.600 INFO:teuthology.orchestra.run.smithi007.stdout:(7/286): ceph-common-19.3.0-4907.ga2782315.el9. 8.6 MB/s | 22 MB 00:02 2024-09-14T11:12:17.672 INFO:teuthology.orchestra.run.smithi189.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 784 kB/s | 85 kB 00:00 2024-09-14T11:12:17.675 INFO:teuthology.orchestra.run.smithi007.stdout:(8/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 4.8 MB/s | 4.8 MB 00:00 2024-09-14T11:12:17.706 INFO:teuthology.orchestra.run.smithi189.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.7 MB/s | 335 kB 00:00 2024-09-14T11:12:17.717 INFO:teuthology.orchestra.run.smithi007.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 609 kB/s | 25 kB 00:00 2024-09-14T11:12:17.849 INFO:teuthology.orchestra.run.smithi189.stdout:(38/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 9.6 MB/s | 14 MB 00:01 2024-09-14T11:12:17.873 INFO:teuthology.orchestra.run.smithi189.stdout:(39/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 246 kB/s | 49 kB 00:00 2024-09-14T11:12:17.898 INFO:teuthology.orchestra.run.smithi189.stdout:(40/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 1.3 MB/s | 262 kB 00:00 2024-09-14T11:12:17.965 INFO:teuthology.orchestra.run.smithi189.stdout:(41/286): libgfortran-11.5.0-2.el9.x86_64.rpm 8.5 MB/s | 801 kB 00:00 2024-09-14T11:12:17.990 INFO:teuthology.orchestra.run.smithi189.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 293 kB/s | 27 kB 00:00 2024-09-14T11:12:18.015 INFO:teuthology.orchestra.run.smithi189.stdout:(43/286): fuse-2.9.9-16.el9.x86_64.rpm 477 kB/s | 80 kB 00:00 2024-09-14T11:12:18.049 INFO:teuthology.orchestra.run.smithi189.stdout:(44/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-14T11:12:18.075 INFO:teuthology.orchestra.run.smithi189.stdout:(45/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-09-14T11:12:18.133 INFO:teuthology.orchestra.run.smithi189.stdout:(46/286): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-14T11:12:18.142 INFO:teuthology.orchestra.run.smithi007.stdout:(10/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 15 MB/s | 17 MB 00:01 2024-09-14T11:12:18.158 INFO:teuthology.orchestra.run.smithi189.stdout:(47/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-14T11:12:18.184 INFO:teuthology.orchestra.run.smithi189.stdout:(48/286): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-09-14T11:12:18.209 INFO:teuthology.orchestra.run.smithi189.stdout:(49/286): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 135 kB 00:00 2024-09-14T11:12:18.234 INFO:teuthology.orchestra.run.smithi189.stdout:(50/286): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-14T11:12:18.259 INFO:teuthology.orchestra.run.smithi189.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-14T11:12:18.276 INFO:teuthology.orchestra.run.smithi007.stdout:(11/286): ceph-radosgw-19.3.0-4907.ga2782315.el 16 MB/s | 11 MB 00:00 2024-09-14T11:12:18.301 INFO:teuthology.orchestra.run.smithi007.stdout:(12/286): libcephfs-devel-19.3.0-4907.ga2782315 200 kB/s | 32 kB 00:00 2024-09-14T11:12:18.343 INFO:teuthology.orchestra.run.smithi007.stdout:(13/286): libcephfs2-19.3.0-4907.ga2782315.el9. 11 MB/s | 756 kB 00:00 2024-09-14T11:12:18.377 INFO:teuthology.orchestra.run.smithi007.stdout:(14/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.1 MB/s | 161 kB 00:00 2024-09-14T11:12:18.402 INFO:teuthology.orchestra.run.smithi007.stdout:(15/286): librados-devel-19.3.0-4907.ga2782315. 2.1 MB/s | 127 kB 00:00 2024-09-14T11:12:18.410 INFO:teuthology.orchestra.run.smithi189.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 3.2 MB/s | 650 kB 00:00 2024-09-14T11:12:18.453 INFO:teuthology.orchestra.run.smithi007.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 6.6 MB/s | 508 kB 00:00 2024-09-14T11:12:18.512 INFO:teuthology.orchestra.run.smithi007.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 774 kB/s | 45 kB 00:00 2024-09-14T11:12:18.577 INFO:teuthology.orchestra.run.smithi189.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.6 MB/s | 523 kB 00:00 2024-09-14T11:12:18.578 INFO:teuthology.orchestra.run.smithi007.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 2.1 MB/s | 143 kB 00:00 2024-09-14T11:12:18.593 INFO:teuthology.orchestra.run.smithi189.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 387 kB/s | 71 kB 00:00 2024-09-14T11:12:18.619 INFO:teuthology.orchestra.run.smithi189.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 7.1 MB/s | 302 kB 00:00 2024-09-14T11:12:18.644 INFO:teuthology.orchestra.run.smithi189.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 283 kB 00:00 2024-09-14T11:12:18.670 INFO:teuthology.orchestra.run.smithi007.stdout:(19/286): librgw2-19.3.0-4907.ga2782315.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-14T11:12:18.677 INFO:teuthology.orchestra.run.smithi189.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 9.3 MB/s | 559 kB 00:00 2024-09-14T11:12:18.702 INFO:teuthology.orchestra.run.smithi189.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-14T11:12:18.704 INFO:teuthology.orchestra.run.smithi007.stdout:(20/286): python3-cephfs-19.3.0-4907.ga2782315. 1.3 MB/s | 161 kB 00:00 2024-09-14T11:12:18.728 INFO:teuthology.orchestra.run.smithi189.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-09-14T11:12:18.729 INFO:teuthology.orchestra.run.smithi007.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 5.4 MB/s | 320 kB 00:00 2024-09-14T11:12:18.745 INFO:teuthology.orchestra.run.smithi189.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 557 kB/s | 23 kB 00:00 2024-09-14T11:12:18.763 INFO:teuthology.orchestra.run.smithi007.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 5.1 MB/s | 305 kB 00:00 2024-09-14T11:12:18.778 INFO:teuthology.orchestra.run.smithi189.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 5.6 MB/s | 292 kB 00:00 2024-09-14T11:12:18.796 INFO:teuthology.orchestra.run.smithi007.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.5 MB/s | 99 kB 00:00 2024-09-14T11:12:18.804 INFO:teuthology.orchestra.run.smithi189.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 252 kB/s | 15 kB 00:00 2024-09-14T11:12:18.822 INFO:teuthology.orchestra.run.smithi007.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-14T11:12:18.829 INFO:teuthology.orchestra.run.smithi189.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-14T11:12:18.854 INFO:teuthology.orchestra.run.smithi189.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T11:12:18.880 INFO:teuthology.orchestra.run.smithi189.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-14T11:12:18.880 INFO:teuthology.orchestra.run.smithi007.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-14T11:12:18.905 INFO:teuthology.orchestra.run.smithi189.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T11:12:18.930 INFO:teuthology.orchestra.run.smithi189.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 561 kB/s | 28 kB 00:00 2024-09-14T11:12:18.955 INFO:teuthology.orchestra.run.smithi189.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-14T11:12:18.956 INFO:teuthology.orchestra.run.smithi007.stdout:(26/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 20 MB/s | 3.2 MB 00:00 2024-09-14T11:12:18.981 INFO:teuthology.orchestra.run.smithi007.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 341 kB/s | 34 kB 00:00 2024-09-14T11:12:19.005 INFO:teuthology.orchestra.run.smithi189.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 6.8 MB/s | 525 kB 00:00 2024-09-14T11:12:19.015 INFO:teuthology.orchestra.run.smithi007.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 2.6 MB/s | 154 kB 00:00 2024-09-14T11:12:19.039 INFO:teuthology.orchestra.run.smithi189.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 11 MB/s | 980 kB 00:00 2024-09-14T11:12:19.182 INFO:teuthology.orchestra.run.smithi189.stdout:(71/286): adwaita-icon-theme-40.1.1-3.el9.noarc 13 MB/s | 12 MB 00:00 2024-09-14T11:12:19.223 INFO:teuthology.orchestra.run.smithi189.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 3.5 MB/s | 781 kB 00:00 2024-09-14T11:12:19.248 INFO:teuthology.orchestra.run.smithi189.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 1.5 MB/s | 325 kB 00:00 2024-09-14T11:12:19.274 INFO:teuthology.orchestra.run.smithi189.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-09-14T11:12:19.299 INFO:teuthology.orchestra.run.smithi189.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 433 kB/s | 22 kB 00:00 2024-09-14T11:12:19.324 INFO:teuthology.orchestra.run.smithi189.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-14T11:12:19.349 INFO:teuthology.orchestra.run.smithi189.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-14T11:12:19.382 INFO:teuthology.orchestra.run.smithi007.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-14T11:12:19.425 INFO:teuthology.orchestra.run.smithi189.stdout:(78/286): flatpak-1.12.9-1.el9.x86_64.rpm 9.8 MB/s | 1.7 MB 00:00 2024-09-14T11:12:19.432 INFO:teuthology.orchestra.run.smithi007.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 5.7 MB/s | 291 kB 00:00 2024-09-14T11:12:19.450 INFO:teuthology.orchestra.run.smithi189.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-09-14T11:12:19.475 INFO:teuthology.orchestra.run.smithi189.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-14T11:12:19.500 INFO:teuthology.orchestra.run.smithi189.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-14T11:12:19.526 INFO:teuthology.orchestra.run.smithi189.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-14T11:12:19.559 INFO:teuthology.orchestra.run.smithi189.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 7.9 MB/s | 473 kB 00:00 2024-09-14T11:12:19.585 INFO:teuthology.orchestra.run.smithi189.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-14T11:12:19.610 INFO:teuthology.orchestra.run.smithi189.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 680 kB/s | 34 kB 00:00 2024-09-14T11:12:19.616 INFO:teuthology.orchestra.run.smithi007.stdout:(31/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 22 MB/s | 14 MB 00:00 2024-09-14T11:12:19.641 INFO:teuthology.orchestra.run.smithi007.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 236 kB/s | 49 kB 00:00 2024-09-14T11:12:19.666 INFO:teuthology.orchestra.run.smithi007.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 329 kB/s | 16 kB 00:00 2024-09-14T11:12:19.677 INFO:teuthology.orchestra.run.smithi189.stdout:(86/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-09-14T11:12:19.692 INFO:teuthology.orchestra.run.smithi007.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.6 MB/s | 285 kB 00:00 2024-09-14T11:12:19.719 INFO:teuthology.orchestra.run.smithi189.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-14T11:12:19.725 INFO:teuthology.orchestra.run.smithi007.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 13 MB/s | 784 kB 00:00 2024-09-14T11:12:19.744 INFO:teuthology.orchestra.run.smithi189.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 495 kB/s | 33 kB 00:00 2024-09-14T11:12:19.796 INFO:teuthology.orchestra.run.smithi189.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 12 MB/s | 2.2 MB 00:00 2024-09-14T11:12:19.861 INFO:teuthology.orchestra.run.smithi189.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 20 MB/s | 2.3 MB 00:00 2024-09-14T11:12:19.876 INFO:teuthology.orchestra.run.smithi007.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 565 kB/s | 85 kB 00:00 2024-09-14T11:12:19.886 INFO:teuthology.orchestra.run.smithi189.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.3 MB/s | 219 kB 00:00 2024-09-14T11:12:19.918 INFO:teuthology.orchestra.run.smithi007.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.5 MB/s | 335 kB 00:00 2024-09-14T11:12:19.928 INFO:teuthology.orchestra.run.smithi189.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 9.6 MB/s | 657 kB 00:00 2024-09-14T11:12:19.943 INFO:teuthology.orchestra.run.smithi007.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 739 kB/s | 49 kB 00:00 2024-09-14T11:12:19.970 INFO:teuthology.orchestra.run.smithi189.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 7.4 MB/s | 632 kB 00:00 2024-09-14T11:12:20.018 INFO:teuthology.orchestra.run.smithi007.stdout:(39/286): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-14T11:12:20.040 INFO:teuthology.orchestra.run.smithi189.stdout:(94/286): gtk3-3.24.31-5.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-14T11:12:20.044 INFO:teuthology.orchestra.run.smithi007.stdout:(40/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.0 MB/s | 262 kB 00:00 2024-09-14T11:12:20.054 INFO:teuthology.orchestra.run.smithi189.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 540 kB/s | 45 kB 00:00 2024-09-14T11:12:20.079 INFO:teuthology.orchestra.run.smithi189.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.6 MB/s | 110 kB 00:00 2024-09-14T11:12:20.094 INFO:teuthology.orchestra.run.smithi007.stdout:(41/286): libpciaccess-0.16-7.el9.x86_64.rpm 539 kB/s | 27 kB 00:00 2024-09-14T11:12:20.105 INFO:teuthology.orchestra.run.smithi189.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.0 MB/s | 413 kB 00:00 2024-09-14T11:12:20.172 INFO:teuthology.orchestra.run.smithi189.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.5 MB 00:00 2024-09-14T11:12:20.211 INFO:teuthology.orchestra.run.smithi007.stdout:(42/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-14T11:12:20.230 INFO:teuthology.orchestra.run.smithi189.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 224 kB/s | 13 kB 00:00 2024-09-14T11:12:20.286 INFO:teuthology.orchestra.run.smithi007.stdout:(43/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-09-14T11:12:20.289 INFO:teuthology.orchestra.run.smithi189.stdout:(100/286): java-11-openjdk-devel-11.0.20.1.1-2. 16 MB/s | 3.3 MB 00:00 2024-09-14T11:12:20.314 INFO:teuthology.orchestra.run.smithi189.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 635 kB/s | 53 kB 00:00 2024-09-14T11:12:20.320 INFO:teuthology.orchestra.run.smithi007.stdout:(44/286): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-14T11:12:20.339 INFO:teuthology.orchestra.run.smithi189.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 480 kB/s | 24 kB 00:00 2024-09-14T11:12:20.365 INFO:teuthology.orchestra.run.smithi189.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 7.3 MB/s | 377 kB 00:00 2024-09-14T11:12:20.404 INFO:teuthology.orchestra.run.smithi007.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-14T11:12:20.406 INFO:teuthology.orchestra.run.smithi189.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 530 kB/s | 35 kB 00:00 2024-09-14T11:12:20.457 INFO:teuthology.orchestra.run.smithi189.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 1.8 MB/s | 168 kB 00:00 2024-09-14T11:12:20.470 INFO:teuthology.orchestra.run.smithi007.stdout:(46/286): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-14T11:12:20.482 INFO:teuthology.orchestra.run.smithi189.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 147 kB/s | 11 kB 00:00 2024-09-14T11:12:20.507 INFO:teuthology.orchestra.run.smithi189.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-14T11:12:20.521 INFO:teuthology.orchestra.run.smithi007.stdout:(47/286): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-14T11:12:20.532 INFO:teuthology.orchestra.run.smithi189.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 615 kB/s | 31 kB 00:00 2024-09-14T11:12:20.558 INFO:teuthology.orchestra.run.smithi189.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 456 kB/s | 23 kB 00:00 2024-09-14T11:12:20.571 INFO:teuthology.orchestra.run.smithi007.stdout:(48/286): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-14T11:12:20.583 INFO:teuthology.orchestra.run.smithi189.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 393 kB/s | 20 kB 00:00 2024-09-14T11:12:20.608 INFO:teuthology.orchestra.run.smithi189.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-14T11:12:20.642 INFO:teuthology.orchestra.run.smithi189.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 257 kB/s | 15 kB 00:00 2024-09-14T11:12:20.654 INFO:teuthology.orchestra.run.smithi007.stdout:(49/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-14T11:12:20.667 INFO:teuthology.orchestra.run.smithi189.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 485 kB/s | 28 kB 00:00 2024-09-14T11:12:20.693 INFO:teuthology.orchestra.run.smithi189.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-09-14T11:12:20.713 INFO:teuthology.orchestra.run.smithi007.stdout:(50/286): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-14T11:12:20.718 INFO:teuthology.orchestra.run.smithi189.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-09-14T11:12:20.743 INFO:teuthology.orchestra.run.smithi189.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 375 kB/s | 19 kB 00:00 2024-09-14T11:12:20.768 INFO:teuthology.orchestra.run.smithi189.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 607 kB/s | 30 kB 00:00 2024-09-14T11:12:20.794 INFO:teuthology.orchestra.run.smithi189.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-14T11:12:20.819 INFO:teuthology.orchestra.run.smithi189.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 632 kB/s | 32 kB 00:00 2024-09-14T11:12:20.836 INFO:teuthology.orchestra.run.smithi189.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.8 MB/s | 161 kB 00:00 2024-09-14T11:12:20.861 INFO:teuthology.orchestra.run.smithi189.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-09-14T11:12:20.886 INFO:teuthology.orchestra.run.smithi189.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-14T11:12:20.911 INFO:teuthology.orchestra.run.smithi189.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 617 kB/s | 31 kB 00:00 2024-09-14T11:12:20.937 INFO:teuthology.orchestra.run.smithi189.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-14T11:12:20.962 INFO:teuthology.orchestra.run.smithi189.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-14T11:12:20.988 INFO:teuthology.orchestra.run.smithi189.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 732 kB/s | 37 kB 00:00 2024-09-14T11:12:21.013 INFO:teuthology.orchestra.run.smithi189.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-14T11:12:21.038 INFO:teuthology.orchestra.run.smithi189.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-14T11:12:21.055 INFO:teuthology.orchestra.run.smithi189.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-09-14T11:12:21.081 INFO:teuthology.orchestra.run.smithi189.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-14T11:12:21.105 INFO:teuthology.orchestra.run.smithi189.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 826 kB/s | 41 kB 00:00 2024-09-14T11:12:21.131 INFO:teuthology.orchestra.run.smithi189.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-14T11:12:21.156 INFO:teuthology.orchestra.run.smithi189.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 872 kB/s | 44 kB 00:00 2024-09-14T11:12:21.181 INFO:teuthology.orchestra.run.smithi189.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 669 kB/s | 34 kB 00:00 2024-09-14T11:12:21.207 INFO:teuthology.orchestra.run.smithi189.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 6.2 MB/s | 319 kB 00:00 2024-09-14T11:12:21.232 INFO:teuthology.orchestra.run.smithi189.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-14T11:12:21.257 INFO:teuthology.orchestra.run.smithi189.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-14T11:12:21.291 INFO:teuthology.orchestra.run.smithi189.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-14T11:12:21.316 INFO:teuthology.orchestra.run.smithi189.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-14T11:12:21.341 INFO:teuthology.orchestra.run.smithi189.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:12:21.367 INFO:teuthology.orchestra.run.smithi189.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-14T11:12:21.392 INFO:teuthology.orchestra.run.smithi189.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-09-14T11:12:21.409 INFO:teuthology.orchestra.run.smithi189.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 851 kB/s | 36 kB 00:00 2024-09-14T11:12:21.442 INFO:teuthology.orchestra.run.smithi189.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-14T11:12:21.464 INFO:teuthology.orchestra.run.smithi007.stdout:(51/286): adwaita-cursor-theme-40.1.1-3.el9.noa 804 kB/s | 650 kB 00:00 2024-09-14T11:12:21.468 INFO:teuthology.orchestra.run.smithi189.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-14T11:12:21.493 INFO:teuthology.orchestra.run.smithi189.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-14T11:12:21.518 INFO:teuthology.orchestra.run.smithi189.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 667 kB/s | 33 kB 00:00 2024-09-14T11:12:21.544 INFO:teuthology.orchestra.run.smithi189.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 387 kB/s | 19 kB 00:00 2024-09-14T11:12:21.569 INFO:teuthology.orchestra.run.smithi189.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 256 kB/s | 13 kB 00:00 2024-09-14T11:12:21.594 INFO:teuthology.orchestra.run.smithi189.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 833 kB/s | 42 kB 00:00 2024-09-14T11:12:21.619 INFO:teuthology.orchestra.run.smithi189.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-14T11:12:21.645 INFO:teuthology.orchestra.run.smithi189.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-14T11:12:21.670 INFO:teuthology.orchestra.run.smithi189.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 252 kB/s | 13 kB 00:00 2024-09-14T11:12:21.681 INFO:teuthology.orchestra.run.smithi007.stdout:(52/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.4 MB/s | 523 kB 00:00 2024-09-14T11:12:21.695 INFO:teuthology.orchestra.run.smithi189.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 713 kB/s | 36 kB 00:00 2024-09-14T11:12:21.721 INFO:teuthology.orchestra.run.smithi189.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T11:12:21.746 INFO:teuthology.orchestra.run.smithi189.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-14T11:12:21.771 INFO:teuthology.orchestra.run.smithi189.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.9 MB/s | 151 kB 00:00 2024-09-14T11:12:21.789 INFO:teuthology.orchestra.run.smithi007.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 654 kB/s | 71 kB 00:00 2024-09-14T11:12:21.796 INFO:teuthology.orchestra.run.smithi189.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 353 kB/s | 18 kB 00:00 2024-09-14T11:12:21.839 INFO:teuthology.orchestra.run.smithi189.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-14T11:12:21.864 INFO:teuthology.orchestra.run.smithi189.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-09-14T11:12:21.898 INFO:teuthology.orchestra.run.smithi189.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 8.6 MB/s | 517 kB 00:00 2024-09-14T11:12:21.906 INFO:teuthology.orchestra.run.smithi007.stdout:(54/286): apache-commons-codec-1.15-7.el9.noarc 2.5 MB/s | 302 kB 00:00 2024-09-14T11:12:21.923 INFO:teuthology.orchestra.run.smithi189.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-14T11:12:21.948 INFO:teuthology.orchestra.run.smithi189.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-14T11:12:22.006 INFO:teuthology.orchestra.run.smithi189.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 193 kB/s | 11 kB 00:00 2024-09-14T11:12:22.048 INFO:teuthology.orchestra.run.smithi007.stdout:(55/286): apache-commons-io-2.8.0-8.el9.noarch. 2.0 MB/s | 283 kB 00:00 2024-09-14T11:12:22.082 INFO:teuthology.orchestra.run.smithi189.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.8 MB/s | 139 kB 00:00 2024-09-14T11:12:22.124 INFO:teuthology.orchestra.run.smithi189.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-14T11:12:22.174 INFO:teuthology.orchestra.run.smithi007.stdout:(56/286): apache-commons-lang3-3.12.0-6.el9.noa 4.4 MB/s | 559 kB 00:00 2024-09-14T11:12:22.182 INFO:teuthology.orchestra.run.smithi189.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 622 kB/s | 36 kB 00:00 2024-09-14T11:12:22.224 INFO:teuthology.orchestra.run.smithi189.stdout:(168/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 1.1 MB/s | 46 kB 00:00 2024-09-14T11:12:22.266 INFO:teuthology.orchestra.run.smithi189.stdout:(169/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 778 kB/s | 32 kB 00:00 2024-09-14T11:12:22.291 INFO:teuthology.orchestra.run.smithi007.stdout:(57/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 745 kB/s | 87 kB 00:00 2024-09-14T11:12:22.308 INFO:teuthology.orchestra.run.smithi189.stdout:(170/286): openblas-0.3.26-2.el9.x86_64.rpm 925 kB/s | 38 kB 00:00 2024-09-14T11:12:22.692 INFO:teuthology.orchestra.run.smithi189.stdout:(171/286): java-11-openjdk-headless-11.0.20.1.1 15 MB/s | 39 MB 00:02 2024-09-14T11:12:22.791 INFO:teuthology.orchestra.run.smithi007.stdout:(58/286): ceph-test-19.3.0-4907.ga2782315.el9.x 9.9 MB/s | 50 MB 00:05 2024-09-14T11:12:22.800 INFO:teuthology.orchestra.run.smithi189.stdout:(172/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 10 MB/s | 8.8 MB 00:00 2024-09-14T11:12:22.816 INFO:teuthology.orchestra.run.smithi007.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 371 kB/s | 195 kB 00:00 2024-09-14T11:12:22.833 INFO:teuthology.orchestra.run.smithi189.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.1 MB/s | 163 kB 00:00 2024-09-14T11:12:22.858 INFO:teuthology.orchestra.run.smithi189.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2024-09-14T11:12:22.884 INFO:teuthology.orchestra.run.smithi189.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-14T11:12:22.909 INFO:teuthology.orchestra.run.smithi189.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 10 MB/s | 531 kB 00:00 2024-09-14T11:12:22.934 INFO:teuthology.orchestra.run.smithi189.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.4 MB/s | 74 kB 00:00 2024-09-14T11:12:22.950 INFO:teuthology.orchestra.run.smithi007.stdout:(60/286): atk-2.36.0-5.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-14T11:12:22.960 INFO:teuthology.orchestra.run.smithi189.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 9.1 MB/s | 468 kB 00:00 2024-09-14T11:12:22.985 INFO:teuthology.orchestra.run.smithi189.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-14T11:12:23.002 INFO:teuthology.orchestra.run.smithi189.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 2.5 MB/s | 107 kB 00:00 2024-09-14T11:12:23.019 INFO:teuthology.orchestra.run.smithi189.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.7 MB/s | 57 kB 00:00 2024-09-14T11:12:23.036 INFO:teuthology.orchestra.run.smithi189.stdout:(182/286): pipewire-jack-audio-connection-kit-1 272 kB/s | 9.1 kB 00:00 2024-09-14T11:12:23.061 INFO:teuthology.orchestra.run.smithi189.stdout:(183/286): pipewire-jack-audio-connection-kit-l 3.2 MB/s | 135 kB 00:00 2024-09-14T11:12:23.067 INFO:teuthology.orchestra.run.smithi007.stdout:(61/286): avahi-glib-0.8-21.el9.x86_64.rpm 127 kB/s | 15 kB 00:00 2024-09-14T11:12:23.092 INFO:teuthology.orchestra.run.smithi007.stdout:(62/286): atinject-1.0.3-6.el9.noarch.rpm 77 kB/s | 23 kB 00:00 2024-09-14T11:12:23.136 INFO:teuthology.orchestra.run.smithi189.stdout:(184/286): openblas-openmp-0.3.26-2.el9.x86_64. 6.0 MB/s | 4.9 MB 00:00 2024-09-14T11:12:23.161 INFO:teuthology.orchestra.run.smithi189.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.9 MB/s | 192 kB 00:00 2024-09-14T11:12:23.176 INFO:teuthology.orchestra.run.smithi007.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 984 kB/s | 107 kB 00:00 2024-09-14T11:12:23.187 INFO:teuthology.orchestra.run.smithi189.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-14T11:12:23.212 INFO:teuthology.orchestra.run.smithi189.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-14T11:12:23.237 INFO:teuthology.orchestra.run.smithi189.stdout:(188/286): plexus-containers-component-annotati 365 kB/s | 18 kB 00:00 2024-09-14T11:12:23.263 INFO:teuthology.orchestra.run.smithi189.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-14T11:12:23.288 INFO:teuthology.orchestra.run.smithi189.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 672 kB/s | 34 kB 00:00 2024-09-14T11:12:23.293 INFO:teuthology.orchestra.run.smithi007.stdout:(64/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-14T11:12:23.313 INFO:teuthology.orchestra.run.smithi189.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 4.9 MB/s | 254 kB 00:00 2024-09-14T11:12:23.318 INFO:teuthology.orchestra.run.smithi007.stdout:(65/286): cdi-api-2.0.2-6.el9.noarch.rpm 236 kB/s | 53 kB 00:00 2024-09-14T11:12:23.355 INFO:teuthology.orchestra.run.smithi189.stdout:(192/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 6.0 MB/s | 1.9 MB 00:00 2024-09-14T11:12:23.402 INFO:teuthology.orchestra.run.smithi007.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 562 kB/s | 61 kB 00:00 2024-09-14T11:12:23.406 INFO:teuthology.orchestra.run.smithi189.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 9.0 MB/s | 1.1 MB 00:00 2024-09-14T11:12:23.427 INFO:teuthology.orchestra.run.smithi007.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 260 kB/s | 28 kB 00:00 2024-09-14T11:12:23.431 INFO:teuthology.orchestra.run.smithi189.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-14T11:12:23.473 INFO:teuthology.orchestra.run.smithi189.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 12 MB/s | 1.9 MB 00:00 2024-09-14T11:12:23.490 INFO:teuthology.orchestra.run.smithi189.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-14T11:12:23.519 INFO:teuthology.orchestra.run.smithi007.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 963 kB/s | 113 kB 00:00 2024-09-14T11:12:23.573 INFO:teuthology.orchestra.run.smithi189.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-09-14T11:12:23.598 INFO:teuthology.orchestra.run.smithi189.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.3 MB/s | 679 kB 00:00 2024-09-14T11:12:23.624 INFO:teuthology.orchestra.run.smithi189.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.8 MB/s | 245 kB 00:00 2024-09-14T11:12:23.649 INFO:teuthology.orchestra.run.smithi189.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-09-14T11:12:23.674 INFO:teuthology.orchestra.run.smithi189.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 511 kB/s | 26 kB 00:00 2024-09-14T11:12:23.699 INFO:teuthology.orchestra.run.smithi189.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-14T11:12:23.725 INFO:teuthology.orchestra.run.smithi189.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-14T11:12:23.750 INFO:teuthology.orchestra.run.smithi189.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 694 kB/s | 35 kB 00:00 2024-09-14T11:12:23.792 INFO:teuthology.orchestra.run.smithi189.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 5.9 MB/s | 250 kB 00:00 2024-09-14T11:12:23.827 INFO:teuthology.orchestra.run.smithi007.stdout:(69/286): exiv2-0.27.5-2.el9.x86_64.rpm 3.1 MB/s | 980 kB 00:00 2024-09-14T11:12:23.867 INFO:teuthology.orchestra.run.smithi189.stdout:(206/286): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-14T11:12:23.892 INFO:teuthology.orchestra.run.smithi189.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 2.2 MB/s | 222 kB 00:00 2024-09-14T11:12:23.912 INFO:teuthology.orchestra.run.smithi007.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 1.1 MB/s | 525 kB 00:00 2024-09-14T11:12:23.918 INFO:teuthology.orchestra.run.smithi189.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-14T11:12:23.943 INFO:teuthology.orchestra.run.smithi189.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 842 kB/s | 42 kB 00:00 2024-09-14T11:12:23.962 INFO:teuthology.orchestra.run.smithi007.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 5.7 MB/s | 781 kB 00:00 2024-09-14T11:12:23.968 INFO:teuthology.orchestra.run.smithi189.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 5.3 MB/s | 269 kB 00:00 2024-09-14T11:12:23.993 INFO:teuthology.orchestra.run.smithi189.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-14T11:12:24.019 INFO:teuthology.orchestra.run.smithi189.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-14T11:12:24.028 INFO:teuthology.orchestra.run.smithi007.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.7 MB/s | 325 kB 00:00 2024-09-14T11:12:24.044 INFO:teuthology.orchestra.run.smithi189.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T11:12:24.069 INFO:teuthology.orchestra.run.smithi189.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-14T11:12:24.079 INFO:teuthology.orchestra.run.smithi007.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2024-09-14T11:12:24.145 INFO:teuthology.orchestra.run.smithi189.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-14T11:12:24.170 INFO:teuthology.orchestra.run.smithi189.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-14T11:12:24.195 INFO:teuthology.orchestra.run.smithi189.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-14T11:12:24.196 INFO:teuthology.orchestra.run.smithi007.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 185 kB/s | 22 kB 00:00 2024-09-14T11:12:24.220 INFO:teuthology.orchestra.run.smithi189.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 718 kB/s | 36 kB 00:00 2024-09-14T11:12:24.245 INFO:teuthology.orchestra.run.smithi189.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-14T11:12:24.271 INFO:teuthology.orchestra.run.smithi189.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-14T11:12:24.296 INFO:teuthology.orchestra.run.smithi189.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 9.9 MB/s | 510 kB 00:00 2024-09-14T11:12:24.304 INFO:teuthology.orchestra.run.smithi007.stdout:(75/286): flatpak-session-helper-1.12.9-1.el9.x 674 kB/s | 73 kB 00:00 2024-09-14T11:12:24.330 INFO:teuthology.orchestra.run.smithi189.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.2 MB/s | 69 kB 00:00 2024-09-14T11:12:24.355 INFO:teuthology.orchestra.run.smithi189.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-14T11:12:24.389 INFO:teuthology.orchestra.run.smithi189.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-14T11:12:24.422 INFO:teuthology.orchestra.run.smithi189.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 152 kB 00:00 2024-09-14T11:12:24.430 INFO:teuthology.orchestra.run.smithi007.stdout:(76/286): flatpak-1.12.9-1.el9.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2024-09-14T11:12:24.447 INFO:teuthology.orchestra.run.smithi189.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 9.3 MB/s | 555 kB 00:00 2024-09-14T11:12:24.455 INFO:teuthology.orchestra.run.smithi007.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 217 kB/s | 33 kB 00:00 2024-09-14T11:12:24.481 INFO:teuthology.orchestra.run.smithi189.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 16 MB/s | 944 kB 00:00 2024-09-14T11:12:24.506 INFO:teuthology.orchestra.run.smithi189.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 906 kB/s | 53 kB 00:00 2024-09-14T11:12:24.532 INFO:teuthology.orchestra.run.smithi189.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-14T11:12:24.557 INFO:teuthology.orchestra.run.smithi189.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-14T11:12:24.580 INFO:teuthology.orchestra.run.smithi007.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-14T11:12:24.582 INFO:teuthology.orchestra.run.smithi189.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 6.0 MB/s | 306 kB 00:00 2024-09-14T11:12:24.607 INFO:teuthology.orchestra.run.smithi189.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-14T11:12:24.633 INFO:teuthology.orchestra.run.smithi189.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 7.0 MB/s | 358 kB 00:00 2024-09-14T11:12:24.658 INFO:teuthology.orchestra.run.smithi189.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 848 kB/s | 42 kB 00:00 2024-09-14T11:12:24.683 INFO:teuthology.orchestra.run.smithi189.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-14T11:12:24.689 INFO:teuthology.orchestra.run.smithi007.stdout:(79/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-14T11:12:24.708 INFO:teuthology.orchestra.run.smithi189.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-14T11:12:24.714 INFO:teuthology.orchestra.run.smithi007.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 666 kB/s | 89 kB 00:00 2024-09-14T11:12:24.751 INFO:teuthology.orchestra.run.smithi189.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-09-14T11:12:24.784 INFO:teuthology.orchestra.run.smithi189.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-14T11:12:24.807 INFO:teuthology.orchestra.run.smithi007.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.0 MB/s | 124 kB 00:00 2024-09-14T11:12:24.818 INFO:teuthology.orchestra.run.smithi189.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 7.4 MB/s | 505 kB 00:00 2024-09-14T11:12:24.832 INFO:teuthology.orchestra.run.smithi007.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-09-14T11:12:24.940 INFO:teuthology.orchestra.run.smithi007.stdout:(83/286): graphene-1.10.6-2.el9.x86_64.rpm 594 kB/s | 64 kB 00:00 2024-09-14T11:12:25.067 INFO:teuthology.orchestra.run.smithi189.stdout:(240/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-14T11:12:25.067 INFO:teuthology.orchestra.run.smithi007.stdout:(84/286): gsm-1.0.19-6.el9.x86_64.rpm 314 kB/s | 34 kB 00:00 2024-09-14T11:12:25.085 INFO:teuthology.orchestra.run.smithi189.stdout:(241/286): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-09-14T11:12:25.152 INFO:teuthology.orchestra.run.smithi189.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 5.7 MB/s | 548 kB 00:00 2024-09-14T11:12:25.177 INFO:teuthology.orchestra.run.smithi189.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 789 kB/s | 19 kB 00:00 2024-09-14T11:12:25.203 INFO:teuthology.orchestra.run.smithi189.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-14T11:12:25.228 INFO:teuthology.orchestra.run.smithi189.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T11:12:25.253 INFO:teuthology.orchestra.run.smithi189.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T11:12:25.274 INFO:teuthology.orchestra.run.smithi007.stdout:(85/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 6.4 MB/s | 1.4 MB 00:00 2024-09-14T11:12:25.278 INFO:teuthology.orchestra.run.smithi189.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-14T11:12:25.304 INFO:teuthology.orchestra.run.smithi189.stdout:(248/286): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-14T11:12:25.337 INFO:teuthology.orchestra.run.smithi189.stdout:(249/286): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-14T11:12:25.379 INFO:teuthology.orchestra.run.smithi189.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-09-14T11:12:25.404 INFO:teuthology.orchestra.run.smithi189.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T11:12:25.429 INFO:teuthology.orchestra.run.smithi189.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T11:12:25.455 INFO:teuthology.orchestra.run.smithi189.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-14T11:12:25.488 INFO:teuthology.orchestra.run.smithi189.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-14T11:12:25.531 INFO:teuthology.orchestra.run.smithi189.stdout:(255/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-09-14T11:12:25.533 INFO:teuthology.orchestra.run.smithi007.stdout:(86/286): gstreamer1-plugins-base-1.22.1-2.el9. 8.7 MB/s | 2.2 MB 00:00 2024-09-14T11:12:25.558 INFO:teuthology.orchestra.run.smithi007.stdout:(87/286): google-guice-4.2.3-9.el9.noarch.rpm 630 kB/s | 473 kB 00:00 2024-09-14T11:12:25.564 INFO:teuthology.orchestra.run.smithi189.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-14T11:12:25.589 INFO:teuthology.orchestra.run.smithi189.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-14T11:12:25.623 INFO:teuthology.orchestra.run.smithi189.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-14T11:12:25.642 INFO:teuthology.orchestra.run.smithi007.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 304 kB/s | 33 kB 00:00 2024-09-14T11:12:25.682 INFO:teuthology.orchestra.run.smithi189.stdout:(259/286): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-14T11:12:25.698 INFO:teuthology.orchestra.run.smithi189.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-09-14T11:12:25.715 INFO:teuthology.orchestra.run.smithi189.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 528 kB/s | 18 kB 00:00 2024-09-14T11:12:25.732 INFO:teuthology.orchestra.run.smithi189.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 692 kB/s | 23 kB 00:00 2024-09-14T11:12:25.749 INFO:teuthology.orchestra.run.smithi189.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 581 kB/s | 19 kB 00:00 2024-09-14T11:12:25.766 INFO:teuthology.orchestra.run.smithi189.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-14T11:12:25.791 INFO:teuthology.orchestra.run.smithi189.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:12:25.816 INFO:teuthology.orchestra.run.smithi189.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:12:25.842 INFO:teuthology.orchestra.run.smithi189.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T11:12:25.875 INFO:teuthology.orchestra.run.smithi189.stdout:(268/286): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-14T11:12:25.901 INFO:teuthology.orchestra.run.smithi189.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-14T11:12:25.935 INFO:teuthology.orchestra.run.smithi189.stdout:(270/286): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-14T11:12:25.960 INFO:teuthology.orchestra.run.smithi189.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-14T11:12:25.985 INFO:teuthology.orchestra.run.smithi189.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-14T11:12:26.010 INFO:teuthology.orchestra.run.smithi189.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T11:12:26.035 INFO:teuthology.orchestra.run.smithi189.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T11:12:26.061 INFO:teuthology.orchestra.run.smithi189.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-14T11:12:26.111 INFO:teuthology.orchestra.run.smithi189.stdout:(276/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-14T11:12:26.136 INFO:teuthology.orchestra.run.smithi189.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 992 kB/s | 74 kB 00:00 2024-09-14T11:12:26.161 INFO:teuthology.orchestra.run.smithi189.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-14T11:12:26.187 INFO:teuthology.orchestra.run.smithi189.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-14T11:12:26.204 INFO:teuthology.orchestra.run.smithi189.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-14T11:12:26.229 INFO:teuthology.orchestra.run.smithi189.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-14T11:12:26.254 INFO:teuthology.orchestra.run.smithi189.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:12:26.279 INFO:teuthology.orchestra.run.smithi189.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-14T11:12:26.330 INFO:teuthology.orchestra.run.smithi189.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T11:12:26.484 INFO:teuthology.orchestra.run.smithi007.stdout:(89/286): guava-30.1-6.el9.noarch.rpm 2.7 MB/s | 2.3 MB 00:00 2024-09-14T11:12:26.763 INFO:teuthology.orchestra.run.smithi189.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 6.8 MB/s | 3.5 MB 00:00 2024-09-14T11:12:26.859 INFO:teuthology.orchestra.run.smithi007.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 584 kB/s | 219 kB 00:00 2024-09-14T11:12:27.496 INFO:teuthology.orchestra.run.smithi189.stdout:(286/286): librbd1-19.3.0-4907.ga2782315.el9.x8 2.7 MB/s | 3.2 MB 00:01 2024-09-14T11:12:27.504 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:12:27.504 INFO:teuthology.orchestra.run.smithi189.stdout:Total 23 MB/s | 327 MB 00:14 2024-09-14T11:12:27.843 INFO:teuthology.orchestra.run.smithi007.stdout:(91/286): httpcomponents-client-4.5.13-3.el9.no 668 kB/s | 657 kB 00:00 2024-09-14T11:12:28.685 INFO:teuthology.orchestra.run.smithi007.stdout:(92/286): adwaita-icon-theme-40.1.1-3.el9.noarc 1.5 MB/s | 12 MB 00:07 2024-09-14T11:12:28.860 INFO:teuthology.orchestra.run.smithi007.stdout:(93/286): iso-codes-4.6.0-3.el9.noarch.rpm 20 MB/s | 3.5 MB 00:00 2024-09-14T11:12:28.885 INFO:teuthology.orchestra.run.smithi007.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 606 kB/s | 632 kB 00:01 2024-09-14T11:12:28.961 INFO:teuthology.orchestra.run.smithi007.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 450 kB/s | 45 kB 00:00 2024-09-14T11:12:28.994 INFO:teuthology.orchestra.run.smithi007.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 1.0 MB/s | 110 kB 00:00 2024-09-14T11:12:29.186 INFO:teuthology.orchestra.run.smithi007.stdout:(97/286): java-11-openjdk-devel-11.0.20.1.1-2.e 17 MB/s | 3.3 MB 00:00 2024-09-14T11:12:29.694 INFO:teuthology.orchestra.run.smithi007.stdout:(98/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 562 kB/s | 413 kB 00:00 2024-09-14T11:12:29.803 INFO:teuthology.orchestra.run.smithi007.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 120 kB/s | 13 kB 00:00 2024-09-14T11:12:29.912 INFO:teuthology.orchestra.run.smithi007.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 489 kB/s | 53 kB 00:00 2024-09-14T11:12:30.020 INFO:teuthology.orchestra.run.smithi007.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 221 kB/s | 24 kB 00:00 2024-09-14T11:12:30.304 INFO:teuthology.orchestra.run.smithi007.stdout:(102/286): gtk3-3.24.31-5.el9.x86_64.rpm 1.0 MB/s | 4.9 MB 00:04 2024-09-14T11:12:30.422 INFO:teuthology.orchestra.run.smithi007.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 303 kB/s | 35 kB 00:00 2024-09-14T11:12:30.723 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-14T11:12:30.772 INFO:teuthology.orchestra.run.smithi007.stdout:(104/286): java-11-openjdk-headless-11.0.20.1.1 25 MB/s | 39 MB 00:01 2024-09-14T11:12:30.805 INFO:teuthology.orchestra.run.smithi007.stdout:(105/286): jsoup-1.13.1-10.el9.noarch.rpm 480 kB/s | 377 kB 00:00 2024-09-14T11:12:30.830 INFO:teuthology.orchestra.run.smithi007.stdout:(106/286): lcms2-2.12-3.el9.x86_64.rpm 410 kB/s | 168 kB 00:00 2024-09-14T11:12:30.881 INFO:teuthology.orchestra.run.smithi007.stdout:(107/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 102 kB/s | 11 kB 00:00 2024-09-14T11:12:30.905 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-14T11:12:30.905 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-14T11:12:30.914 INFO:teuthology.orchestra.run.smithi007.stdout:(108/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 221 kB/s | 24 kB 00:00 2024-09-14T11:12:30.940 INFO:teuthology.orchestra.run.smithi007.stdout:(109/286): libXcursor-1.2.0-7.el9.x86_64.rpm 282 kB/s | 31 kB 00:00 2024-09-14T11:12:30.990 INFO:teuthology.orchestra.run.smithi007.stdout:(110/286): libXdamage-1.1.5-7.el9.x86_64.rpm 210 kB/s | 23 kB 00:00 2024-09-14T11:12:31.024 INFO:teuthology.orchestra.run.smithi007.stdout:(111/286): libXfixes-5.0.3-16.el9.x86_64.rpm 182 kB/s | 20 kB 00:00 2024-09-14T11:12:31.049 INFO:teuthology.orchestra.run.smithi007.stdout:(112/286): libXi-1.7.10-8.el9.x86_64.rpm 364 kB/s | 40 kB 00:00 2024-09-14T11:12:31.100 INFO:teuthology.orchestra.run.smithi007.stdout:(113/286): libXinerama-1.1.4-10.el9.x86_64.rpm 138 kB/s | 15 kB 00:00 2024-09-14T11:12:31.133 INFO:teuthology.orchestra.run.smithi007.stdout:(114/286): libXrandr-1.5.2-8.el9.x86_64.rpm 261 kB/s | 28 kB 00:00 2024-09-14T11:12:31.158 INFO:teuthology.orchestra.run.smithi007.stdout:(115/286): libXtst-1.2.3-16.el9.x86_64.rpm 197 kB/s | 21 kB 00:00 2024-09-14T11:12:31.209 INFO:teuthology.orchestra.run.smithi007.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 175 kB/s | 19 kB 00:00 2024-09-14T11:12:31.242 INFO:teuthology.orchestra.run.smithi007.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 172 kB/s | 19 kB 00:00 2024-09-14T11:12:31.267 INFO:teuthology.orchestra.run.smithi007.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 279 kB/s | 30 kB 00:00 2024-09-14T11:12:31.318 INFO:teuthology.orchestra.run.smithi007.stdout:(119/286): libcanberra-0.30-27.el9.x86_64.rpm 794 kB/s | 86 kB 00:00 2024-09-14T11:12:31.351 INFO:teuthology.orchestra.run.smithi007.stdout:(120/286): libcanberra-gtk3-0.30-27.el9.x86_64. 292 kB/s | 32 kB 00:00 2024-09-14T11:12:31.435 INFO:teuthology.orchestra.run.smithi007.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 2.0 MB/s | 241 kB 00:00 2024-09-14T11:12:31.477 INFO:teuthology.orchestra.run.smithi007.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 3.4 MB/s | 435 kB 00:00 2024-09-14T11:12:31.544 INFO:teuthology.orchestra.run.smithi007.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 285 kB/s | 31 kB 00:00 2024-09-14T11:12:31.586 INFO:teuthology.orchestra.run.smithi007.stdout:(124/286): libdrm-2.4.121-1.el9.x86_64.rpm 505 kB/s | 161 kB 00:00 2024-09-14T11:12:31.611 INFO:teuthology.orchestra.run.smithi007.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 617 kB/s | 83 kB 00:00 2024-09-14T11:12:31.653 INFO:teuthology.orchestra.run.smithi007.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 135 kB 00:00 2024-09-14T11:12:31.695 INFO:teuthology.orchestra.run.smithi007.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 337 kB/s | 37 kB 00:00 2024-09-14T11:12:31.720 INFO:teuthology.orchestra.run.smithi007.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.3 MB/s | 142 kB 00:00 2024-09-14T11:12:31.771 INFO:teuthology.orchestra.run.smithi007.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-09-14T11:12:31.821 INFO:teuthology.orchestra.run.smithi007.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 610 kB/s | 61 kB 00:00 2024-09-14T11:12:31.871 INFO:teuthology.orchestra.run.smithi007.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 412 kB/s | 41 kB 00:00 2024-09-14T11:12:31.896 INFO:teuthology.orchestra.run.smithi007.stdout:(132/286): libgxps-0.3.2-3.el9.x86_64.rpm 392 kB/s | 79 kB 00:00 2024-09-14T11:12:31.930 INFO:teuthology.orchestra.run.smithi007.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-14T11:12:31.972 INFO:teuthology.orchestra.run.smithi007.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 433 kB/s | 44 kB 00:00 2024-09-14T11:12:31.997 INFO:teuthology.orchestra.run.smithi007.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 333 kB/s | 34 kB 00:00 2024-09-14T11:12:32.048 INFO:teuthology.orchestra.run.smithi007.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 2.7 MB/s | 319 kB 00:00 2024-09-14T11:12:32.081 INFO:teuthology.orchestra.run.smithi007.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-14T11:12:32.107 INFO:teuthology.orchestra.run.smithi007.stdout:(138/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 415 kB/s | 45 kB 00:00 2024-09-14T11:12:32.165 INFO:teuthology.orchestra.run.smithi007.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-14T11:12:32.191 INFO:teuthology.orchestra.run.smithi007.stdout:(140/286): libsbc-1.4-9.el9.x86_64.rpm 411 kB/s | 45 kB 00:00 2024-09-14T11:12:32.302 INFO:teuthology.orchestra.run.smithi007.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.2 MB/s | 164 kB 00:00 2024-09-14T11:12:32.328 INFO:teuthology.orchestra.run.smithi007.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2024-09-14T11:12:32.411 INFO:teuthology.orchestra.run.smithi007.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 328 kB/s | 36 kB 00:00 2024-09-14T11:12:32.445 INFO:teuthology.orchestra.run.smithi007.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 2.7 MB/s | 324 kB 00:00 2024-09-14T11:12:32.503 INFO:teuthology.orchestra.run.smithi007.stdout:(145/286): libsndfile-1.0.31-8.el9.x86_64.rpm 521 kB/s | 206 kB 00:00 2024-09-14T11:12:32.529 INFO:teuthology.orchestra.run.smithi007.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.2 MB/s | 144 kB 00:00 2024-09-14T11:12:32.562 INFO:teuthology.orchestra.run.smithi007.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 1.6 MB/s | 193 kB 00:00 2024-09-14T11:12:32.613 INFO:teuthology.orchestra.run.smithi007.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 306 kB/s | 33 kB 00:00 2024-09-14T11:12:32.638 INFO:teuthology.orchestra.run.smithi007.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 178 kB/s | 19 kB 00:00 2024-09-14T11:12:32.672 INFO:teuthology.orchestra.run.smithi007.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 118 kB/s | 13 kB 00:00 2024-09-14T11:12:32.722 INFO:teuthology.orchestra.run.smithi007.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 384 kB/s | 42 kB 00:00 2024-09-14T11:12:32.756 INFO:teuthology.orchestra.run.smithi007.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 2.3 MB/s | 277 kB 00:00 2024-09-14T11:12:32.789 INFO:teuthology.orchestra.run.smithi007.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.1 MB/s | 133 kB 00:00 2024-09-14T11:12:32.831 INFO:teuthology.orchestra.run.smithi007.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 116 kB/s | 13 kB 00:00 2024-09-14T11:12:32.865 INFO:teuthology.orchestra.run.smithi007.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 329 kB/s | 36 kB 00:00 2024-09-14T11:12:32.907 INFO:teuthology.orchestra.run.smithi007.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-14T11:12:32.974 INFO:teuthology.orchestra.run.smithi007.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2024-09-14T11:12:33.016 INFO:teuthology.orchestra.run.smithi007.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 163 kB/s | 18 kB 00:00 2024-09-14T11:12:33.117 INFO:teuthology.orchestra.run.smithi007.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 10 MB/s | 1.5 MB 00:00 2024-09-14T11:12:33.142 INFO:teuthology.orchestra.run.smithi007.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 72 kB/s | 9.0 kB 00:00 2024-09-14T11:12:33.167 INFO:teuthology.orchestra.run.smithi007.stdout:(161/286): lua-5.4.4-4.el9.x86_64.rpm 562 kB/s | 188 kB 00:00 2024-09-14T11:12:33.234 INFO:teuthology.orchestra.run.smithi007.stdout:(162/286): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-14T11:12:33.259 INFO:teuthology.orchestra.run.smithi007.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 1.3 MB/s | 151 kB 00:00 2024-09-14T11:12:33.399 INFO:teuthology.orchestra.run.smithi007.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 484 kB/s | 112 kB 00:00 2024-09-14T11:12:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 67 kB/s | 11 kB 00:00 2024-09-14T11:12:33.510 INFO:teuthology.orchestra.run.smithi007.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 139 kB 00:00 2024-09-14T11:12:33.644 INFO:teuthology.orchestra.run.smithi007.stdout:(167/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 21 MB/s | 8.8 MB 00:00 2024-09-14T11:12:33.669 INFO:teuthology.orchestra.run.smithi007.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 228 kB/s | 36 kB 00:00 2024-09-14T11:12:33.753 INFO:teuthology.orchestra.run.smithi007.stdout:(169/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 524 kB/s | 171 kB 00:00 2024-09-14T11:12:33.778 INFO:teuthology.orchestra.run.smithi007.stdout:(170/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 344 kB/s | 46 kB 00:00 2024-09-14T11:12:33.803 INFO:teuthology.orchestra.run.smithi007.stdout:(171/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 241 kB/s | 32 kB 00:00 2024-09-14T11:12:33.862 INFO:teuthology.orchestra.run.smithi007.stdout:(172/286): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-14T11:12:33.937 INFO:teuthology.orchestra.run.smithi007.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.2 MB/s | 163 kB 00:00 2024-09-14T11:12:34.029 INFO:teuthology.orchestra.run.smithi007.stdout:(174/286): openblas-openmp-0.3.26-2.el9.x86_64. 20 MB/s | 4.9 MB 00:00 2024-09-14T11:12:34.054 INFO:teuthology.orchestra.run.smithi007.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 1.5 MB/s | 183 kB 00:00 2024-09-14T11:12:34.147 INFO:teuthology.orchestra.run.smithi007.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 4.4 MB/s | 531 kB 00:00 2024-09-14T11:12:34.172 INFO:teuthology.orchestra.run.smithi007.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 631 kB/s | 74 kB 00:00 2024-09-14T11:12:34.199 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-14T11:12:34.199 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-14T11:12:34.255 INFO:teuthology.orchestra.run.smithi007.stdout:(178/286): opus-1.3.1-10.el9.x86_64.rpm 508 kB/s | 200 kB 00:00 2024-09-14T11:12:34.281 INFO:teuthology.orchestra.run.smithi007.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 3.4 MB/s | 468 kB 00:00 2024-09-14T11:12:34.306 INFO:teuthology.orchestra.run.smithi007.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 1.8 MB/s | 246 kB 00:00 2024-09-14T11:12:34.390 INFO:teuthology.orchestra.run.smithi007.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 527 kB/s | 57 kB 00:00 2024-09-14T11:12:34.415 INFO:teuthology.orchestra.run.smithi007.stdout:(182/286): pipewire-jack-audio-connection-kit-1 84 kB/s | 9.1 kB 00:00 2024-09-14T11:12:34.457 INFO:teuthology.orchestra.run.smithi007.stdout:(183/286): pipewire-1.0.1-1.el9.x86_64.rpm 529 kB/s | 107 kB 00:00 2024-09-14T11:12:34.499 INFO:teuthology.orchestra.run.smithi007.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.2 MB/s | 135 kB 00:00 2024-09-14T11:12:34.557 INFO:teuthology.orchestra.run.smithi007.stdout:(185/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 14 MB/s | 1.9 MB 00:00 2024-09-14T11:12:34.608 INFO:teuthology.orchestra.run.smithi007.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 237 kB/s | 26 kB 00:00 2024-09-14T11:12:34.667 INFO:teuthology.orchestra.run.smithi007.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 553 kB/s | 60 kB 00:00 2024-09-14T11:12:34.716 INFO:teuthology.orchestra.run.smithi007.stdout:(188/286): plexus-containers-component-annotati 169 kB/s | 18 kB 00:00 2024-09-14T11:12:34.775 INFO:teuthology.orchestra.run.smithi007.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 734 kB/s | 80 kB 00:00 2024-09-14T11:12:34.826 INFO:teuthology.orchestra.run.smithi007.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 309 kB/s | 34 kB 00:00 2024-09-14T11:12:34.851 INFO:teuthology.orchestra.run.smithi007.stdout:(191/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 487 kB/s | 192 kB 00:00 2024-09-14T11:12:34.893 INFO:teuthology.orchestra.run.smithi007.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 2.1 MB/s | 254 kB 00:00 2024-09-14T11:12:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 7.9 MB/s | 1.1 MB 00:00 2024-09-14T11:12:35.010 INFO:teuthology.orchestra.run.smithi007.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 1.3 MB/s | 152 kB 00:00 2024-09-14T11:12:35.085 INFO:teuthology.orchestra.run.smithi007.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-14T11:12:35.119 INFO:teuthology.orchestra.run.smithi007.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 761 kB/s | 83 kB 00:00 2024-09-14T11:12:35.211 INFO:teuthology.orchestra.run.smithi007.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.3 MB/s | 679 kB 00:00 2024-09-14T11:12:35.411 INFO:teuthology.orchestra.run.smithi007.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 1.2 MB/s | 245 kB 00:00 2024-09-14T11:12:35.627 INFO:teuthology.orchestra.run.smithi007.stdout:(199/286): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-14T11:12:35.653 INFO:teuthology.orchestra.run.smithi007.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 1.0 MB/s | 248 kB 00:00 2024-09-14T11:12:35.704 INFO:teuthology.orchestra.run.smithi007.stdout:(201/286): poppler-data-0.4.9-9.el9.noarch.rpm 2.2 MB/s | 1.9 MB 00:00 2024-09-14T11:12:35.738 INFO:teuthology.orchestra.run.smithi007.stdout:(202/286): python3-jsonpatch-1.21-16.el9.noarch 232 kB/s | 26 kB 00:00 2024-09-14T11:12:35.763 INFO:teuthology.orchestra.run.smithi007.stdout:(203/286): python3-jsonpointer-2.0-4.el9.noarch 176 kB/s | 19 kB 00:00 2024-09-14T11:12:35.813 INFO:teuthology.orchestra.run.smithi007.stdout:(204/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-14T11:12:35.847 INFO:teuthology.orchestra.run.smithi007.stdout:(205/286): python3-markupsafe-1.1.1-12.el9.x86_ 319 kB/s | 35 kB 00:00 2024-09-14T11:12:35.947 INFO:teuthology.orchestra.run.smithi007.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.8 MB/s | 250 kB 00:00 2024-09-14T11:12:35.981 INFO:teuthology.orchestra.run.smithi007.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 1.6 MB/s | 222 kB 00:00 2024-09-14T11:12:36.065 INFO:teuthology.orchestra.run.smithi007.stdout:(208/286): python3-numpy-1.20.1-5.el9.x86_64.rp 17 MB/s | 5.1 MB 00:00 2024-09-14T11:12:36.090 INFO:teuthology.orchestra.run.smithi007.stdout:(209/286): python3-packaging-20.9-5.el9.noarch. 541 kB/s | 77 kB 00:00 2024-09-14T11:12:36.115 INFO:teuthology.orchestra.run.smithi007.stdout:(210/286): python3-prettytable-0.7.2-27.el9.noa 316 kB/s | 42 kB 00:00 2024-09-14T11:12:36.182 INFO:teuthology.orchestra.run.smithi007.stdout:(211/286): python3-protobuf-3.14.0-13.el9.noarc 2.2 MB/s | 269 kB 00:00 2024-09-14T11:12:36.207 INFO:teuthology.orchestra.run.smithi007.stdout:(212/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.3 MB/s | 159 kB 00:00 2024-09-14T11:12:36.233 INFO:teuthology.orchestra.run.smithi007.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 2.3 MB/s | 279 kB 00:00 2024-09-14T11:12:36.291 INFO:teuthology.orchestra.run.smithi007.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-14T11:12:36.333 INFO:teuthology.orchestra.run.smithi007.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 427 kB/s | 54 kB 00:00 2024-09-14T11:12:36.425 INFO:teuthology.orchestra.run.smithi007.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-09-14T11:12:36.459 INFO:teuthology.orchestra.run.smithi007.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-14T11:12:36.534 INFO:teuthology.orchestra.run.smithi007.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 330 kB/s | 36 kB 00:00 2024-09-14T11:12:36.568 INFO:teuthology.orchestra.run.smithi007.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-14T11:12:36.651 INFO:teuthology.orchestra.run.smithi007.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 479 kB/s | 56 kB 00:00 2024-09-14T11:12:36.685 INFO:teuthology.orchestra.run.smithi007.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 4.3 MB/s | 510 kB 00:00 2024-09-14T11:12:36.794 INFO:teuthology.orchestra.run.smithi007.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 486 kB/s | 69 kB 00:00 2024-09-14T11:12:36.819 INFO:teuthology.orchestra.run.smithi007.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-14T11:12:36.995 INFO:teuthology.orchestra.run.smithi007.stdout:(224/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-14T11:12:37.020 INFO:teuthology.orchestra.run.smithi007.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 761 kB/s | 152 kB 00:00 2024-09-14T11:12:37.053 INFO:teuthology.orchestra.run.smithi007.stdout:(226/286): sound-theme-freedesktop-0.8-17.el9.n 1.4 MB/s | 383 kB 00:00 2024-09-14T11:12:37.112 INFO:teuthology.orchestra.run.smithi007.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 4.6 MB/s | 555 kB 00:00 2024-09-14T11:12:37.146 INFO:teuthology.orchestra.run.smithi007.stdout:(228/286): tracker-miners-3.1.2-4.el9.x86_64.rp 7.3 MB/s | 944 kB 00:00 2024-09-14T11:12:37.171 INFO:teuthology.orchestra.run.smithi007.stdout:(229/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 453 kB/s | 53 kB 00:00 2024-09-14T11:12:37.238 INFO:teuthology.orchestra.run.smithi007.stdout:(230/286): tzdata-java-2024a-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-14T11:12:37.263 INFO:teuthology.orchestra.run.smithi007.stdout:(231/286): upower-0.99.11-11.el9.x86_64.rpm 1.4 MB/s | 173 kB 00:00 2024-09-14T11:12:37.288 INFO:teuthology.orchestra.run.smithi007.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 2.5 MB/s | 306 kB 00:00 2024-09-14T11:12:37.347 INFO:teuthology.orchestra.run.smithi007.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 887 kB/s | 96 kB 00:00 2024-09-14T11:12:37.381 INFO:teuthology.orchestra.run.smithi007.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-14T11:12:37.415 INFO:teuthology.orchestra.run.smithi007.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 337 kB/s | 42 kB 00:00 2024-09-14T11:12:37.473 INFO:teuthology.orchestra.run.smithi007.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.0 MB/s | 385 kB 00:00 2024-09-14T11:12:37.498 INFO:teuthology.orchestra.run.smithi007.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.1 MB/s | 134 kB 00:00 2024-09-14T11:12:37.541 INFO:teuthology.orchestra.run.smithi007.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 6.7 MB/s | 859 kB 00:00 2024-09-14T11:12:37.582 INFO:teuthology.orchestra.run.smithi007.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 584 kB/s | 64 kB 00:00 2024-09-14T11:12:37.633 INFO:teuthology.orchestra.run.smithi007.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.7 MB/s | 505 kB 00:00 2024-09-14T11:12:37.666 INFO:teuthology.orchestra.run.smithi007.stdout:(241/286): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-14T11:12:37.708 INFO:teuthology.orchestra.run.smithi007.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-14T11:12:37.733 INFO:teuthology.orchestra.run.smithi007.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 844 kB/s | 19 kB 00:00 2024-09-14T11:12:37.767 INFO:teuthology.orchestra.run.smithi007.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-14T11:12:37.792 INFO:teuthology.orchestra.run.smithi007.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T11:12:37.818 INFO:teuthology.orchestra.run.smithi007.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T11:12:37.843 INFO:teuthology.orchestra.run.smithi007.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-14T11:12:37.868 INFO:teuthology.orchestra.run.smithi007.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-14T11:12:37.994 INFO:teuthology.orchestra.run.smithi007.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 839 kB 00:00 2024-09-14T11:12:38.028 INFO:teuthology.orchestra.run.smithi007.stdout:(250/286): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-14T11:12:38.069 INFO:teuthology.orchestra.run.smithi007.stdout:(251/286): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-14T11:12:38.094 INFO:teuthology.orchestra.run.smithi007.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-14T11:12:38.120 INFO:teuthology.orchestra.run.smithi007.stdout:(253/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 471 kB/s | 43 kB 00:00 2024-09-14T11:12:38.145 INFO:teuthology.orchestra.run.smithi007.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-14T11:12:38.204 INFO:teuthology.orchestra.run.smithi007.stdout:(255/286): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-14T11:12:38.229 INFO:teuthology.orchestra.run.smithi007.stdout:(256/286): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-09-14T11:12:38.254 INFO:teuthology.orchestra.run.smithi007.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-14T11:12:38.288 INFO:teuthology.orchestra.run.smithi007.stdout:(258/286): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-09-14T11:12:38.313 INFO:teuthology.orchestra.run.smithi007.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-14T11:12:38.338 INFO:teuthology.orchestra.run.smithi007.stdout:(260/286): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-14T11:12:38.355 INFO:teuthology.orchestra.run.smithi007.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 421 kB/s | 18 kB 00:00 2024-09-14T11:12:38.381 INFO:teuthology.orchestra.run.smithi007.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 548 kB/s | 23 kB 00:00 2024-09-14T11:12:38.398 INFO:teuthology.orchestra.run.smithi007.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 461 kB/s | 19 kB 00:00 2024-09-14T11:12:38.415 INFO:teuthology.orchestra.run.smithi007.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 594 kB/s | 20 kB 00:00 2024-09-14T11:12:38.440 INFO:teuthology.orchestra.run.smithi007.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:12:38.465 INFO:teuthology.orchestra.run.smithi007.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:12:38.491 INFO:teuthology.orchestra.run.smithi007.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-14T11:12:38.525 INFO:teuthology.orchestra.run.smithi007.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-14T11:12:38.550 INFO:teuthology.orchestra.run.smithi007.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-14T11:12:38.583 INFO:teuthology.orchestra.run.smithi007.stdout:(270/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-14T11:12:38.609 INFO:teuthology.orchestra.run.smithi007.stdout:(271/286): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-14T11:12:38.634 INFO:teuthology.orchestra.run.smithi007.stdout:(272/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-14T11:12:38.659 INFO:teuthology.orchestra.run.smithi007.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T11:12:38.685 INFO:teuthology.orchestra.run.smithi007.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T11:12:38.710 INFO:teuthology.orchestra.run.smithi007.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-14T11:12:38.735 INFO:teuthology.orchestra.run.smithi007.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-14T11:12:38.777 INFO:teuthology.orchestra.run.smithi007.stdout:(277/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-14T11:12:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-14T11:12:38.828 INFO:teuthology.orchestra.run.smithi007.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-14T11:12:38.853 INFO:teuthology.orchestra.run.smithi007.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-14T11:12:38.879 INFO:teuthology.orchestra.run.smithi007.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:12:38.912 INFO:teuthology.orchestra.run.smithi007.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 3.4 MB/s | 206 kB 00:00 2024-09-14T11:12:38.946 INFO:teuthology.orchestra.run.smithi007.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-14T11:12:38.996 INFO:teuthology.orchestra.run.smithi007.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-14T11:12:39.196 INFO:teuthology.orchestra.run.smithi007.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-14T11:12:39.305 INFO:teuthology.orchestra.run.smithi007.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 8.8 MB/s | 3.5 MB 00:00 2024-09-14T11:12:39.310 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:12:39.310 INFO:teuthology.orchestra.run.smithi007.stdout:Total 13 MB/s | 327 MB 00:24 2024-09-14T11:12:42.511 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-14T11:12:42.714 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-14T11:12:42.714 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-14T11:12:44.358 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:12:44.514 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:12:44.669 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-14T11:12:44.729 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:12:44.812 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:12:45.074 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:12:45.134 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:12:45.187 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:12:45.227 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:12:45.252 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:12:45.300 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:12:45.645 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:12:45.753 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:12:45.876 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:12:45.904 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:12:45.996 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:12:46.025 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:12:46.071 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:12:46.101 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:12:46.101 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-14T11:12:46.102 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-14T11:12:46.126 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:12:46.153 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:12:46.193 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:12:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:12:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:12:46.289 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:12:46.431 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:12:46.569 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:12:46.611 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:12:46.648 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:12:46.676 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:12:46.765 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:12:46.793 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:12:46.840 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:12:46.873 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:12:46.895 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:12:46.922 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:12:47.115 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:12:47.145 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:12:47.255 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:12:47.287 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:12:47.322 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:12:47.397 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:12:47.450 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:12:47.490 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:12:47.533 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:12:47.565 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:12:47.584 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:12:47.609 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:12:47.635 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:12:47.663 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:12:47.695 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:12:47.720 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:12:47.769 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:12:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:12:47.876 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:12:47.937 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:12:47.967 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:12:48.021 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:12:48.063 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:12:48.120 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:12:48.198 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:12:48.238 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:12:48.282 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:12:48.324 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:12:48.535 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:12:48.593 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:12:49.139 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:12:49.230 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:12:49.266 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:12:49.336 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:12:49.380 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:12:49.416 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:12:49.445 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:12:49.517 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:12:49.548 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:12:49.581 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:12:49.616 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:12:49.654 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:12:49.686 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:12:49.718 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:12:49.752 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:12:49.812 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:12:49.845 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:12:49.882 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:12:49.975 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:12:50.039 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:12:50.159 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:12:50.195 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:12:50.242 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:12:50.287 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:12:50.329 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:12:50.469 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:12:50.506 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:12:50.547 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:12:50.652 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:12:50.689 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:12:50.730 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:12:50.763 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:12:50.787 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:12:50.873 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:12:51.000 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:12:51.039 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:12:51.250 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:12:51.290 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:12:51.322 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:12:51.351 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:12:51.393 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:12:51.421 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:12:51.435 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:12:51.435 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:12:51.436 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:12:51.628 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:12:51.714 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:12:51.763 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:12:51.796 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:12:51.821 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:12:51.847 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:12:52.282 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:12:52.309 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:12:52.324 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:12:52.366 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:12:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:12:52.433 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:12:52.475 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:12:52.509 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:12:52.598 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:12:52.648 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:12:52.679 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:12:52.810 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:12:52.872 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:12:53.625 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:12:53.677 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:12:53.710 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:12:53.812 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:12:53.860 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:12:54.056 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:12:54.100 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:12:54.146 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:12:54.665 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:12:54.725 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:12:54.770 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:12:54.804 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:12:55.023 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:12:55.052 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:12:55.139 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:12:55.830 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:12:55.943 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:12:56.510 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:12:56.687 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:12:56.850 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-14T11:12:56.921 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:12:56.950 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:12:57.029 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:12:57.093 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:12:57.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:12:57.195 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:12:57.219 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:12:57.240 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:12:57.266 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:12:57.345 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:12:57.417 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:12:57.447 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:12:57.474 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:12:57.495 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:12:57.508 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:12:57.508 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:12:57.508 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:12:57.561 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:12:57.591 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:12:57.619 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:12:57.619 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:12:57.729 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:12:57.857 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:12:57.896 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:12:57.942 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:12:57.982 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:12:57.989 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:12:58.026 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:12:58.065 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:12:58.080 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:12:58.098 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:12:58.110 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:12:58.130 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:12:58.137 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:12:58.159 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:12:58.162 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:12:58.194 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:12:58.217 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:12:58.227 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:12:58.250 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:12:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:12:58.275 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:12:58.282 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:12:58.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:12:58.348 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:12:58.454 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:12:58.611 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:12:58.617 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:12:58.651 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:12:58.667 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:12:58.696 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:12:58.703 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:12:58.724 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:12:58.728 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:12:58.754 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:12:58.779 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:12:58.803 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:12:58.831 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:12:58.832 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:12:58.858 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:12:58.868 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:12:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:12:58.921 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:12:58.943 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:12:58.946 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:12:58.968 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:12:58.991 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:12:58.996 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:12:59.018 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:12:59.189 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:12:59.228 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:12:59.340 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:12:59.375 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:12:59.411 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:12:59.477 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:12:59.487 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:12:59.547 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:12:59.586 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:12:59.611 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:12:59.629 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:12:59.654 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:12:59.666 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:12:59.681 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:12:59.691 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:12:59.714 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:12:59.720 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:12:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:12:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:12:59.788 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:12:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:12:59.830 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:12:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:12:59.859 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:12:59.879 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:12:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:12:59.905 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:12:59.931 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:12:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:12:59.971 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:12:59.994 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:13:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:13:00.065 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:13:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:13:00.155 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:13:00.190 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:13:00.223 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:13:00.303 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:13:00.342 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:13:00.386 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:13:00.427 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:13:00.506 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:13:00.662 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:13:00.732 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:13:01.301 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:13:01.404 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:13:01.438 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:13:01.519 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:13:01.569 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:13:01.613 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:13:01.642 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:13:01.716 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:13:01.753 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:13:01.787 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:13:01.822 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:13:01.860 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:13:01.893 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:13:01.925 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:13:01.967 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:13:02.027 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:13:02.069 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:13:02.114 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:13:02.210 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:13:02.272 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:13:02.347 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:13:02.383 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:13:02.421 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:13:02.468 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:13:02.521 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:13:02.571 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:13:02.716 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:13:02.755 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:13:02.797 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:13:02.905 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:13:02.939 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:13:02.980 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:13:03.012 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:13:03.037 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:13:03.130 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:13:03.270 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:13:03.322 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:13:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:13:03.583 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:13:03.623 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:13:03.653 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:13:03.695 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:13:03.723 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:13:03.737 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:13:03.738 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:13:03.738 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:03.935 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:13:04.013 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:13:04.064 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:13:04.088 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:13:04.114 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:13:04.140 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:13:04.636 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:13:04.669 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:13:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:13:04.685 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:13:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:04.726 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:13:04.760 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:13:04.794 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:13:04.836 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:13:04.872 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:13:04.972 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:13:05.026 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:13:05.065 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:13:05.175 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:13:05.235 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:13:06.017 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:13:06.072 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:13:06.105 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:13:06.213 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:13:06.254 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:13:06.458 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:13:06.504 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:13:06.554 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:13:07.108 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:13:07.172 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:13:07.208 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:13:07.242 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:13:07.283 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:13:07.474 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:13:07.506 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:13:07.585 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:13:08.307 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:13:08.444 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:13:09.799 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:13:09.884 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:13:09.937 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:13:09.978 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:13:10.007 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:13:10.035 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:13:10.047 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:13:10.047 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:13:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:10.104 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:13:10.147 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:13:10.177 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:13:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:13:10.556 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:13:10.657 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:13:10.688 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:13:10.729 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:13:10.776 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:13:10.857 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:13:10.899 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:13:10.925 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:13:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:13:10.998 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:13:11.519 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:13:11.610 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:13:11.652 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:13:11.679 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:13:11.724 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:13:11.725 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:13:11.753 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:13:11.754 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:13:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:13:11.790 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:13:11.808 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:13:11.838 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:13:11.863 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:13:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:13:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:13:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:13:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:13:12.078 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:13:12.120 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:13:12.307 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:13:12.345 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:13:12.416 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:13:12.446 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:13:12.604 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:13:12.746 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:13:12.803 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:13:12.828 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:13:12.856 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:13:12.927 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:13:12.973 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:13:13.004 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:13:13.026 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:13:13.059 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:13:13.086 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:13:13.129 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:13:13.157 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:13:14.816 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:13:14.853 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:13:15.417 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:13:15.456 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:13:15.549 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:13:15.549 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:13:15.549 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:13:15.549 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:15.582 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:13:24.839 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:25.013 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:13:25.029 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:13:25.029 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:25.029 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:13:25.030 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:25.176 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:13:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:13:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:13:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:13:25.365 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:13:25.889 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:13:25.920 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:13:26.001 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:13:26.030 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:13:26.489 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:13:26.516 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:13:26.516 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:26.516 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:13:26.517 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:13:26.517 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:13:26.517 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:26.739 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:13:26.763 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:13:26.763 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:26.763 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:13:26.763 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:13:26.764 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:13:26.764 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:27.206 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:13:27.230 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:13:27.230 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:27.231 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:13:27.231 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:13:27.231 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:13:27.231 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:27.334 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:13:28.482 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:13:28.538 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:13:29.123 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:13:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:13:29.266 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:13:29.267 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:13:29.267 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:13:29.267 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:29.301 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:13:30.182 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:13:30.290 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:13:30.347 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:13:30.404 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:13:30.589 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:13:30.652 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:13:30.730 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:13:30.828 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:13:30.967 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:13:31.010 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:13:31.044 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:13:31.930 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:13:31.983 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:13:32.331 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:13:32.373 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:13:32.403 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:13:32.431 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:13:32.466 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:13:32.503 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:13:32.530 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:13:32.556 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:13:32.582 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:13:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:13:32.633 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:13:32.659 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:13:32.677 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:13:32.698 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:13:32.726 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:13:32.761 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:13:32.828 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:13:32.863 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:13:32.897 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:13:32.933 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:13:32.972 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:13:33.014 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:13:33.058 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:13:33.090 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:13:33.113 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:13:33.167 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:13:33.199 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:13:33.229 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:13:33.258 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:13:33.283 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:13:33.461 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:13:33.492 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:13:33.528 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:13:33.555 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:13:33.587 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:13:33.714 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:13:33.777 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:13:33.845 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:13:33.874 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:13:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:13:34.046 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:13:34.070 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:13:34.099 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:13:34.122 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:13:34.579 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:13:34.618 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:13:34.636 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:34.860 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:13:34.932 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:13:34.979 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:13:35.015 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:13:35.040 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:13:35.383 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:13:35.411 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:13:35.427 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:13:35.937 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:13:36.014 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:13:36.061 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:13:36.090 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:13:36.298 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:13:36.358 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:13:36.385 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:13:36.408 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:13:36.436 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:13:36.503 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:13:36.539 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:13:36.550 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:13:36.581 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:13:36.601 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:13:36.632 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:13:37.036 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:13:37.063 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:13:37.096 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:13:37.171 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:13:37.196 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:13:39.173 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-09-14T11:13:39.174 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:39.351 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:13:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:13:39.368 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:39.368 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:13:39.368 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:40.386 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:13:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:13:40.910 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:13:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:13:40.939 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:40.939 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:13:40.939 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:13:40.939 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:13:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:41.177 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:13:41.202 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:13:41.202 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:41.202 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:13:41.202 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:13:41.202 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:13:41.202 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:41.483 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:13:41.527 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:13:41.642 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:13:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:13:41.703 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:13:41.703 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:41.703 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:13:41.703 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:13:41.704 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:13:41.704 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:41.807 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:13:41.808 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:13:41.829 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:13:41.854 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:13:41.854 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:41.854 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:13:41.854 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:13:41.854 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:13:41.854 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:41.905 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:13:41.918 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:13:41.940 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:13:41.968 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:13:42.017 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:13:42.041 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:13:42.057 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:13:42.057 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:13:42.057 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:43.017 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:13:43.041 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:13:43.041 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:43.041 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:13:43.041 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:13:43.041 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:13:43.041 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:43.084 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:13:43.107 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:13:43.107 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:43.107 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:13:43.107 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:43.418 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:13:43.442 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:13:43.442 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:43.442 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:13:43.442 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:13:43.442 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:13:43.442 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:44.833 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:13:44.940 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:13:44.998 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:13:45.063 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:13:45.256 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:13:45.310 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:13:45.390 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:13:45.489 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:13:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:13:45.674 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:13:45.710 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:13:46.621 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:13:46.674 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:13:47.050 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:13:47.089 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:13:47.120 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:13:47.147 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:13:47.183 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:13:47.219 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:13:47.247 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:13:47.273 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:13:47.298 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:13:47.323 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:13:47.349 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:13:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:13:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:13:47.432 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:13:47.460 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:13:47.495 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:13:47.531 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:13:47.562 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:13:47.597 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:13:47.631 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:13:47.668 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:13:47.707 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:13:47.749 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:13:47.793 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:13:47.825 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:13:47.856 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:13:47.912 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:13:47.941 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:13:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:13:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:13:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:13:48.163 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:13:48.203 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:13:48.204 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:13:48.236 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:13:48.243 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:13:48.270 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:13:48.297 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:13:48.329 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:13:48.340 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:13:48.404 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:13:48.435 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:13:48.435 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:13:48.455 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:13:48.521 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:13:48.528 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:13:48.528 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:13:48.601 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:13:48.619 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:13:48.635 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:13:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:13:48.643 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:13:48.651 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:13:48.662 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:13:48.662 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:13:48.663 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:13:48.663 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:13:48.725 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:13:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:13:48.795 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:13:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:13:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:13:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:13:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:13:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:13:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:13:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:13:49.311 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:13:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:13:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:13:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:13:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:13:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:13:50.184 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:13:50.210 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:13:50.227 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:13:50.768 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:13:50.858 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:13:50.910 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:13:50.939 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:13:51.141 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:13:51.226 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:13:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:13:51.285 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:13:51.356 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:13:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:13:51.399 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:13:51.430 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:13:51.444 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:13:51.472 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:13:51.861 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:13:51.886 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:13:51.912 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:13:51.981 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:13:52.011 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:13:55.385 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:13:55.450 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:13:56.462 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:13:56.492 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:13:56.616 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:13:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:13:56.810 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:13:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:13:56.836 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:56.836 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:13:56.836 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:13:56.836 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:13:56.836 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:56.886 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:13:56.898 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:13:56.921 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:13:56.950 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:13:56.999 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:13:57.030 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:13:57.047 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:13:57.047 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:13:57.047 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:58.056 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:13:58.081 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:13:58.081 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:58.081 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:13:58.081 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:13:58.081 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:13:58.081 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:58.123 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:13:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:13:58.147 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:58.147 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:13:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:58.473 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:13:58.498 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:13:58.499 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:13:58.499 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:13:58.499 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:13:58.499 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:13:58.499 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:13:58.888 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:13:58.888 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:13:58.888 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:13:58.888 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:13:58.888 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:13:58.888 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:13:58.889 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:13:58.890 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:13:58.891 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:13:58.892 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:13:58.893 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:13:58.896 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:13:58.900 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:13:58.901 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:13:58.902 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:13:58.903 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:13:58.904 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:13:58.905 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:13:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:13:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:13:58.908 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:13:58.909 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:13:58.910 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:13:58.911 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:13:58.912 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:13:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:13:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:13:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:13:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:13:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:13:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:13:58.913 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:14:02.256 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:14:02.256 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:14:02.257 INFO:teuthology.orchestra.run.smithi189.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.258 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi189.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi189.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:14:02.262 INFO:teuthology.orchestra.run.smithi189.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:14:02.263 INFO:teuthology.orchestra.run.smithi189.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:14:02.264 INFO:teuthology.orchestra.run.smithi189.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:14:02.265 INFO:teuthology.orchestra.run.smithi189.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:14:02.266 INFO:teuthology.orchestra.run.smithi189.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:14:02.267 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:14:02.268 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:14:02.269 INFO:teuthology.orchestra.run.smithi189.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:14:02.270 INFO:teuthology.orchestra.run.smithi189.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.271 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:14:02.272 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:14:02.273 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:14:02.274 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:14:02.275 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:14:02.276 INFO:teuthology.orchestra.run.smithi189.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:14:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:02.278 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-14T11:14:02.678 DEBUG:teuthology.parallel:result is None 2024-09-14T11:14:03.494 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:14:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:14:03.566 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:14:03.675 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:14:03.737 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:14:03.766 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:14:03.766 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:14:03.858 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:14:03.858 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:14:03.958 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:14:03.978 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:14:03.985 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:14:03.994 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:14:04.005 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:14:04.005 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:14:04.005 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:14:04.005 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:04.072 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:14:04.144 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:14:14.466 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:14:14.466 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:14:14.466 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:14:14.466 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:14:14.468 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:14:14.490 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:14:14.492 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:14:14.493 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:14:14.494 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:14:14.495 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:14:14.496 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:14:14.497 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:14:14.498 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:14:14.499 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:14:14.500 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:14:14.503 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:14:14.504 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:14:14.505 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:14:14.506 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:14:14.507 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:14:14.508 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:14:18.129 INFO:teuthology.orchestra.run.smithi007.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:14:18.130 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.131 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:14:18.132 INFO:teuthology.orchestra.run.smithi007.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:14:18.133 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:14:18.134 INFO:teuthology.orchestra.run.smithi007.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:14:18.135 INFO:teuthology.orchestra.run.smithi007.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:14:18.136 INFO:teuthology.orchestra.run.smithi007.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:14:18.137 INFO:teuthology.orchestra.run.smithi007.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.138 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:14:18.139 INFO:teuthology.orchestra.run.smithi007.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:14:18.140 INFO:teuthology.orchestra.run.smithi007.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:14:18.141 INFO:teuthology.orchestra.run.smithi007.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:14:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:14:18.143 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:14:18.144 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:14:18.145 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:14:18.146 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:14:18.147 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:14:18.148 INFO:teuthology.orchestra.run.smithi007.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:14:18.149 INFO:teuthology.orchestra.run.smithi007.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:14:18.150 INFO:teuthology.orchestra.run.smithi007.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:14:18.150 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:14:18.150 INFO:teuthology.orchestra.run.smithi007.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:14:18.150 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:18.150 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-14T11:14:18.607 DEBUG:teuthology.parallel:result is None 2024-09-14T11:14:18.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:14:18.755 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:14:18.822 INFO:teuthology.orchestra.run.smithi007.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:14:18.823 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:14:18.823 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:14:18.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:14:18.960 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:14:19.040 INFO:teuthology.orchestra.run.smithi189.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:14:19.040 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:14:19.040 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:14:19.042 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:14:19.042 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:19.042 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:14:19.086 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:19.086 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:14:19.134 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:14:19.134 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:19.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:14:19.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:14:19.255 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:19.255 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:14:19.298 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:14:19.380 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:14:19.380 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:19.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:14:19.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:14:19.499 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:19.499 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:14:19.539 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:14:19.617 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:14:19.618 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:19.618 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:14:19.657 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:14:19.736 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:19.737 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:14:19.775 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:14:19.855 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:14:19.932 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:14:19.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2024-09-14T11:14:19.935 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /var/log/ceph 2024-09-14T11:14:19.973 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:14:19.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:14:20.015 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:14:20.054 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:14:20.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:14:20.094 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:14:20.143 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:14:20.143 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:14:20.143 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904172', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': False, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLh3wyQkiACyCkcVFiaeyunGp7P8WIyesZYKhWlnfMBupFUTT0Tn5hSaV7QzCBGVOlN94fpGrUBNzOkc5g6bl7k=', 'smithi189.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJj5L4CIpdoFJ8/7h67Ih9gGSmMDiOsGtMz95V5PZrZ3qYT8papP3kpDMbIC1Dg5dqIUpoUU3hhCw0ZCTw30zJ8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:14:20.144 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:14:20.174 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:14:20.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:14:20.244 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:14:20.282 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:20.282 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:14:20.352 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:14:20.352 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-14 11:14:05.166269414 +0000 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-14 11:11:33.206506225 +0000 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-14 11:11:33.206506225 +0000 2024-09-14T11:14:20.421 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-14 11:11:33.206506225 +0000 2024-09-14T11:14:20.422 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:14:20.499 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-14T11:14:20.499 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-14T11:14:20.499 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.00010409 s, 4.9 MB/s 2024-09-14T11:14:20.500 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:14:20.572 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-14 11:14:05.166269414 +0000 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-14 11:11:33.551500986 +0000 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-14 11:11:33.551500986 +0000 2024-09-14T11:14:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-14 11:11:33.551500986 +0000 2024-09-14T11:14:20.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:14:20.719 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-14T11:14:20.719 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-14T11:14:20.719 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000100673 s, 5.1 MB/s 2024-09-14T11:14:20.721 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:14:20.791 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-14T11:14:20.860 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-14 11:14:05.167269399 +0000 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-14 11:11:33.861496279 +0000 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-14 11:11:33.861496279 +0000 2024-09-14T11:14:20.861 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-14 11:11:33.861496279 +0000 2024-09-14T11:14:20.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:14:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-14T11:14:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-14T11:14:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000100992 s, 5.1 MB/s 2024-09-14T11:14:20.941 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:14:21.011 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-14 11:14:05.167269399 +0000 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-14 11:11:34.189491298 +0000 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-14 11:11:34.189491298 +0000 2024-09-14T11:14:21.080 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-14 11:11:34.189491298 +0000 2024-09-14T11:14:21.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:14:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-14T11:14:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-14T11:14:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000103493 s, 4.9 MB/s 2024-09-14T11:14:21.159 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:14:21.229 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:21.229 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:21.229 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:14:21.262 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:14:21.262 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-14T11:14:21.335 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:14:21.335 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:21.335 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-14T11:14:21.335 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:21.335 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:21.335 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-14 11:13:49.864267736 +0000 2024-09-14T11:14:21.335 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-14 11:11:26.355990985 +0000 2024-09-14T11:14:21.336 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-14 11:11:26.355990985 +0000 2024-09-14T11:14:21.336 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-14 11:11:26.355990985 +0000 2024-09-14T11:14:21.336 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:14:21.414 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-14T11:14:21.414 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-14T11:14:21.414 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000216326 s, 2.4 MB/s 2024-09-14T11:14:21.416 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:14:21.487 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-14T11:14:21.557 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:14:21.557 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:21.557 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T11:14:21.557 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:21.557 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:21.557 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-14 11:13:49.864267736 +0000 2024-09-14T11:14:21.557 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-14 11:11:26.677984273 +0000 2024-09-14T11:14:21.558 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-14 11:11:26.677984273 +0000 2024-09-14T11:14:21.558 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-14 11:11:26.677984273 +0000 2024-09-14T11:14:21.558 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:14:21.634 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-14T11:14:21.634 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-14T11:14:21.635 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.00021995 s, 2.3 MB/s 2024-09-14T11:14:21.636 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:14:21.706 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-14T11:14:21.775 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-14 11:13:49.865267716 +0000 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-14 11:11:26.985977853 +0000 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-14 11:11:26.985977853 +0000 2024-09-14T11:14:21.776 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-14 11:11:26.985977853 +0000 2024-09-14T11:14:21.776 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:14:21.853 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-14T11:14:21.853 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-14T11:14:21.854 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000243144 s, 2.1 MB/s 2024-09-14T11:14:21.855 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:14:21.925 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-14T11:14:21.993 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:14:21.993 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:14:21.993 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-14T11:14:21.993 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:14:21.994 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:14:21.994 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-14 11:13:49.865267716 +0000 2024-09-14T11:14:21.994 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-14 11:11:27.301971266 +0000 2024-09-14T11:14:21.994 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-14 11:11:27.301971266 +0000 2024-09-14T11:14:21.994 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-14 11:11:27.301971266 +0000 2024-09-14T11:14:21.994 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:14:22.071 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-14T11:14:22.071 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-14T11:14:22.071 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000187998 s, 2.7 MB/s 2024-09-14T11:14:22.072 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:14:22.141 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:22.141 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:14:22.141 INFO:tasks.ceph:Generating config... 2024-09-14T11:14:22.142 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:14:22.143 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:14:22.144 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:14:22.144 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:14:22.144 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:14:22.144 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:14:22.144 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:14:22.144 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:14:22.144 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:14:22.144 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:14:22.144 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:14:22.144 INFO:tasks.ceph:[mon] lockdep = True 2024-09-14T11:14:22.144 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:14:22.144 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:14:22.144 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:14:22.144 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] lockdep = True 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:14:22.145 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:14:22.146 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:14:22.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:14:22.213 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:14:22.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:14:22.277 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:14:22.317 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.c', '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]'), ('mon.b', '172.21.15.189')] 2024-09-14T11:14:22.318 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.189', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:14:22.319 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:22.319 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:14:22.387 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --addv c '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]' --add b 172.21.15.189 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:22.488 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:22.488 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:22.489 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:22.489 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:14:22.489 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-09-14T11:14:22.489 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2024-09-14T11:14:22.489 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:14:22.489 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:14:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:14:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 17 (quincy) 2024-09-14T11:14:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2024-09-14T11:14:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:14:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:14:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:14:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:14:22.491 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:14:22.520 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3191632e-7a9b-4e48-9872-c4da022399f4... 2024-09-14T11:14:22.521 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:14:22.562 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:14:22.618 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-14T11:14:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-09-14T11:14:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:14:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-09-14T11:14:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:14:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.189" 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: mon client directed command retry = 5 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject socket failures = 5000 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:14:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-09-14T11:14:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: bdev async discard = True 2024-09-14T11:14:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: bdev enable discard = True 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore allocator = bitmap 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 1/20 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 1/20 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: debug objclass = 20 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 4/10 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: lockdep = True 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-09-14T11:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: osd shutdown pgref assert = True 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-09-14T11:14:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:14:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: lockdep = True 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = True 2024-09-14T11:14:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: debug rgw = 20 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: debug rgw notification = 20 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw bucket counters cache = True 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw crypt require ssl = False 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw s3 auth use sts = True 2024-09-14T11:14:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: rgw torrent flag = True 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: rgw user counters cache = True 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: setgroup = ceph 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: setuser = ceph 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-09-14T11:14:22.629 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-09-14T11:14:22.630 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:14:22.631 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.189" 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: mon client directed command retry = 5 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: ms inject socket failures = 5000 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:14:22.632 INFO:teuthology.orchestra.run.smithi189.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-09-14T11:14:22.633 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-09-14T11:14:22.634 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: bdev async discard = True 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: bdev enable discard = True 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore allocator = bitmap 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 1/20 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 1/20 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: debug objclass = 20 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 4/10 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: lockdep = True 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-09-14T11:14:22.635 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: osd shutdown pgref assert = True 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-09-14T11:14:22.636 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:14:22.637 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: lockdep = True 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = True 2024-09-14T11:14:22.638 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: debug rgw = 20 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: debug rgw notification = 20 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw bucket counters cache = True 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw crypt require ssl = False 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw s3 auth use sts = True 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw torrent flag = True 2024-09-14T11:14:22.639 INFO:teuthology.orchestra.run.smithi189.stdout: rgw user counters cache = True 2024-09-14T11:14:22.640 INFO:teuthology.orchestra.run.smithi189.stdout: setgroup = ceph 2024-09-14T11:14:22.640 INFO:teuthology.orchestra.run.smithi189.stdout: setuser = ceph 2024-09-14T11:14:22.640 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-09-14T11:14:22.640 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-09-14T11:14:22.640 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-09-14T11:14:22.641 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:14:22.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:14:22.752 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:14:22.753 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:22.753 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:14:22.782 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:22.782 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:14:22.851 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T11:14:22.851 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:22.851 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:14:22.851 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:14:22.940 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:22.940 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:23.010 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T11:14:23.010 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:23.011 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:14:23.011 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:14:23.061 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:23.061 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:23.130 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:14:23.130 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:14:23.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:14:23.196 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:14:23.199 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:14:23.274 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:14:23.277 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:14:23.277 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:14:23.277 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:14:23.334 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:14:23.347 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:14:23.402 INFO:teuthology.orchestra.run.smithi189.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:14:23.415 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:14:23.415 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:14:23.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:14:23.455 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:23.455 INFO:tasks.ceph:role: osd.0 2024-09-14T11:14:23.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T11:14:23.456 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:14:23.534 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:23.534 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:23.534 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:23.534 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:23.534 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:23.535 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:23.535 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:23.535 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:23.535 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:23.535 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:23.566 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-14T11:14:23.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-14T11:14:23.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:14:23.652 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:14:23.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:14:23.777 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:23.778 INFO:tasks.ceph:role: osd.1 2024-09-14T11:14:23.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T11:14:23.778 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:14:23.858 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:23.859 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:23.891 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-14T11:14:23.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-14T11:14:23.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:14:23.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:14:24.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:14:24.143 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:24.143 INFO:tasks.ceph:role: osd.2 2024-09-14T11:14:24.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T11:14:24.143 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:14:24.232 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:24.232 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:24.232 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:24.233 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:24.233 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:24.233 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:24.264 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-14T11:14:24.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-14T11:14:24.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:14:24.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:14:24.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:14:24.475 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:24.475 INFO:tasks.ceph:role: osd.3 2024-09-14T11:14:24.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T11:14:24.476 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:14:24.554 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:24.554 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:24.554 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:24.554 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:24.554 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:24.555 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:24.555 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:24.555 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:24.555 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:24.555 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:24.586 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-14T11:14:24.588 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-14T11:14:24.589 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:14:24.671 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:14:24.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:24.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:24.871+0000 7fe178158640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:14:24.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:24.872+0000 7fe178158640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:14:24.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:24.872+0000 7fe178158640 -1 bdev(0x564804219800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:24.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:24.872+0000 7fe178158640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:14:27.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:14:27.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:27.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:27.902+0000 7fa3d90b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:14:27.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:27.902+0000 7fa3d90b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:14:27.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:27.902+0000 7fa3d90b6640 -1 bdev(0x5555597b9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:27.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:27.902+0000 7fa3d90b6640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:14:30.820 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:14:30.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:30.932+0000 7f667c40b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:14:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:30.933+0000 7f667c40b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:14:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:30.933+0000 7f667c40b640 -1 bdev(0x55cc9302b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:30.933+0000 7f667c40b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:14:34.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:14:34.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:34.193+0000 7fe534b17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:14:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:34.193+0000 7fe534b17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:14:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:34.193+0000 7fe534b17640 -1 bdev(0x557669527800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:14:34.193+0000 7fe534b17640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:14:37.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:14:37.153 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:14:37.198 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:37.199 INFO:tasks.ceph:role: osd.4 2024-09-14T11:14:37.199 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T11:14:37.199 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:14:37.247 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:37.247 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:37.247 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:37.247 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:37.247 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:37.248 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:37.248 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:37.248 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:37.248 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:37.248 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:37.765 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-09-14T11:14:37.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-09-14T11:14:37.767 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:14:37.892 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:14:37.940 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:14:37.981 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:37.981 INFO:tasks.ceph:role: osd.5 2024-09-14T11:14:37.981 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T11:14:37.981 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:14:38.067 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:38.067 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:38.067 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:38.067 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:38.068 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:38.068 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:38.068 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:38.068 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:38.068 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:38.068 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:38.516 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-09-14T11:14:38.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-09-14T11:14:38.518 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:14:38.586 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:14:38.628 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:14:38.706 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:38.706 INFO:tasks.ceph:role: osd.6 2024-09-14T11:14:38.706 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T11:14:38.706 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:14:38.791 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:38.792 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:38.792 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:38.792 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:38.792 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:38.792 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:38.792 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:38.792 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:38.793 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:38.793 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:39.279 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-09-14T11:14:39.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-09-14T11:14:39.281 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:14:39.389 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:14:39.433 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:14:39.512 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:14:39.512 INFO:tasks.ceph:role: osd.7 2024-09-14T11:14:39.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T11:14:39.512 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:14:39.598 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:14:40.127 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-09-14T11:14:40.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-09-14T11:14:40.129 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:14:40.249 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:14:40.294 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:40.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:40.365+0000 7f72d1618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:14:40.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:40.366+0000 7f72d1618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:14:40.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:40.366+0000 7f72d1618640 -1 bdev(0x55f0a9641800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:40.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:40.366+0000 7f72d1618640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:14:43.766 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:14:43.811 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:43.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:43.918+0000 7f5700358640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:14:43.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:43.918+0000 7f5700358640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:14:43.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:43.918+0000 7f5700358640 -1 bdev(0x56539900b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:43.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:43.918+0000 7f5700358640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:14:46.828 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:14:46.871 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:46.974 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:46.976+0000 7f0d84011640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:14:46.974 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:46.976+0000 7f0d84011640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:14:46.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:46.976+0000 7f0d84011640 -1 bdev(0x556c1904f800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:46.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:46.976+0000 7f0d84011640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:14:50.137 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:14:50.181 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:50.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:50.287+0000 7fc4d9ba8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:14:50.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:50.287+0000 7fc4d9ba8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:14:50.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:50.287+0000 7fc4d9ba8640 -1 bdev(0x5647b3b15800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:14:50.286 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-14T11:14:50.287+0000 7fc4d9ba8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:14:53.693 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:14:53.737 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:14:53.738 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:53.738 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:14:53.785 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:53.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:14:53.870 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:53.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:14:53.953 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:53.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:14:54.033 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:54.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:14:54.114 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:54.114 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:14:54.159 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:54.159 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:14:54.241 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:54.242 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:14:54.324 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:54.324 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:14:54.404 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:54.404 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:14:54.483 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:14:54.483 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:14:54.516 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:14:54.517 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:14:54.551 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:14:54.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:14:54.559 DEBUG:teuthology.orchestra.run.smithi189:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAPcOVmaajkCxAAXmxfcHrmH0+cGUAlPL9Rww== 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAQcOVmbNcNNBAApHtraBv8dGV4aEh0KGUtIQ== 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQATcOVmlGThNRAAF22GSGWrFPIBZ/HdiQCZvA== 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAWcOVmRaqwNxAAnQGU5vLznRpv9eWYFcCbqg== 2024-09-14T11:14:54.597 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAacOVm5vSdCxAAuRN+AKUc2Ca2d1gVl8Sa5g== 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAPcOVmaJCFEBAAP5M/F/6TW9X5eEdppiUUOw== 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAgcOVmk9jbFRAAyFgZH8rILUJzzVe252CHbw== 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAjcOVmYQ3INhAALllx07CxNqGkBHNDYjKUPA== 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAmcOVmGag8OhAA4mF6X3cgM6+E72e8H2mYuQ== 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAqcOVmfvApERAAO29BRFejH8n0GDmMEqiUlg== 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-14T11:14:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAPcOVmttAZFBAA/LRWku3rrIfgfqbzhGZf6A== 2024-09-14T11:14:54.599 INFO:teuthology.orchestra.run.smithi007.stdout:[client.1] 2024-09-14T11:14:54.599 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAPcOVmMZAnGBAAJIP1Q5cV4ZlSbPtXXKhV8g== 2024-09-14T11:14:54.628 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.y] 2024-09-14T11:14:54.628 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAPcOVmaajkCxAAXmxfcHrmH0+cGUAlPL9Rww== 2024-09-14T11:14:54.628 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.0] 2024-09-14T11:14:54.628 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAQcOVmbNcNNBAApHtraBv8dGV4aEh0KGUtIQ== 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.1] 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQATcOVmlGThNRAAF22GSGWrFPIBZ/HdiQCZvA== 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.2] 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAWcOVmRaqwNxAAnQGU5vLznRpv9eWYFcCbqg== 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.3] 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAacOVm5vSdCxAAuRN+AKUc2Ca2d1gVl8Sa5g== 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.x] 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAPcOVmaJCFEBAAP5M/F/6TW9X5eEdppiUUOw== 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.4] 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAgcOVmk9jbFRAAyFgZH8rILUJzzVe252CHbw== 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.5] 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAjcOVmYQ3INhAALllx07CxNqGkBHNDYjKUPA== 2024-09-14T11:14:54.629 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.6] 2024-09-14T11:14:54.630 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAmcOVmGag8OhAA4mF6X3cgM6+E72e8H2mYuQ== 2024-09-14T11:14:54.630 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.7] 2024-09-14T11:14:54.630 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAqcOVmfvApERAAO29BRFejH8n0GDmMEqiUlg== 2024-09-14T11:14:54.630 INFO:teuthology.orchestra.run.smithi189.stdout:[client.0] 2024-09-14T11:14:54.630 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAPcOVmttAZFBAA/LRWku3rrIfgfqbzhGZf6A== 2024-09-14T11:14:54.630 INFO:teuthology.orchestra.run.smithi189.stdout:[client.1] 2024-09-14T11:14:54.630 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQAPcOVmMZAnGBAAJIP1Q5cV4ZlSbPtXXKhV8g== 2024-09-14T11:14:54.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:14:54.642 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:14:54.735 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:54.737 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:54.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:54.805 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:54.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:54.872 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:54.937 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:54.939 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.004 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:14:55.006 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:14:55.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.073 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.141 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.207 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.274 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:14:55.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:14:55.341 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:14:55.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:14:55.411 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:14:55.479 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:14:55.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:14:55.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:14:55.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:14:55.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:14:55.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:14:55.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:14:55.900 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:14:55.939 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:14:56.049 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:14:56.087 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:56.089 DEBUG:teuthology.orchestra.run.smithi189:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:14:56.156 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:14:56.157 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:14:56.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:14:56.159 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:14:56.159 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:14:56.159 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:14:56.162 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:14:56.162 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:14:56.162 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:14:56.199 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:14:56.200 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:14:56.200 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:14:56.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:14:56.202 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:14:56.202 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:14:56.203 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:14:56.205 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:14:56.205 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:14:56.205 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:14:56.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:15:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-14T11:15:01.592 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:15:01.592 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:15:01.592 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:15:01.592 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:15:01.633 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:15:01.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:15:01.712 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:15:01.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:15:01.792 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:15:01.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:15:01.873 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:15:01.873 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:15:01.912 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:15:01.912 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:15:01.992 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:15:01.992 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:15:02.073 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-14T11:15:02.073 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:15:02.153 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new e9b06921-3a5a-4b73-8300-c634ce4f76a4 0 2024-09-14T11:15:02.390 INFO:teuthology.orchestra.run.smithi189.stdout:0 2024-09-14T11:15:02.402 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new a57fac7b-95a0-4b30-8ed7-07f3550085e3 1 2024-09-14T11:15:02.603 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-09-14T11:15:02.614 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 8fedc24b-fce6-473c-8bbf-adb45d26c422 2 2024-09-14T11:15:02.825 INFO:teuthology.orchestra.run.smithi189.stdout:2 2024-09-14T11:15:02.837 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 85a0433f-7d76-47ab-8c54-9c6c23d97266 3 2024-09-14T11:15:03.041 INFO:teuthology.orchestra.run.smithi189.stdout:3 2024-09-14T11:15:03.052 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new fb43b2a1-f7ab-4f36-983d-9e670254aad6 4 2024-09-14T11:15:03.252 INFO:teuthology.orchestra.run.smithi189.stdout:4 2024-09-14T11:15:03.263 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new a95c54bf-8518-4383-89e7-4c0a7ef64f25 5 2024-09-14T11:15:03.459 INFO:teuthology.orchestra.run.smithi189.stdout:5 2024-09-14T11:15:03.471 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new e13cf82c-fd2a-4b30-94e0-f064900f9364 6 2024-09-14T11:15:03.666 INFO:teuthology.orchestra.run.smithi189.stdout:6 2024-09-14T11:15:03.691 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 6d19b2cb-bf45-42ea-ac07-94e8eecc7a43 7 2024-09-14T11:15:03.903 INFO:teuthology.orchestra.run.smithi189.stdout:7 2024-09-14T11:15:03.914 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:15:03.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:15:03.917 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:15:03.917 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:15:03.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:15:03.919 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:15:03.920 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:15:03.920 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:15:03.922 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:15:03.922 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:15:03.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:15:03.924 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:15:03.924 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:15:03.925 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:15:03.927 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:15:03.927 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:15:03.927 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:15:03.929 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:15:03.929 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:15:03.929 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:15:03.931 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:15:03.932 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:15:03.932 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:15:03.934 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:15:03.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:15:04.161 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:04.161 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"3191632e-7a9b-4e48-9872-c4da022399f4","created":"2024-09-14T11:15:01.483350+0000","modified":"2024-09-14T11:15:03.903527+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:15:03.903527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e9b06921-3a5a-4b73-8300-c634ce4f76a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a57fac7b-95a0-4b30-8ed7-07f3550085e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8fedc24b-fce6-473c-8bbf-adb45d26c422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"85a0433f-7d76-47ab-8c54-9c6c23d97266","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb43b2a1-f7ab-4f36-983d-9e670254aad6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a95c54bf-8518-4383-89e7-4c0a7ef64f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e13cf82c-fd2a-4b30-94e0-f064900f9364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6d19b2cb-bf45-42ea-ac07-94e8eecc7a43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:15:04.172 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:15:04.173 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:15:04.928 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-14T11:15:04.930+0000 7ff7ef030640 -1 Falling back to public interface 2024-09-14T11:15:04.979 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:15:05.158 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-14T11:15:05.158 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"3191632e-7a9b-4e48-9872-c4da022399f4","created":"2024-09-14T11:15:01.483350+0000","modified":"2024-09-14T11:15:03.903527+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:15:03.903527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e9b06921-3a5a-4b73-8300-c634ce4f76a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a57fac7b-95a0-4b30-8ed7-07f3550085e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8fedc24b-fce6-473c-8bbf-adb45d26c422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"85a0433f-7d76-47ab-8c54-9c6c23d97266","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb43b2a1-f7ab-4f36-983d-9e670254aad6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a95c54bf-8518-4383-89e7-4c0a7ef64f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e13cf82c-fd2a-4b30-94e0-f064900f9364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6d19b2cb-bf45-42ea-ac07-94e8eecc7a43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:15:05.161 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-14T11:15:05.163+0000 7f7dcae11640 -1 Falling back to public interface 2024-09-14T11:15:05.168 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:15:05.396 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-09-14T11:15:05.397+0000 7f4d0380b640 -1 Falling back to public interface 2024-09-14T11:15:05.400 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-14T11:15:05.402+0000 7f6c9a1a2640 -1 Falling back to public interface 2024-09-14T11:15:05.412 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-14T11:15:05.414+0000 7f8af7151640 -1 Falling back to public interface 2024-09-14T11:15:05.424 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-09-14T11:15:05.425+0000 7fef02818640 -1 Falling back to public interface 2024-09-14T11:15:05.646 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-14T11:15:05.648+0000 7f65d6e64640 -1 Falling back to public interface 2024-09-14T11:15:05.647 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-14T11:15:05.649+0000 7eff6b215640 -1 Falling back to public interface 2024-09-14T11:15:06.771 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-14T11:15:06.773+0000 7fa5ec848640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:15:06.772 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-14T11:15:06.773+0000 7fa5ec848640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:15:08.720 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-14T11:15:08.722+0000 7ff7ef030640 -1 osd.1 0 log_to_monitors true 2024-09-14T11:15:08.998 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-14T11:15:09.000+0000 7f8af7151640 -1 osd.5 0 log_to_monitors true 2024-09-14T11:15:09.200 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-14T11:15:09.202+0000 7f7dcae11640 -1 osd.3 0 log_to_monitors true 2024-09-14T11:15:09.201 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-09-14T11:15:09.202+0000 7f4d0380b640 -1 osd.7 0 log_to_monitors true 2024-09-14T11:15:09.463 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-14T11:15:09.465+0000 7f6c9a1a2640 -1 osd.4 0 log_to_monitors true 2024-09-14T11:15:09.707 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-14T11:15:09.709+0000 7eff6b215640 -1 osd.2 0 log_to_monitors true 2024-09-14T11:15:09.721 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-14T11:15:09.723+0000 7f65d6e64640 -1 osd.0 0 log_to_monitors true 2024-09-14T11:15:09.976 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-09-14T11:15:09.978+0000 7fef02818640 -1 osd.6 0 log_to_monitors true 2024-09-14T11:15:10.478 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-14T11:15:10.480+0000 7ff7ea577640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:15:10.491 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-14T11:15:10.494+0000 7ff7e2396640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:11.975 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:15:12.025 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-14T11:15:12.027+0000 7eff66b2d640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:15:12.038 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-14T11:15:12.040+0000 7eff5e94c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:12.053 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-14T11:15:12.055+0000 7f65d2df8640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:15:12.055 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-14T11:15:12.057+0000 7f7dc6821640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:15:12.065 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-14T11:15:12.068+0000 7f65cac17640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:12.072 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-14T11:15:12.075+0000 7f7dbe640640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:12.306 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-14T11:15:12.306 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":14,"fsid":"3191632e-7a9b-4e48-9872-c4da022399f4","created":"2024-09-14T11:15:01.483350+0000","modified":"2024-09-14T11:15:11.774762+0000","last_up_change":"2024-09-14T11:15:10.773564+0000","last_in_change":"2024-09-14T11:15:03.903527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e9b06921-3a5a-4b73-8300-c634ce4f76a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a57fac7b-95a0-4b30-8ed7-07f3550085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6801","nonce":3296984494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6803","nonce":3296984494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6807","nonce":3296984494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6805","nonce":3296984494}]},"public_addr":"172.21.15.7:6801/3296984494","cluster_addr":"172.21.15.7:6803/3296984494","heartbeat_back_addr":"172.21.15.7:6807/3296984494","heartbeat_front_addr":"172.21.15.7:6805/3296984494","state":["exists","up"]},{"osd":2,"uuid":"8fedc24b-fce6-473c-8bbf-adb45d26c422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"85a0433f-7d76-47ab-8c54-9c6c23d97266","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb43b2a1-f7ab-4f36-983d-9e670254aad6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a95c54bf-8518-4383-89e7-4c0a7ef64f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e13cf82c-fd2a-4b30-94e0-f064900f9364","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6d19b2cb-bf45-42ea-ac07-94e8eecc7a43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.683781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:15:12.317 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-14T11:15:12.575 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-14T11:15:12.577+0000 7f6c96136640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:15:12.596 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-14T11:15:12.598+0000 7f6c8df55640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:12.609 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-14T11:15:12.611+0000 7f8af30e5640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:15:12.625 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-14T11:15:12.627+0000 7f8aeaf04640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:12.637 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-09-14T11:15:12.639+0000 7f4cff1de640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:15:12.652 INFO:tasks.ceph.osd.7.smithi189.stderr:2024-09-14T11:15:12.654+0000 7f4cf6ffd640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:12.857 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-09-14T11:15:12.859+0000 7feefe181640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:15:12.868 INFO:tasks.ceph.osd.6.smithi189.stderr:2024-09-14T11:15:12.870+0000 7feef5fa0640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:15:19.124 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:15:19.444 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-14T11:15:19.444 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":18,"fsid":"3191632e-7a9b-4e48-9872-c4da022399f4","created":"2024-09-14T11:15:01.483350+0000","modified":"2024-09-14T11:15:16.042890+0000","last_up_change":"2024-09-14T11:15:13.031058+0000","last_in_change":"2024-09-14T11:15:03.903527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:15:13.785417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9b06921-3a5a-4b73-8300-c634ce4f76a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6817","nonce":2474842914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6821","nonce":2474842914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6830","nonce":2474842914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6825","nonce":2474842914}]},"public_addr":"172.21.15.7:6817/2474842914","cluster_addr":"172.21.15.7:6821/2474842914","heartbeat_back_addr":"172.21.15.7:6830/2474842914","heartbeat_front_addr":"172.21.15.7:6825/2474842914","state":["exists","up"]},{"osd":1,"uuid":"a57fac7b-95a0-4b30-8ed7-07f3550085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6801","nonce":3296984494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6803","nonce":3296984494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6807","nonce":3296984494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6805","nonce":3296984494}]},"public_addr":"172.21.15.7:6801/3296984494","cluster_addr":"172.21.15.7:6803/3296984494","heartbeat_back_addr":"172.21.15.7:6807/3296984494","heartbeat_front_addr":"172.21.15.7:6805/3296984494","state":["exists","up"]},{"osd":2,"uuid":"8fedc24b-fce6-473c-8bbf-adb45d26c422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6820","nonce":2124660824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6824","nonce":2124660824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6829","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6831","nonce":2124660824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6827","nonce":2124660824}]},"public_addr":"172.21.15.7:6820/2124660824","cluster_addr":"172.21.15.7:6824/2124660824","heartbeat_back_addr":"172.21.15.7:6831/2124660824","heartbeat_front_addr":"172.21.15.7:6827/2124660824","state":["exists","up"]},{"osd":3,"uuid":"85a0433f-7d76-47ab-8c54-9c6c23d97266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6809","nonce":3803654234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6811","nonce":3803654234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6815","nonce":3803654234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6813","nonce":3803654234}]},"public_addr":"172.21.15.7:6809/3803654234","cluster_addr":"172.21.15.7:6811/3803654234","heartbeat_back_addr":"172.21.15.7:6815/3803654234","heartbeat_front_addr":"172.21.15.7:6813/3803654234","state":["exists","up"]},{"osd":4,"uuid":"fb43b2a1-f7ab-4f36-983d-9e670254aad6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6809","nonce":2808372927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6811","nonce":2808372927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6815","nonce":2808372927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6813","nonce":2808372927}]},"public_addr":"172.21.15.189:6809/2808372927","cluster_addr":"172.21.15.189:6811/2808372927","heartbeat_back_addr":"172.21.15.189:6815/2808372927","heartbeat_front_addr":"172.21.15.189:6813/2808372927","state":["exists","up"]},{"osd":5,"uuid":"a95c54bf-8518-4383-89e7-4c0a7ef64f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6817","nonce":1502257343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6819","nonce":1502257343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6823","nonce":1502257343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6821","nonce":1502257343}]},"public_addr":"172.21.15.189:6817/1502257343","cluster_addr":"172.21.15.189:6819/1502257343","heartbeat_back_addr":"172.21.15.189:6823/1502257343","heartbeat_front_addr":"172.21.15.189:6821/1502257343","state":["exists","up"]},{"osd":6,"uuid":"e13cf82c-fd2a-4b30-94e0-f064900f9364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6825","nonce":3886110165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6827","nonce":3886110165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6831","nonce":3886110165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6829","nonce":3886110165}]},"public_addr":"172.21.15.189:6825/3886110165","cluster_addr":"172.21.15.189:6827/3886110165","heartbeat_back_addr":"172.21.15.189:6831/3886110165","heartbeat_front_addr":"172.21.15.189:6829/3886110165","state":["exists","up"]},{"osd":7,"uuid":"6d19b2cb-bf45-42ea-ac07-94e8eecc7a43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6801","nonce":1267134272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6803","nonce":1267134272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6807","nonce":1267134272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6805","nonce":1267134272}]},"public_addr":"172.21.15.189:6801/1267134272","cluster_addr":"172.21.15.189:6803/1267134272","heartbeat_back_addr":"172.21.15.189:6807/1267134272","heartbeat_front_addr":"172.21.15.189:6805/1267134272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.709651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.683781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.695823+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.235680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.460457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.956182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:11.027782+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.177660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:15:19.456 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:15:19.456 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:15:19.456 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:15:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'rbd' created 2024-09-14T11:15:20.069 DEBUG:teuthology.orchestra.run.smithi007:> rbd --cluster ceph pool init rbd 2024-09-14T11:15:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:23.086 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:15:23.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:15:23.088 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:15:23.414 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:23.427 INFO:teuthology.orchestra.run.smithi007.stdout:[{"version":9,"timestamp":"2024-09-14T11:15:12.861027+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"6748.900626"}]}] 2024-09-14T11:15:23.427 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:15:23.427 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:15:23.427 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:15:23.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:15:23.795 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:23.806 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":898534802},{"type":"v1","addr":"172.21.15.189:6833","nonce":898534802}]},"active_addr":"172.21.15.189:6833/898534802","active_change":"2024-09-14T11:15:05.759792+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":1884046106}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":2742758208}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":972686780}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":930007621}]}]} 2024-09-14T11:15:23.810 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:15:23.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:15:23.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:15:24.127 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:24.188 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"fsid":"3191632e-7a9b-4e48-9872-c4da022399f4","created":"2024-09-14T11:15:01.483350+0000","modified":"2024-09-14T11:15:23.067480+0000","last_up_change":"2024-09-14T11:15:13.031058+0000","last_in_change":"2024-09-14T11:15:03.903527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:15:13.785417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:15:19.772518+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9b06921-3a5a-4b73-8300-c634ce4f76a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6817","nonce":2474842914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6821","nonce":2474842914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6830","nonce":2474842914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6825","nonce":2474842914}]},"public_addr":"172.21.15.7:6817/2474842914","cluster_addr":"172.21.15.7:6821/2474842914","heartbeat_back_addr":"172.21.15.7:6830/2474842914","heartbeat_front_addr":"172.21.15.7:6825/2474842914","state":["exists","up"]},{"osd":1,"uuid":"a57fac7b-95a0-4b30-8ed7-07f3550085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6801","nonce":3296984494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6803","nonce":3296984494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6807","nonce":3296984494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6805","nonce":3296984494}]},"public_addr":"172.21.15.7:6801/3296984494","cluster_addr":"172.21.15.7:6803/3296984494","heartbeat_back_addr":"172.21.15.7:6807/3296984494","heartbeat_front_addr":"172.21.15.7:6805/3296984494","state":["exists","up"]},{"osd":2,"uuid":"8fedc24b-fce6-473c-8bbf-adb45d26c422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6820","nonce":2124660824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6824","nonce":2124660824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6829","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6831","nonce":2124660824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6827","nonce":2124660824}]},"public_addr":"172.21.15.7:6820/2124660824","cluster_addr":"172.21.15.7:6824/2124660824","heartbeat_back_addr":"172.21.15.7:6831/2124660824","heartbeat_front_addr":"172.21.15.7:6827/2124660824","state":["exists","up"]},{"osd":3,"uuid":"85a0433f-7d76-47ab-8c54-9c6c23d97266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6809","nonce":3803654234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6811","nonce":3803654234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6815","nonce":3803654234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6813","nonce":3803654234}]},"public_addr":"172.21.15.7:6809/3803654234","cluster_addr":"172.21.15.7:6811/3803654234","heartbeat_back_addr":"172.21.15.7:6815/3803654234","heartbeat_front_addr":"172.21.15.7:6813/3803654234","state":["exists","up"]},{"osd":4,"uuid":"fb43b2a1-f7ab-4f36-983d-9e670254aad6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6809","nonce":2808372927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6811","nonce":2808372927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6815","nonce":2808372927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6813","nonce":2808372927}]},"public_addr":"172.21.15.189:6809/2808372927","cluster_addr":"172.21.15.189:6811/2808372927","heartbeat_back_addr":"172.21.15.189:6815/2808372927","heartbeat_front_addr":"172.21.15.189:6813/2808372927","state":["exists","up"]},{"osd":5,"uuid":"a95c54bf-8518-4383-89e7-4c0a7ef64f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6817","nonce":1502257343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6819","nonce":1502257343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6823","nonce":1502257343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6821","nonce":1502257343}]},"public_addr":"172.21.15.189:6817/1502257343","cluster_addr":"172.21.15.189:6819/1502257343","heartbeat_back_addr":"172.21.15.189:6823/1502257343","heartbeat_front_addr":"172.21.15.189:6821/1502257343","state":["exists","up"]},{"osd":6,"uuid":"e13cf82c-fd2a-4b30-94e0-f064900f9364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6825","nonce":3886110165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6827","nonce":3886110165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6831","nonce":3886110165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6829","nonce":3886110165}]},"public_addr":"172.21.15.189:6825/3886110165","cluster_addr":"172.21.15.189:6827/3886110165","heartbeat_back_addr":"172.21.15.189:6831/3886110165","heartbeat_front_addr":"172.21.15.189:6829/3886110165","state":["exists","up"]},{"osd":7,"uuid":"6d19b2cb-bf45-42ea-ac07-94e8eecc7a43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6801","nonce":1267134272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6803","nonce":1267134272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6807","nonce":1267134272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6805","nonce":1267134272}]},"public_addr":"172.21.15.189:6801/1267134272","cluster_addr":"172.21.15.189:6803/1267134272","heartbeat_back_addr":"172.21.15.189:6807/1267134272","heartbeat_front_addr":"172.21.15.189:6805/1267134272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.709651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.683781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.695823+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.235680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.460457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.956182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:11.027782+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.177660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:15:24.190 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:15:24.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:15:24.503 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:24.504 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"fsid":"3191632e-7a9b-4e48-9872-c4da022399f4","created":"2024-09-14T11:15:01.483350+0000","modified":"2024-09-14T11:15:23.067480+0000","last_up_change":"2024-09-14T11:15:13.031058+0000","last_in_change":"2024-09-14T11:15:03.903527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:15:13.785417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:15:19.772518+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9b06921-3a5a-4b73-8300-c634ce4f76a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6817","nonce":2474842914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6821","nonce":2474842914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6830","nonce":2474842914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6825","nonce":2474842914}]},"public_addr":"172.21.15.7:6817/2474842914","cluster_addr":"172.21.15.7:6821/2474842914","heartbeat_back_addr":"172.21.15.7:6830/2474842914","heartbeat_front_addr":"172.21.15.7:6825/2474842914","state":["exists","up"]},{"osd":1,"uuid":"a57fac7b-95a0-4b30-8ed7-07f3550085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6801","nonce":3296984494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6803","nonce":3296984494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6807","nonce":3296984494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6805","nonce":3296984494}]},"public_addr":"172.21.15.7:6801/3296984494","cluster_addr":"172.21.15.7:6803/3296984494","heartbeat_back_addr":"172.21.15.7:6807/3296984494","heartbeat_front_addr":"172.21.15.7:6805/3296984494","state":["exists","up"]},{"osd":2,"uuid":"8fedc24b-fce6-473c-8bbf-adb45d26c422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6820","nonce":2124660824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6824","nonce":2124660824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6829","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6831","nonce":2124660824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6827","nonce":2124660824}]},"public_addr":"172.21.15.7:6820/2124660824","cluster_addr":"172.21.15.7:6824/2124660824","heartbeat_back_addr":"172.21.15.7:6831/2124660824","heartbeat_front_addr":"172.21.15.7:6827/2124660824","state":["exists","up"]},{"osd":3,"uuid":"85a0433f-7d76-47ab-8c54-9c6c23d97266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6809","nonce":3803654234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6811","nonce":3803654234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6815","nonce":3803654234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6813","nonce":3803654234}]},"public_addr":"172.21.15.7:6809/3803654234","cluster_addr":"172.21.15.7:6811/3803654234","heartbeat_back_addr":"172.21.15.7:6815/3803654234","heartbeat_front_addr":"172.21.15.7:6813/3803654234","state":["exists","up"]},{"osd":4,"uuid":"fb43b2a1-f7ab-4f36-983d-9e670254aad6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6809","nonce":2808372927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6811","nonce":2808372927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6815","nonce":2808372927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6813","nonce":2808372927}]},"public_addr":"172.21.15.189:6809/2808372927","cluster_addr":"172.21.15.189:6811/2808372927","heartbeat_back_addr":"172.21.15.189:6815/2808372927","heartbeat_front_addr":"172.21.15.189:6813/2808372927","state":["exists","up"]},{"osd":5,"uuid":"a95c54bf-8518-4383-89e7-4c0a7ef64f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6817","nonce":1502257343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6819","nonce":1502257343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6823","nonce":1502257343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6821","nonce":1502257343}]},"public_addr":"172.21.15.189:6817/1502257343","cluster_addr":"172.21.15.189:6819/1502257343","heartbeat_back_addr":"172.21.15.189:6823/1502257343","heartbeat_front_addr":"172.21.15.189:6821/1502257343","state":["exists","up"]},{"osd":6,"uuid":"e13cf82c-fd2a-4b30-94e0-f064900f9364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6825","nonce":3886110165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6827","nonce":3886110165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6831","nonce":3886110165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6829","nonce":3886110165}]},"public_addr":"172.21.15.189:6825/3886110165","cluster_addr":"172.21.15.189:6827/3886110165","heartbeat_back_addr":"172.21.15.189:6831/3886110165","heartbeat_front_addr":"172.21.15.189:6829/3886110165","state":["exists","up"]},{"osd":7,"uuid":"6d19b2cb-bf45-42ea-ac07-94e8eecc7a43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6801","nonce":1267134272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6803","nonce":1267134272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6807","nonce":1267134272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6805","nonce":1267134272}]},"public_addr":"172.21.15.189:6801/1267134272","cluster_addr":"172.21.15.189:6803/1267134272","heartbeat_back_addr":"172.21.15.189:6807/1267134272","heartbeat_front_addr":"172.21.15.189:6805/1267134272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.709651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.683781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.695823+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.235680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.460457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.956182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:11.027782+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.177660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:15:24.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:15:24.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:15:24.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:15:24.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:15:24.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:15:24.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:15:24.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:15:24.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:15:24.777 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:24.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:15:24.787 INFO:teuthology.orchestra.run.smithi007.stdout:64424509447 2024-09-14T11:15:24.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:15:24.792 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-09-14T11:15:24.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:15:24.796 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:24.796 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:15:24.797 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:24.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:15:24.799 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-14T11:15:24.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:15:24.801 INFO:teuthology.orchestra.run.smithi007.stdout:64424509447 2024-09-14T11:15:24.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:15:24.802 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:24.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:15:25.418 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-14T11:15:25.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.2 2024-09-14T11:15:25.440 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-14T11:15:25.440 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2024-09-14T11:15:25.442 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-14T11:15:25.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-09-14T11:15:25.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.5 2024-09-14T11:15:25.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.3 2024-09-14T11:15:25.464 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-14T11:15:25.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.4 2024-09-14T11:15:25.481 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-14T11:15:25.487 INFO:teuthology.orchestra.run.smithi007.stdout:64424509443 2024-09-14T11:15:25.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-14T11:15:25.503 INFO:teuthology.orchestra.run.smithi007.stdout:64424509444 2024-09-14T11:15:25.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-14T11:15:25.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-09-14T11:15:26.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:15:26.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:15:26.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:15:26.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:15:26.481 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:15:26.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:15:26.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:15:26.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:15:27.077 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:27.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-14T11:15:27.098 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.121 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:27.124 INFO:teuthology.orchestra.run.smithi007.stdout:55834574853 2024-09-14T11:15:27.132 INFO:teuthology.orchestra.run.smithi007.stdout:64424509447 2024-09-14T11:15:27.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-14T11:15:27.142 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-14T11:15:27.142 INFO:teuthology.orchestra.run.smithi007.stdout:64424509447 2024-09-14T11:15:27.142 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-14T11:15:27.154 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-14T11:15:27.155 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.162 INFO:teuthology.orchestra.run.smithi007.stdout:64424509445 2024-09-14T11:15:27.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-14T11:15:27.176 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.188 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:27.194 INFO:teuthology.orchestra.run.smithi007.stdout:64424509446 2024-09-14T11:15:27.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-14T11:15:27.203 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-14T11:15:27.207 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:27.207 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:15:27.208 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:15:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:15:27.572 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-14T11:15:26.278611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235796,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738924,"statfs":{"total":773094113280,"available":772852658176,"internally_reserved":0,"allocated":2965504,"data_stored":1783958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.219660"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927382+0000","last_change":"2024-09-14T11:15:23.927661+0000","last_active":"2024-09-14T11:15:23.927382+0000","last_peered":"2024-09-14T11:15:23.927382+0000","last_clean":"2024-09-14T11:15:23.927382+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:15:23.927382+0000","last_undegraded":"2024-09-14T11:15:23.927382+0000","last_fullsized":"2024-09-14T11:15:23.927382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:47.701947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.084647+0000","last_change":"2024-09-14T11:15:23.084925+0000","last_active":"2024-09-14T11:15:23.084647+0000","last_peered":"2024-09-14T11:15:23.084647+0000","last_clean":"2024-09-14T11:15:23.084647+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:15:23.084647+0000","last_undegraded":"2024-09-14T11:15:23.084647+0000","last_fullsized":"2024-09-14T11:15:23.084647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.357227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927396+0000","last_change":"2024-09-14T11:15:23.927653+0000","last_active":"2024-09-14T11:15:23.927396+0000","last_peered":"2024-09-14T11:15:23.927396+0000","last_clean":"2024-09-14T11:15:23.927396+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:15:23.927396+0000","last_undegraded":"2024-09-14T11:15:23.927396+0000","last_fullsized":"2024-09-14T11:15:23.927396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:15.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.084708+0000","last_change":"2024-09-14T11:15:23.085013+0000","last_active":"2024-09-14T11:15:23.084708+0000","last_peered":"2024-09-14T11:15:23.084708+0000","last_clean":"2024-09-14T11:15:23.084708+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:15:23.084708+0000","last_undegraded":"2024-09-14T11:15:23.084708+0000","last_fullsized":"2024-09-14T11:15:23.084708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:25.505724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.083803+0000","last_change":"2024-09-14T11:15:23.082813+0000","last_active":"2024-09-14T11:15:23.083803+0000","last_peered":"2024-09-14T11:15:23.083803+0000","last_clean":"2024-09-14T11:15:23.083803+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:15:23.083803+0000","last_undegraded":"2024-09-14T11:15:23.083803+0000","last_fullsized":"2024-09-14T11:15:23.083803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:09.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.072067+0000","last_change":"2024-09-14T11:15:23.072067+0000","last_active":"2024-09-14T11:15:23.072067+0000","last_peered":"2024-09-14T11:15:23.072067+0000","last_clean":"2024-09-14T11:15:23.072067+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:15:23.072067+0000","last_undegraded":"2024-09-14T11:15:23.072067+0000","last_fullsized":"2024-09-14T11:15:23.072067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:39.257423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927446+0000","last_change":"2024-09-14T11:15:23.927708+0000","last_active":"2024-09-14T11:15:23.927446+0000","last_peered":"2024-09-14T11:15:23.927446+0000","last_clean":"2024-09-14T11:15:23.927446+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:15:23.927446+0000","last_undegraded":"2024-09-14T11:15:23.927446+0000","last_fullsized":"2024-09-14T11:15:23.927446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.482495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.082390+0000","last_change":"2024-09-14T11:15:23.082390+0000","last_active":"2024-09-14T11:15:23.082390+0000","last_peered":"2024-09-14T11:15:23.082390+0000","last_clean":"2024-09-14T11:15:23.082390+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:15:23.082390+0000","last_undegraded":"2024-09-14T11:15:23.082390+0000","last_fullsized":"2024-09-14T11:15:23.082390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:33.700173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927074+0000","last_change":"2024-09-14T11:15:15.722374+0000","last_active":"2024-09-14T11:15:23.927074+0000","last_peered":"2024-09-14T11:15:23.927074+0000","last_clean":"2024-09-14T11:15:23.927074+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:15:23.927074+0000","last_undegraded":"2024-09-14T11:15:23.927074+0000","last_fullsized":"2024-09-14T11:15:23.927074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_clean_scrub_stamp":"2024-09-14T11:15:14.033306+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:20.114027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":665766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:15:27.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:15:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:27.883 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:15:27.895 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-14T11:15:27.769942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235796,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738924,"statfs":{"total":773094113280,"available":772852658176,"internally_reserved":0,"allocated":2965504,"data_stored":1783958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001343"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927382+0000","last_change":"2024-09-14T11:15:23.927661+0000","last_active":"2024-09-14T11:15:23.927382+0000","last_peered":"2024-09-14T11:15:23.927382+0000","last_clean":"2024-09-14T11:15:23.927382+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:15:23.927382+0000","last_undegraded":"2024-09-14T11:15:23.927382+0000","last_fullsized":"2024-09-14T11:15:23.927382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:47.701947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.084647+0000","last_change":"2024-09-14T11:15:23.084925+0000","last_active":"2024-09-14T11:15:23.084647+0000","last_peered":"2024-09-14T11:15:23.084647+0000","last_clean":"2024-09-14T11:15:23.084647+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:15:23.084647+0000","last_undegraded":"2024-09-14T11:15:23.084647+0000","last_fullsized":"2024-09-14T11:15:23.084647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.357227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927396+0000","last_change":"2024-09-14T11:15:23.927653+0000","last_active":"2024-09-14T11:15:23.927396+0000","last_peered":"2024-09-14T11:15:23.927396+0000","last_clean":"2024-09-14T11:15:23.927396+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:15:23.927396+0000","last_undegraded":"2024-09-14T11:15:23.927396+0000","last_fullsized":"2024-09-14T11:15:23.927396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:15.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.084708+0000","last_change":"2024-09-14T11:15:23.085013+0000","last_active":"2024-09-14T11:15:23.084708+0000","last_peered":"2024-09-14T11:15:23.084708+0000","last_clean":"2024-09-14T11:15:23.084708+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:15:23.084708+0000","last_undegraded":"2024-09-14T11:15:23.084708+0000","last_fullsized":"2024-09-14T11:15:23.084708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:25.505724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.083803+0000","last_change":"2024-09-14T11:15:23.082813+0000","last_active":"2024-09-14T11:15:23.083803+0000","last_peered":"2024-09-14T11:15:23.083803+0000","last_clean":"2024-09-14T11:15:23.083803+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:15:23.083803+0000","last_undegraded":"2024-09-14T11:15:23.083803+0000","last_fullsized":"2024-09-14T11:15:23.083803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:09.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.072067+0000","last_change":"2024-09-14T11:15:23.072067+0000","last_active":"2024-09-14T11:15:23.072067+0000","last_peered":"2024-09-14T11:15:23.072067+0000","last_clean":"2024-09-14T11:15:23.072067+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:15:23.072067+0000","last_undegraded":"2024-09-14T11:15:23.072067+0000","last_fullsized":"2024-09-14T11:15:23.072067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:39.257423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927446+0000","last_change":"2024-09-14T11:15:23.927708+0000","last_active":"2024-09-14T11:15:23.927446+0000","last_peered":"2024-09-14T11:15:23.927446+0000","last_clean":"2024-09-14T11:15:23.927446+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:15:23.927446+0000","last_undegraded":"2024-09-14T11:15:23.927446+0000","last_fullsized":"2024-09-14T11:15:23.927446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.482495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.082390+0000","last_change":"2024-09-14T11:15:23.082390+0000","last_active":"2024-09-14T11:15:23.082390+0000","last_peered":"2024-09-14T11:15:23.082390+0000","last_clean":"2024-09-14T11:15:23.082390+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:15:23.082390+0000","last_undegraded":"2024-09-14T11:15:23.082390+0000","last_fullsized":"2024-09-14T11:15:23.082390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:33.700173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:15:23.927074+0000","last_change":"2024-09-14T11:15:15.722374+0000","last_active":"2024-09-14T11:15:23.927074+0000","last_peered":"2024-09-14T11:15:23.927074+0000","last_clean":"2024-09-14T11:15:23.927074+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:15:23.927074+0000","last_undegraded":"2024-09-14T11:15:23.927074+0000","last_fullsized":"2024-09-14T11:15:23.927074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_clean_scrub_stamp":"2024-09-14T11:15:14.033306+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:20.114027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":665766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:15:27.895 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:15:27.895 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:15:27.896 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:15:27.896 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:15:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:15:28.242 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:15:28.255 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:15:28.255 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:15:28.266 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T11:15:28.267 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:15:28.297 DEBUG:teuthology.orchestra.run.smithi007:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T11:15:28.913 INFO:teuthology.orchestra.run.smithi007.stderr:........+..+++++++++++++++++++++++++++++++++++++++++++++*..+.......+.....+...+.+..+.......+...+..+.+......+..............+............+...+.+......+..+...+...+....+...+.....+.........+.+...+......+...........+..........+.....+++++++++++++++++++++++++++++++++++++++++++++*.......+..+.+.................+..........+.........+........+.......+...........+.......+.....+...+.......+....................+.......+...+......+.....+.........+.+............+...+......+.....+....+..+.........+...+...........................+..........+.....+.............+.....+.......+...............+......+..+...+.........+.+.....+.......+........+...+..........+......+.....+....+..+....+......+.....+..........+...+.....+............+...+......+.............+...+........+.......+...+..+..................+..........+..............+.+.....................+...+..............................+......+..+............+.+.....+.+...+........+.......+...........+..........+.........+........+....+.....+.+...+..+...+....+.....+.+...........+.............+.....+...+.........+...............+.+..+...+....+..............+.+.....+.............+..+......+....+..............+....+......+..+....+...+......+..............+....................................+......+...+.+.........+........+...............+...+.+......+...+...........+......+............+...+.............+.................+..................+....+...+.........+......+..+......+.........+...............................+.....+....+.......................+++++ 2024-09-14T11:15:29.036 INFO:teuthology.orchestra.run.smithi007.stderr:..+.........+......+............+..+++++++++++++++++++++++++++++++++++++++++++++*...+..+.............+..+....+++++++++++++++++++++++++++++++++++++++++++++*.....+....+...+..........................+.+......+...+..+.......+...........+.....................+....+......+.........+.....+....+.....+..........+..................+..+.......+.....+.+..............+......+...+............+....+..............+.+......+..+......+.+........+.....................+++++ 2024-09-14T11:15:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:----- 2024-09-14T11:15:29.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T11:15:29.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo update-ca-trust 2024-09-14T11:15:30.247 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:15:30.276 DEBUG:teuthology.orchestra.run.smithi007:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi007.front.sepia.ceph.com 2024-09-14T11:15:30.412 INFO:teuthology.orchestra.run.smithi007.stderr:....+.+..+.+......+...+..+......+...+......+....+.....+......+...+.+.........+.....+......+....+.....+...+.........+.+..+.......+...........+....+......+.....+++++++++++++++++++++++++++++++++++++++*...+.....+......+...+.+........+.+++++++++++++++++++++++++++++++++++++++*.+.....+.+............+..+.+.....+.......+..+......+..........+..+....+...+........+...+.+...+..+.............+..+..........+...+..+..................+.+....................+......+......++++++ 2024-09-14T11:15:30.412 INFO:teuthology.orchestra.run.smithi007.stderr:.....+.....+...+.+............+..+.+++++++++++++++++++++++++++++++++++++++*..+.....+.+++++++++++++++++++++++++++++++++++++++*..+...+....+..+.+.....+.......+......+.....+......+...+.......+........+.......+........+.+..+.......+...+....................+...+....+.....+.......+......+............+......+...........+....+..+...+..........+......+...+..+.+..+.+...........+.........+......+......+....+.........+.........+..+......+.........+......+....+...+........+...+.+..............+.......+.........+...+.....+...+...+.+.........+............+............+..+...+.......+......+...+..+....+......+..+.+...........+..........+...+..+..........+...+..+.++++++ 2024-09-14T11:15:30.413 INFO:teuthology.orchestra.run.smithi007.stderr:----- 2024-09-14T11:15:30.413 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:15:30.413 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:15:30.482 DEBUG:teuthology.orchestra.run.smithi007:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:15:30.560 INFO:teuthology.orchestra.run.smithi007.stderr:Certificate request self-signature ok 2024-09-14T11:15:30.560 INFO:teuthology.orchestra.run.smithi007.stderr:subject=CN=smithi007.front.sepia.ceph.com 2024-09-14T11:15:30.571 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:15:30.640 DEBUG:teuthology.orchestra.run.smithi007:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:15:30.712 INFO:teuthology.orchestra.run.smithi007.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T11:15:30.713 DEBUG:teuthology.orchestra.run.smithi007:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:15:30.782 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:15:30.796 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-14T11:15:30.797 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:15:30.797 INFO:tasks.rgw:Creating data pools 2024-09-14T11:15:30.797 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:15:30.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-14T11:15:31.287 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:15:31.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:15:32.293 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:15:32.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:15:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:15:33.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:15:34.303 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:15:34.340 DEBUG:tasks.rgw:Pools created 2024-09-14T11:15:34.340 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:15:34.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:15:34.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:15:34.340 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:15:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:34.448 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:36.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.364+0000 7f9c866dd640 0 -- 172.21.15.7:0/3094811719 >> [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] conn(0x7f9b5c077140 msgr2=0x7f9b5c079600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:36.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.369+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.370+0000 7f9c86ede640 0 -- 172.21.15.7:0/3054425134 >> [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] conn(0x7f9b4c077230 msgr2=0x7f9b4c0796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 20 realm 2024-09-14T11:15:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:36.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.371+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.375+0000 7f9c8a92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.375+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.376+0000 7f9c8a92e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:15:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.376+0000 7f9c8a92e800 20 searching for the correct realm 2024-09-14T11:15:36.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:15:36.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:36.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:36.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:15:36.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:36.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:36.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:36.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.388+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 zone default found 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 4 Realm: () 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 zonegroup default 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:36.389+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:38.336+0000 7f9c8a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:38.336+0000 7f9c8a92e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:38.338+0000 7f9c8a92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:38.338+0000 7f9c8a92e800 20 started sync module instance, tier type = 2024-09-14T11:15:38.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:38.338+0000 7f9c8a92e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:15:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.366+0000 7f9c8a92e800 20 add_watcher() i=0 2024-09-14T11:15:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.366+0000 7f9c8a92e800 20 add_watcher() i=1 2024-09-14T11:15:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.366+0000 7f9c8a92e800 20 add_watcher() i=2 2024-09-14T11:15:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.366+0000 7f9c8a92e800 20 add_watcher() i=3 2024-09-14T11:15:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.366+0000 7f9c8a92e800 20 add_watcher() i=4 2024-09-14T11:15:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.366+0000 7f9c8a92e800 20 add_watcher() i=5 2024-09-14T11:15:40.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.366+0000 7f9c8a92e800 20 add_watcher() i=6 2024-09-14T11:15:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.367+0000 7f9c8a92e800 20 add_watcher() i=7 2024-09-14T11:15:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.367+0000 7f9c8a92e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.367+0000 7f9c8a92e800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:15:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.367+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:15:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.367+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:15:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:15:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:15:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:15:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.368+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:15:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:15:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:15:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:15:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:15:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.369+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:15:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.370+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:15:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:15:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:15:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:15:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.371+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:15:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:15:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:15:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:15:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.372+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:15:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:15:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:15:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:15:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.373+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:15:40.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.374+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:15:40.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.375+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:15:40.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.376+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.377+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.378+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:15:40.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:15:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:15:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:15:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:15:40.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.379+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:15:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:15:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:15:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:15:40.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.380+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:15:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.381+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:15:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.382+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:15:40.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.383+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:15:40.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.384+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:15:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.385+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:15:40.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.386+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:15:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.387+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.388+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.389+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:15:40.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.390+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:15:40.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:15:40.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:15:40.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:15:40.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:15:40.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:15:40.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.391+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:15:40.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:15:40.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.392+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:15:40.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.393+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.394+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:15:40.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:15:40.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.395+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.396+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:15:40.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.397+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.398+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:15:40.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.399+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:15:40.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:15:40.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:15:40.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:15:40.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.400+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.401+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:15:40.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.403+0000 7f9c8a92e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:15:40.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.408+0000 7f9b38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:40.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.408+0000 7f9c8a92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:40.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:40.408+0000 7f9c8a92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.339+0000 7f9c8a92e800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:15:43.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.339+0000 7f9c8a92e800 5 note: GC not initialized 2024-09-14T11:15:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.339+0000 7f9aa37fe640 20 reqs_thread_entry: start 2024-09-14T11:15:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.340+0000 7f9c8a92e800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.340+0000 7f9c8a92e800 20 Filter name: none 2024-09-14T11:15:43.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.340+0000 7f9aa17fa640 20 reqs_thread_entry: start 2024-09-14T11:15:43.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.369+0000 7f9b38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:43.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.372+0000 7f9c8a92e800 20 remove_watcher() i=0 2024-09-14T11:15:43.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.372+0000 7f9c8a92e800 2 removed watcher, disabling cache 2024-09-14T11:15:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.374+0000 7f9c8a92e800 20 remove_watcher() i=1 2024-09-14T11:15:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.375+0000 7f9c8a92e800 20 remove_watcher() i=2 2024-09-14T11:15:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.376+0000 7f9c8a92e800 20 remove_watcher() i=3 2024-09-14T11:15:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.377+0000 7f9c8a92e800 20 remove_watcher() i=4 2024-09-14T11:15:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.379+0000 7f9c8a92e800 20 remove_watcher() i=5 2024-09-14T11:15:43.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.380+0000 7f9c8a92e800 20 remove_watcher() i=6 2024-09-14T11:15:43.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.381+0000 7f9c8a92e800 20 remove_watcher() i=7 2024-09-14T11:15:43.402 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-14T11:15:43.402 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:15:43.402 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:15:43.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:15:43.403 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:15:43.470 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:43.470 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:43.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.500+0000 7fd818746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:43.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.500+0000 7fd818746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:43.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.505+0000 7fd6d97e2640 20 reqs_thread_entry: start 2024-09-14T11:15:43.521 INFO:teuthology.orchestra.run.smithi007.stdout:{"id":"00289ab1-7de4-4b62-b8d0-ad917abd1b51","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:15:43.522 DEBUG:tasks.util.rgw: json result: {'id': '00289ab1-7de4-4b62-b8d0-ad917abd1b51', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:15:43.522 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-14T11:15:43.522 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p /tmp/rgw_datacache 2024-09-14T11:15:43.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-14T11:15:43.631 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:15:43.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:15:43.631 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:15:43.728 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:43.728 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:43.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.765+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:43.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.969+0000 7fc627335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:43.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.969+0000 7fc627335800 20 realm 2024-09-14T11:15:43.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.969+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:43.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.969+0000 7fc627335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:43.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.970+0000 7fc627335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:43.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.970+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:43.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.970+0000 7fc627335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:43.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.970+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:43.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.971+0000 7fc627335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:43.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.971+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:43.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.972+0000 7fc627335800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:15:43.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.972+0000 7fc627335800 20 searching for the correct realm 2024-09-14T11:15:43.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:43.973+0000 7fc622820640 0 -- 172.21.15.7:0/1516144694 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fc614087400 msgr2=0x7fc614087880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:44.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.180+0000 7fc623822640 0 -- 172.21.15.7:0/1516144694 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc618018070 msgr2=0x7fc618076150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:44.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.187+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:15:44.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 20 zone default found 2024-09-14T11:15:44.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 4 Realm: () 2024-09-14T11:15:44.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:15:44.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:15:44.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:44.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 20 zonegroup default 2024-09-14T11:15:44.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.188+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.189+0000 7fc627335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.189+0000 7fc627335800 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.189+0000 7fc627335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.189+0000 7fc627335800 20 started sync module instance, tier type = 2024-09-14T11:15:44.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.189+0000 7fc627335800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:15:44.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.201+0000 7fc627335800 20 add_watcher() i=0 2024-09-14T11:15:44.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.201+0000 7fc627335800 20 add_watcher() i=1 2024-09-14T11:15:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.201+0000 7fc627335800 20 add_watcher() i=2 2024-09-14T11:15:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.201+0000 7fc627335800 20 add_watcher() i=3 2024-09-14T11:15:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.201+0000 7fc627335800 20 add_watcher() i=4 2024-09-14T11:15:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.201+0000 7fc627335800 20 add_watcher() i=5 2024-09-14T11:15:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.202+0000 7fc627335800 20 add_watcher() i=6 2024-09-14T11:15:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.203+0000 7fc627335800 20 add_watcher() i=7 2024-09-14T11:15:44.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.203+0000 7fc627335800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc4d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc627335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc627335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc627335800 5 note: GC not initialized 2024-09-14T11:15:44.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc4d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc627335800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc627335800 20 Filter name: none 2024-09-14T11:15:44.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.205+0000 7fc4527fc640 20 reqs_thread_entry: start 2024-09-14T11:15:44.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.216+0000 7fc4d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:44.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.218+0000 7fc627335800 20 remove_watcher() i=0 2024-09-14T11:15:44.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.218+0000 7fc627335800 2 removed watcher, disabling cache 2024-09-14T11:15:44.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.220+0000 7fc627335800 20 remove_watcher() i=1 2024-09-14T11:15:44.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.221+0000 7fc627335800 20 remove_watcher() i=2 2024-09-14T11:15:44.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.222+0000 7fc627335800 20 remove_watcher() i=3 2024-09-14T11:15:44.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.223+0000 7fc627335800 20 remove_watcher() i=4 2024-09-14T11:15:44.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.224+0000 7fc627335800 20 remove_watcher() i=5 2024-09-14T11:15:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.225+0000 7fc627335800 20 remove_watcher() i=6 2024-09-14T11:15:44.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.226+0000 7fc627335800 20 remove_watcher() i=7 2024-09-14T11:15:44.236 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-14T11:15:44.236 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:15:44.237 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:15:44.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:15:44.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:15:44.237 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:15:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.331+0000 7f5c0792c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.331+0000 7f5c0792c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.336+0000 7f5a89ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:44.352 INFO:teuthology.orchestra.run.smithi007.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:15:44.352 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:15:44.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:15:44.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:15:44.352 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:15:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:44.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.447+0000 7fd9a6928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:44.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.447+0000 7fd9a6928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.451+0000 7fd8657e2640 20 reqs_thread_entry: start 2024-09-14T11:15:44.467 INFO:teuthology.orchestra.run.smithi007.stdout:{"id":"00289ab1-7de4-4b62-b8d0-ad917abd1b51","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:15:44.467 DEBUG:tasks.util.rgw: json result: {'id': '00289ab1-7de4-4b62-b8d0-ad917abd1b51', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:15:44.468 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:15:44.468 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:15:44.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:15:44.468 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:15:44.531 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:44.532 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:44.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.559+0000 7f17cd946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:44.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.559+0000 7f17cd946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:44.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.563+0000 7f1621ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:15:44.635 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:15:44.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:15:44.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:15:44.636 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:15:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:44.702 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:44.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.730+0000 7fe8db519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:44.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.730+0000 7fe8db519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:44.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:15:44.734+0000 7fe7177fe640 20 reqs_thread_entry: start 2024-09-14T11:15:44.750 INFO:teuthology.orchestra.run.smithi007.stdout:{"id":"00289ab1-7de4-4b62-b8d0-ad917abd1b51","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:15:44.750 DEBUG:tasks.util.rgw: json result: {'id': '00289ab1-7de4-4b62-b8d0-ad917abd1b51', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:15:44.751 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:15:44.751 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-14T11:15:44.751 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:15:44.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo echo -n https://smithi007.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:15:44.792 INFO:teuthology.orchestra.run.smithi007.stdout:https://smithi007.front.sepia.ceph.com:443 2024-09-14T11:15:44.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:15:44.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo keytool -import -alias smithi007.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T11:15:45.078 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T11:15:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:Certificate was added to keystore 2024-09-14T11:15:45.238 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:15:45.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:15:45.241 INFO:tasks.rgw.client.0:Started 2024-09-14T11:15:45.241 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi007.front.sepia.ceph.com:443/ 2024-09-14T11:15:45.241 DEBUG:teuthology.orchestra.run.smithi007:> curl https://smithi007.front.sepia.ceph.com:443/ 2024-09-14T11:15:45.279 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:15:45.280 INFO:teuthology.orchestra.run.smithi007.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:15:45.280 INFO:teuthology.orchestra.run.smithi007.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:15:45.280 INFO:teuthology.orchestra.run.smithi007.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:15:45.280 INFO:teuthology.orchestra.run.smithi007.stderr:curl: (7) Failed to connect to smithi007.front.sepia.ceph.com port 443: Connection refused 2024-09-14T11:15:45.694 INFO:tasks.rgw.client.0.smithi007.stdout:2024-09-14T11:15:45.695+0000 7fd1bf582880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T11:15:46.281 DEBUG:teuthology.orchestra.run.smithi007:> curl https://smithi007.front.sepia.ceph.com:443/ 2024-09-14T11:15:46.315 INFO:teuthology.orchestra.run.smithi007.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:15:46.315 INFO:teuthology.orchestra.run.smithi007.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:15:46.368 INFO:teuthology.orchestra.run.smithi007.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 3528 0 --:--:-- --:--:-- --:--:-- 3528 2024-09-14T11:15:46.369 INFO:teuthology.orchestra.run.smithi007.stdout:anonymous 2024-09-14T11:15:46.370 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:15:46.379 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:15:46.379 DEBUG:teuthology.orchestra.run.smithi007:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:15:48.791 DEBUG:teuthology.orchestra.run.smithi007:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting tox==3.15.0 2024-09-14T11:15:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:15:49.489 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:15:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:15:49.585 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:15:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:15:49.696 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:15:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:15:49.839 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:15:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:15:49.965 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting packaging>=14 2024-09-14T11:15:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:15:50.056 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting toml>=0.9.4 2024-09-14T11:15:50.070 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:15:50.339 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:15:50.353 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:15:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:15:50.616 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:15:50.724 INFO:teuthology.orchestra.run.smithi007.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:15:50.738 INFO:teuthology.orchestra.run.smithi007.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:15:50.868 INFO:teuthology.orchestra.run.smithi007.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T11:15:51.725 INFO:teuthology.orchestra.run.smithi007.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:15:51.940 INFO:teuthology.orchestra.run.smithi007.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T11:15:51.940 INFO:teuthology.orchestra.run.smithi007.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T11:15:52.001 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:15:52.014 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:15:52.014 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:15:52.014 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:52.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:15:52.045 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:15:52.045 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:52.115 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:52.115 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:15:52.186 INFO:tasks.workunit:timeout=3h 2024-09-14T11:15:52.186 INFO:tasks.workunit:cleanup=True 2024-09-14T11:15:52.187 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:15:52.255 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:16:49.271 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 94% (12139/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:16:49.576 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-14T11:16:49.577 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:16:49.578 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:16:49.578 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:16:49.578 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:16:49.579 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:16:49.657 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:16:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:16:49.660 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:16:50.362 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:16:50.438 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:16:50.480 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:16:50.482 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:16:50.482 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:16:50.522 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:16:50.525 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:16:50.525 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:16:50.595 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-14T11:16:50.597 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-14T11:16:50.597 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:16:50.670 INFO:tasks.workunit.client.0.smithi007.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:16:50.670 INFO:tasks.workunit.client.0.smithi007.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:50.670 INFO:tasks.workunit.client.0.smithi007.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:53.051 INFO:tasks.workunit.client.0.smithi007.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ deactivate nondestructive 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:16:53.052 INFO:tasks.workunit.client.0.smithi007.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:53.053 INFO:tasks.workunit.client.0.smithi007.stderr:++ export VIRTUAL_ENV 2024-09-14T11:16:53.053 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PATH 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -z '' ']' 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ PS1='(rgw) ' 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PS1 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:16:53.054 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install pip --upgrade 2024-09-14T11:16:53.288 INFO:tasks.workunit.client.0.smithi007.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:16:53.477 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting pip 2024-09-14T11:16:53.529 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:16:53.697 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: pip 2024-09-14T11:16:53.697 INFO:tasks.workunit.client.0.smithi007.stdout: Attempting uninstall: pip 2024-09-14T11:16:53.697 INFO:tasks.workunit.client.0.smithi007.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:16:53.861 INFO:tasks.workunit.client.0.smithi007.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:16:53.866 INFO:tasks.workunit.client.0.smithi007.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:16:54.631 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed pip-24.2 2024-09-14T11:16:54.869 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install configobj 2024-09-14T11:16:55.253 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting configobj 2024-09-14T11:16:55.294 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-14T11:16:55.419 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting six (from configobj) 2024-09-14T11:16:55.432 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:16:55.496 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-14T11:16:55.569 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:16:55.633 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: six, configobj 2024-09-14T11:16:55.759 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-14T11:16:55.808 INFO:tasks.workunit.client.0.smithi007.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-14T11:16:55.841 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-14T11:16:55.841 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-14T11:16:55.843 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:55.843 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-14T11:16:55.843 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:55.843 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-14T11:16:55.885 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:55.885 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 43982/radosgw \ntcp6 0 0 :::443 :::* LISTEN 43982/radosgw \n' 2024-09-14T11:16:55.885 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:radosgw port: 443 2024-09-14T11:16:55.885 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-14T11:16:55.885 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-14T11:16:55.907 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:55.907 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b'' 2024-09-14T11:16:55.907 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-14T11:16:56.244 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:56.244 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-14T11:16:56.219715Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-14T11:16:56.219697Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-14T11:16:56.244 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:Creating s3cmd config... 2024-09-14T11:16:56.244 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:proto for s3cmd config is https 2024-09-14T11:16:56.244 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:s3cmd config written 2024-09-14T11:16:56.244 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-14T11:16:56.439 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:56.439 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-14T11:16:56.439 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-14T11:16:56.730 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:56.730 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 68.42 MB/s) [1 of 1]\n" 2024-09-14T11:16:56.730 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-14T11:16:56.946 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:56.946 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 190.11 MB/s)\n" 2024-09-14T11:16:56.946 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-14T11:16:57.275 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:57.275 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "0c23ad2818e8981008c3ff4e72af1d34",\n "tag": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.519564058442686239",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".DO1m3QiAeqZguXXyGp8QtEd3pfHREbi_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 4194304,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1",\n "bucket_id": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1",\n "bucket_id": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7340376,\n "stripe_size": 3146072,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1",\n "bucket_id": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".DO1m3QiAeqZguXXyGp8QtEd3pfHREbi_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-14T11:16:56.699786Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.519564058442686239",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726312615/ctime:1726312615/gid:1333/gname:ubuntu/md5:0c23ad2818e8981008c3ff4e72af1d34/mode:33188/mtime:1726312615/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-14T11:16:57.275 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:Cached object name is: .DO1m3QiAeqZguXXyGp8QtEd3pfHREbi_ 2024-09-14T11:16:57.275 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-14T11:16:57.289 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:command succeeded 2024-09-14T11:16:57.289 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:b'0\n' 2024-09-14T11:16:57.289 INFO:tasks.workunit.client.0.smithi007.stderr:DEBUG:root:Check cache dir content: 0 2024-09-14T11:16:57.289 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-14T11:16:57.289 INFO:tasks.workunit.client.0.smithi007.stderr:INFO:root:Completed Datacache tests 2024-09-14T11:16:57.291 INFO:tasks.workunit.client.0.smithi007.stderr:+ deactivate 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ export PATH 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ hash -r 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset -f deactivate 2024-09-14T11:16:57.292 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo OK. 2024-09-14T11:16:57.293 INFO:tasks.workunit.client.0.smithi007.stdout:OK. 2024-09-14T11:16:57.294 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:16:57.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:57.376 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-14T11:16:57.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:16:57.727 DEBUG:teuthology.parallel:result is None 2024-09-14T11:16:57.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:57.766 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:57.766 DEBUG:teuthology.orchestra.run.smithi007:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:57.845 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:57.845 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:16:57.855 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:16:57.855 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:16:57.855 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:57.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:16:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:16:57.916 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:57.985 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:57.985 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:16:58.054 INFO:tasks.workunit:timeout=3h 2024-09-14T11:16:58.054 INFO:tasks.workunit:cleanup=True 2024-09-14T11:16:58.055 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:16:58.125 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:17:54.904 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 95% (12338/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:17:55.561 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:17:55.561 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:17:55.561 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:17:55.561 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:17:55.561 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:17:55.562 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:17:55.563 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:17:55.633 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:17:55.636 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:17:55.636 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:17:55.685 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:17:55.736 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:17:55.776 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:17:55.778 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:17:55.778 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:17:55.818 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:17:55.821 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:17:55.821 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:17:55.892 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:17:55.893 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:17:55.893 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:17:55.967 INFO:tasks.workunit.client.0.smithi007.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:17:55.968 INFO:tasks.workunit.client.0.smithi007.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:17:55.968 INFO:tasks.workunit.client.0.smithi007.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:17:58.248 INFO:tasks.workunit.client.0.smithi007.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:17:58.248 INFO:tasks.workunit.client.0.smithi007.stderr:++ deactivate nondestructive 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ export VIRTUAL_ENV 2024-09-14T11:17:58.249 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:17:58.250 INFO:tasks.workunit.client.0.smithi007.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:17:58.250 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PATH 2024-09-14T11:17:58.250 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:17:58.250 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -z '' ']' 2024-09-14T11:17:58.250 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:17:58.250 INFO:tasks.workunit.client.0.smithi007.stderr:++ PS1='(rgw) ' 2024-09-14T11:17:58.251 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PS1 2024-09-14T11:17:58.251 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:17:58.251 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:17:58.251 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install pip --upgrade 2024-09-14T11:17:58.492 INFO:tasks.workunit.client.0.smithi007.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:17:58.680 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting pip 2024-09-14T11:17:58.686 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:17:58.733 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: pip 2024-09-14T11:17:58.733 INFO:tasks.workunit.client.0.smithi007.stdout: Attempting uninstall: pip 2024-09-14T11:17:58.733 INFO:tasks.workunit.client.0.smithi007.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:17:58.906 INFO:tasks.workunit.client.0.smithi007.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:17:58.912 INFO:tasks.workunit.client.0.smithi007.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:17:59.677 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed pip-24.2 2024-09-14T11:17:59.725 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install boto3 2024-09-14T11:18:00.608 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting boto3 2024-09-14T11:18:00.664 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:18:01.283 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:18:01.297 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:18:01.430 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:18:01.444 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:18:01.585 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:18:01.714 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:18:01.728 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:18:01.877 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:18:01.891 INFO:tasks.workunit.client.0.smithi007.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:18:02.103 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:18:02.105 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:18:02.122 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:18:02.194 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:18:02.409 INFO:tasks.workunit.client.0.smithi007.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 61.2 MB/s eta 0:00:00 2024-09-14T11:18:02.423 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:18:02.487 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:18:02.556 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:18:02.622 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:18:02.677 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:18:02.754 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:18:03.822 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:18:03.941 INFO:tasks.workunit.client.0.smithi007.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:18:04.087 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:18:04.123 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:04.123 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:04.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.164+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.165+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.165+0000 7f3ea7298800 20 realm 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.165+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.166+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.166+0000 7f3ea7298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.166+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.166+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.166+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.167+0000 7f3ea7298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:04.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.167+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.168+0000 7f3ea7298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:04.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.168+0000 7f3ea7298800 20 searching for the correct realm 2024-09-14T11:18:04.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.170+0000 7f3ea5583640 0 -- 172.21.15.7:0/3919439810 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f3e8c06a4c0 msgr2=0x7f3e8c087a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:04.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.376+0000 7f3ea4581640 0 -- 172.21.15.7:0/3919439810 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f3e94026040 msgr2=0x7f3e94083ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.583+0000 7f3ea7298800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.583+0000 7f3ea7298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.583+0000 7f3ea7298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.583+0000 7f3ea7298800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.583+0000 7f3ea7298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.583+0000 7f3ea7298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.583+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.584+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.584+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.584+0000 7f3ea7298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.584+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 zone default found 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 4 Realm: () 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 zonegroup default 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.585+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.586+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.586+0000 7f3ea7298800 20 started sync module instance, tier type = 2024-09-14T11:18:04.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.586+0000 7f3ea7298800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:04.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.596+0000 7f3ea7298800 20 add_watcher() i=0 2024-09-14T11:18:04.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.596+0000 7f3ea7298800 20 add_watcher() i=1 2024-09-14T11:18:04.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.596+0000 7f3ea7298800 20 add_watcher() i=2 2024-09-14T11:18:04.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.596+0000 7f3ea7298800 20 add_watcher() i=3 2024-09-14T11:18:04.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.596+0000 7f3ea7298800 20 add_watcher() i=4 2024-09-14T11:18:04.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.596+0000 7f3ea7298800 20 add_watcher() i=5 2024-09-14T11:18:04.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.596+0000 7f3ea7298800 20 add_watcher() i=6 2024-09-14T11:18:04.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.597+0000 7f3ea7298800 20 add_watcher() i=7 2024-09-14T11:18:04.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.597+0000 7f3ea7298800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.599+0000 7f3d5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ea7298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ea7298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ea7298800 5 note: GC not initialized 2024-09-14T11:18:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3d59fe3640 20 reqs_thread_entry: start 2024-09-14T11:18:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ea7298800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:04.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ea7298800 20 Filter name: none 2024-09-14T11:18:04.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ccb7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:04.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ea7298800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:18:04.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.600+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 20 rados->read ofs=0 len=0 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:18:04.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.601+0000 7f3ea7298800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:18:04.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.603+0000 7f3ea7298800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:18:04.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.603+0000 7f3ea7298800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:18:04.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.603+0000 7f3ea7298800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:18:04.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.603+0000 7f3d7bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757249 cookie 94184903170128 notifier 4620 bl.length()=593 2024-09-14T11:18:04.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.603+0000 7f3d7bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:18:04.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.603+0000 7f3d7bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:18:04.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.605+0000 7f3ea7298800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:18:04.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.605+0000 7f3ea7298800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:18:04.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.605+0000 7f3ea7298800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:18:04.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.605+0000 7f3d7bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757249 cookie 94184903159264 notifier 4620 bl.length()=186 2024-09-14T11:18:04.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.605+0000 7f3d7bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:18:04.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.605+0000 7f3d7bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:18:04.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.607+0000 7f3d5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:04.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.609+0000 7f3ea7298800 20 remove_watcher() i=0 2024-09-14T11:18:04.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.609+0000 7f3ea7298800 2 removed watcher, disabling cache 2024-09-14T11:18:04.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.611+0000 7f3ea7298800 20 remove_watcher() i=1 2024-09-14T11:18:04.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.612+0000 7f3ea7298800 20 remove_watcher() i=2 2024-09-14T11:18:04.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.613+0000 7f3ea7298800 20 remove_watcher() i=3 2024-09-14T11:18:04.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.614+0000 7f3ea7298800 20 remove_watcher() i=4 2024-09-14T11:18:04.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.615+0000 7f3ea7298800 20 remove_watcher() i=5 2024-09-14T11:18:04.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.616+0000 7f3ea7298800 20 remove_watcher() i=6 2024-09-14T11:18:04.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:04.617+0000 7f3ea7298800 20 remove_watcher() i=7 2024-09-14T11:18:04.781 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.781 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.828 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.828 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.873 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.873 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.888 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.888 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.897 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.898 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.901 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.901 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.907 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.907 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.910 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.911 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.915 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.915 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.927 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.927 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.931 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.931 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.944 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.944 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.948 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.948 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.961 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.961 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.964 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.965 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.976 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:04.977 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:04.979 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:18:04.979 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:04.981 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:18:05.011 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:05.011 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:05.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.052+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 20 realm 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.054+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.055+0000 7f7e81496800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.055+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.056+0000 7f7e81496800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.056+0000 7f7e81496800 20 searching for the correct realm 2024-09-14T11:18:05.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.058+0000 7f7e7f781640 0 -- 172.21.15.7:0/3562614325 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f7e7401e020 msgr2=0x7f7e74057970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.062+0000 7f7e7e77f640 0 -- 172.21.15.7:0/3562614325 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f7e700b33f0 msgr2=0x7f7e700b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.268+0000 7f7e81496800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.268+0000 7f7e81496800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.268+0000 7f7e81496800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.268+0000 7f7e81496800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.268+0000 7f7e81496800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.268+0000 7f7e81496800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.268+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 zone default found 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 4 Realm: () 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 zonegroup default 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.269+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.270+0000 7f7e81496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.270+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.270+0000 7f7e81496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.270+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.270+0000 7f7e81496800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.270+0000 7f7e81496800 20 started sync module instance, tier type = 2024-09-14T11:18:05.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.270+0000 7f7e81496800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:05.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.280+0000 7f7e81496800 20 add_watcher() i=0 2024-09-14T11:18:05.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.280+0000 7f7e81496800 20 add_watcher() i=1 2024-09-14T11:18:05.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.280+0000 7f7e81496800 20 add_watcher() i=2 2024-09-14T11:18:05.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.280+0000 7f7e81496800 20 add_watcher() i=3 2024-09-14T11:18:05.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.280+0000 7f7e81496800 20 add_watcher() i=4 2024-09-14T11:18:05.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.280+0000 7f7e81496800 20 add_watcher() i=5 2024-09-14T11:18:05.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.280+0000 7f7e81496800 20 add_watcher() i=6 2024-09-14T11:18:05.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.281+0000 7f7e81496800 20 add_watcher() i=7 2024-09-14T11:18:05.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.281+0000 7f7e81496800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:05.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.283+0000 7f7d357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.283+0000 7f7e81496800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.283+0000 7f7e81496800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.283+0000 7f7e81496800 5 note: GC not initialized 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7caffff640 20 reqs_thread_entry: start 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 20 Filter name: none 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7cadffb640 20 reqs_thread_entry: start 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:05.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:05.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:05.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:05.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:05.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.284+0000 7f7e81496800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.285+0000 7f7e81496800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.285+0000 7f7e81496800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.285+0000 7f7e81496800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.285+0000 7f7e81496800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.285+0000 7f7e81496800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.285+0000 7f7e81496800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.285+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.286+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:05.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.286+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:05.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.287+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:05.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.288+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:05.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.288+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:05.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.289+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:05.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.289+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:05.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.290+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:05.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.291+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:05.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.291+0000 7f7e81496800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:05.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.297+0000 7f7d357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.299+0000 7f7e81496800 20 remove_watcher() i=0 2024-09-14T11:18:05.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.300+0000 7f7e81496800 2 removed watcher, disabling cache 2024-09-14T11:18:05.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.301+0000 7f7e81496800 20 remove_watcher() i=1 2024-09-14T11:18:05.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.302+0000 7f7e81496800 20 remove_watcher() i=2 2024-09-14T11:18:05.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.303+0000 7f7e81496800 20 remove_watcher() i=3 2024-09-14T11:18:05.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.304+0000 7f7e81496800 20 remove_watcher() i=4 2024-09-14T11:18:05.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.305+0000 7f7e81496800 20 remove_watcher() i=5 2024-09-14T11:18:05.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.306+0000 7f7e81496800 20 remove_watcher() i=6 2024-09-14T11:18:05.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.307+0000 7f7e81496800 20 remove_watcher() i=7 2024-09-14T11:18:05.318 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:18:05.347 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:05.347 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:05.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.388+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 20 realm 2024-09-14T11:18:05.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.390+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.391+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.391+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.392+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.392+0000 7f1205722800 20 searching for the correct realm 2024-09-14T11:18:05.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.394+0000 7f1201c69640 0 -- 172.21.15.7:0/956776868 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f11f80b5e90 msgr2=0x7f11f80ab660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.399+0000 7f1200c67640 0 -- 172.21.15.7:0/956776868 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f11f406a5b0 msgr2=0x7f11f4097a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:05.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:05.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:05.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:05.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:05.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:05.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.605+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:05.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 20 zone default found 2024-09-14T11:18:05.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 4 Realm: () 2024-09-14T11:18:05.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:05.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 20 zonegroup default 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.606+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.607+0000 7f1205722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.607+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.607+0000 7f1205722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.607+0000 7f1205722800 20 started sync module instance, tier type = 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.607+0000 7f1205722800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:05.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.617+0000 7f1205722800 20 add_watcher() i=0 2024-09-14T11:18:05.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.617+0000 7f1205722800 20 add_watcher() i=1 2024-09-14T11:18:05.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.617+0000 7f1205722800 20 add_watcher() i=2 2024-09-14T11:18:05.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.617+0000 7f1205722800 20 add_watcher() i=3 2024-09-14T11:18:05.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.617+0000 7f1205722800 20 add_watcher() i=4 2024-09-14T11:18:05.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.617+0000 7f1205722800 20 add_watcher() i=5 2024-09-14T11:18:05.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.617+0000 7f1205722800 20 add_watcher() i=6 2024-09-14T11:18:05.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.618+0000 7f1205722800 20 add_watcher() i=7 2024-09-14T11:18:05.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.618+0000 7f1205722800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:05.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.620+0000 7f10b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.620+0000 7f1205722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.620+0000 7f1205722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.620+0000 7f1205722800 5 note: GC not initialized 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.620+0000 7f10b67e4640 20 reqs_thread_entry: start 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.620+0000 7f1205722800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.621+0000 7f1205722800 20 Filter name: none 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.621+0000 7f1027fff640 20 reqs_thread_entry: start 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.621+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.621+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.621+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.622+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.622+0000 7f1205722800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.622+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.622+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.622+0000 7f1205722800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.623+0000 7f1205722800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:05.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.623+0000 7f1205722800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:05.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.624+0000 7f10b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.627+0000 7f1205722800 20 remove_watcher() i=0 2024-09-14T11:18:05.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.627+0000 7f1205722800 2 removed watcher, disabling cache 2024-09-14T11:18:05.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.629+0000 7f1205722800 20 remove_watcher() i=1 2024-09-14T11:18:05.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.630+0000 7f1205722800 20 remove_watcher() i=2 2024-09-14T11:18:05.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.631+0000 7f1205722800 20 remove_watcher() i=3 2024-09-14T11:18:05.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.632+0000 7f1205722800 20 remove_watcher() i=4 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.633+0000 7f1205722800 20 remove_watcher() i=5 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.634+0000 7f1205722800 20 remove_watcher() i=6 2024-09-14T11:18:05.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.635+0000 7f1205722800 20 remove_watcher() i=7 2024-09-14T11:18:05.646 INFO:tasks.workunit.client.0.smithi007.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 95, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:18:05.646 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:18:05.646 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:05.647 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.722+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 20 realm 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.724+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.725+0000 7f89d0723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.725+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.726+0000 7f89d0723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.726+0000 7f89d0723800 20 searching for the correct realm 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.728+0000 7f89ccc0d640 0 -- 172.21.15.7:0/2842805932 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f89c0001c20 msgr2=0x7f89c001eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:05.935+0000 7f89cbc0b640 0 -- 172.21.15.7:0/2842805932 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f89bc0ab3a0 msgr2=0x7f89bc0dd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:06.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:06.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:06.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:06.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:06.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:06.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:06.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.143+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:06.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:06.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 20 zone default found 2024-09-14T11:18:06.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 4 Realm: () 2024-09-14T11:18:06.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:06.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 20 zonegroup default 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.144+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.145+0000 7f89d0723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.145+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.145+0000 7f89d0723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.145+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.145+0000 7f89d0723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.145+0000 7f89d0723800 20 started sync module instance, tier type = 2024-09-14T11:18:06.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.145+0000 7f89d0723800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:06.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.156+0000 7f89d0723800 20 add_watcher() i=0 2024-09-14T11:18:06.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.156+0000 7f89d0723800 20 add_watcher() i=1 2024-09-14T11:18:06.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.156+0000 7f89d0723800 20 add_watcher() i=2 2024-09-14T11:18:06.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.156+0000 7f89d0723800 20 add_watcher() i=3 2024-09-14T11:18:06.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.156+0000 7f89d0723800 20 add_watcher() i=4 2024-09-14T11:18:06.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.156+0000 7f89d0723800 20 add_watcher() i=5 2024-09-14T11:18:06.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.157+0000 7f89d0723800 20 add_watcher() i=6 2024-09-14T11:18:06.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.157+0000 7f89d0723800 20 add_watcher() i=7 2024-09-14T11:18:06.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.157+0000 7f89d0723800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:06.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.160+0000 7f8882fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.160+0000 7f89d0723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.160+0000 7f89d0723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.160+0000 7f89d0723800 5 note: GC not initialized 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.160+0000 7f8881fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.160+0000 7f89d0723800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 20 Filter name: none 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f87f37fe640 20 reqs_thread_entry: start 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:06.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:06.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:06.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:06.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:06.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.161+0000 7f89d0723800 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.162+0000 7f89d0723800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:06.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.162+0000 7f89d0723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:06.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.162+0000 7f89d0723800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:06.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.162+0000 7f89d0723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:06.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.162+0000 7f89d0723800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:06.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.162+0000 7f89d0723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:06.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.162+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:06.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.163+0000 7f89d0723800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:18:06.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.163+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:06.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.163+0000 7f89d0723800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:18:06.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.163+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:06.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.164+0000 7f89d0723800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:18:06.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.164+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:06.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.164+0000 7f89d0723800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:18:06.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.164+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:06.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.165+0000 7f89d0723800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:18:06.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.165+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:06.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.165+0000 7f89d0723800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:18:06.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.165+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:06.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.166+0000 7f89d0723800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:18:06.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.166+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:06.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.167+0000 7f89d0723800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:18:06.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.167+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:06.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.167+0000 7f89d0723800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:18:06.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.167+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:06.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.168+0000 7f89d0723800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:18:06.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.168+0000 7f89d0723800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:06.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.168+0000 7f89d0723800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:18:06.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.168+0000 7f89d0723800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:18:06.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.169+0000 7f8882fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:06.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.172+0000 7f89d0723800 20 remove_watcher() i=0 2024-09-14T11:18:06.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.172+0000 7f89d0723800 2 removed watcher, disabling cache 2024-09-14T11:18:06.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.173+0000 7f89d0723800 20 remove_watcher() i=1 2024-09-14T11:18:06.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.174+0000 7f89d0723800 20 remove_watcher() i=2 2024-09-14T11:18:06.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.175+0000 7f89d0723800 20 remove_watcher() i=3 2024-09-14T11:18:06.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.176+0000 7f89d0723800 20 remove_watcher() i=4 2024-09-14T11:18:06.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.177+0000 7f89d0723800 20 remove_watcher() i=5 2024-09-14T11:18:06.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.179+0000 7f89d0723800 20 remove_watcher() i=6 2024-09-14T11:18:06.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:06.180+0000 7f89d0723800 20 remove_watcher() i=7 2024-09-14T11:18:06.192 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:18:06.605 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:18:08.023 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:08.023 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:08.077 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:08.079 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:18:08.115 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:08.115 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:08.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.161+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 20 realm 2024-09-14T11:18:08.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:08.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.366+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.368+0000 7f42dbf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:08.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.368+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.369+0000 7f42dbf40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:08.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.369+0000 7f42dbf40800 20 searching for the correct realm 2024-09-14T11:18:08.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.371+0000 7f42d84c1640 0 -- 172.21.15.7:0/2521548019 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f42cc063a00 msgr2=0x7f42cc076620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:08.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.580+0000 7f42d74bf640 0 -- 172.21.15.7:0/2521548019 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f42c8073040 msgr2=0x7f42c8082930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.787+0000 7f42dbf40800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.787+0000 7f42dbf40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.787+0000 7f42dbf40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.787+0000 7f42dbf40800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.787+0000 7f42dbf40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.787+0000 7f42dbf40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.787+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.788+0000 7f42dbf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.788+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.788+0000 7f42dbf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:08.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.788+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.788+0000 7f42dbf40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:08.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.788+0000 7f42dbf40800 20 zone default found 2024-09-14T11:18:08.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.788+0000 7f42dbf40800 4 Realm: () 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 20 zonegroup default 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.789+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.790+0000 7f42dbf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.790+0000 7f42dbf40800 20 started sync module instance, tier type = 2024-09-14T11:18:08.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.790+0000 7f42dbf40800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:08.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.803+0000 7f42dbf40800 20 add_watcher() i=0 2024-09-14T11:18:08.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.803+0000 7f42dbf40800 20 add_watcher() i=1 2024-09-14T11:18:08.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.803+0000 7f42dbf40800 20 add_watcher() i=2 2024-09-14T11:18:08.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.803+0000 7f42dbf40800 20 add_watcher() i=3 2024-09-14T11:18:08.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.803+0000 7f42dbf40800 20 add_watcher() i=4 2024-09-14T11:18:08.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.803+0000 7f42dbf40800 20 add_watcher() i=5 2024-09-14T11:18:08.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.803+0000 7f42dbf40800 20 add_watcher() i=6 2024-09-14T11:18:08.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.805+0000 7f42dbf40800 20 add_watcher() i=7 2024-09-14T11:18:08.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.805+0000 7f42dbf40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:08.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.807+0000 7f418dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:08.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.807+0000 7f42dbf40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:08.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.807+0000 7f42dbf40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:08.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.808+0000 7f42dbf40800 5 note: GC not initialized 2024-09-14T11:18:08.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.808+0000 7f418cfe1640 20 reqs_thread_entry: start 2024-09-14T11:18:08.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.808+0000 7f42dbf40800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:08.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.808+0000 7f42dbf40800 20 Filter name: none 2024-09-14T11:18:08.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.808+0000 7f41067fc640 20 reqs_thread_entry: start 2024-09-14T11:18:08.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.808+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.809+0000 7f42dbf40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:08.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.809+0000 7f42dbf40800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.809+0000 7f42dbf40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:08.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.809+0000 7f42dbf40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:08.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.809+0000 7f42dbf40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:08.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.809+0000 7f42dbf40800 20 INFO: main: starting shard=0 2024-09-14T11:18:08.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.809+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:08.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.810+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.810+0000 7f42dbf40800 20 INFO: main: starting shard=1 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.810+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.811+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.811+0000 7f42dbf40800 20 INFO: main: starting shard=2 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.811+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.811+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.811+0000 7f42dbf40800 20 INFO: main: starting shard=3 2024-09-14T11:18:08.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.811+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:08.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.812+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.812+0000 7f42dbf40800 20 INFO: main: starting shard=4 2024-09-14T11:18:08.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.812+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:08.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.812+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.812+0000 7f42dbf40800 20 INFO: main: starting shard=5 2024-09-14T11:18:08.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.812+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:08.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.813+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.813+0000 7f42dbf40800 20 INFO: main: starting shard=6 2024-09-14T11:18:08.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.813+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:08.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.814+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.814+0000 7f42dbf40800 20 INFO: main: starting shard=7 2024-09-14T11:18:08.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.814+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:08.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.814+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.814+0000 7f42dbf40800 20 INFO: main: starting shard=8 2024-09-14T11:18:08.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.814+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:08.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.815+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:18:08.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.815+0000 7f42dbf40800 20 INFO: main: starting shard=9 2024-09-14T11:18:08.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.815+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:08.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.816+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.816+0000 7f42dbf40800 20 INFO: main: starting shard=10 2024-09-14T11:18:08.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.816+0000 7f42dbf40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:08.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.816+0000 7f42dbf40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:08.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.816+0000 7f42dbf40800 20 INFO: main: done 2024-09-14T11:18:08.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.817+0000 7f418dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:08.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.820+0000 7f42dbf40800 20 remove_watcher() i=0 2024-09-14T11:18:08.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.820+0000 7f42dbf40800 2 removed watcher, disabling cache 2024-09-14T11:18:08.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.822+0000 7f42dbf40800 20 remove_watcher() i=1 2024-09-14T11:18:08.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.823+0000 7f42dbf40800 20 remove_watcher() i=2 2024-09-14T11:18:08.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.824+0000 7f42dbf40800 20 remove_watcher() i=3 2024-09-14T11:18:08.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.826+0000 7f42dbf40800 20 remove_watcher() i=4 2024-09-14T11:18:08.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.827+0000 7f42dbf40800 20 remove_watcher() i=5 2024-09-14T11:18:08.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.828+0000 7f42dbf40800 20 remove_watcher() i=6 2024-09-14T11:18:08.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.830+0000 7f42dbf40800 20 remove_watcher() i=7 2024-09-14T11:18:08.845 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:08.845 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:08.849 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:08.849 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:08.852 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:08.852 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:08.900 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:08.902 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:18:08.936 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:08.936 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:08.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.981+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.982+0000 7fcdc25ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.982+0000 7fcdc25ad800 20 realm 2024-09-14T11:18:08.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.982+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.982+0000 7fcdc25ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.982+0000 7fcdc25ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:08.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.982+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.983+0000 7fcdc25ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.983+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.984+0000 7fcdc25ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:08.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.984+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.985+0000 7fcdc25ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:08.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.985+0000 7fcdc25ad800 20 searching for the correct realm 2024-09-14T11:18:08.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.985+0000 7fcdc0097640 0 -- 172.21.15.7:0/1622434563 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55d23c78ae60 msgr2=0x55d23c78d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:08.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.988+0000 7fcdc0097640 0 -- 172.21.15.7:0/1622434563 >> [v2:172.21.15.7:6800/3296984494,v1:172.21.15.7:6801/3296984494] conn(0x55d23c77e6b0 msgr2=0x55d23c780b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.996+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 zone default found 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 4 Realm: () 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 zonegroup default 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.997+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.998+0000 7fcdc25ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:08.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.998+0000 7fcdc25ad800 20 started sync module instance, tier type = 2024-09-14T11:18:08.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:08.998+0000 7fcdc25ad800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:09.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.009+0000 7fcdc25ad800 20 add_watcher() i=0 2024-09-14T11:18:09.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.009+0000 7fcdc25ad800 20 add_watcher() i=1 2024-09-14T11:18:09.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.009+0000 7fcdc25ad800 20 add_watcher() i=2 2024-09-14T11:18:09.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.009+0000 7fcdc25ad800 20 add_watcher() i=3 2024-09-14T11:18:09.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.009+0000 7fcdc25ad800 20 add_watcher() i=4 2024-09-14T11:18:09.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.009+0000 7fcdc25ad800 20 add_watcher() i=5 2024-09-14T11:18:09.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.009+0000 7fcdc25ad800 20 add_watcher() i=6 2024-09-14T11:18:09.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.010+0000 7fcdc25ad800 20 add_watcher() i=7 2024-09-14T11:18:09.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.010+0000 7fcdc25ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:09.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.012+0000 7fcc76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.012+0000 7fcdc25ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.012+0000 7fcdc25ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.012+0000 7fcdc25ad800 5 note: GC not initialized 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.013+0000 7fcc75fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.013+0000 7fcdc25ad800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.013+0000 7fcdc25ad800 20 Filter name: none 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.013+0000 7fcbe77fe640 20 reqs_thread_entry: start 2024-09-14T11:18:09.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.013+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.013+0000 7fcdc25ad800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:09.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.013+0000 7fcdc25ad800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:09.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:09.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:09.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 INFO: main: starting shard=0 2024-09-14T11:18:09.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:09.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 INFO: main: starting shard=1 2024-09-14T11:18:09.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.014+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:09.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.015+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.015+0000 7fcdc25ad800 20 INFO: main: starting shard=2 2024-09-14T11:18:09.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.015+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:09.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.015+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.015+0000 7fcdc25ad800 20 INFO: main: starting shard=3 2024-09-14T11:18:09.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.015+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:09.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.016+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.016+0000 7fcdc25ad800 20 INFO: main: starting shard=4 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.016+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.016+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.016+0000 7fcdc25ad800 20 INFO: main: starting shard=5 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.016+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.017+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.017+0000 7fcdc25ad800 20 INFO: main: starting shard=6 2024-09-14T11:18:09.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.017+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:09.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.018+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.018+0000 7fcdc25ad800 20 INFO: main: starting shard=7 2024-09-14T11:18:09.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.018+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:09.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.018+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.018+0000 7fcdc25ad800 20 INFO: main: starting shard=8 2024-09-14T11:18:09.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.018+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:09.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.019+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.019+0000 7fcdc25ad800 20 INFO: main: starting shard=9 2024-09-14T11:18:09.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.019+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:09.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.019+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.019+0000 7fcdc25ad800 20 INFO: main: starting shard=10 2024-09-14T11:18:09.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.019+0000 7fcdc25ad800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:09.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.020+0000 7fcdc25ad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.020+0000 7fcdc25ad800 20 INFO: main: done 2024-09-14T11:18:09.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.021+0000 7fcc76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:09.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.023+0000 7fcdc25ad800 20 remove_watcher() i=0 2024-09-14T11:18:09.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.023+0000 7fcdc25ad800 2 removed watcher, disabling cache 2024-09-14T11:18:09.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.024+0000 7fcdc25ad800 20 remove_watcher() i=1 2024-09-14T11:18:09.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.025+0000 7fcdc25ad800 20 remove_watcher() i=2 2024-09-14T11:18:09.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.026+0000 7fcdc25ad800 20 remove_watcher() i=3 2024-09-14T11:18:09.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.028+0000 7fcdc25ad800 20 remove_watcher() i=4 2024-09-14T11:18:09.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.029+0000 7fcdc25ad800 20 remove_watcher() i=5 2024-09-14T11:18:09.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.029+0000 7fcdc25ad800 20 remove_watcher() i=6 2024-09-14T11:18:09.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.030+0000 7fcdc25ad800 20 remove_watcher() i=7 2024-09-14T11:18:09.043 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:09.043 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:09.046 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:09.046 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:09.049 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:09.050 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:09.098 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:18:09.131 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:09.131 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:09.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.171+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 20 realm 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.173+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.174+0000 7f5a3af42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:09.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.174+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.175+0000 7f5a3af42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:09.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.175+0000 7f5a3af42800 20 searching for the correct realm 2024-09-14T11:18:09.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.177+0000 7f5a3922d640 0 -- 172.21.15.7:0/1143008192 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f5a20077060 msgr2=0x7f5a2006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:09.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.383+0000 7f5a3822b640 0 -- 172.21.15.7:0/1143008192 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f5a28055410 msgr2=0x7f5a28055870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:09.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:09.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:09.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:09.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:09.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.589+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 20 zone default found 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 4 Realm: () 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 20 zonegroup default 2024-09-14T11:18:09.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.590+0000 7f5a3af42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.591+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.591+0000 7f5a3af42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.591+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.591+0000 7f5a3af42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.591+0000 7f5a3af42800 20 started sync module instance, tier type = 2024-09-14T11:18:09.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.591+0000 7f5a3af42800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:09.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.601+0000 7f5a3af42800 20 add_watcher() i=0 2024-09-14T11:18:09.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.601+0000 7f5a3af42800 20 add_watcher() i=1 2024-09-14T11:18:09.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.601+0000 7f5a3af42800 20 add_watcher() i=2 2024-09-14T11:18:09.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.601+0000 7f5a3af42800 20 add_watcher() i=3 2024-09-14T11:18:09.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.601+0000 7f5a3af42800 20 add_watcher() i=4 2024-09-14T11:18:09.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.601+0000 7f5a3af42800 20 add_watcher() i=5 2024-09-14T11:18:09.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.601+0000 7f5a3af42800 20 add_watcher() i=6 2024-09-14T11:18:09.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.602+0000 7f5a3af42800 20 add_watcher() i=7 2024-09-14T11:18:09.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.602+0000 7f5a3af42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:09.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.604+0000 7f58eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.604+0000 7f5a3af42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.604+0000 7f5a3af42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.604+0000 7f5a3af42800 5 note: GC not initialized 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.605+0000 7f58edfe3640 20 reqs_thread_entry: start 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.605+0000 7f5a3af42800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.605+0000 7f5a3af42800 20 Filter name: none 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.605+0000 7f585f7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:09.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.605+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.605+0000 7f5a3af42800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:09.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.605+0000 7f5a3af42800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:09.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:09.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:09.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 INFO: main: starting shard=0 2024-09-14T11:18:09.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:09.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 INFO: main: starting shard=1 2024-09-14T11:18:09.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.606+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:09.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.607+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:18:09.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.607+0000 7f5a3af42800 20 INFO: main: starting shard=2 2024-09-14T11:18:09.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.607+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:09.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.608+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.608+0000 7f5a3af42800 20 INFO: main: starting shard=3 2024-09-14T11:18:09.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.608+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:09.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.608+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.608+0000 7f5a3af42800 20 INFO: main: starting shard=4 2024-09-14T11:18:09.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.608+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:09.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.609+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.609+0000 7f5a3af42800 20 INFO: main: starting shard=5 2024-09-14T11:18:09.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.609+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:09.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.609+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.609+0000 7f5a3af42800 20 INFO: main: starting shard=6 2024-09-14T11:18:09.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.609+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:09.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.610+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.610+0000 7f5a3af42800 20 INFO: main: starting shard=7 2024-09-14T11:18:09.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.610+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:09.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.610+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.610+0000 7f5a3af42800 20 INFO: main: starting shard=8 2024-09-14T11:18:09.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.610+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:09.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.611+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.611+0000 7f5a3af42800 20 INFO: main: starting shard=9 2024-09-14T11:18:09.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.611+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:09.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.612+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.612+0000 7f5a3af42800 20 INFO: main: starting shard=10 2024-09-14T11:18:09.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.612+0000 7f5a3af42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:09.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.612+0000 7f5a3af42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:09.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.612+0000 7f5a3af42800 20 INFO: main: done 2024-09-14T11:18:09.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.613+0000 7f58eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:09.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.616+0000 7f5a3af42800 20 remove_watcher() i=0 2024-09-14T11:18:09.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.616+0000 7f5a3af42800 2 removed watcher, disabling cache 2024-09-14T11:18:09.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.617+0000 7f5a3af42800 20 remove_watcher() i=1 2024-09-14T11:18:09.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.618+0000 7f5a3af42800 20 remove_watcher() i=2 2024-09-14T11:18:09.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.620+0000 7f5a3af42800 20 remove_watcher() i=3 2024-09-14T11:18:09.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.621+0000 7f5a3af42800 20 remove_watcher() i=4 2024-09-14T11:18:09.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.622+0000 7f5a3af42800 20 remove_watcher() i=5 2024-09-14T11:18:09.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.623+0000 7f5a3af42800 20 remove_watcher() i=6 2024-09-14T11:18:09.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.624+0000 7f5a3af42800 20 remove_watcher() i=7 2024-09-14T11:18:09.636 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:09.637 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:09.642 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:09.642 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:09.694 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:09.695 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:18:09.727 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:09.727 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:09.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.768+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 20 realm 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.770+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.771+0000 7fe636d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:09.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.771+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.772+0000 7fe636d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:09.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.772+0000 7fe636d28800 20 searching for the correct realm 2024-09-14T11:18:09.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.774+0000 7fe63324c640 0 -- 172.21.15.7:0/2727824365 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe62808e0d0 msgr2=0x7fe6280a4030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:09.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.778+0000 7fe63224a640 0 -- 172.21.15.7:0/2727824365 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe6240423e0 msgr2=0x7fe624042820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:09.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.985+0000 7fe636d28800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:09.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.985+0000 7fe636d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:09.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.985+0000 7fe636d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:09.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.985+0000 7fe636d28800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:09.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.985+0000 7fe636d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:09.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.985+0000 7fe636d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:09.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.986+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.986+0000 7fe636d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.986+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.986+0000 7fe636d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:09.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.986+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 zone default found 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 4 Realm: () 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 zonegroup default 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.987+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.988+0000 7fe636d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.988+0000 7fe636d28800 20 started sync module instance, tier type = 2024-09-14T11:18:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:09.988+0000 7fe636d28800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:09.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.000+0000 7fe636d28800 20 add_watcher() i=0 2024-09-14T11:18:09.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.000+0000 7fe636d28800 20 add_watcher() i=1 2024-09-14T11:18:09.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.000+0000 7fe636d28800 20 add_watcher() i=2 2024-09-14T11:18:09.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.000+0000 7fe636d28800 20 add_watcher() i=3 2024-09-14T11:18:09.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.000+0000 7fe636d28800 20 add_watcher() i=4 2024-09-14T11:18:10.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.000+0000 7fe636d28800 20 add_watcher() i=5 2024-09-14T11:18:10.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.000+0000 7fe636d28800 20 add_watcher() i=6 2024-09-14T11:18:10.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.001+0000 7fe636d28800 20 add_watcher() i=7 2024-09-14T11:18:10.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.001+0000 7fe636d28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:10.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.002+0000 7fe4e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe636d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe636d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe636d28800 5 note: GC not initialized 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe463fff640 20 reqs_thread_entry: start 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe636d28800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe636d28800 20 Filter name: none 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe461ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.003+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:10.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.004+0000 7fe636d28800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.004+0000 7fe636d28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.004+0000 7fe636d28800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.004+0000 7fe636d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.004+0000 7fe636d28800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.004+0000 7fe636d28800 20 INFO: main: starting shard=0 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.004+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.005+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.005+0000 7fe636d28800 20 INFO: main: starting shard=1 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.005+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.005+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.005+0000 7fe636d28800 20 INFO: main: starting shard=2 2024-09-14T11:18:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.005+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.006+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.006+0000 7fe636d28800 20 INFO: main: starting shard=3 2024-09-14T11:18:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.006+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.007+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.007+0000 7fe636d28800 20 INFO: main: starting shard=4 2024-09-14T11:18:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.007+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.007+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.007+0000 7fe636d28800 20 INFO: main: starting shard=5 2024-09-14T11:18:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.007+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.008+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.008+0000 7fe636d28800 20 INFO: main: starting shard=6 2024-09-14T11:18:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.008+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.008+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.008+0000 7fe636d28800 20 INFO: main: starting shard=7 2024-09-14T11:18:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.008+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.009+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.009+0000 7fe636d28800 20 INFO: main: starting shard=8 2024-09-14T11:18:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.009+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.009+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.009+0000 7fe636d28800 20 INFO: main: starting shard=9 2024-09-14T11:18:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.009+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.010+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.010+0000 7fe636d28800 20 INFO: main: starting shard=10 2024-09-14T11:18:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.010+0000 7fe636d28800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.010+0000 7fe636d28800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:18:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.010+0000 7fe636d28800 20 INFO: main: done 2024-09-14T11:18:10.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.011+0000 7fe4e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:10.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.014+0000 7fe636d28800 20 remove_watcher() i=0 2024-09-14T11:18:10.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.014+0000 7fe636d28800 2 removed watcher, disabling cache 2024-09-14T11:18:10.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.015+0000 7fe636d28800 20 remove_watcher() i=1 2024-09-14T11:18:10.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.017+0000 7fe636d28800 20 remove_watcher() i=2 2024-09-14T11:18:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.018+0000 7fe636d28800 20 remove_watcher() i=3 2024-09-14T11:18:10.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.019+0000 7fe636d28800 20 remove_watcher() i=4 2024-09-14T11:18:10.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.020+0000 7fe636d28800 20 remove_watcher() i=5 2024-09-14T11:18:10.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.021+0000 7fe636d28800 20 remove_watcher() i=6 2024-09-14T11:18:10.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.022+0000 7fe636d28800 20 remove_watcher() i=7 2024-09-14T11:18:10.035 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:10.039 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:18:10.448 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:18:10.854 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:18:10.854 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:10.855 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:18:10.889 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:10.889 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:10.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.930+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 20 realm 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.932+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:10.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.933+0000 7f6054b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:10.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.933+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:10.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.934+0000 7f6054b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:10.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.934+0000 7f6054b39800 20 searching for the correct realm 2024-09-14T11:18:10.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.936+0000 7f6051026640 0 -- 172.21.15.7:0/2775095729 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f603802f070 msgr2=0x7f6038055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:10.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:10.940+0000 7f6050024640 0 -- 172.21.15.7:0/2775095729 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f60400d91b0 msgr2=0x7f60400ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:11.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:11.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:11.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:11.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:11.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:11.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:11.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.147+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:11.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:11.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 zone default found 2024-09-14T11:18:11.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 4 Realm: () 2024-09-14T11:18:11.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 zonegroup default 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.148+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.149+0000 7f6054b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.149+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.149+0000 7f6054b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.149+0000 7f6054b39800 20 started sync module instance, tier type = 2024-09-14T11:18:11.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.149+0000 7f6054b39800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:11.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.161+0000 7f6054b39800 20 add_watcher() i=0 2024-09-14T11:18:11.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.161+0000 7f6054b39800 20 add_watcher() i=1 2024-09-14T11:18:11.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.161+0000 7f6054b39800 20 add_watcher() i=2 2024-09-14T11:18:11.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.161+0000 7f6054b39800 20 add_watcher() i=3 2024-09-14T11:18:11.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.161+0000 7f6054b39800 20 add_watcher() i=4 2024-09-14T11:18:11.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.161+0000 7f6054b39800 20 add_watcher() i=5 2024-09-14T11:18:11.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.161+0000 7f6054b39800 20 add_watcher() i=6 2024-09-14T11:18:11.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.162+0000 7f6054b39800 20 add_watcher() i=7 2024-09-14T11:18:11.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.162+0000 7f6054b39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:11.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.164+0000 7f5f077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:11.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.164+0000 7f6054b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.164+0000 7f6054b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.164+0000 7f6054b39800 5 note: GC not initialized 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.164+0000 7f5f067e4640 20 reqs_thread_entry: start 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.164+0000 7f6054b39800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 20 Filter name: none 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f5efffff640 20 reqs_thread_entry: start 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:11.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:11.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:11.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:11.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:11.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.165+0000 7f6054b39800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:18:11.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.166+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.167+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:11.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.167+0000 7f6054b39800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:18:11.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.167+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:11.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.168+0000 7f6054b39800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:18:11.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.168+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:11.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.168+0000 7f6054b39800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:18:11.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.168+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.169+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:11.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.169+0000 7f6054b39800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:18:11.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.169+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:11.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.169+0000 7f6054b39800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:18:11.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.169+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.170+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:11.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.171+0000 7f6054b39800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:18:11.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.171+0000 7f6054b39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.171+0000 7f6054b39800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:18:11.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.171+0000 7f6054b39800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:18:11.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.171+0000 7f6054b39800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:18:11.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.172+0000 7f6054b39800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:18:11.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.172+0000 7f6054b39800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:18:11.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.173+0000 7f5f077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:11.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.175+0000 7f6054b39800 20 remove_watcher() i=0 2024-09-14T11:18:11.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.175+0000 7f6054b39800 2 removed watcher, disabling cache 2024-09-14T11:18:11.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.176+0000 7f6054b39800 20 remove_watcher() i=1 2024-09-14T11:18:11.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.177+0000 7f6054b39800 20 remove_watcher() i=2 2024-09-14T11:18:11.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.179+0000 7f6054b39800 20 remove_watcher() i=3 2024-09-14T11:18:11.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.181+0000 7f6054b39800 20 remove_watcher() i=4 2024-09-14T11:18:11.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.182+0000 7f6054b39800 20 remove_watcher() i=5 2024-09-14T11:18:11.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.183+0000 7f6054b39800 20 remove_watcher() i=6 2024-09-14T11:18:11.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.184+0000 7f6054b39800 20 remove_watcher() i=7 2024-09-14T11:18:11.195 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: unlinked entries are not listable 2024-09-14T11:18:11.195 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:11.197 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.197 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.202 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:18:11.202 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:11.205 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.205 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.248 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.248 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.292 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:18:11.292 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:11.293 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:18:11.329 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:11.329 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:11.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.371+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.372+0000 7f6e7f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.372+0000 7f6e7f72c800 20 realm 2024-09-14T11:18:11.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.372+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.372+0000 7f6e7f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.372+0000 7f6e7f72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:11.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.372+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.373+0000 7f6e7f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.373+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.374+0000 7f6e7f72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:11.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.374+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.375+0000 7f6e7f72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:11.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.375+0000 7f6e7f72c800 20 searching for the correct realm 2024-09-14T11:18:11.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.377+0000 7f6e7bb46640 0 -- 172.21.15.7:0/4290964848 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6e64087f50 msgr2=0x7f6e64096250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:11.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.381+0000 7f6e72b44640 0 -- 172.21.15.7:0/4290964848 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f6e6c06d040 msgr2=0x7f6e6c08b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:11.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:11.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:11.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:11.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.588+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:11.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 20 zone default found 2024-09-14T11:18:11.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 4 Realm: () 2024-09-14T11:18:11.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:11.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:11.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 20 zonegroup default 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.589+0000 7f6e7f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.590+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.590+0000 7f6e7f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.590+0000 7f6e7f72c800 20 started sync module instance, tier type = 2024-09-14T11:18:11.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.590+0000 7f6e7f72c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:11.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.599+0000 7f6e7f72c800 20 add_watcher() i=0 2024-09-14T11:18:11.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.599+0000 7f6e7f72c800 20 add_watcher() i=1 2024-09-14T11:18:11.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.599+0000 7f6e7f72c800 20 add_watcher() i=2 2024-09-14T11:18:11.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.599+0000 7f6e7f72c800 20 add_watcher() i=3 2024-09-14T11:18:11.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.599+0000 7f6e7f72c800 20 add_watcher() i=4 2024-09-14T11:18:11.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.599+0000 7f6e7f72c800 20 add_watcher() i=5 2024-09-14T11:18:11.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.599+0000 7f6e7f72c800 20 add_watcher() i=6 2024-09-14T11:18:11.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.600+0000 7f6e7f72c800 20 add_watcher() i=7 2024-09-14T11:18:11.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.600+0000 7f6e7f72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:11.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.602+0000 7f6d31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:11.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.602+0000 7f6e7f72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:11.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.602+0000 7f6e7f72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:11.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 5 note: GC not initialized 2024-09-14T11:18:11.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6d30fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:11.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 20 Filter name: none 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6caa7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:11.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.603+0000 7f6e7f72c800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.604+0000 7f6e7f72c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.604+0000 7f6e7f72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.604+0000 7f6e7f72c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.604+0000 7f6e7f72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.604+0000 7f6e7f72c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.604+0000 7f6e7f72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.604+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.605+0000 7f6e7f72c800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:18:11.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.605+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.605+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:11.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.606+0000 7f6e7f72c800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:18:11.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.606+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:11.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.606+0000 7f6e7f72c800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:18:11.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.606+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:11.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.607+0000 7f6e7f72c800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:18:11.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.607+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.607+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:11.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.608+0000 7f6e7f72c800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:18:11.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.608+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:11.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.608+0000 7f6e7f72c800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:18:11.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.608+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.609+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:11.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.610+0000 7f6e7f72c800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:18:11.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.610+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.610+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.611+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49792ba0 obj=check-bucket:e state=0x562b49a449e8 s->prefetch_data=0 2024-09-14T11:18:11.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.611+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.611+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49778380 obj=check-bucket:d state=0x562b49a46438 s->prefetch_data=0 2024-09-14T11:18:11.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.611+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.611+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49a45540 obj=check-bucket:c state=0x562b49a48838 s->prefetch_data=0 2024-09-14T11:18:11.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.611+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49a47190 obj=check-bucket:f state=0x562b49a41db8 s->prefetch_data=0 2024-09-14T11:18:11.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to uo1s38ve66ggpv0a4zywtaqu5qwibiwd 2024-09-14T11:18:11.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state_impl: setting s->olh_tag to 5urtsmm11qcvos86ogdksbh3ko1uhaxc 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5urtsmm11qcvos86ogdksbh3ko1uhaxc 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to 22jpmyw50llaydw8ddxk8pvcoouol7cd 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state_impl: setting s->olh_tag to ab8py1v3625wt6zuiefz098a8b2o770f 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ab8py1v3625wt6zuiefz098a8b2o770f 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to 9xgtido8yimeib2yvk7df0825rjl6boh 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state_impl: setting s->olh_tag to wi4mpk7upmh8wgngjq84osq5hm8g6ybw 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wi4mpk7upmh8wgngjq84osq5hm8g6ybw 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to ufzsj9onso0htjiymg7j2p344a0bqds7 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 get_obj_state_impl: setting s->olh_tag to bsh75wmby9s5a2ijrwtfyo1b2mlx5wfz 2024-09-14T11:18:11.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.612+0000 7f6e7f72c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bsh75wmby9s5a2ijrwtfyo1b2mlx5wfz 2024-09-14T11:18:11.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.613+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.613+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.613+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.614+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:18:11.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 olh_log_entry: epoch=2 op=3 key=e[1Bo35-sryl6WUT9HVwuH31ps2CcbHWm] 2024-09-14T11:18:11.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49792ba0 obj=check-bucket:_:1Bo35-sryl6WUT9HVwuH31ps2CcbHWm_e state=0x562b49afa688 s->prefetch_data=0 2024-09-14T11:18:11.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 olh_log_entry: epoch=3 op=3 key=d[dnsiA3XgUixfxtXaqWOoUWK9zE8Tb1-] 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49778380 obj=check-bucket:_:dnsiA3XgUixfxtXaqWOoUWK9zE8Tb1-_d state=0x562b49b01248 s->prefetch_data=0 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 olh_log_entry: epoch=3 op=3 key=c[fq2MYrAD9ngSKshMURB3C-UhwQV-hl7] 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.615+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49a45540 obj=check-bucket:_:fq2MYrAD9ngSKshMURB3C-UhwQV-hl7_c state=0x562b49b07698 s->prefetch_data=0 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 10 manifest: total_size = 22 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7618494015961468160 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49a45540 obj=check-bucket:_:fq2MYrAD9ngSKshMURB3C-UhwQV-hl7_c state=0x562b49b07698 s->prefetch_data=0 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 prepare_atomic_modification: state is not atomic. state=0x562b49b07698 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 10 manifest: total_size = 9 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14182497175688478532 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49792ba0 obj=check-bucket:_:1Bo35-sryl6WUT9HVwuH31ps2CcbHWm_e state=0x562b49afa688 s->prefetch_data=0 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 prepare_atomic_modification: state is not atomic. state=0x562b49afa688 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 10 manifest: total_size = 11 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6444729206429704677 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49778380 obj=check-bucket:_:dnsiA3XgUixfxtXaqWOoUWK9zE8Tb1-_d state=0x562b49b01248 s->prefetch_data=0 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 prepare_atomic_modification: state is not atomic. state=0x562b49b01248 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 olh_log_entry: epoch=2 op=3 key=f[CcxUlsxW9Mvc9aygsHrn-gdY2UMSUq0] 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.616+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49a47190 obj=check-bucket:_:CcxUlsxW9Mvc9aygsHrn-gdY2UMSUq0_f state=0x562b49b18548 s->prefetch_data=0 2024-09-14T11:18:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.617+0000 7f6e7f72c800 10 manifest: total_size = 9 2024-09-14T11:18:11.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.617+0000 7f6e7f72c800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5592614083429859481 2024-09-14T11:18:11.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.617+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49a47190 obj=check-bucket:_:CcxUlsxW9Mvc9aygsHrn-gdY2UMSUq0_f state=0x562b49b18548 s->prefetch_data=0 2024-09-14T11:18:11.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.617+0000 7f6e7f72c800 20 prepare_atomic_modification: state is not atomic. state=0x562b49b18548 2024-09-14T11:18:11.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.617+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.620+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.620+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.620+0000 7f6d5effd640 20 handle_completion(): completion ok for obj=d[dnsiA3XgUixfxtXaqWOoUWK9zE8Tb1-] 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.620+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49792ba0 obj=check-bucket:e state=0x562b49a449e8 s->prefetch_data=0 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.620+0000 7f6e7f72c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5urtsmm11qcvos86ogdksbh3ko1uhaxc 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.621+0000 7f6d5effd640 20 handle_completion(): completion ok for obj=e[1Bo35-sryl6WUT9HVwuH31ps2CcbHWm] 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.621+0000 7f6d5e7fc640 20 handle_completion(): completion ok for obj=c[fq2MYrAD9ngSKshMURB3C-UhwQV-hl7] 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.621+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.621+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.622+0000 7f6e7f72c800 20 get_obj_state: octx=0x562b49a47190 obj=check-bucket:f state=0x562b49a41db8 s->prefetch_data=0 2024-09-14T11:18:11.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.622+0000 7f6e7f72c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bsh75wmby9s5a2ijrwtfyo1b2mlx5wfz 2024-09-14T11:18:11.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.622+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:11.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.622+0000 7f6e7f72c800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:18:11.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.622+0000 7f6d5e7fc640 20 handle_completion(): completion ok for obj=f[CcxUlsxW9Mvc9aygsHrn-gdY2UMSUq0] 2024-09-14T11:18:11.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.622+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:11.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.622+0000 7f6e7f72c800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:18:11.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.623+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.626+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:11.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.626+0000 7f6e7f72c800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:18:11.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.626+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.629+0000 7f6e7f72c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:11.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.629+0000 7f6e7f72c800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:18:11.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.629+0000 7f6e7f72c800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:18:11.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.630+0000 7f6d31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:11.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.632+0000 7f6e7f72c800 20 remove_watcher() i=0 2024-09-14T11:18:11.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.632+0000 7f6e7f72c800 2 removed watcher, disabling cache 2024-09-14T11:18:11.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.633+0000 7f6e7f72c800 20 remove_watcher() i=1 2024-09-14T11:18:11.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.634+0000 7f6e7f72c800 20 remove_watcher() i=2 2024-09-14T11:18:11.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.635+0000 7f6e7f72c800 20 remove_watcher() i=3 2024-09-14T11:18:11.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.637+0000 7f6e7f72c800 20 remove_watcher() i=4 2024-09-14T11:18:11.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.638+0000 7f6e7f72c800 20 remove_watcher() i=5 2024-09-14T11:18:11.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.639+0000 7f6e7f72c800 20 remove_watcher() i=6 2024-09-14T11:18:11.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.640+0000 7f6e7f72c800 20 remove_watcher() i=7 2024-09-14T11:18:11.652 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.652 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.655 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.655 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.657 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.657 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.660 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.660 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.661 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:18:11.661 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:11.662 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.662 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.707 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.707 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.710 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.710 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.713 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.713 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.716 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:11.716 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:11.717 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:18:11.717 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:11.719 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:18:11.752 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:11.752 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:11.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.793+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.794+0000 7f48f6b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.794+0000 7f48f6b75800 20 realm 2024-09-14T11:18:11.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.794+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.795+0000 7f48f6b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.795+0000 7f48f6b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:11.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.795+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.795+0000 7f48f6b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:11.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.795+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.796+0000 7f48f6b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:11.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.796+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:11.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.796+0000 7f48f6b75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:11.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.796+0000 7f48f6b75800 20 searching for the correct realm 2024-09-14T11:18:11.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.798+0000 7f48f4e60640 0 -- 172.21.15.7:0/3874411107 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f48e8059040 msgr2=0x7f48e8060b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:11.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:11.802+0000 7f48f3e5e640 0 -- 172.21.15.7:0/3874411107 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f48e4088920 msgr2=0x7f48e4097400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.009+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 20 zone default found 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 4 Realm: () 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 20 zonegroup default 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.010+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.011+0000 7f48f6b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.011+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.011+0000 7f48f6b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.011+0000 7f48f6b75800 20 started sync module instance, tier type = 2024-09-14T11:18:12.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.011+0000 7f48f6b75800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:12.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.021+0000 7f48f6b75800 20 add_watcher() i=0 2024-09-14T11:18:12.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.021+0000 7f48f6b75800 20 add_watcher() i=1 2024-09-14T11:18:12.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.021+0000 7f48f6b75800 20 add_watcher() i=2 2024-09-14T11:18:12.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.021+0000 7f48f6b75800 20 add_watcher() i=3 2024-09-14T11:18:12.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.021+0000 7f48f6b75800 20 add_watcher() i=4 2024-09-14T11:18:12.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.021+0000 7f48f6b75800 20 add_watcher() i=5 2024-09-14T11:18:12.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.021+0000 7f48f6b75800 20 add_watcher() i=6 2024-09-14T11:18:12.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.022+0000 7f48f6b75800 20 add_watcher() i=7 2024-09-14T11:18:12.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.022+0000 7f48f6b75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.024+0000 7f47aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.024+0000 7f48f6b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.024+0000 7f48f6b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.024+0000 7f48f6b75800 5 note: GC not initialized 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f47a9fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 20 Filter name: none 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f471b7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:12.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:12.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.025+0000 7f48f6b75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.026+0000 7f48f6b75800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.026+0000 7f48f6b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.026+0000 7f48f6b75800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.026+0000 7f48f6b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.026+0000 7f48f6b75800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.026+0000 7f48f6b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:12.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.026+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:12.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.027+0000 7f48f6b75800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:18:12.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.027+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:12.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.028+0000 7f48f6b75800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:18:12.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.028+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:12.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.028+0000 7f48f6b75800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:18:12.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.028+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:12.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.029+0000 7f48f6b75800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:18:12.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.029+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:12.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.029+0000 7f48f6b75800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:18:12.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.029+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:12.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.029+0000 7f48f6b75800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:18:12.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.029+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:12.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.030+0000 7f48f6b75800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:18:12.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.030+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:12.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.031+0000 7f48f6b75800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:18:12.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.031+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:12.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.031+0000 7f48f6b75800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:18:12.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.031+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:12.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.032+0000 7f48f6b75800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:18:12.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.032+0000 7f48f6b75800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:12.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.032+0000 7f48f6b75800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:18:12.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.032+0000 7f48f6b75800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:18:12.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.033+0000 7f47aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:12.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.036+0000 7f48f6b75800 20 remove_watcher() i=0 2024-09-14T11:18:12.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.036+0000 7f48f6b75800 2 removed watcher, disabling cache 2024-09-14T11:18:12.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.037+0000 7f48f6b75800 20 remove_watcher() i=1 2024-09-14T11:18:12.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.038+0000 7f48f6b75800 20 remove_watcher() i=2 2024-09-14T11:18:12.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.039+0000 7f48f6b75800 20 remove_watcher() i=3 2024-09-14T11:18:12.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.040+0000 7f48f6b75800 20 remove_watcher() i=4 2024-09-14T11:18:12.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.041+0000 7f48f6b75800 20 remove_watcher() i=5 2024-09-14T11:18:12.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.042+0000 7f48f6b75800 20 remove_watcher() i=6 2024-09-14T11:18:12.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.043+0000 7f48f6b75800 20 remove_watcher() i=7 2024-09-14T11:18:12.056 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:12.056 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:12.069 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:12.069 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:12.084 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:18:12.115 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:12.115 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:12.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.155+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.157+0000 7f6e7c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.157+0000 7f6e7c319800 20 realm 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.157+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.157+0000 7f6e7c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.157+0000 7f6e7c319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.157+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.158+0000 7f6e7c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.158+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.158+0000 7f6e7c319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:12.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.158+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.159+0000 7f6e7c319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:12.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.159+0000 7f6e7c319800 20 searching for the correct realm 2024-09-14T11:18:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.161+0000 7f6e7a60b640 0 -- 172.21.15.7:0/1776337654 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6e7007a550 msgr2=0x7f6e70061ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:12.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.366+0000 7f6e79609640 0 -- 172.21.15.7:0/1776337654 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f6e6c01c040 msgr2=0x7f6e6c041960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:12.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:12.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:12.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:12.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.573+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 zone default found 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 4 Realm: () 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:12.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:12.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 zonegroup default 2024-09-14T11:18:12.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.574+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.575+0000 7f6e7c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.575+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.575+0000 7f6e7c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.575+0000 7f6e7c319800 20 started sync module instance, tier type = 2024-09-14T11:18:12.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.575+0000 7f6e7c319800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:12.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.585+0000 7f6e7c319800 20 add_watcher() i=0 2024-09-14T11:18:12.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.585+0000 7f6e7c319800 20 add_watcher() i=1 2024-09-14T11:18:12.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.585+0000 7f6e7c319800 20 add_watcher() i=2 2024-09-14T11:18:12.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.585+0000 7f6e7c319800 20 add_watcher() i=3 2024-09-14T11:18:12.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.585+0000 7f6e7c319800 20 add_watcher() i=4 2024-09-14T11:18:12.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.585+0000 7f6e7c319800 20 add_watcher() i=5 2024-09-14T11:18:12.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.585+0000 7f6e7c319800 20 add_watcher() i=6 2024-09-14T11:18:12.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.586+0000 7f6e7c319800 20 add_watcher() i=7 2024-09-14T11:18:12.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.586+0000 7f6e7c319800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:12.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.587+0000 7f6d2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:12.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6e7c319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6e7c319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6e7c319800 5 note: GC not initialized 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6d2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6e7c319800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6e7c319800 20 Filter name: none 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6c9bfff640 20 reqs_thread_entry: start 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.588+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.589+0000 7f6e7c319800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:12.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.589+0000 7f6e7c319800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.589+0000 7f6e7c319800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:12.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.589+0000 7f6e7c319800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:12.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.589+0000 7f6e7c319800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:12.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.589+0000 7f6e7c319800 20 INFO: main: starting shard=0 2024-09-14T11:18:12.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.589+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:12.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.590+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.590+0000 7f6e7c319800 20 INFO: main: starting shard=1 2024-09-14T11:18:12.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.590+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:12.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.590+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.590+0000 7f6e7c319800 20 INFO: main: starting shard=2 2024-09-14T11:18:12.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.590+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:12.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.591+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.591+0000 7f6e7c319800 20 INFO: main: starting shard=3 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.591+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.591+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.591+0000 7f6e7c319800 20 INFO: main: starting shard=4 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.591+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.592+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.592+0000 7f6e7c319800 20 INFO: main: starting shard=5 2024-09-14T11:18:12.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.592+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.592+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.592+0000 7f6e7c319800 20 INFO: main: starting shard=6 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.592+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.593+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.593+0000 7f6e7c319800 20 INFO: main: starting shard=7 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.593+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.593+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.593+0000 7f6e7c319800 20 INFO: main: starting shard=8 2024-09-14T11:18:12.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.593+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:12.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.593+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:18:12.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.594+0000 7f6e7c319800 20 INFO: main: starting shard=9 2024-09-14T11:18:12.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.594+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:12.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.594+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.594+0000 7f6e7c319800 20 INFO: main: starting shard=10 2024-09-14T11:18:12.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.594+0000 7f6e7c319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:12.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.595+0000 7f6e7c319800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:12.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.595+0000 7f6e7c319800 20 INFO: main: done 2024-09-14T11:18:12.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.596+0000 7f6d2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:12.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.599+0000 7f6e7c319800 20 remove_watcher() i=0 2024-09-14T11:18:12.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.599+0000 7f6e7c319800 2 removed watcher, disabling cache 2024-09-14T11:18:12.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.600+0000 7f6e7c319800 20 remove_watcher() i=1 2024-09-14T11:18:12.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.601+0000 7f6e7c319800 20 remove_watcher() i=2 2024-09-14T11:18:12.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.602+0000 7f6e7c319800 20 remove_watcher() i=3 2024-09-14T11:18:12.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.603+0000 7f6e7c319800 20 remove_watcher() i=4 2024-09-14T11:18:12.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.604+0000 7f6e7c319800 20 remove_watcher() i=5 2024-09-14T11:18:12.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.605+0000 7f6e7c319800 20 remove_watcher() i=6 2024-09-14T11:18:12.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.606+0000 7f6e7c319800 20 remove_watcher() i=7 2024-09-14T11:18:12.618 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:18:12.648 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:12.648 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:12.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.688+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.690+0000 7fb0b1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.690+0000 7fb0b1098800 20 realm 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.690+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.691+0000 7fb0b1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.691+0000 7fb0b1098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.691+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.691+0000 7fb0b1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.691+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.692+0000 7fb0b1098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:12.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.692+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:12.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.692+0000 7fb0b1098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:12.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.692+0000 7fb0b1098800 20 searching for the correct realm 2024-09-14T11:18:12.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:12.896+0000 7fb0aeb82640 0 -- 172.21.15.7:0/108909953 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fb0a800ac20 msgr2=0x7fb0a8083a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:13.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.303+0000 7fb0aeb82640 0 -- 172.21.15.7:0/108909953 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fb0a800ac20 msgr2=0x7fb0a8083a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:13.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:13.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:13.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:13.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:13.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:13.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:13.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.308+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 zone default found 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 4 Realm: () 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 zonegroup default 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.309+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.310+0000 7fb0b1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.310+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.310+0000 7fb0b1098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.310+0000 7fb0b1098800 20 started sync module instance, tier type = 2024-09-14T11:18:13.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.310+0000 7fb0b1098800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:13.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.323+0000 7fb0b1098800 20 add_watcher() i=0 2024-09-14T11:18:13.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.323+0000 7fb0b1098800 20 add_watcher() i=1 2024-09-14T11:18:13.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.323+0000 7fb0b1098800 20 add_watcher() i=2 2024-09-14T11:18:13.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.323+0000 7fb0b1098800 20 add_watcher() i=3 2024-09-14T11:18:13.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.323+0000 7fb0b1098800 20 add_watcher() i=4 2024-09-14T11:18:13.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.323+0000 7fb0b1098800 20 add_watcher() i=5 2024-09-14T11:18:13.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.323+0000 7fb0b1098800 20 add_watcher() i=6 2024-09-14T11:18:13.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.324+0000 7fb0b1098800 20 add_watcher() i=7 2024-09-14T11:18:13.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.324+0000 7fb0b1098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:13.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.326+0000 7faf657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.326+0000 7fb0b1098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.326+0000 7fb0b1098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.327+0000 7fb0b1098800 5 note: GC not initialized 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.327+0000 7faedffff640 20 reqs_thread_entry: start 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.327+0000 7fb0b1098800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.327+0000 7fb0b1098800 20 Filter name: none 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.327+0000 7faeddffb640 20 reqs_thread_entry: start 2024-09-14T11:18:13.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.327+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.328+0000 7fb0b1098800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:13.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.328+0000 7fb0b1098800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.328+0000 7fb0b1098800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:13.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.328+0000 7fb0b1098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:13.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.328+0000 7fb0b1098800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:13.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.328+0000 7fb0b1098800 20 INFO: main: starting shard=0 2024-09-14T11:18:13.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.328+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:13.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.329+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.329+0000 7fb0b1098800 20 INFO: main: starting shard=1 2024-09-14T11:18:13.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.329+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:13.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.329+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.329+0000 7fb0b1098800 20 INFO: main: starting shard=2 2024-09-14T11:18:13.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.329+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:13.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.330+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.330+0000 7fb0b1098800 20 INFO: main: starting shard=3 2024-09-14T11:18:13.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.330+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:13.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.331+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.331+0000 7fb0b1098800 20 INFO: main: starting shard=4 2024-09-14T11:18:13.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.331+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:13.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.331+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.331+0000 7fb0b1098800 20 INFO: main: starting shard=5 2024-09-14T11:18:13.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.331+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:13.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.332+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:18:13.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.332+0000 7fb0b1098800 20 INFO: main: starting shard=6 2024-09-14T11:18:13.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.332+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:13.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.333+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.333+0000 7fb0b1098800 20 INFO: main: starting shard=7 2024-09-14T11:18:13.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.333+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:13.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.333+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.333+0000 7fb0b1098800 20 INFO: main: starting shard=8 2024-09-14T11:18:13.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.333+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:13.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.334+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.334+0000 7fb0b1098800 20 INFO: main: starting shard=9 2024-09-14T11:18:13.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.334+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:13.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.335+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.335+0000 7fb0b1098800 20 INFO: main: starting shard=10 2024-09-14T11:18:13.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.335+0000 7fb0b1098800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:13.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.335+0000 7fb0b1098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:13.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.335+0000 7fb0b1098800 20 INFO: main: done 2024-09-14T11:18:13.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.336+0000 7faf657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:13.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.339+0000 7fb0b1098800 20 remove_watcher() i=0 2024-09-14T11:18:13.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.339+0000 7fb0b1098800 2 removed watcher, disabling cache 2024-09-14T11:18:13.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.341+0000 7fb0b1098800 20 remove_watcher() i=1 2024-09-14T11:18:13.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.342+0000 7fb0b1098800 20 remove_watcher() i=2 2024-09-14T11:18:13.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.344+0000 7fb0b1098800 20 remove_watcher() i=3 2024-09-14T11:18:13.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.345+0000 7fb0b1098800 20 remove_watcher() i=4 2024-09-14T11:18:13.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.346+0000 7fb0b1098800 20 remove_watcher() i=5 2024-09-14T11:18:13.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.348+0000 7fb0b1098800 20 remove_watcher() i=6 2024-09-14T11:18:13.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.349+0000 7fb0b1098800 20 remove_watcher() i=7 2024-09-14T11:18:13.361 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:18:13.361 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:13.363 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:18:13.396 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:13.396 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:13.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.440+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 20 realm 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.441+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.442+0000 7ffac7123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:13.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.442+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.443+0000 7ffac7123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:13.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.443+0000 7ffac7123800 20 searching for the correct realm 2024-09-14T11:18:13.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.445+0000 7ffac360d640 0 -- 172.21.15.7:0/3378223262 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ffab8078410 msgr2=0x7ffab8078870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:13.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.651+0000 7ffac260b640 0 -- 172.21.15.7:0/3378223262 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ffab408a040 msgr2=0x7ffab4066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:13.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:13.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:13.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:13.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:13.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:13.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:13.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.858+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 20 zone default found 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 4 Realm: () 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:13.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 20 zonegroup default 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.859+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.860+0000 7ffac7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.860+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.860+0000 7ffac7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.860+0000 7ffac7123800 20 started sync module instance, tier type = 2024-09-14T11:18:13.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.860+0000 7ffac7123800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:13.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.871+0000 7ffac7123800 20 add_watcher() i=0 2024-09-14T11:18:13.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.871+0000 7ffac7123800 20 add_watcher() i=1 2024-09-14T11:18:13.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.871+0000 7ffac7123800 20 add_watcher() i=2 2024-09-14T11:18:13.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.871+0000 7ffac7123800 20 add_watcher() i=3 2024-09-14T11:18:13.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.871+0000 7ffac7123800 20 add_watcher() i=4 2024-09-14T11:18:13.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.871+0000 7ffac7123800 20 add_watcher() i=5 2024-09-14T11:18:13.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.871+0000 7ffac7123800 20 add_watcher() i=6 2024-09-14T11:18:13.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.873+0000 7ffac7123800 20 add_watcher() i=7 2024-09-14T11:18:13.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.873+0000 7ffac7123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:13.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.875+0000 7ff9797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:13.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.875+0000 7ffac7123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.875+0000 7ffac7123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.875+0000 7ffac7123800 5 note: GC not initialized 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.875+0000 7ff8f3fff640 20 reqs_thread_entry: start 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.875+0000 7ffac7123800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.875+0000 7ffac7123800 20 Filter name: none 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ff8f1ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ffac7123800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:13.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ffac7123800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:13.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ffac7123800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:13.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ffac7123800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:13.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ffac7123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:13.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.876+0000 7ffac7123800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:18:13.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.877+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:13.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.878+0000 7ffac7123800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:18:13.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.878+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:13.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.878+0000 7ffac7123800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:18:13.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.878+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:13.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.879+0000 7ffac7123800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:18:13.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.879+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:13.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.879+0000 7ffac7123800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:18:13.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.879+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:13.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.880+0000 7ffac7123800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:18:13.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.880+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:13.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.880+0000 7ffac7123800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:18:13.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.880+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:13.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.881+0000 7ffac7123800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:18:13.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.881+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:13.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.882+0000 7ffac7123800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:18:13.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.882+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:13.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.882+0000 7ffac7123800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:18:13.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.882+0000 7ffac7123800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:13.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.883+0000 7ffac7123800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:18:13.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.883+0000 7ffac7123800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:18:13.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.884+0000 7ff9797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:13.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.886+0000 7ffac7123800 20 remove_watcher() i=0 2024-09-14T11:18:13.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.886+0000 7ffac7123800 2 removed watcher, disabling cache 2024-09-14T11:18:13.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.888+0000 7ffac7123800 20 remove_watcher() i=1 2024-09-14T11:18:13.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.889+0000 7ffac7123800 20 remove_watcher() i=2 2024-09-14T11:18:13.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.891+0000 7ffac7123800 20 remove_watcher() i=3 2024-09-14T11:18:13.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.892+0000 7ffac7123800 20 remove_watcher() i=4 2024-09-14T11:18:13.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.893+0000 7ffac7123800 20 remove_watcher() i=5 2024-09-14T11:18:13.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.894+0000 7ffac7123800 20 remove_watcher() i=6 2024-09-14T11:18:13.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.895+0000 7ffac7123800 20 remove_watcher() i=7 2024-09-14T11:18:13.906 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:18:13.906 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:13.908 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:18:13.942 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:13.942 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:13.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.983+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 20 realm 2024-09-14T11:18:13.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:13.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:13.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.985+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.986+0000 7feccd22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:13.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.986+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:13.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.987+0000 7feccd22f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:13.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.987+0000 7feccd22f800 20 searching for the correct realm 2024-09-14T11:18:13.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:13.989+0000 7feccb51a640 0 -- 172.21.15.7:0/3895586846 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fecc0017040 msgr2=0x7fecc003e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:14.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.196+0000 7fecca518640 0 -- 172.21.15.7:0/3895586846 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fecbc04d940 msgr2=0x7fecbc043430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:14.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.402+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:14.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 zone default found 2024-09-14T11:18:14.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 4 Realm: () 2024-09-14T11:18:14.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 zonegroup default 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.403+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.404+0000 7feccd22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.404+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.404+0000 7feccd22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.404+0000 7feccd22f800 20 started sync module instance, tier type = 2024-09-14T11:18:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.404+0000 7feccd22f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:14.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.415+0000 7feccd22f800 20 add_watcher() i=0 2024-09-14T11:18:14.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.415+0000 7feccd22f800 20 add_watcher() i=1 2024-09-14T11:18:14.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.415+0000 7feccd22f800 20 add_watcher() i=2 2024-09-14T11:18:14.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.415+0000 7feccd22f800 20 add_watcher() i=3 2024-09-14T11:18:14.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.415+0000 7feccd22f800 20 add_watcher() i=4 2024-09-14T11:18:14.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.415+0000 7feccd22f800 20 add_watcher() i=5 2024-09-14T11:18:14.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.415+0000 7feccd22f800 20 add_watcher() i=6 2024-09-14T11:18:14.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.416+0000 7feccd22f800 20 add_watcher() i=7 2024-09-14T11:18:14.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.416+0000 7feccd22f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:14.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.418+0000 7feb817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:14.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feccd22f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:14.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feccd22f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:14.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feccd22f800 5 note: GC not initialized 2024-09-14T11:18:14.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feafbfff640 20 reqs_thread_entry: start 2024-09-14T11:18:14.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feccd22f800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:14.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feccd22f800 20 Filter name: none 2024-09-14T11:18:14.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feaf9ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:14.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feccd22f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:14.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.419+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:14.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:14.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:14.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.420+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:14.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.421+0000 7feccd22f800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:18:14.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.421+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:14.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.422+0000 7feccd22f800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:18:14.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.422+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:14.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.422+0000 7feccd22f800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:18:14.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.422+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:14.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.423+0000 7feccd22f800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:18:14.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.423+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:14.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.423+0000 7feccd22f800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:18:14.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.423+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:14.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.424+0000 7feccd22f800 20 get_obj_state: octx=0x55df9c790b80 obj=check-bucket:d state=0x55df9ca47518 s->prefetch_data=0 2024-09-14T11:18:14.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.424+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:14.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.424+0000 7feccd22f800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:18:14.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.424+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:14.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.425+0000 7feccd22f800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:18:14.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.425+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:14.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.425+0000 7feccd22f800 20 get_obj_state: octx=0x55df9c776360 obj=check-bucket:c state=0x55df9ca450e8 s->prefetch_data=0 2024-09-14T11:18:14.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.425+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:14.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.426+0000 7feccd22f800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:18:14.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.426+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:14.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.426+0000 7feccd22f800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:18:14.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.426+0000 7feccd22f800 20 get_obj_state: setting s->obj_tag to 22jpmyw50llaydw8ddxk8pvcoouol7cd 2024-09-14T11:18:14.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.426+0000 7feccd22f800 20 get_obj_state_impl: setting s->olh_tag to ab8py1v3625wt6zuiefz098a8b2o770f 2024-09-14T11:18:14.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:14.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 get_obj_state: setting s->obj_tag to 9xgtido8yimeib2yvk7df0825rjl6boh 2024-09-14T11:18:14.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 get_obj_state_impl: setting s->olh_tag to wi4mpk7upmh8wgngjq84osq5hm8g6ybw 2024-09-14T11:18:14.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:14.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:18:14.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 olh_log_entry: epoch=4 op=3 key=d[7N2xlX2lSfjgvBF2m0xW1yEJTNPW0.0] 2024-09-14T11:18:14.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 get_obj_state: octx=0x55df9ca7ecb0 obj=check-bucket:_:7N2xlX2lSfjgvBF2m0xW1yEJTNPW0.0_d state=0x55df9caa56f8 s->prefetch_data=0 2024-09-14T11:18:14.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:18:14.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 olh_log_entry: epoch=4 op=3 key=c[Mt4eXMSGA6KepTlJQT6pDgZgbH3X13q] 2024-09-14T11:18:14.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.427+0000 7feccd22f800 20 get_obj_state: octx=0x55df9ca9ecb0 obj=check-bucket:_:Mt4eXMSGA6KepTlJQT6pDgZgbH3X13q_c state=0x55df9caacea8 s->prefetch_data=0 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 get_obj_state: octx=0x55df9ca9ecb0 obj=check-bucket:c state=0x55df9ca9f698 s->prefetch_data=0 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 get_obj_state: octx=0x55df9ca7ecb0 obj=check-bucket:d state=0x55df9ca41a88 s->prefetch_data=0 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 get_obj_state: setting s->obj_tag to 22jpmyw50llaydw8ddxk8pvcoouol7cd 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 get_obj_state_impl: setting s->olh_tag to ab8py1v3625wt6zuiefz098a8b2o770f 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ab8py1v3625wt6zuiefz098a8b2o770f 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 get_obj_state: setting s->obj_tag to 9xgtido8yimeib2yvk7df0825rjl6boh 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 get_obj_state_impl: setting s->olh_tag to wi4mpk7upmh8wgngjq84osq5hm8g6ybw 2024-09-14T11:18:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.429+0000 7feccd22f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wi4mpk7upmh8wgngjq84osq5hm8g6ybw 2024-09-14T11:18:14.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.431+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:14.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.432+0000 7feccd22f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:14.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.433+0000 7feccd22f800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:18:14.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.434+0000 7feccd22f800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:18:14.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.434+0000 7feccd22f800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:18:14.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.435+0000 7feb817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:14.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.439+0000 7feccd22f800 20 remove_watcher() i=0 2024-09-14T11:18:14.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.439+0000 7feccd22f800 2 removed watcher, disabling cache 2024-09-14T11:18:14.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.439+0000 7feccd22f800 20 remove_watcher() i=1 2024-09-14T11:18:14.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.440+0000 7feccd22f800 20 remove_watcher() i=2 2024-09-14T11:18:14.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.444+0000 7feccd22f800 20 remove_watcher() i=3 2024-09-14T11:18:14.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.445+0000 7feccd22f800 20 remove_watcher() i=4 2024-09-14T11:18:14.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.447+0000 7feccd22f800 20 remove_watcher() i=5 2024-09-14T11:18:14.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.448+0000 7feccd22f800 20 remove_watcher() i=6 2024-09-14T11:18:14.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.449+0000 7feccd22f800 20 remove_watcher() i=7 2024-09-14T11:18:14.460 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:18:14.491 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:14.491 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:14.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.533+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 20 realm 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.535+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.536+0000 7f2ea4210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:14.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.536+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.537+0000 7f2ea4210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:14.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.537+0000 7f2ea4210800 20 searching for the correct realm 2024-09-14T11:18:14.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.539+0000 7f2ea01e1640 0 -- 172.21.15.7:0/2313144075 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f2e94084c20 msgr2=0x7f2e94039160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:14.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.543+0000 7f2e9f1df640 0 -- 172.21.15.7:0/2313144075 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f2e900b6e60 msgr2=0x7f2e900b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:14.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.749+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 zone default found 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 4 Realm: () 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:14.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 zonegroup default 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.750+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.751+0000 7f2ea4210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.751+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.751+0000 7f2ea4210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.751+0000 7f2ea4210800 20 started sync module instance, tier type = 2024-09-14T11:18:14.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.751+0000 7f2ea4210800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.761+0000 7f2ea4210800 20 add_watcher() i=0 2024-09-14T11:18:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.761+0000 7f2ea4210800 20 add_watcher() i=1 2024-09-14T11:18:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.761+0000 7f2ea4210800 20 add_watcher() i=2 2024-09-14T11:18:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.761+0000 7f2ea4210800 20 add_watcher() i=3 2024-09-14T11:18:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.761+0000 7f2ea4210800 20 add_watcher() i=4 2024-09-14T11:18:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.761+0000 7f2ea4210800 20 add_watcher() i=5 2024-09-14T11:18:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.761+0000 7f2ea4210800 20 add_watcher() i=6 2024-09-14T11:18:14.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.762+0000 7f2ea4210800 20 add_watcher() i=7 2024-09-14T11:18:14.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.762+0000 7f2ea4210800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:14.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.764+0000 7f2d55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.764+0000 7f2ea4210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.764+0000 7f2ea4210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.764+0000 7f2ea4210800 5 note: GC not initialized 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.764+0000 7f2d54fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.765+0000 7f2ea4210800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.765+0000 7f2ea4210800 20 Filter name: none 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.765+0000 7f2cce7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:14.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.765+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.765+0000 7f2ea4210800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.765+0000 7f2ea4210800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: starting shard=0 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: starting shard=1 2024-09-14T11:18:14.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:14.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: starting shard=2 2024-09-14T11:18:14.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:14.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 INFO: main: starting shard=3 2024-09-14T11:18:14.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.767+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:14.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 INFO: main: starting shard=4 2024-09-14T11:18:14.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 INFO: main: starting shard=5 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 INFO: main: starting shard=6 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.768+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.769+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.769+0000 7f2ea4210800 20 INFO: main: starting shard=7 2024-09-14T11:18:14.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.769+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:14.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.769+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.769+0000 7f2ea4210800 20 INFO: main: starting shard=8 2024-09-14T11:18:14.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.769+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:14.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.770+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.770+0000 7f2ea4210800 20 INFO: main: starting shard=9 2024-09-14T11:18:14.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.770+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:14.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.772+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.772+0000 7f2ea4210800 20 INFO: main: starting shard=10 2024-09-14T11:18:14.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.772+0000 7f2ea4210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:14.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.772+0000 7f2ea4210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:14.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.772+0000 7f2ea4210800 20 INFO: main: done 2024-09-14T11:18:14.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.772+0000 7f2d55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:14.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.776+0000 7f2ea4210800 20 remove_watcher() i=0 2024-09-14T11:18:14.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.776+0000 7f2ea4210800 2 removed watcher, disabling cache 2024-09-14T11:18:14.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.776+0000 7f2ea4210800 20 remove_watcher() i=1 2024-09-14T11:18:14.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.777+0000 7f2ea4210800 20 remove_watcher() i=2 2024-09-14T11:18:14.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.779+0000 7f2ea4210800 20 remove_watcher() i=3 2024-09-14T11:18:14.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.780+0000 7f2ea4210800 20 remove_watcher() i=4 2024-09-14T11:18:14.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.781+0000 7f2ea4210800 20 remove_watcher() i=5 2024-09-14T11:18:14.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.782+0000 7f2ea4210800 20 remove_watcher() i=6 2024-09-14T11:18:14.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.783+0000 7f2ea4210800 20 remove_watcher() i=7 2024-09-14T11:18:14.794 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:18:14.826 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:14.826 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:14.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.866+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 20 realm 2024-09-14T11:18:14.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:14.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:14.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.868+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.869+0000 7fd388b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:14.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.869+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:14.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.870+0000 7fd388b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:14.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.870+0000 7fd388b25800 20 searching for the correct realm 2024-09-14T11:18:14.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:14.872+0000 7fd384f34640 0 -- 172.21.15.7:0/2398379540 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fd3780b96f0 msgr2=0x7fd378090740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:15.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.077+0000 7fd383f32640 0 -- 172.21.15.7:0/2398379540 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fd37402d3d0 msgr2=0x7fd37402d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:15.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:15.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:15.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:15.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:15.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:15.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:15.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.284+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:15.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:15.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 zone default found 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 4 Realm: () 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 zonegroup default 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.285+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.286+0000 7fd388b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.286+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.286+0000 7fd388b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.286+0000 7fd388b25800 20 started sync module instance, tier type = 2024-09-14T11:18:15.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.286+0000 7fd388b25800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:15.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.299+0000 7fd388b25800 20 add_watcher() i=0 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.299+0000 7fd388b25800 20 add_watcher() i=1 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.299+0000 7fd388b25800 20 add_watcher() i=2 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.299+0000 7fd388b25800 20 add_watcher() i=3 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.299+0000 7fd388b25800 20 add_watcher() i=4 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.299+0000 7fd388b25800 20 add_watcher() i=5 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.299+0000 7fd388b25800 20 add_watcher() i=6 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.300+0000 7fd388b25800 20 add_watcher() i=7 2024-09-14T11:18:15.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.300+0000 7fd388b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:15.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.301+0000 7fd23afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:15.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.302+0000 7fd388b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:15.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.302+0000 7fd388b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:15.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.302+0000 7fd388b25800 5 note: GC not initialized 2024-09-14T11:18:15.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.302+0000 7fd239fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:15.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.302+0000 7fd388b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:15.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.302+0000 7fd388b25800 20 Filter name: none 2024-09-14T11:18:15.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.302+0000 7fd1ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:15.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.303+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.303+0000 7fd388b25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.303+0000 7fd388b25800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: starting shard=0 2024-09-14T11:18:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:15.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: starting shard=1 2024-09-14T11:18:15.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:15.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: starting shard=2 2024-09-14T11:18:15.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:15.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 INFO: main: starting shard=3 2024-09-14T11:18:15.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.305+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:15.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.306+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.306+0000 7fd388b25800 20 INFO: main: starting shard=4 2024-09-14T11:18:15.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.306+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:15.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.306+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.306+0000 7fd388b25800 20 INFO: main: starting shard=5 2024-09-14T11:18:15.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.306+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:15.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.307+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.307+0000 7fd388b25800 20 INFO: main: starting shard=6 2024-09-14T11:18:15.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.307+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:15.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 INFO: main: starting shard=7 2024-09-14T11:18:15.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:15.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 INFO: main: starting shard=8 2024-09-14T11:18:15.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:15.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 INFO: main: starting shard=9 2024-09-14T11:18:15.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.309+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:15.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.310+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.310+0000 7fd388b25800 20 INFO: main: starting shard=10 2024-09-14T11:18:15.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.310+0000 7fd388b25800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:15.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.310+0000 7fd388b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:15.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.310+0000 7fd388b25800 20 INFO: main: done 2024-09-14T11:18:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.311+0000 7fd23afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.315+0000 7fd388b25800 20 remove_watcher() i=0 2024-09-14T11:18:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.315+0000 7fd388b25800 2 removed watcher, disabling cache 2024-09-14T11:18:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.315+0000 7fd388b25800 20 remove_watcher() i=1 2024-09-14T11:18:15.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.316+0000 7fd388b25800 20 remove_watcher() i=2 2024-09-14T11:18:15.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.318+0000 7fd388b25800 20 remove_watcher() i=3 2024-09-14T11:18:15.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.318+0000 7fd388b25800 20 remove_watcher() i=4 2024-09-14T11:18:15.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.319+0000 7fd388b25800 20 remove_watcher() i=5 2024-09-14T11:18:15.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.320+0000 7fd388b25800 20 remove_watcher() i=6 2024-09-14T11:18:15.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.321+0000 7fd388b25800 20 remove_watcher() i=7 2024-09-14T11:18:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:18:15.331 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:15.333 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:18:15.364 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:15.365 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:15.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.406+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.407+0000 7fa746d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.407+0000 7fa746d26800 20 realm 2024-09-14T11:18:15.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.407+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.408+0000 7fa746d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.408+0000 7fa746d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:15.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.408+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.408+0000 7fa746d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.408+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.409+0000 7fa746d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:15.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.409+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.409+0000 7fa746d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:15.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.409+0000 7fa746d26800 20 searching for the correct realm 2024-09-14T11:18:15.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.412+0000 7fa74215c640 0 -- 172.21.15.7:0/1267856846 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fa73401ebb0 msgr2=0x7fa73402f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:15.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.618+0000 7fa74315e640 0 -- 172.21.15.7:0/1267856846 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x55d2b43cdd30 msgr2=0x7fa73808a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.624+0000 7fa746d26800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.624+0000 7fa746d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.624+0000 7fa746d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.624+0000 7fa746d26800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.624+0000 7fa746d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.624+0000 7fa746d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.624+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:15.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 zone default found 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 4 Realm: () 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 zonegroup default 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 started sync module instance, tier type = 2024-09-14T11:18:15.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.625+0000 7fa746d26800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:15.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.636+0000 7fa746d26800 20 add_watcher() i=0 2024-09-14T11:18:15.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.636+0000 7fa746d26800 20 add_watcher() i=1 2024-09-14T11:18:15.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.636+0000 7fa746d26800 20 add_watcher() i=2 2024-09-14T11:18:15.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.636+0000 7fa746d26800 20 add_watcher() i=3 2024-09-14T11:18:15.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.636+0000 7fa746d26800 20 add_watcher() i=4 2024-09-14T11:18:15.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.636+0000 7fa746d26800 20 add_watcher() i=5 2024-09-14T11:18:15.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.636+0000 7fa746d26800 20 add_watcher() i=6 2024-09-14T11:18:15.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.637+0000 7fa746d26800 20 add_watcher() i=7 2024-09-14T11:18:15.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.637+0000 7fa746d26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa5f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 5 note: GC not initialized 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa573fff640 20 reqs_thread_entry: start 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 Filter name: none 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa571ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:15.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:15.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:15.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:15.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:15.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:15.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.639+0000 7fa746d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.640+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.640+0000 7fa746d26800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:18:15.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.640+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:15.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.642+0000 7fa746d26800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:18:15.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.642+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:15.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.642+0000 7fa746d26800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:18:15.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.642+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:15.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.643+0000 7fa746d26800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:18:15.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.643+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:15.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.643+0000 7fa746d26800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:18:15.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.643+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:15.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:18:15.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:15.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:18:15.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:15.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:18:15.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:15.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:18:15.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.644+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:15.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.646+0000 7fa746d26800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:18:15.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.646+0000 7fa746d26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:15.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.646+0000 7fa746d26800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:18:15.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.646+0000 7fa746d26800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:18:15.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.647+0000 7fa5f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:15.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.649+0000 7fa746d26800 20 remove_watcher() i=0 2024-09-14T11:18:15.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.649+0000 7fa746d26800 2 removed watcher, disabling cache 2024-09-14T11:18:15.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.651+0000 7fa746d26800 20 remove_watcher() i=1 2024-09-14T11:18:15.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.652+0000 7fa746d26800 20 remove_watcher() i=2 2024-09-14T11:18:15.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.653+0000 7fa746d26800 20 remove_watcher() i=3 2024-09-14T11:18:15.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.654+0000 7fa746d26800 20 remove_watcher() i=4 2024-09-14T11:18:15.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.655+0000 7fa746d26800 20 remove_watcher() i=5 2024-09-14T11:18:15.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.656+0000 7fa746d26800 20 remove_watcher() i=6 2024-09-14T11:18:15.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:15.657+0000 7fa746d26800 20 remove_watcher() i=7 2024-09-14T11:18:15.666 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:18:15.666 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:15.668 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.668 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.672 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.672 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.674 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.675 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.718 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:18:15.718 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:18:15.719 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.719 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.764 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.764 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.806 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.807 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.821 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.821 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.824 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.824 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.837 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.837 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.840 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.840 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.853 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.853 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.856 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.856 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.869 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.869 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.871 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.872 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.886 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.886 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.889 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.889 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.901 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:15.901 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:15.904 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:18:16.312 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:18:17.729 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:17.729 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:17.781 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:17.783 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:18:17.819 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:17.819 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:17.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.867+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 20 realm 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.869+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.870+0000 7f3cb211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.870+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.871+0000 7f3cb211f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:17.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.871+0000 7f3cb211f800 20 searching for the correct realm 2024-09-14T11:18:17.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:17.873+0000 7f3cae6a3640 0 -- 172.21.15.7:0/1014985152 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f3ca40ba020 msgr2=0x7f3ca40a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:18.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.080+0000 7f3cad6a1640 0 -- 172.21.15.7:0/1014985152 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f3ca001b040 msgr2=0x7f3ca0067410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:18.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.288+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:18.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 20 zone default found 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 4 Realm: () 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 20 zonegroup default 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.289+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.290+0000 7f3cb211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.290+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.290+0000 7f3cb211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.290+0000 7f3cb211f800 20 started sync module instance, tier type = 2024-09-14T11:18:18.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.290+0000 7f3cb211f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:18.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.302+0000 7f3cb211f800 20 add_watcher() i=0 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.302+0000 7f3cb211f800 20 add_watcher() i=1 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.302+0000 7f3cb211f800 20 add_watcher() i=2 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.302+0000 7f3cb211f800 20 add_watcher() i=3 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.302+0000 7f3cb211f800 20 add_watcher() i=4 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.302+0000 7f3cb211f800 20 add_watcher() i=5 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.302+0000 7f3cb211f800 20 add_watcher() i=6 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.303+0000 7f3cb211f800 20 add_watcher() i=7 2024-09-14T11:18:18.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.303+0000 7f3cb211f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:18.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.305+0000 7f3b63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:18.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.306+0000 7f3cb211f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:18.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.306+0000 7f3cb211f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:18.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.306+0000 7f3cb211f800 5 note: GC not initialized 2024-09-14T11:18:18.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.306+0000 7f3b62fe5640 20 reqs_thread_entry: start 2024-09-14T11:18:18.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.306+0000 7f3cb211f800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:18.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.306+0000 7f3cb211f800 20 Filter name: none 2024-09-14T11:18:18.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.306+0000 7f3b60fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:18.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.307+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.307+0000 7f3cb211f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.307+0000 7f3cb211f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 INFO: main: starting shard=0 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 INFO: main: starting shard=1 2024-09-14T11:18:18.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.308+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:18.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.309+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.309+0000 7f3cb211f800 20 INFO: main: starting shard=2 2024-09-14T11:18:18.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.309+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:18.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.310+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.310+0000 7f3cb211f800 20 INFO: main: starting shard=3 2024-09-14T11:18:18.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.310+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:18.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.310+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.310+0000 7f3cb211f800 20 INFO: main: starting shard=4 2024-09-14T11:18:18.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.310+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:18.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.311+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.311+0000 7f3cb211f800 20 INFO: main: starting shard=5 2024-09-14T11:18:18.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.311+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:18.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.312+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.312+0000 7f3cb211f800 20 INFO: main: starting shard=6 2024-09-14T11:18:18.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.312+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:18.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.312+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.312+0000 7f3cb211f800 20 INFO: main: starting shard=7 2024-09-14T11:18:18.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.312+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:18.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.313+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.313+0000 7f3cb211f800 20 INFO: main: starting shard=8 2024-09-14T11:18:18.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.313+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:18.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.314+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:18:18.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.314+0000 7f3cb211f800 20 INFO: main: starting shard=9 2024-09-14T11:18:18.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.314+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:18.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.314+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.314+0000 7f3cb211f800 20 INFO: main: starting shard=10 2024-09-14T11:18:18.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.314+0000 7f3cb211f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:18.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.315+0000 7f3cb211f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.315+0000 7f3cb211f800 20 INFO: main: done 2024-09-14T11:18:18.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.316+0000 7f3b63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:18.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.319+0000 7f3cb211f800 20 remove_watcher() i=0 2024-09-14T11:18:18.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.319+0000 7f3cb211f800 2 removed watcher, disabling cache 2024-09-14T11:18:18.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.320+0000 7f3cb211f800 20 remove_watcher() i=1 2024-09-14T11:18:18.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.321+0000 7f3cb211f800 20 remove_watcher() i=2 2024-09-14T11:18:18.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.323+0000 7f3cb211f800 20 remove_watcher() i=3 2024-09-14T11:18:18.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.324+0000 7f3cb211f800 20 remove_watcher() i=4 2024-09-14T11:18:18.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.325+0000 7f3cb211f800 20 remove_watcher() i=5 2024-09-14T11:18:18.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.326+0000 7f3cb211f800 20 remove_watcher() i=6 2024-09-14T11:18:18.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.327+0000 7f3cb211f800 20 remove_watcher() i=7 2024-09-14T11:18:18.341 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:18.342 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:18.345 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:18.345 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:18.348 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:18.349 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:18.396 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:18.397 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:18:18.431 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:18.431 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:18.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.476+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.477+0000 7f10f1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.477+0000 7f10f1640800 20 realm 2024-09-14T11:18:18.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.477+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.478+0000 7f10f1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.478+0000 7f10f1640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:18.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.478+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.478+0000 7f10f1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.478+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.479+0000 7f10f1640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:18.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.479+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.479+0000 7f10f1640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:18.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.479+0000 7f10f1640800 20 searching for the correct realm 2024-09-14T11:18:18.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.481+0000 7f10ef92b640 0 -- 172.21.15.7:0/3611706276 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f10e408d040 msgr2=0x7f10e408d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:18.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.687+0000 7f10ee929640 0 -- 172.21.15.7:0/3611706276 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f10e00843a0 msgr2=0x7f10e00a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:18.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.895+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:18.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:18.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 zone default found 2024-09-14T11:18:18.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 4 Realm: () 2024-09-14T11:18:18.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:18.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 zonegroup default 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.896+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.897+0000 7f10f1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.897+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.897+0000 7f10f1640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.897+0000 7f10f1640800 20 started sync module instance, tier type = 2024-09-14T11:18:18.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.897+0000 7f10f1640800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:18.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.909+0000 7f10f1640800 20 add_watcher() i=0 2024-09-14T11:18:18.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.909+0000 7f10f1640800 20 add_watcher() i=1 2024-09-14T11:18:18.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.909+0000 7f10f1640800 20 add_watcher() i=2 2024-09-14T11:18:18.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.909+0000 7f10f1640800 20 add_watcher() i=3 2024-09-14T11:18:18.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.909+0000 7f10f1640800 20 add_watcher() i=4 2024-09-14T11:18:18.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.909+0000 7f10f1640800 20 add_watcher() i=5 2024-09-14T11:18:18.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.909+0000 7f10f1640800 20 add_watcher() i=6 2024-09-14T11:18:18.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.910+0000 7f10f1640800 20 add_watcher() i=7 2024-09-14T11:18:18.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.910+0000 7f10f1640800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:18.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.912+0000 7f0fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f10f1640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f10f1640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f10f1640800 5 note: GC not initialized 2024-09-14T11:18:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f0fa4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f10f1640800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f10f1640800 20 Filter name: none 2024-09-14T11:18:18.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f0f1e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:18.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.913+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.914+0000 7f10f1640800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:18.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.914+0000 7f10f1640800 20 rados->read ofs=0 len=0 2024-09-14T11:18:18.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:18.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:18.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:18.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 INFO: main: starting shard=0 2024-09-14T11:18:18.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:18.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 INFO: main: starting shard=1 2024-09-14T11:18:18.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.915+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:18.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.916+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.916+0000 7f10f1640800 20 INFO: main: starting shard=2 2024-09-14T11:18:18.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.916+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:18.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.917+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.917+0000 7f10f1640800 20 INFO: main: starting shard=3 2024-09-14T11:18:18.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.917+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:18.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.917+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.917+0000 7f10f1640800 20 INFO: main: starting shard=4 2024-09-14T11:18:18.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.917+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:18.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.918+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.918+0000 7f10f1640800 20 INFO: main: starting shard=5 2024-09-14T11:18:18.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.918+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:18.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.918+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:18:18.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.918+0000 7f10f1640800 20 INFO: main: starting shard=6 2024-09-14T11:18:18.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.918+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:18.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.919+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.919+0000 7f10f1640800 20 INFO: main: starting shard=7 2024-09-14T11:18:18.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.919+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:18.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.919+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.919+0000 7f10f1640800 20 INFO: main: starting shard=8 2024-09-14T11:18:18.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.919+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:18.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.920+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.920+0000 7f10f1640800 20 INFO: main: starting shard=9 2024-09-14T11:18:18.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.920+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:18.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.921+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.921+0000 7f10f1640800 20 INFO: main: starting shard=10 2024-09-14T11:18:18.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.921+0000 7f10f1640800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:18.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.922+0000 7f10f1640800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:18.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.922+0000 7f10f1640800 20 INFO: main: done 2024-09-14T11:18:18.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.923+0000 7f0fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:18.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.925+0000 7f10f1640800 20 remove_watcher() i=0 2024-09-14T11:18:18.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.926+0000 7f10f1640800 2 removed watcher, disabling cache 2024-09-14T11:18:18.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.927+0000 7f10f1640800 20 remove_watcher() i=1 2024-09-14T11:18:18.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.928+0000 7f10f1640800 20 remove_watcher() i=2 2024-09-14T11:18:18.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.930+0000 7f10f1640800 20 remove_watcher() i=3 2024-09-14T11:18:18.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.931+0000 7f10f1640800 20 remove_watcher() i=4 2024-09-14T11:18:18.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.932+0000 7f10f1640800 20 remove_watcher() i=5 2024-09-14T11:18:18.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.933+0000 7f10f1640800 20 remove_watcher() i=6 2024-09-14T11:18:18.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:18.934+0000 7f10f1640800 20 remove_watcher() i=7 2024-09-14T11:18:18.949 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:18.949 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:18.953 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:18.953 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:18.956 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:18.956 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:19.004 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:19.006 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:18:19.039 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:19.039 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:19.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.083+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.085+0000 7f1cbc575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.085+0000 7f1cbc575800 20 realm 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.085+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.086+0000 7f1cbc575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.086+0000 7f1cbc575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.086+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.086+0000 7f1cbc575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.086+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.087+0000 7f1cbc575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:19.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.087+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.088+0000 7f1cbc575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:19.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.088+0000 7f1cbc575800 20 searching for the correct realm 2024-09-14T11:18:19.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.088+0000 7f1cba05f640 0 -- 172.21.15.7:0/2579139717 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55ed12d10550 msgr2=0x55ed12d12a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:19.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.294+0000 7f1cba05f640 0 -- 172.21.15.7:0/2579139717 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55ed12d10550 msgr2=0x55ed12d12a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:19.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.302+0000 7f1cbc575800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:19.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.302+0000 7f1cbc575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:19.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.302+0000 7f1cbc575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:19.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.302+0000 7f1cbc575800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:19.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.302+0000 7f1cbc575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:19.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.302+0000 7f1cbc575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:19.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.302+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:19.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:19.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 zone default found 2024-09-14T11:18:19.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 4 Realm: () 2024-09-14T11:18:19.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 zonegroup default 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.303+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.304+0000 7f1cbc575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.304+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.304+0000 7f1cbc575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.304+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.304+0000 7f1cbc575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.304+0000 7f1cbc575800 20 started sync module instance, tier type = 2024-09-14T11:18:19.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.304+0000 7f1cbc575800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:19.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.318+0000 7f1cbc575800 20 add_watcher() i=0 2024-09-14T11:18:19.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.318+0000 7f1cbc575800 20 add_watcher() i=1 2024-09-14T11:18:19.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.318+0000 7f1cbc575800 20 add_watcher() i=2 2024-09-14T11:18:19.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.318+0000 7f1cbc575800 20 add_watcher() i=3 2024-09-14T11:18:19.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.318+0000 7f1cbc575800 20 add_watcher() i=4 2024-09-14T11:18:19.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.318+0000 7f1cbc575800 20 add_watcher() i=5 2024-09-14T11:18:19.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.318+0000 7f1cbc575800 20 add_watcher() i=6 2024-09-14T11:18:19.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.319+0000 7f1cbc575800 20 add_watcher() i=7 2024-09-14T11:18:19.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.319+0000 7f1cbc575800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:19.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.321+0000 7f1b70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:19.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1cbc575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:19.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1cbc575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:19.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1cbc575800 5 note: GC not initialized 2024-09-14T11:18:19.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1aeb7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:19.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1cbc575800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:19.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1cbc575800 20 Filter name: none 2024-09-14T11:18:19.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1ae97fa640 20 reqs_thread_entry: start 2024-09-14T11:18:19.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.322+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.323+0000 7f1cbc575800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.323+0000 7f1cbc575800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.323+0000 7f1cbc575800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.323+0000 7f1cbc575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.323+0000 7f1cbc575800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.323+0000 7f1cbc575800 20 INFO: main: starting shard=0 2024-09-14T11:18:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.323+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.324+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.324+0000 7f1cbc575800 20 INFO: main: starting shard=1 2024-09-14T11:18:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.324+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.325+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:18:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.325+0000 7f1cbc575800 20 INFO: main: starting shard=2 2024-09-14T11:18:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.325+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.325+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.325+0000 7f1cbc575800 20 INFO: main: starting shard=3 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.325+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.326+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.326+0000 7f1cbc575800 20 INFO: main: starting shard=4 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.326+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.326+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.326+0000 7f1cbc575800 20 INFO: main: starting shard=5 2024-09-14T11:18:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.326+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.327+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.327+0000 7f1cbc575800 20 INFO: main: starting shard=6 2024-09-14T11:18:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.327+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.327+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.327+0000 7f1cbc575800 20 INFO: main: starting shard=7 2024-09-14T11:18:19.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.327+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:19.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.328+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.328+0000 7f1cbc575800 20 INFO: main: starting shard=8 2024-09-14T11:18:19.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.328+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:19.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.328+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.328+0000 7f1cbc575800 20 INFO: main: starting shard=9 2024-09-14T11:18:19.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.328+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:19.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.329+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.329+0000 7f1cbc575800 20 INFO: main: starting shard=10 2024-09-14T11:18:19.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.329+0000 7f1cbc575800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:19.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.330+0000 7f1cbc575800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.330+0000 7f1cbc575800 20 INFO: main: done 2024-09-14T11:18:19.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.331+0000 7f1b70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:19.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.333+0000 7f1cbc575800 20 remove_watcher() i=0 2024-09-14T11:18:19.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.333+0000 7f1cbc575800 2 removed watcher, disabling cache 2024-09-14T11:18:19.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.334+0000 7f1cbc575800 20 remove_watcher() i=1 2024-09-14T11:18:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.335+0000 7f1cbc575800 20 remove_watcher() i=2 2024-09-14T11:18:19.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.336+0000 7f1cbc575800 20 remove_watcher() i=3 2024-09-14T11:18:19.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.337+0000 7f1cbc575800 20 remove_watcher() i=4 2024-09-14T11:18:19.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.338+0000 7f1cbc575800 20 remove_watcher() i=5 2024-09-14T11:18:19.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.339+0000 7f1cbc575800 20 remove_watcher() i=6 2024-09-14T11:18:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.340+0000 7f1cbc575800 20 remove_watcher() i=7 2024-09-14T11:18:19.352 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:19.352 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:19.356 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:19.356 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:19.404 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:18:19.405 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:18:19.437 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:19.437 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:19.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.479+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.480+0000 7f8bf613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.480+0000 7f8bf613b800 20 realm 2024-09-14T11:18:19.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.480+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.480+0000 7f8bf613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.480+0000 7f8bf613b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:19.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.480+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.481+0000 7f8bf613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.481+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.482+0000 7f8bf613b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:19.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.482+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.482+0000 7f8bf613b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:19.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.482+0000 7f8bf613b800 20 searching for the correct realm 2024-09-14T11:18:19.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.484+0000 7f8bf2626640 0 -- 172.21.15.7:0/998200472 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8bdc032060 msgr2=0x7f8bdc086030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:19.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.690+0000 7f8bebfff640 0 -- 172.21.15.7:0/998200472 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8be40a6090 msgr2=0x7f8be40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.897+0000 7f8bf613b800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.898+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 zone default found 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 4 Realm: () 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 zonegroup default 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.899+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.900+0000 7f8bf613b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:19.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.900+0000 7f8bf613b800 20 started sync module instance, tier type = 2024-09-14T11:18:19.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.900+0000 7f8bf613b800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:19.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.911+0000 7f8bf613b800 20 add_watcher() i=0 2024-09-14T11:18:19.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.911+0000 7f8bf613b800 20 add_watcher() i=1 2024-09-14T11:18:19.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.911+0000 7f8bf613b800 20 add_watcher() i=2 2024-09-14T11:18:19.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.911+0000 7f8bf613b800 20 add_watcher() i=3 2024-09-14T11:18:19.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.911+0000 7f8bf613b800 20 add_watcher() i=4 2024-09-14T11:18:19.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.911+0000 7f8bf613b800 20 add_watcher() i=5 2024-09-14T11:18:19.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.911+0000 7f8bf613b800 20 add_watcher() i=6 2024-09-14T11:18:19.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.912+0000 7f8bf613b800 20 add_watcher() i=7 2024-09-14T11:18:19.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.912+0000 7f8bf613b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:19.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.914+0000 7f8aa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:19.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8bf613b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:19.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8bf613b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:19.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8bf613b800 5 note: GC not initialized 2024-09-14T11:18:19.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8aa27fc640 20 reqs_thread_entry: start 2024-09-14T11:18:19.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8bf613b800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:19.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8bf613b800 20 Filter name: none 2024-09-14T11:18:19.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8a17fff640 20 reqs_thread_entry: start 2024-09-14T11:18:19.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.915+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.916+0000 7f8bf613b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:19.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.916+0000 7f8bf613b800 20 rados->read ofs=0 len=0 2024-09-14T11:18:19.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.916+0000 7f8bf613b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:19.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.916+0000 7f8bf613b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:19.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.916+0000 7f8bf613b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:18:19.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.916+0000 7f8bf613b800 20 INFO: main: starting shard=0 2024-09-14T11:18:19.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.916+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:19.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.917+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.917+0000 7f8bf613b800 20 INFO: main: starting shard=1 2024-09-14T11:18:19.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.917+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:19.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.918+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.918+0000 7f8bf613b800 20 INFO: main: starting shard=2 2024-09-14T11:18:19.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.918+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:19.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.919+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.919+0000 7f8bf613b800 20 INFO: main: starting shard=3 2024-09-14T11:18:19.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.919+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:19.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.919+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.919+0000 7f8bf613b800 20 INFO: main: starting shard=4 2024-09-14T11:18:19.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.919+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.920+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.920+0000 7f8bf613b800 20 INFO: main: starting shard=5 2024-09-14T11:18:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.920+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.920+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.920+0000 7f8bf613b800 20 INFO: main: starting shard=6 2024-09-14T11:18:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.920+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:19.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.921+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.921+0000 7f8bf613b800 20 INFO: main: starting shard=7 2024-09-14T11:18:19.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.921+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:19.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.922+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.922+0000 7f8bf613b800 20 INFO: main: starting shard=8 2024-09-14T11:18:19.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.922+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:19.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.923+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.923+0000 7f8bf613b800 20 INFO: main: starting shard=9 2024-09-14T11:18:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.923+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.923+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:18:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.923+0000 7f8bf613b800 20 INFO: main: starting shard=10 2024-09-14T11:18:19.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.923+0000 7f8bf613b800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:19.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.924+0000 7f8bf613b800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:18:19.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.924+0000 7f8bf613b800 20 INFO: main: done 2024-09-14T11:18:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.925+0000 7f8aa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:19.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.928+0000 7f8bf613b800 20 remove_watcher() i=0 2024-09-14T11:18:19.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.928+0000 7f8bf613b800 2 removed watcher, disabling cache 2024-09-14T11:18:19.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.929+0000 7f8bf613b800 20 remove_watcher() i=1 2024-09-14T11:18:19.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.930+0000 7f8bf613b800 20 remove_watcher() i=2 2024-09-14T11:18:19.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.931+0000 7f8bf613b800 20 remove_watcher() i=3 2024-09-14T11:18:19.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.933+0000 7f8bf613b800 20 remove_watcher() i=4 2024-09-14T11:18:19.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.934+0000 7f8bf613b800 20 remove_watcher() i=5 2024-09-14T11:18:19.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.935+0000 7f8bf613b800 20 remove_watcher() i=6 2024-09-14T11:18:19.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:19.936+0000 7f8bf613b800 20 remove_watcher() i=7 2024-09-14T11:18:19.948 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:19.948 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:19.952 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:18:20.366 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:18:20.771 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:18:20.801 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:20.801 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:20.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.844+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:20.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:20.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 20 realm 2024-09-14T11:18:20.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:20.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:20.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:20.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:20.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:20.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.845+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:20.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.846+0000 7f53b4f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:20.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.846+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:20.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.847+0000 7f53b4f20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:20.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.847+0000 7f53b4f20800 20 searching for the correct realm 2024-09-14T11:18:20.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:20.850+0000 7f53b0b02640 0 -- 172.21.15.7:0/3926010696 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f53ac061040 msgr2=0x7f53ac07b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:21.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.057+0000 7f53b0b02640 0 -- 172.21.15.7:0/3926010696 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f53ac061040 msgr2=0x7f53ac07b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:21.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.062+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 20 zone default found 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 4 Realm: () 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 20 zonegroup default 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.063+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.064+0000 7f53b4f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.064+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.064+0000 7f53b4f20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.064+0000 7f53b4f20800 20 started sync module instance, tier type = 2024-09-14T11:18:21.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.064+0000 7f53b4f20800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:21.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=0 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=1 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=2 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=3 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=4 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=5 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=6 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 20 add_watcher() i=7 2024-09-14T11:18:21.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.074+0000 7f53b4f20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:21.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.076+0000 7f52677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:21.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f53b4f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:21.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f53b4f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:21.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f53b4f20800 5 note: GC not initialized 2024-09-14T11:18:21.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f52667e4640 20 reqs_thread_entry: start 2024-09-14T11:18:21.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f53b4f20800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:21.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f53b4f20800 20 Filter name: none 2024-09-14T11:18:21.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f525f7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:21.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f53b4f20800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:21.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.077+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:21.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:21.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:21.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:21.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.078+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:21.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.079+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.080+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:21.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.081+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:21.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.081+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:21.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.082+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.082+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:21.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.083+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:21.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.083+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.084+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:21.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.085+0000 7f53b4f20800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.091+0000 7f52677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:21.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.093+0000 7f53b4f20800 20 remove_watcher() i=0 2024-09-14T11:18:21.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.093+0000 7f53b4f20800 2 removed watcher, disabling cache 2024-09-14T11:18:21.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.095+0000 7f53b4f20800 20 remove_watcher() i=1 2024-09-14T11:18:21.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.096+0000 7f53b4f20800 20 remove_watcher() i=2 2024-09-14T11:18:21.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.097+0000 7f53b4f20800 20 remove_watcher() i=3 2024-09-14T11:18:21.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.098+0000 7f53b4f20800 20 remove_watcher() i=4 2024-09-14T11:18:21.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.099+0000 7f53b4f20800 20 remove_watcher() i=5 2024-09-14T11:18:21.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.100+0000 7f53b4f20800 20 remove_watcher() i=6 2024-09-14T11:18:21.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.101+0000 7f53b4f20800 20 remove_watcher() i=7 2024-09-14T11:18:21.111 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:18:21.147 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:21.147 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:21.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.189+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.190+0000 7f6388740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.191+0000 7f6388740800 20 realm 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.191+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.191+0000 7f6388740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.191+0000 7f6388740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.191+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.191+0000 7f6388740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.191+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.192+0000 7f6388740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:21.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.192+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.193+0000 7f6388740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:21.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.193+0000 7f6388740800 20 searching for the correct realm 2024-09-14T11:18:21.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.195+0000 7f6384c87640 0 -- 172.21.15.7:0/1546828424 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f63780619a0 msgr2=0x7f637806baf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:21.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.199+0000 7f6383c85640 0 -- 172.21.15.7:0/1546828424 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f637409ea30 msgr2=0x7f6374082120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:21.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:21.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:21.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:21.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:21.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:21.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:21.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.407+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:21.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:21.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 zone default found 2024-09-14T11:18:21.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 4 Realm: () 2024-09-14T11:18:21.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 zonegroup default 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.408+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.409+0000 7f6388740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.409+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.409+0000 7f6388740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.409+0000 7f6388740800 20 started sync module instance, tier type = 2024-09-14T11:18:21.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.409+0000 7f6388740800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:21.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.419+0000 7f6388740800 20 add_watcher() i=0 2024-09-14T11:18:21.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.419+0000 7f6388740800 20 add_watcher() i=1 2024-09-14T11:18:21.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.419+0000 7f6388740800 20 add_watcher() i=2 2024-09-14T11:18:21.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.419+0000 7f6388740800 20 add_watcher() i=3 2024-09-14T11:18:21.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.419+0000 7f6388740800 20 add_watcher() i=4 2024-09-14T11:18:21.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.419+0000 7f6388740800 20 add_watcher() i=5 2024-09-14T11:18:21.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.419+0000 7f6388740800 20 add_watcher() i=6 2024-09-14T11:18:21.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.420+0000 7f6388740800 20 add_watcher() i=7 2024-09-14T11:18:21.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.420+0000 7f6388740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:21.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.422+0000 7f623afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:21.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.422+0000 7f6388740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:21.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.422+0000 7f6388740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:21.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.422+0000 7f6388740800 5 note: GC not initialized 2024-09-14T11:18:21.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.422+0000 7f6239fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:21.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 20 Filter name: none 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f61ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 : miss 2024-09-14T11:18:21.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.423+0000 7f6388740800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.424+0000 7f6388740800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.424+0000 7f6388740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 info.flags=0x17 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.424+0000 7f6388740800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 to cache LRU end 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.424+0000 7f6388740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.424+0000 7f6388740800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.424+0000 7f6388740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.424+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.0 2024-09-14T11:18:21.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.425+0000 7f6388740800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:18:21.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.425+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.426+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.2 2024-09-14T11:18:21.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.426+0000 7f6388740800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:18:21.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.426+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.3 2024-09-14T11:18:21.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.427+0000 7f6388740800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:18:21.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.427+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.4 2024-09-14T11:18:21.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.427+0000 7f6388740800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:18:21.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.427+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.428+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.6 2024-09-14T11:18:21.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.428+0000 7f6388740800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:18:21.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.428+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.7 2024-09-14T11:18:21.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.429+0000 7f6388740800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:18:21.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.429+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.430+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.9 2024-09-14T11:18:21.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.430+0000 7f6388740800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:18:21.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.430+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.431+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.431+0000 7f6388740800 20 get_obj_state: octx=0x55c05511eba0 obj=check-bucket:e state=0x55c0553d4bc8 s->prefetch_data=0 2024-09-14T11:18:21.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.431+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.431+0000 7f6388740800 20 get_obj_state: octx=0x55c055104380 obj=check-bucket:d state=0x55c0553d37a8 s->prefetch_data=0 2024-09-14T11:18:21.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.431+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state: octx=0x55c0553d5540 obj=check-bucket:c state=0x55c05546e288 s->prefetch_data=0 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state: octx=0x55c05546f1c0 obj=check-bucket:f state=0x55c05546f668 s->prefetch_data=0 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to arb0p23laoxeau93js44kvl5o2l708me 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state_impl: setting s->olh_tag to 2qka0dkh7ia54l6xn4uilzqdxmpfv3le 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2qka0dkh7ia54l6xn4uilzqdxmpfv3le 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to cgnap3deneoi2pft31pu8fgj5sc3e3pd 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state_impl: setting s->olh_tag to 9k8an8ii9fj5mjf27yoop94f8azws1pp 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9k8an8ii9fj5mjf27yoop94f8azws1pp 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to 3yyytsk1q4ee2173st2l0xr9n7702fed 2024-09-14T11:18:21.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 get_obj_state_impl: setting s->olh_tag to sggn58kigyj764ykocpa0ndwcg4p05nv 2024-09-14T11:18:21.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.432+0000 7f6388740800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sggn58kigyj764ykocpa0ndwcg4p05nv 2024-09-14T11:18:21.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.433+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to 8hi4me20c950szz53fuyocvc3qa85nwo 2024-09-14T11:18:21.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.433+0000 7f6388740800 20 get_obj_state_impl: setting s->olh_tag to cxa94wc5tvezt6ealll266zrfdki1mhk 2024-09-14T11:18:21.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.433+0000 7f6388740800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cxa94wc5tvezt6ealll266zrfdki1mhk 2024-09-14T11:18:21.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.433+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.434+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.434+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.434+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.435+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.435+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.435+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 olh_log_entry: epoch=2 op=3 key=e[kwM3ilj8c8PopXfNuydUyEn8w5ys2Vz] 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: octx=0x55c05511eba0 obj=check-bucket:_:kwM3ilj8c8PopXfNuydUyEn8w5ys2Vz_e state=0x55c055480a18 s->prefetch_data=0 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 olh_log_entry: epoch=3 op=3 key=d[p5hXt6qv7c0eL4nHCDNHKh.dpSKNQtn] 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: octx=0x55c055104380 obj=check-bucket:_:p5hXt6qv7c0eL4nHCDNHKh.dpSKNQtn_d state=0x55c05548dc58 s->prefetch_data=0 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 olh_log_entry: epoch=3 op=3 key=c[XPLGh3uqoOYPSj.if-K3jL6vppbgpEn] 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: octx=0x55c0553d5540 obj=check-bucket:_:XPLGh3uqoOYPSj.if-K3jL6vppbgpEn_c state=0x55c055494868 s->prefetch_data=0 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 10 manifest: total_size = 11 2024-09-14T11:18:21.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15093547141473807592 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: octx=0x55c05511eba0 obj=check-bucket:_:kwM3ilj8c8PopXfNuydUyEn8w5ys2Vz_e state=0x55c055480a18 s->prefetch_data=0 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 prepare_atomic_modification: state is not atomic. state=0x55c055480a18 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 10 manifest: total_size = 22 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13832839882736806352 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: octx=0x55c055104380 obj=check-bucket:_:p5hXt6qv7c0eL4nHCDNHKh.dpSKNQtn_d state=0x55c05548dc58 s->prefetch_data=0 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 prepare_atomic_modification: state is not atomic. state=0x55c05548dc58 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 10 manifest: total_size = 11 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8882195135145154295 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 get_obj_state: octx=0x55c0553d5540 obj=check-bucket:_:XPLGh3uqoOYPSj.if-K3jL6vppbgpEn_c state=0x55c055494868 s->prefetch_data=0 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 prepare_atomic_modification: state is not atomic. state=0x55c055494868 2024-09-14T11:18:21.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.436+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.437+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:18:21.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 20 olh_log_entry: epoch=2 op=3 key=f[fiigxOyQrP9BMJe2Rm5udX5GaseAhky] 2024-09-14T11:18:21.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 20 get_obj_state: octx=0x55c05546f1c0 obj=check-bucket:_:fiigxOyQrP9BMJe2Rm5udX5GaseAhky_f state=0x55c0554a2908 s->prefetch_data=0 2024-09-14T11:18:21.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 10 manifest: total_size = 22 2024-09-14T11:18:21.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14010350556487315147 2024-09-14T11:18:21.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 20 get_obj_state: octx=0x55c05546f1c0 obj=check-bucket:_:fiigxOyQrP9BMJe2Rm5udX5GaseAhky_f state=0x55c0554a2908 s->prefetch_data=0 2024-09-14T11:18:21.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 20 prepare_atomic_modification: state is not atomic. state=0x55c0554a2908 2024-09-14T11:18:21.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.438+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.440+0000 7f625b7fe640 20 handle_completion(): completion ok for obj=d[p5hXt6qv7c0eL4nHCDNHKh.dpSKNQtn] 2024-09-14T11:18:21.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.441+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.441+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.442+0000 7f625b7fe640 20 handle_completion(): completion ok for obj=c[XPLGh3uqoOYPSj.if-K3jL6vppbgpEn] 2024-09-14T11:18:21.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.443+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.8 2024-09-14T11:18:21.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.443+0000 7f6388740800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:18:21.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.443+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.443+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.444+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.5 2024-09-14T11:18:21.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.444+0000 7f6388740800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:18:21.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.444+0000 7f6388740800 20 get_obj_state: octx=0x55c05511eba0 obj=check-bucket:e state=0x55c0553d4bc8 s->prefetch_data=0 2024-09-14T11:18:21.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.444+0000 7f6388740800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2qka0dkh7ia54l6xn4uilzqdxmpfv3le 2024-09-14T11:18:21.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.446+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.448+0000 7f6388740800 20 get_obj_state: octx=0x55c05546f1c0 obj=check-bucket:f state=0x55c05546f668 s->prefetch_data=0 2024-09-14T11:18:21.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.448+0000 7f6388740800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cxa94wc5tvezt6ealll266zrfdki1mhk 2024-09-14T11:18:21.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.448+0000 7f625affd640 20 handle_completion(): completion ok for obj=e[kwM3ilj8c8PopXfNuydUyEn8w5ys2Vz] 2024-09-14T11:18:21.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.449+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.1 2024-09-14T11:18:21.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.449+0000 7f6388740800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:18:21.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.449+0000 7f625affd640 20 handle_completion(): completion ok for obj=f[fiigxOyQrP9BMJe2Rm5udX5GaseAhky] 2024-09-14T11:18:21.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.453+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.454+0000 7f6388740800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2.10 2024-09-14T11:18:21.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.454+0000 7f6388740800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:18:21.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.454+0000 7f6388740800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:18:21.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.455+0000 7f623afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:21.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.458+0000 7f6388740800 20 remove_watcher() i=0 2024-09-14T11:18:21.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.458+0000 7f6388740800 2 removed watcher, disabling cache 2024-09-14T11:18:21.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.459+0000 7f6388740800 20 remove_watcher() i=1 2024-09-14T11:18:21.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.460+0000 7f6388740800 20 remove_watcher() i=2 2024-09-14T11:18:21.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.461+0000 7f6388740800 20 remove_watcher() i=3 2024-09-14T11:18:21.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.462+0000 7f6388740800 20 remove_watcher() i=4 2024-09-14T11:18:21.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.463+0000 7f6388740800 20 remove_watcher() i=5 2024-09-14T11:18:21.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.464+0000 7f6388740800 20 remove_watcher() i=6 2024-09-14T11:18:21.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.465+0000 7f6388740800 20 remove_watcher() i=7 2024-09-14T11:18:21.477 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:21.477 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:21.482 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:21.482 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:21.526 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:18:21.555 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:21.555 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:21.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.596+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.597+0000 7fcb8682d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.597+0000 7fcb8682d800 20 realm 2024-09-14T11:18:21.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.597+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.598+0000 7fcb8682d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.598+0000 7fcb8682d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:21.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.598+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.598+0000 7fcb8682d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.598+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.599+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.599+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.599+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.599+0000 7fcb8682d800 20 searching for the correct realm 2024-09-14T11:18:21.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.602+0000 7fcb84317640 0 -- 172.21.15.7:0/490141637 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fcb7c031040 msgr2=0x7fcb7c03c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:21.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.809+0000 7fcb84317640 0 -- 172.21.15.7:0/490141637 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fcb7c031040 msgr2=0x7fcb7c03c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:21.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:18:21.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:21.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:21.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:18:21.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:21.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:21.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.813+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 zone default found 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 4 Realm: () 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 zonegroup default 2024-09-14T11:18:21.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.814+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.815+0000 7fcb8682d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.815+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.815+0000 7fcb8682d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:21.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.815+0000 7fcb8682d800 20 started sync module instance, tier type = 2024-09-14T11:18:21.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.815+0000 7fcb8682d800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:18:21.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.826+0000 7fcb8682d800 20 add_watcher() i=0 2024-09-14T11:18:21.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.826+0000 7fcb8682d800 20 add_watcher() i=1 2024-09-14T11:18:21.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.826+0000 7fcb8682d800 20 add_watcher() i=2 2024-09-14T11:18:21.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.826+0000 7fcb8682d800 20 add_watcher() i=3 2024-09-14T11:18:21.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.826+0000 7fcb8682d800 20 add_watcher() i=4 2024-09-14T11:18:21.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.826+0000 7fcb8682d800 20 add_watcher() i=5 2024-09-14T11:18:21.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.826+0000 7fcb8682d800 20 add_watcher() i=6 2024-09-14T11:18:21.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.827+0000 7fcb8682d800 20 add_watcher() i=7 2024-09-14T11:18:21.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.827+0000 7fcb8682d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:21.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.828+0000 7fca3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:21.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fcb8682d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:21.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fcb8682d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:21.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fcb8682d800 5 note: GC not initialized 2024-09-14T11:18:21.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fca39fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:21.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fcb8682d800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:21.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fcb8682d800 20 Filter name: none 2024-09-14T11:18:21.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fc9ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:21.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.829+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.830+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:21.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.830+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.830+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:21.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.830+0000 7fcb8682d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:21.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.830+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.831+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:18:21.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.831+0000 7fcb8682d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:21.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.831+0000 7fcb8682d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:18:21.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.831+0000 7fcb8682d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:21.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.833+0000 7fca3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:21.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.835+0000 7fcb8682d800 20 remove_watcher() i=0 2024-09-14T11:18:21.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.835+0000 7fcb8682d800 2 removed watcher, disabling cache 2024-09-14T11:18:21.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.836+0000 7fcb8682d800 20 remove_watcher() i=1 2024-09-14T11:18:21.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.837+0000 7fcb8682d800 20 remove_watcher() i=2 2024-09-14T11:18:21.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.839+0000 7fcb8682d800 20 remove_watcher() i=3 2024-09-14T11:18:21.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.840+0000 7fcb8682d800 20 remove_watcher() i=4 2024-09-14T11:18:21.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.841+0000 7fcb8682d800 20 remove_watcher() i=5 2024-09-14T11:18:21.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.842+0000 7fcb8682d800 20 remove_watcher() i=6 2024-09-14T11:18:21.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:18:21.843+0000 7fcb8682d800 20 remove_watcher() i=7 2024-09-14T11:18:21.853 INFO:tasks.workunit.client.0.smithi007.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:18:21.853 INFO:tasks.workunit.client.0.smithi007.stderr:Deleting bucket check-bucket 2024-09-14T11:18:21.855 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:21.855 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:21.859 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:21.859 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:18:21.885 INFO:tasks.workunit.client.0.smithi007.stderr:Completed bucket check tests 2024-09-14T11:18:21.885 INFO:tasks.workunit.client.0.smithi007.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:18:21.885 INFO:tasks.workunit.client.0.smithi007.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:18:21.885 INFO:tasks.workunit.client.0.smithi007.stdout:connected to https://localhost:443 2024-09-14T11:18:21.947 INFO:tasks.workunit.client.0.smithi007.stderr:+ deactivate 2024-09-14T11:18:21.947 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:18:21.947 INFO:tasks.workunit.client.0.smithi007.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:18:21.947 INFO:tasks.workunit.client.0.smithi007.stderr:+ export PATH 2024-09-14T11:18:21.947 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:18:21.947 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:18:21.947 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:18:21.948 INFO:tasks.workunit.client.0.smithi007.stderr:+ hash -r 2024-09-14T11:18:21.948 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:18:21.948 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:18:21.948 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:18:21.948 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset -f deactivate 2024-09-14T11:18:21.948 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo OK. 2024-09-14T11:18:21.949 INFO:tasks.workunit.client.0.smithi007.stdout:OK. 2024-09-14T11:18:21.949 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:18:21.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:18:22.028 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:18:22.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:18:22.425 DEBUG:teuthology.parallel:result is None 2024-09-14T11:18:22.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:18:22.465 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:18:22.465 DEBUG:teuthology.orchestra.run.smithi007:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:18:22.535 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:18:22.535 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:18:22.547 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:18:22.547 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:18:22.547 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:18:22.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:18:22.605 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:18:22.605 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:18:22.675 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:18:22.675 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:18:22.744 INFO:tasks.workunit:timeout=3h 2024-09-14T11:18:22.744 INFO:tasks.workunit:cleanup=True 2024-09-14T11:18:22.744 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:18:22.814 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:19:20.066 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 96% (12412/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-14T11:19:20.158 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:19:20.158 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-14T11:19:20.158 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:19:20.158 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:19:20.158 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:19:20.158 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:19:20.159 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:19:20.229 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:19:20.231 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:19:20.231 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:19:20.282 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:19:20.332 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:19:20.372 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:19:20.374 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:19:20.374 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:19:20.413 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:19:20.417 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:19:20.417 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:19:20.488 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:19:20.490 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:19:20.490 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:19:20.572 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:20.572 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:19:20.573 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:20.573 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:19:20.573 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:19:22.316 INFO:tasks.workunit.client.0.smithi007.stdout:lock: mylock 2024-09-14T11:19:22.316 INFO:tasks.workunit.client.0.smithi007.stdout: lock_type: exclusive 2024-09-14T11:19:22.316 INFO:tasks.workunit.client.0.smithi007.stdout: tag: 2024-09-14T11:19:22.317 INFO:tasks.workunit.client.0.smithi007.stdout: lockers: 2024-09-14T11:19:22.317 INFO:tasks.workunit.client.0.smithi007.stdout: client.5118 expiration=2024-09-14T11:21:22.315257+0000 addr=v1:172.21.15.7:0/486499199 cookie= 2024-09-14T11:19:22.323 INFO:tasks.workunit.client.0.smithi007.stdout:lock: mylock 2024-09-14T11:19:22.323 INFO:tasks.workunit.client.0.smithi007.stdout: lock_type: shared 2024-09-14T11:19:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: tag: 2024-09-14T11:19:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: lockers: 2024-09-14T11:19:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.7:0/1433470629 cookie= 2024-09-14T11:19:22.324 INFO:tasks.workunit.client.0.smithi007.stdout: client.5118 expiration=2024-09-14T11:21:22.323961+0000 addr=v1:172.21.15.7:0/486499199 cookie= 2024-09-14T11:19:22.326 INFO:tasks.workunit.client.0.smithi007.stdout:lock: mylock 2024-09-14T11:19:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: lock_type: shared 2024-09-14T11:19:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: tag: 2024-09-14T11:19:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: lockers: 2024-09-14T11:19:22.327 INFO:tasks.workunit.client.0.smithi007.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.7:0/1433470629 cookie= 2024-09-14T11:19:23.297 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestMultiLocking (2724 ms) 2024-09-14T11:19:23.297 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:19:25.546 INFO:tasks.workunit.client.0.smithi007.stdout:lock: mylock 2024-09-14T11:19:25.547 INFO:tasks.workunit.client.0.smithi007.stdout: lock_type: shared 2024-09-14T11:19:25.547 INFO:tasks.workunit.client.0.smithi007.stdout: tag: 2024-09-14T11:19:25.547 INFO:tasks.workunit.client.0.smithi007.stdout: lockers: 2024-09-14T11:19:25.547 INFO:tasks.workunit.client.0.smithi007.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.7:0/2200258398 cookie= 2024-09-14T11:19:25.549 INFO:tasks.workunit.client.0.smithi007.stdout:lock: mylock 2024-09-14T11:19:25.549 INFO:tasks.workunit.client.0.smithi007.stdout: lock_type: exclusive 2024-09-14T11:19:25.549 INFO:tasks.workunit.client.0.smithi007.stdout: tag: new_tag 2024-09-14T11:19:25.549 INFO:tasks.workunit.client.0.smithi007.stdout: lockers: 2024-09-14T11:19:25.549 INFO:tasks.workunit.client.0.smithi007.stdout: client.5030 expiration=0.000000 addr=v1:172.21.15.7:0/1946670114 cookie= 2024-09-14T11:19:26.313 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestMeta (3017 ms) 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:19:28.339 INFO:tasks.workunit.client.0.smithi007.stdout:lock: mylock 2024-09-14T11:19:28.339 INFO:tasks.workunit.client.0.smithi007.stdout: lock_type: exclusive 2024-09-14T11:19:28.339 INFO:tasks.workunit.client.0.smithi007.stdout: tag: 2024-09-14T11:19:28.339 INFO:tasks.workunit.client.0.smithi007.stdout: lockers: 2024-09-14T11:19:28.342 INFO:tasks.workunit.client.0.smithi007.stdout:lock: mylock 2024-09-14T11:19:28.342 INFO:tasks.workunit.client.0.smithi007.stdout: lock_type: shared 2024-09-14T11:19:28.342 INFO:tasks.workunit.client.0.smithi007.stdout: tag: 2024-09-14T11:19:28.342 INFO:tasks.workunit.client.0.smithi007.stdout: lockers: 2024-09-14T11:19:28.342 INFO:tasks.workunit.client.0.smithi007.stdout: client.5142 expiration=0.000000 addr=v1:172.21.15.7:0/2361607530 cookie= 2024-09-14T11:19:28.342 INFO:tasks.workunit.client.0.smithi007.stdout: client.5142 expiration=0.000000 addr=v1:172.21.15.7:0/2361607530 cookie=new cookie 2024-09-14T11:19:29.324 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestCookie (3009 ms) 2024-09-14T11:19:29.325 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:19:32.349 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestMultipleLocks (3026 ms) 2024-09-14T11:19:32.349 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:19:40.381 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestLockDuration (8032 ms) 2024-09-14T11:19:40.381 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:19:43.400 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestAssertLocked (3019 ms) 2024-09-14T11:19:43.400 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:19:46.416 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestSetCookie (3017 ms) 2024-09-14T11:19:46.416 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:20:07.466 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestRenew (21049 ms) 2024-09-14T11:20:07.467 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:20:14.498 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7031 ms) 2024-09-14T11:20:14.498 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:20:22.529 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8032 ms) 2024-09-14T11:20:22.530 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:20:30.559 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8030 ms) 2024-09-14T11:20:30.559 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 11 tests from ClsLock (69986 ms total) 2024-09-14T11:20:30.560 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:20:30.560 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:30.560 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 11 tests from 1 test suite ran. (69986 ms total) 2024-09-14T11:20:30.560 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 11 tests. 2024-09-14T11:20:30.563 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:20:30.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:20:30.609 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:20:30.610 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:20:30.610 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:20:30.658 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:20:30.658 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:20:30.658 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:30.658 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 4 tests from cls_log 2024-09-14T11:20:30.658 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:20:33.574 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_log.test_log_add_same_time (2916 ms) 2024-09-14T11:20:33.575 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:20:36.595 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_log.test_log_add_different_time (3020 ms) 2024-09-14T11:20:36.595 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:20:39.609 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_log.trim_by_time (3013 ms) 2024-09-14T11:20:39.609 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:20:42.636 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_log.trim_by_marker (3028 ms) 2024-09-14T11:20:42.636 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 4 tests from cls_log (11977 ms total) 2024-09-14T11:20:42.636 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:20:42.636 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:42.636 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 4 tests from 1 test suite ran. (11977 ms total) 2024-09-14T11:20:42.636 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 4 tests. 2024-09-14T11:20:42.640 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:20:42.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:20:42.685 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:20:42.686 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:20:42.687 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:20:42.734 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:20:42.734 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:20:42.735 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:42.735 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:20:42.735 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:20:45.651 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_implicit (2916 ms) 2024-09-14T11:20:45.651 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:20:48.679 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3029 ms) 2024-09-14T11:20:48.680 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:20:57.726 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_put_snap (9045 ms) 2024-09-14T11:20:57.726 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:21:00.752 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_explicit (3028 ms) 2024-09-14T11:21:00.753 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:21:03.768 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.set (3013 ms) 2024-09-14T11:21:03.769 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:21:10.802 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_implicit_ec (7037 ms) 2024-09-14T11:21:10.803 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:21:17.854 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7051 ms) 2024-09-14T11:21:17.854 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:21:30.927 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_put_snap_ec (13073 ms) 2024-09-14T11:21:30.927 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:21:37.952 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.test_explicit_ec (7026 ms) 2024-09-14T11:21:37.953 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:21:44.977 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_refcount.set_ec (7024 ms) 2024-09-14T11:21:44.977 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 10 tests from cls_refcount (62242 ms total) 2024-09-14T11:21:44.978 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:21:44.978 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:44.978 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 10 tests from 1 test suite ran. (62242 ms total) 2024-09-14T11:21:44.978 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 10 tests. 2024-09-14T11:21:44.980 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:21:44.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:21:45.027 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:21:45.028 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:21:45.028 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:21:45.079 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:21:45.079 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:21:45.079 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:45.079 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:21:46.987 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:21:47.031 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_basic (44 ms) 2024-09-14T11:21:47.031 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:21:47.063 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (33 ms) 2024-09-14T11:21:47.063 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:21:47.111 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_remove_object (47 ms) 2024-09-14T11:21:47.111 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:21:48.611 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_suggest (1501 ms) 2024-09-14T11:21:48.611 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:21:48.624 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_suggest_complete (13 ms) 2024-09-14T11:21:48.624 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:21:48.645 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_list (21 ms) 2024-09-14T11:21:48.645 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:22:08.663 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_list_delimited (20017 ms) 2024-09-14T11:22:08.663 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:22:08.733 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.bi_list (70 ms) 2024-09-14T11:22:08.733 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:22:08.743 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.gc_set (11 ms) 2024-09-14T11:22:08.743 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:22:08.753 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-09-14T11:22:08.753 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:22:16.048 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.gc_defer (7293 ms) 2024-09-14T11:22:16.048 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:22:16.131 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.usage_basic (84 ms) 2024-09-14T11:22:16.131 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:22:16.132 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-14T11:22:16.132 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:22:16.228 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.usage_clear (95 ms) 2024-09-14T11:22:16.228 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:22:16.269 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.bi_log_trim (41 ms) 2024-09-14T11:22:16.269 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:22:16.282 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2024-09-14T11:22:16.282 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:22:16.296 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.reshardlog_list (15 ms) 2024-09-14T11:22:16.296 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:22:16.309 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw.reshardlog_num (12 ms) 2024-09-14T11:22:17.051 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 18 tests from cls_rgw (29322 ms total) 2024-09-14T11:22:17.052 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:22:17.052 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:17.052 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 18 tests from 1 test suite ran. (31973 ms total) 2024-09-14T11:22:17.052 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 18 tests. 2024-09-14T11:22:17.055 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:17.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:17.100 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:22:17.102 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:22:17.102 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:22:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:22:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:22:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:22:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:22:19.063 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.init (1913 ms) 2024-09-14T11:22:19.063 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:22:19.083 INFO:tasks.workunit.client.0.smithi007.stderr:[ ] list info tag = chain-0 2024-09-14T11:22:19.083 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (21 ms) 2024-09-14T11:22:19.083 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:22:19.090 INFO:tasks.workunit.client.0.smithi007.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:22:19.090 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-14T11:22:19.090 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:22:19.099 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-14T11:22:19.099 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:22:19.380 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (281 ms) 2024-09-14T11:22:19.380 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:22:19.389 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-14T11:22:19.389 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:22:19.398 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (10 ms) 2024-09-14T11:22:19.398 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:22:19.608 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (210 ms) 2024-09-14T11:22:19.608 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:22:20.077 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_gc.finalize (468 ms) 2024-09-14T11:22:20.077 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 9 tests from cls_rgw_gc (2927 ms total) 2024-09-14T11:22:20.077 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:22:20.077 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:20.078 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 9 tests from 1 test suite ran. (2927 ms total) 2024-09-14T11:22:20.078 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 9 tests. 2024-09-14T11:22:20.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:20.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:20.125 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:22:20.126 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:22:20.127 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:22:20.223 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:20.223 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:20.223 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:22:20.223 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:22.088 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:22:22.089 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:22:22.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.106+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=Q5I0LEWA5OUY type=del size=1621212 2024-09-14T11:22:22.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.107+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=CU6IQBWAIIR3 type=del size=2875852 2024-09-14T11:22:22.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.110+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~ZM7Y2JR7B2H1.0 size=1048576 2024-09-14T11:22:22.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.111+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~ZM7Y2JR7B2H1.1 size=476023 2024-09-14T11:22:22.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.111+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=ZM7Y2JR7B2H1 tag=T572617P3LR2 type=write size=2573175 2024-09-14T11:22:22.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.114+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~CB7VECCARP3N.0 size=1048576 2024-09-14T11:22:22.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.115+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~CB7VECCARP3N.1 size=362184 2024-09-14T11:22:22.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.115+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=CB7VECCARP3N tag=TN87QLBGHIEU type=write size=2459336 2024-09-14T11:22:22.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.116+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=SND3RG040ACE type=del size=2713491 2024-09-14T11:22:22.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.118+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=XRV0XIEW7CNS type=del size=1707139 2024-09-14T11:22:22.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.120+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=A9OQE27XJU2B type=del size=4121136 2024-09-14T11:22:22.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.122+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~B1W4PTZG41L3.0 size=1048576 2024-09-14T11:22:22.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.123+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~B1W4PTZG41L3.1 size=443988 2024-09-14T11:22:22.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.123+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=B1W4PTZG41L3 tag=FHSDWTGDFAIY type=write size=2541140 2024-09-14T11:22:22.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.125+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=13XPJZ8MGVY0 type=del size=2210092 2024-09-14T11:22:22.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.126+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=L95B6CUDO3N2 type=del size=2268681 2024-09-14T11:22:22.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.129+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~OXT92C0V393O.0 size=1048576 2024-09-14T11:22:22.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.130+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~OXT92C0V393O.1 size=1048576 2024-09-14T11:22:22.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.131+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~OXT92C0V393O.2 size=325093 2024-09-14T11:22:22.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.131+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=OXT92C0V393O tag=IZR83204CFYM type=write size=3470821 2024-09-14T11:22:22.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.133+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=FZ64FNP8FZ12 type=del size=3484486 2024-09-14T11:22:22.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.134+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=64Z3D13KDVRL type=del size=3676184 2024-09-14T11:22:22.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.135+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=UGPJKBD2D4E1 type=del size=4049462 2024-09-14T11:22:22.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.137+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=LHW1E512YOYY type=del size=1516803 2024-09-14T11:22:22.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.140+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~G9YLY8WH7UMQ.0 size=1048576 2024-09-14T11:22:22.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.141+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~G9YLY8WH7UMQ.1 size=856345 2024-09-14T11:22:22.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.141+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=G9YLY8WH7UMQ tag=931P1MND6IHW type=write size=2953497 2024-09-14T11:22:22.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.143+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=Q5I0LEWA5OUY type=del 2024-09-14T11:22:22.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.144+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=67VF7Z0MSBGH type=del size=1780708 2024-09-14T11:22:22.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.146+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=CU6IQBWAIIR3 type=del 2024-09-14T11:22:22.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.148+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~HT678938OP6B.0 size=1048576 2024-09-14T11:22:22.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.149+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~HT678938OP6B.1 size=1048576 2024-09-14T11:22:22.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.151+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~HT678938OP6B.2 size=717422 2024-09-14T11:22:22.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.151+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=HT678938OP6B tag=4WCI1X0COZ0Q type=write size=3863150 2024-09-14T11:22:22.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.152+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~ZM7Y2JR7B2H1.0 size=1048576 2024-09-14T11:22:22.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.153+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~ZM7Y2JR7B2H1.1 size=476023 2024-09-14T11:22:22.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.155+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=ZM7Y2JR7B2H1 tag=T572617P3LR2 type=write size=2573175 2024-09-14T11:22:22.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.158+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~IBEDFDEGW37S.0 size=1048576 2024-09-14T11:22:22.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.159+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~IBEDFDEGW37S.1 size=1048576 2024-09-14T11:22:22.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.160+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~IBEDFDEGW37S.2 size=542057 2024-09-14T11:22:22.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.160+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=IBEDFDEGW37S tag=U7M0XXGSSJXQ type=write size=3687785 2024-09-14T11:22:22.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.161+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~CB7VECCARP3N.0 size=1048576 2024-09-14T11:22:22.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.162+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~CB7VECCARP3N.1 size=362184 2024-09-14T11:22:22.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.164+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=CB7VECCARP3N tag=TN87QLBGHIEU type=write size=2459336 2024-09-14T11:22:22.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.166+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=44W95POZW3S3 type=del size=3879408 2024-09-14T11:22:22.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.167+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=SND3RG040ACE type=del 2024-09-14T11:22:22.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.170+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~Y29TNTPJ21RA.0 size=1048576 2024-09-14T11:22:22.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.171+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~Y29TNTPJ21RA.1 size=971840 2024-09-14T11:22:22.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.171+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=Y29TNTPJ21RA tag=TH4BMU9UHACT type=write size=3068992 2024-09-14T11:22:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.172+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=XRV0XIEW7CNS type=del 2024-09-14T11:22:22.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.173+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=ZE1D5F3QO1GA type=write size=470946 2024-09-14T11:22:22.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.175+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=A9OQE27XJU2B type=del 2024-09-14T11:22:22.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.177+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~IQ2028GQRYOM.0 size=1048576 2024-09-14T11:22:22.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.178+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~IQ2028GQRYOM.1 size=1048576 2024-09-14T11:22:22.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.179+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~IQ2028GQRYOM.2 size=845292 2024-09-14T11:22:22.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.179+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=IQ2028GQRYOM tag=XQOEIPVJ39I5 type=write size=3991020 2024-09-14T11:22:22.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.181+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~B1W4PTZG41L3.0 size=1048576 2024-09-14T11:22:22.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.182+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~B1W4PTZG41L3.1 size=443988 2024-09-14T11:22:22.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.184+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=B1W4PTZG41L3 tag=FHSDWTGDFAIY type=write size=2541140 2024-09-14T11:22:22.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.185+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=2V2XOBQ0QNTZ type=del size=124297 2024-09-14T11:22:22.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.186+0000 7f43cc561780 1 < canceled operation key=IFHWMI5YO5L5 tag=13XPJZ8MGVY0 type=del size=2210092 2024-09-14T11:22:22.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.189+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~YZLYP5L2U1DB.0 size=732328 2024-09-14T11:22:22.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.189+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=YZLYP5L2U1DB tag=FVBGFNRD6Z1N type=write size=1780904 2024-09-14T11:22:22.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.191+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=L95B6CUDO3N2 type=del 2024-09-14T11:22:22.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.192+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=UCWV12J98O9J type=del size=3165488 2024-09-14T11:22:22.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.193+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~OXT92C0V393O.0 size=1048576 2024-09-14T11:22:22.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.194+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~OXT92C0V393O.1 size=1048576 2024-09-14T11:22:22.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.195+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~OXT92C0V393O.2 size=325093 2024-09-14T11:22:22.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.197+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=OXT92C0V393O tag=IZR83204CFYM type=write size=3470821 2024-09-14T11:22:22.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.199+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=1AWQT8K6BZP4 type=del size=2384020 2024-09-14T11:22:22.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.200+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=FZ64FNP8FZ12 type=del 2024-09-14T11:22:22.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.202+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~DJW4J4DBXADA.0 size=662974 2024-09-14T11:22:22.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.202+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=DJW4J4DBXADA tag=1RK6KUQ56679 type=write size=1711550 2024-09-14T11:22:22.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.203+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=64Z3D13KDVRL type=del 2024-09-14T11:22:22.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.206+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~OB19TZ3AXHIT.0 size=135494 2024-09-14T11:22:22.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.206+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=OB19TZ3AXHIT tag=XBR5Q633W758 type=write size=1184070 2024-09-14T11:22:22.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.207+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=UGPJKBD2D4E1 type=del 2024-09-14T11:22:22.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.209+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=L6ADHTLZRB2I type=del size=788441 2024-09-14T11:22:22.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.211+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=LHW1E512YOYY type=del size=1516803 2024-09-14T11:22:22.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.213+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~JYDJAB0717VD.0 size=1048576 2024-09-14T11:22:22.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.214+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~JYDJAB0717VD.1 size=1048576 2024-09-14T11:22:22.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.215+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~JYDJAB0717VD.2 size=582528 2024-09-14T11:22:22.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.215+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=JYDJAB0717VD tag=34M5KR9W0EWM type=write size=3728256 2024-09-14T11:22:22.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.217+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~G9YLY8WH7UMQ.0 size=1048576 2024-09-14T11:22:22.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.218+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~G9YLY8WH7UMQ.1 size=856345 2024-09-14T11:22:22.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.220+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=G9YLY8WH7UMQ tag=931P1MND6IHW type=write size=2953497 2024-09-14T11:22:22.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.221+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=04KF8E2ZUEJK type=del size=1162081 2024-09-14T11:22:22.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.222+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=67VF7Z0MSBGH type=del 2024-09-14T11:22:22.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.223+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=JLANMIG21YR6 type=del size=3871770 2024-09-14T11:22:22.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.225+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~HT678938OP6B.0 size=1048576 2024-09-14T11:22:22.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.226+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~HT678938OP6B.1 size=1048576 2024-09-14T11:22:22.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.227+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~HT678938OP6B.2 size=717422 2024-09-14T11:22:22.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.229+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=HT678938OP6B tag=4WCI1X0COZ0Q type=write size=3863150 2024-09-14T11:22:22.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.231+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~JCNQ1R577C1S.0 size=1006352 2024-09-14T11:22:22.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.231+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=JCNQ1R577C1S tag=AJVLD5CFHJ4D type=write size=2054928 2024-09-14T11:22:22.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.232+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~IBEDFDEGW37S.0 size=1048576 2024-09-14T11:22:22.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.233+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~IBEDFDEGW37S.1 size=1048576 2024-09-14T11:22:22.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.234+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~IBEDFDEGW37S.2 size=542057 2024-09-14T11:22:22.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.236+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=IBEDFDEGW37S tag=U7M0XXGSSJXQ type=write size=3687785 2024-09-14T11:22:22.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.237+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=RHCIVJG90264 type=del size=2020131 2024-09-14T11:22:22.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.239+0000 7f43cc561780 1 < canceled operation key=W679WIFVPVOH tag=44W95POZW3S3 type=del size=3879408 2024-09-14T11:22:22.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.242+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~QP47P1RZO7KI.0 size=227682 2024-09-14T11:22:22.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.242+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=QP47P1RZO7KI tag=6C61YMOYK947 type=write size=1276258 2024-09-14T11:22:22.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.243+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~Y29TNTPJ21RA.0 size=1048576 2024-09-14T11:22:22.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.244+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~Y29TNTPJ21RA.1 size=971840 2024-09-14T11:22:22.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.246+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=Y29TNTPJ21RA tag=TH4BMU9UHACT type=write size=3068992 2024-09-14T11:22:22.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.248+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=KG2KO7V0BFVK type=del size=3076968 2024-09-14T11:22:22.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.249+0000 7f43cc561780 1 < completed write operation key=3YHEZHW0RS1W tag=ZE1D5F3QO1GA type=write size=470946 2024-09-14T11:22:22.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.250+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=65F5A25WI1GX type=del size=618700 2024-09-14T11:22:22.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.251+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~IQ2028GQRYOM.0 size=1048576 2024-09-14T11:22:22.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.252+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~IQ2028GQRYOM.1 size=1048576 2024-09-14T11:22:22.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.254+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~IQ2028GQRYOM.2 size=845292 2024-09-14T11:22:22.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.256+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=IQ2028GQRYOM tag=XQOEIPVJ39I5 type=write size=3991020 2024-09-14T11:22:22.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.259+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~38RAHWT0QH4J.0 size=240511 2024-09-14T11:22:22.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.259+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=38RAHWT0QH4J tag=3A13D5BI7LWD type=write size=1289087 2024-09-14T11:22:22.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.260+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=2V2XOBQ0QNTZ type=del 2024-09-14T11:22:22.260 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.261+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=TGH93PCNPBXR type=write size=40940 2024-09-14T11:22:22.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.263+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~YZLYP5L2U1DB.0 size=732328 2024-09-14T11:22:22.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.265+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=YZLYP5L2U1DB tag=FVBGFNRD6Z1N type=write size=1780904 2024-09-14T11:22:22.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.267+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=954KRILMR9WG type=del size=1930854 2024-09-14T11:22:22.267 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.268+0000 7f43cc561780 1 < canceled operation key=A1B2LIZIPET3 tag=UCWV12J98O9J type=del size=3165488 2024-09-14T11:22:22.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.270+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~EV4XBR6EA2AD.0 size=963654 2024-09-14T11:22:22.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.271+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=EV4XBR6EA2AD tag=NL7K7TSLKW6S type=write size=2012230 2024-09-14T11:22:22.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.272+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=1AWQT8K6BZP4 type=del 2024-09-14T11:22:22.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.274+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~0OUBFHU7IWAL.0 size=1048576 2024-09-14T11:22:22.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.275+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~0OUBFHU7IWAL.1 size=100612 2024-09-14T11:22:22.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.275+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=0OUBFHU7IWAL tag=I4ZCHFEVNI8O type=write size=2197764 2024-09-14T11:22:22.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.277+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~DJW4J4DBXADA.0 size=662974 2024-09-14T11:22:22.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.279+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=DJW4J4DBXADA tag=1RK6KUQ56679 type=write size=1711550 2024-09-14T11:22:22.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.280+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=AOTHTTU7IQRE type=del size=560581 2024-09-14T11:22:22.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.281+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~OB19TZ3AXHIT.0 size=135494 2024-09-14T11:22:22.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.283+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=OB19TZ3AXHIT tag=XBR5Q633W758 type=write size=1184070 2024-09-14T11:22:22.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.285+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~MYVHPFCTJXFQ.0 size=1048576 2024-09-14T11:22:22.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.286+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~MYVHPFCTJXFQ.1 size=258277 2024-09-14T11:22:22.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.286+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=MYVHPFCTJXFQ tag=PLI67P29HO5O type=write size=2355429 2024-09-14T11:22:22.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.287+0000 7f43cc561780 1 < canceled operation key=END3SHHS0FSA tag=L6ADHTLZRB2I type=del size=788441 2024-09-14T11:22:22.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.288+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=9JMMQ4YKIKSR type=del size=988017 2024-09-14T11:22:22.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.290+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~JYDJAB0717VD.0 size=1048576 2024-09-14T11:22:22.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.291+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~JYDJAB0717VD.1 size=1048576 2024-09-14T11:22:22.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.291+0000 7f43cc561780 1 < canceled part key=_multipart_E6FDCACWGA2Y.2~JYDJAB0717VD.2 size=582528 2024-09-14T11:22:22.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.293+0000 7f43cc561780 1 < canceled multipart upload key=E6FDCACWGA2Y upload=JYDJAB0717VD tag=34M5KR9W0EWM type=write size=3728256 2024-09-14T11:22:22.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.294+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=M0VSSS8LO6ZE type=del size=670734 2024-09-14T11:22:22.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.295+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=04KF8E2ZUEJK type=del 2024-09-14T11:22:22.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.296+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=LWR6EC3I1HGZ type=del size=2366324 2024-09-14T11:22:22.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.297+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=JLANMIG21YR6 type=del 2024-09-14T11:22:22.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.298+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=FAR94XAA81KP type=del size=137819 2024-09-14T11:22:22.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.300+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~JCNQ1R577C1S.0 size=1006352 2024-09-14T11:22:22.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.301+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=JCNQ1R577C1S tag=AJVLD5CFHJ4D type=write size=2054928 2024-09-14T11:22:22.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.303+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=4LBSF22BL0N1 type=write size=726317 2024-09-14T11:22:22.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.304+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=RHCIVJG90264 type=del 2024-09-14T11:22:22.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.305+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=VRMP2M83ADGH type=write size=969174 2024-09-14T11:22:22.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.306+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~QP47P1RZO7KI.0 size=227682 2024-09-14T11:22:22.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.308+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=QP47P1RZO7KI tag=6C61YMOYK947 type=write size=1276258 2024-09-14T11:22:22.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.309+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=3RXXVOA4TA7A type=del size=4173124 2024-09-14T11:22:22.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.310+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=KG2KO7V0BFVK type=del 2024-09-14T11:22:22.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.312+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=E99A4LSJKTNL type=del size=2897459 2024-09-14T11:22:22.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.313+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=65F5A25WI1GX type=del 2024-09-14T11:22:22.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.315+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~UXD7Q206UXV5.0 size=1048576 2024-09-14T11:22:22.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.316+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~UXD7Q206UXV5.1 size=1048576 2024-09-14T11:22:22.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.317+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~UXD7Q206UXV5.2 size=514447 2024-09-14T11:22:22.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.317+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=UXD7Q206UXV5 tag=6IV4TVKKN1Z0 type=write size=3660175 2024-09-14T11:22:22.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.317+0000 7f43cc561780 1 < canceled part key=_multipart_D8EBH4NWN7SK.2~38RAHWT0QH4J.0 size=240511 2024-09-14T11:22:22.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.319+0000 7f43cc561780 1 < canceled multipart upload key=D8EBH4NWN7SK upload=38RAHWT0QH4J tag=3A13D5BI7LWD type=write size=1289087 2024-09-14T11:22:22.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.320+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=6C0FC0YOH06A type=del size=1800470 2024-09-14T11:22:22.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.322+0000 7f43cc561780 1 < completed write operation key=W679WIFVPVOH tag=TGH93PCNPBXR type=write size=40940 2024-09-14T11:22:22.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.323+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=LIOEPAAO6LXJ type=del size=2619918 2024-09-14T11:22:22.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.324+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=954KRILMR9WG type=del 2024-09-14T11:22:22.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.325+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=7NXAO9EAHYL6 type=del size=1358871 2024-09-14T11:22:22.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.327+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~EV4XBR6EA2AD.0 size=963654 2024-09-14T11:22:22.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.329+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=EV4XBR6EA2AD tag=NL7K7TSLKW6S type=write size=2012230 2024-09-14T11:22:22.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.331+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H7EBUBD5B94L.0 size=1048576 2024-09-14T11:22:22.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.332+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H7EBUBD5B94L.1 size=1048576 2024-09-14T11:22:22.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.333+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H7EBUBD5B94L.2 size=734369 2024-09-14T11:22:22.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.333+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=H7EBUBD5B94L tag=NM1X55JL07DZ type=write size=3880097 2024-09-14T11:22:22.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.335+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~0OUBFHU7IWAL.0 size=1048576 2024-09-14T11:22:22.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.336+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~0OUBFHU7IWAL.1 size=100612 2024-09-14T11:22:22.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.339+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=0OUBFHU7IWAL tag=I4ZCHFEVNI8O type=write size=2197764 2024-09-14T11:22:22.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.341+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~MQYYVNUT574M.0 size=1048576 2024-09-14T11:22:22.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.342+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~MQYYVNUT574M.1 size=266332 2024-09-14T11:22:22.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.342+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=MQYYVNUT574M tag=WCTW7QX9VG8M type=write size=2363484 2024-09-14T11:22:22.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.344+0000 7f43cc561780 1 < suggested remove operation key=FISMBWPDPCTA tag=AOTHTTU7IQRE type=del 2024-09-14T11:22:22.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.345+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=E1GZD8VIZH3A type=del size=4038108 2024-09-14T11:22:22.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.347+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~MYVHPFCTJXFQ.0 size=1048576 2024-09-14T11:22:22.347 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.348+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~MYVHPFCTJXFQ.1 size=258277 2024-09-14T11:22:22.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.351+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=MYVHPFCTJXFQ tag=PLI67P29HO5O type=write size=2355429 2024-09-14T11:22:22.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.353+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~MS170G1HGODV.0 size=843961 2024-09-14T11:22:22.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.353+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=MS170G1HGODV tag=R4QH2I2MGMPM type=write size=1892537 2024-09-14T11:22:22.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.354+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=9JMMQ4YKIKSR type=del 2024-09-14T11:22:22.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.357+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~4DRTEII7COVJ.0 size=1048576 2024-09-14T11:22:22.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.359+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~4DRTEII7COVJ.1 size=273152 2024-09-14T11:22:22.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.359+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=4DRTEII7COVJ tag=FK2VIKYASW0K type=write size=2370304 2024-09-14T11:22:22.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.360+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=M0VSSS8LO6ZE type=del 2024-09-14T11:22:22.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.362+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=4U5CQCW1GHXN type=del size=922812 2024-09-14T11:22:22.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.363+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=LWR6EC3I1HGZ type=del 2024-09-14T11:22:22.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.365+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~10QH5F3FQL14.0 size=1048576 2024-09-14T11:22:22.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.366+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~10QH5F3FQL14.1 size=251537 2024-09-14T11:22:22.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.366+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=10QH5F3FQL14 tag=99NQQ84KUNVT type=write size=2348689 2024-09-14T11:22:22.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.367+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=FAR94XAA81KP type=del size=137819: (22) Invalid argument 2024-09-14T11:22:22.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.368+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=NE3W004FLLC5 type=del size=472063 2024-09-14T11:22:22.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.369+0000 7f43cc561780 1 < completed write operation key=9XIAGZKIUBGH tag=4LBSF22BL0N1 type=write size=726317 2024-09-14T11:22:22.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.371+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~0J8E0E2BPQMV.0 size=1048576 2024-09-14T11:22:22.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.372+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~0J8E0E2BPQMV.1 size=1048576 2024-09-14T11:22:22.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.373+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~0J8E0E2BPQMV.2 size=969334 2024-09-14T11:22:22.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.373+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=0J8E0E2BPQMV tag=KP5SYODHWI60 type=write size=4115062 2024-09-14T11:22:22.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.376+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=VRMP2M83ADGH type=write 2024-09-14T11:22:22.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.377+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=1YDUV0D2XNYB type=write size=334007 2024-09-14T11:22:22.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.378+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=3RXXVOA4TA7A type=del size=4173124: (22) Invalid argument 2024-09-14T11:22:22.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.381+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~FADYM0L9GCF1.0 size=68924 2024-09-14T11:22:22.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.381+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=FADYM0L9GCF1 tag=WIWJHH41QZ0W type=write size=1117500 2024-09-14T11:22:22.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.383+0000 7f43cc561780 1 < suggested update operation key=MD14RGOQY0LK tag=E99A4LSJKTNL type=del size=2897459 2024-09-14T11:22:22.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.384+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=2F1B3CMHNQNP type=del size=3710250 2024-09-14T11:22:22.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.386+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~UXD7Q206UXV5.0 size=1048576 2024-09-14T11:22:22.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.386+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~UXD7Q206UXV5.1 size=1048576 2024-09-14T11:22:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.387+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~UXD7Q206UXV5.2 size=514447 2024-09-14T11:22:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.389+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=UXD7Q206UXV5 tag=6IV4TVKKN1Z0 type=write size=3660175 2024-09-14T11:22:22.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.391+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=89X58332UDN1 type=del size=2958548 2024-09-14T11:22:22.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.392+0000 7f43cc561780 1 < canceled operation key=OV4ATW747PY4 tag=6C0FC0YOH06A type=del size=1800470 2024-09-14T11:22:22.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.393+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=P8XUNGUVN81R type=write size=540323 2024-09-14T11:22:22.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.394+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=LIOEPAAO6LXJ type=del 2024-09-14T11:22:22.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.397+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~8IAWK35S50YS.0 size=1048576 2024-09-14T11:22:22.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.398+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~8IAWK35S50YS.1 size=642527 2024-09-14T11:22:22.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.398+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=8IAWK35S50YS tag=9GXSJ27IRYDL type=write size=2739679 2024-09-14T11:22:22.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.399+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=7NXAO9EAHYL6 type=del 2024-09-14T11:22:22.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.401+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~PKKDGZ10NMS7.0 size=1048576 2024-09-14T11:22:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.402+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~PKKDGZ10NMS7.1 size=1048576 2024-09-14T11:22:22.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.403+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~PKKDGZ10NMS7.2 size=101417 2024-09-14T11:22:22.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.403+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=PKKDGZ10NMS7 tag=3N3BY25GCIME type=write size=3247145 2024-09-14T11:22:22.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.404+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H7EBUBD5B94L.0 size=1048576 2024-09-14T11:22:22.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.405+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H7EBUBD5B94L.1 size=1048576 2024-09-14T11:22:22.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.406+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H7EBUBD5B94L.2 size=734369 2024-09-14T11:22:22.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.408+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=H7EBUBD5B94L tag=NM1X55JL07DZ type=write size=3880097 2024-09-14T11:22:22.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.409+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=YNIAY0MIVPF9 type=write size=369791 2024-09-14T11:22:22.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.410+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~MQYYVNUT574M.0 size=1048576 2024-09-14T11:22:22.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.411+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~MQYYVNUT574M.1 size=266332 2024-09-14T11:22:22.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.413+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=MQYYVNUT574M tag=WCTW7QX9VG8M type=write size=2363484 2024-09-14T11:22:22.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.415+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~17P79AMQFDM5.0 size=1048576 2024-09-14T11:22:22.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.416+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~17P79AMQFDM5.1 size=616635 2024-09-14T11:22:22.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.416+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=17P79AMQFDM5 tag=YBMQAMRLXOQQ type=write size=2713787 2024-09-14T11:22:22.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.419+0000 7f43cc561780 1 < suggested update operation key=OV4ATW747PY4 tag=E1GZD8VIZH3A type=del size=4038108 2024-09-14T11:22:22.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.421+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PBF8WQ54492M.0 size=1048576 2024-09-14T11:22:22.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.422+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PBF8WQ54492M.1 size=296879 2024-09-14T11:22:22.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.422+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=PBF8WQ54492M tag=GAA4RNOFEYLL type=write size=2394031 2024-09-14T11:22:22.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.423+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~MS170G1HGODV.0 size=843961 2024-09-14T11:22:22.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.425+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=MS170G1HGODV tag=R4QH2I2MGMPM type=write size=1892537 2024-09-14T11:22:22.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.427+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~90T7KVOTHWUH.0 size=1048576 2024-09-14T11:22:22.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.428+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~90T7KVOTHWUH.1 size=177012 2024-09-14T11:22:22.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.428+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=90T7KVOTHWUH tag=UIUH4J3VKBD4 type=write size=2274164 2024-09-14T11:22:22.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.428+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~4DRTEII7COVJ.0 size=1048576 2024-09-14T11:22:22.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.429+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~4DRTEII7COVJ.1 size=273152 2024-09-14T11:22:22.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.431+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=4DRTEII7COVJ tag=FK2VIKYASW0K type=write size=2370304 2024-09-14T11:22:22.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.433+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~UL2W0J4M209F.0 size=1048576 2024-09-14T11:22:22.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.434+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~UL2W0J4M209F.1 size=1048576 2024-09-14T11:22:22.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.435+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~UL2W0J4M209F.2 size=506665 2024-09-14T11:22:22.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.435+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=UL2W0J4M209F tag=JFS2HUKME2TJ type=write size=3652393 2024-09-14T11:22:22.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.436+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=4U5CQCW1GHXN type=del 2024-09-14T11:22:22.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.437+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=3DAXA7NOOLJW type=del size=1566594 2024-09-14T11:22:22.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.438+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~10QH5F3FQL14.0 size=1048576 2024-09-14T11:22:22.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.439+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~10QH5F3FQL14.1 size=251537 2024-09-14T11:22:22.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.441+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=10QH5F3FQL14 tag=99NQQ84KUNVT type=write size=2348689 2024-09-14T11:22:22.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.444+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~G8BZSTS7XUE2.0 size=1048576 2024-09-14T11:22:22.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.444+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~G8BZSTS7XUE2.1 size=936656 2024-09-14T11:22:22.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.444+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=G8BZSTS7XUE2 tag=R5OCEJW1MM7L type=write size=3033808 2024-09-14T11:22:22.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.446+0000 7f43cc561780 -1 < failed to complete operation key=OV4ATW747PY4 tag=NE3W004FLLC5 type=del size=472063: (22) Invalid argument 2024-09-14T11:22:22.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.447+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=PVLX0QMLTF75 type=del size=727002 2024-09-14T11:22:22.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.448+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~0J8E0E2BPQMV.0 size=1048576 2024-09-14T11:22:22.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.449+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~0J8E0E2BPQMV.1 size=1048576 2024-09-14T11:22:22.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.449+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~0J8E0E2BPQMV.2 size=969334 2024-09-14T11:22:22.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.451+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=0J8E0E2BPQMV tag=KP5SYODHWI60 type=write size=4115062 2024-09-14T11:22:22.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.452+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=559H8DH4R0TC type=del size=1924244 2024-09-14T11:22:22.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.454+0000 7f43cc561780 1 < completed write operation key=AY7JGVM96MO7 tag=1YDUV0D2XNYB type=write size=334007 2024-09-14T11:22:22.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.455+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=H3UK6YUO4J2W type=write size=1026582 2024-09-14T11:22:22.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.456+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~FADYM0L9GCF1.0 size=68924 2024-09-14T11:22:22.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.458+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=FADYM0L9GCF1 tag=WIWJHH41QZ0W type=write size=1117500 2024-09-14T11:22:22.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.460+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~8QNNGYF1GD17.0 size=806335 2024-09-14T11:22:22.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.460+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=8QNNGYF1GD17 tag=33XDR3TU35G5 type=write size=1854911 2024-09-14T11:22:22.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.462+0000 7f43cc561780 1 < suggested remove operation key=80ZYEEE1EE78 tag=2F1B3CMHNQNP type=del 2024-09-14T11:22:22.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.463+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=UVRCU67RP6OX type=del size=1884905 2024-09-14T11:22:22.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.466+0000 7f43cc561780 1 < suggested remove operation key=FISMBWPDPCTA tag=89X58332UDN1 type=del 2024-09-14T11:22:22.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.467+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=GSCOKX3D3DTN type=write size=18356 2024-09-14T11:22:22.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.469+0000 7f43cc561780 1 < completed write operation key=9XIAGZKIUBGH tag=P8XUNGUVN81R type=write size=540323 2024-09-14T11:22:22.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.471+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~1DXSA1AJCJZR.0 size=448726 2024-09-14T11:22:22.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.471+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=1DXSA1AJCJZR tag=BDM5JZK2NQQE type=write size=1497302 2024-09-14T11:22:22.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.472+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~8IAWK35S50YS.0 size=1048576 2024-09-14T11:22:22.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.473+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~8IAWK35S50YS.1 size=642527 2024-09-14T11:22:22.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.475+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=8IAWK35S50YS tag=9GXSJ27IRYDL type=write size=2739679 2024-09-14T11:22:22.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.476+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=67HRHLD2PCAA type=del size=243895 2024-09-14T11:22:22.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.477+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~PKKDGZ10NMS7.0 size=1048576 2024-09-14T11:22:22.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.478+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~PKKDGZ10NMS7.1 size=1048576 2024-09-14T11:22:22.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.479+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~PKKDGZ10NMS7.2 size=101417 2024-09-14T11:22:22.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.481+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=PKKDGZ10NMS7 tag=3N3BY25GCIME type=write size=3247145 2024-09-14T11:22:22.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.482+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=AG9T2ORIW0T4 type=write size=15133 2024-09-14T11:22:22.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.483+0000 7f43cc561780 -1 < failed to complete operation key=OV4ATW747PY4 tag=YNIAY0MIVPF9 type=write size=369791: (22) Invalid argument 2024-09-14T11:22:22.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.484+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=DYXG9PAHXG48 type=del size=294183 2024-09-14T11:22:22.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.486+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~17P79AMQFDM5.0 size=1048576 2024-09-14T11:22:22.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.487+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~17P79AMQFDM5.1 size=616635 2024-09-14T11:22:22.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.489+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=17P79AMQFDM5 tag=YBMQAMRLXOQQ type=write size=2713787 2024-09-14T11:22:22.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.490+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=K4VP57P171W1 type=write size=503622 2024-09-14T11:22:22.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.491+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PBF8WQ54492M.0 size=1048576 2024-09-14T11:22:22.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.492+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PBF8WQ54492M.1 size=296879 2024-09-14T11:22:22.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.494+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=PBF8WQ54492M tag=GAA4RNOFEYLL type=write size=2394031 2024-09-14T11:22:22.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.496+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~FPEN3ZBTZ1BN.0 size=1048576 2024-09-14T11:22:22.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.497+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~FPEN3ZBTZ1BN.1 size=1027536 2024-09-14T11:22:22.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.497+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=FPEN3ZBTZ1BN tag=G02R3VBZMRKN type=write size=3124688 2024-09-14T11:22:22.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.499+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~90T7KVOTHWUH.0 size=1048576 2024-09-14T11:22:22.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.499+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~90T7KVOTHWUH.1 size=177012 2024-09-14T11:22:22.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.502+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=90T7KVOTHWUH tag=UIUH4J3VKBD4 type=write size=2274164 2024-09-14T11:22:22.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.504+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~8Z4N18C5KKYB.0 size=1003381 2024-09-14T11:22:22.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.504+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=8Z4N18C5KKYB tag=VBZFYU5UYQCI type=write size=2051957 2024-09-14T11:22:22.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.505+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~UL2W0J4M209F.0 size=1048576 2024-09-14T11:22:22.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.506+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~UL2W0J4M209F.1 size=1048576 2024-09-14T11:22:22.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.507+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~UL2W0J4M209F.2 size=506665 2024-09-14T11:22:22.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.509+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=UL2W0J4M209F tag=JFS2HUKME2TJ type=write size=3652393 2024-09-14T11:22:22.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.512+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~M3VBN3ZPG3UN.0 size=973659 2024-09-14T11:22:22.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.512+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=M3VBN3ZPG3UN tag=TFWGI602RYCH type=write size=2022235 2024-09-14T11:22:22.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.513+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=3DAXA7NOOLJW type=del size=1566594: (22) Invalid argument 2024-09-14T11:22:22.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.515+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~YK5TBO0NYNAY.0 size=1048576 2024-09-14T11:22:22.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.516+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~YK5TBO0NYNAY.1 size=1048576 2024-09-14T11:22:22.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.517+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~YK5TBO0NYNAY.2 size=396290 2024-09-14T11:22:22.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.517+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=YK5TBO0NYNAY tag=8PHN2MA2UX0R type=write size=3542018 2024-09-14T11:22:22.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.518+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~G8BZSTS7XUE2.0 size=1048576 2024-09-14T11:22:22.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.519+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~G8BZSTS7XUE2.1 size=936656 2024-09-14T11:22:22.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.521+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=G8BZSTS7XUE2 tag=R5OCEJW1MM7L type=write size=3033808 2024-09-14T11:22:22.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.523+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=XCJZ5MAX8C2X type=del size=2464025 2024-09-14T11:22:22.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.524+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=PVLX0QMLTF75 type=del 2024-09-14T11:22:22.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.526+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~FD30SUYHXADF.0 size=1048576 2024-09-14T11:22:22.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.527+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~FD30SUYHXADF.1 size=1048576 2024-09-14T11:22:22.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.528+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~FD30SUYHXADF.2 size=3181 2024-09-14T11:22:22.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.528+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=FD30SUYHXADF tag=34TLD54EW9LG type=write size=3148909 2024-09-14T11:22:22.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.530+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=559H8DH4R0TC type=del 2024-09-14T11:22:22.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.531+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=EKYYOCY06FTO type=del size=2666319 2024-09-14T11:22:22.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.532+0000 7f43cc561780 1 < completed write operation key=3YHEZHW0RS1W tag=H3UK6YUO4J2W type=write size=1026582 2024-09-14T11:22:22.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.534+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~PKC90D8549DY.0 size=967510 2024-09-14T11:22:22.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.534+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=PKC90D8549DY tag=E7LWITTCN4K5 type=write size=2016086 2024-09-14T11:22:22.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.536+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~8QNNGYF1GD17.0 size=806335 2024-09-14T11:22:22.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.538+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=8QNNGYF1GD17 tag=33XDR3TU35G5 type=write size=1854911 2024-09-14T11:22:22.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.539+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=4PRC5I0FFRXZ type=del size=2273112 2024-09-14T11:22:22.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.540+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=UVRCU67RP6OX type=del 2024-09-14T11:22:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.541+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=Q9VHU3OZWCSV type=del size=1219670 2024-09-14T11:22:22.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.543+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=GSCOKX3D3DTN type=write size=18356 2024-09-14T11:22:22.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.545+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~VNLKBPZT3FY3.0 size=1048576 2024-09-14T11:22:22.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.546+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~VNLKBPZT3FY3.1 size=318608 2024-09-14T11:22:22.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.546+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=VNLKBPZT3FY3 tag=V562B10ITBP0 type=write size=2415760 2024-09-14T11:22:22.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.547+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~1DXSA1AJCJZR.0 size=448726 2024-09-14T11:22:22.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.549+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=1DXSA1AJCJZR tag=BDM5JZK2NQQE type=write size=1497302 2024-09-14T11:22:22.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.550+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=C64IIYTMD13S type=del size=1686064 2024-09-14T11:22:22.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.551+0000 7f43cc561780 1 < canceled operation key=OV4ATW747PY4 tag=67HRHLD2PCAA type=del size=243895 2024-09-14T11:22:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.553+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=224IJ80HCCTU type=del size=2353508 2024-09-14T11:22:22.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.554+0000 7f43cc561780 1 < completed write operation key=AY7JGVM96MO7 tag=AG9T2ORIW0T4 type=write size=15133 2024-09-14T11:22:22.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.555+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=TTOV6UEVID0G type=del size=2696147 2024-09-14T11:22:22.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.556+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=DYXG9PAHXG48 type=del 2024-09-14T11:22:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.557+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=JCIVXZDCNEQB type=write size=543723 2024-09-14T11:22:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.559+0000 7f43cc561780 1 < completed write operation key=IFHWMI5YO5L5 tag=K4VP57P171W1 type=write size=503622 2024-09-14T11:22:22.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.560+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=VWRTZB0HLN98 type=del size=2967997 2024-09-14T11:22:22.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.561+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~FPEN3ZBTZ1BN.0 size=1048576 2024-09-14T11:22:22.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.562+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~FPEN3ZBTZ1BN.1 size=1027536 2024-09-14T11:22:22.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.564+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=FPEN3ZBTZ1BN tag=G02R3VBZMRKN type=write size=3124688 2024-09-14T11:22:22.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.566+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~G6VGWHIM30H1.0 size=685618 2024-09-14T11:22:22.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.566+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=G6VGWHIM30H1 tag=7XF5GP88R5AJ type=write size=1734194 2024-09-14T11:22:22.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.568+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~8Z4N18C5KKYB.0 size=1003381 2024-09-14T11:22:22.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.570+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=8Z4N18C5KKYB tag=VBZFYU5UYQCI type=write size=2051957 2024-09-14T11:22:22.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.571+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=HMMEVHFC32OJ type=del size=835187 2024-09-14T11:22:22.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.572+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~M3VBN3ZPG3UN.0 size=973659 2024-09-14T11:22:22.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.574+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=M3VBN3ZPG3UN tag=TFWGI602RYCH type=write size=2022235 2024-09-14T11:22:22.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.576+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=U5Y0LCLYD68O type=del size=1935482 2024-09-14T11:22:22.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.577+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~YK5TBO0NYNAY.0 size=1048576 2024-09-14T11:22:22.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.578+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~YK5TBO0NYNAY.1 size=1048576 2024-09-14T11:22:22.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.579+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~YK5TBO0NYNAY.2 size=396290 2024-09-14T11:22:22.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.582+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=YK5TBO0NYNAY tag=8PHN2MA2UX0R type=write size=3542018 2024-09-14T11:22:22.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.584+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~H4QJFJESQLSJ.0 size=96107 2024-09-14T11:22:22.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.584+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=H4QJFJESQLSJ tag=KHIJWOPIST9W type=write size=1144683 2024-09-14T11:22:22.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.586+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=XCJZ5MAX8C2X type=del 2024-09-14T11:22:22.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.587+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=VAFKSJ89HN3N type=del size=4038537 2024-09-14T11:22:22.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.588+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~FD30SUYHXADF.0 size=1048576 2024-09-14T11:22:22.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.589+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~FD30SUYHXADF.1 size=1048576 2024-09-14T11:22:22.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.590+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~FD30SUYHXADF.2 size=3181 2024-09-14T11:22:22.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.592+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=FD30SUYHXADF tag=34TLD54EW9LG type=write size=3148909 2024-09-14T11:22:22.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.593+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=MP7N3CH31KYQ type=del size=616116 2024-09-14T11:22:22.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.594+0000 7f43cc561780 1 < canceled operation key=15F3ZZAAKT9B tag=EKYYOCY06FTO type=del size=2666319 2024-09-14T11:22:22.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.597+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~Q9PYHG9VDH1T.0 size=1048576 2024-09-14T11:22:22.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.598+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~Q9PYHG9VDH1T.1 size=1048576 2024-09-14T11:22:22.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.599+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~Q9PYHG9VDH1T.2 size=702815 2024-09-14T11:22:22.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.599+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=Q9PYHG9VDH1T tag=V86TVEICEU12 type=write size=3848543 2024-09-14T11:22:22.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.600+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~PKC90D8549DY.0 size=967510 2024-09-14T11:22:22.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.602+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=PKC90D8549DY tag=E7LWITTCN4K5 type=write size=2016086 2024-09-14T11:22:22.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.603+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=VGHCRDZOL8BV type=del size=1644848 2024-09-14T11:22:22.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.606+0000 7f43cc561780 1 < suggested update operation key=END3SHHS0FSA tag=4PRC5I0FFRXZ type=del size=2273112 2024-09-14T11:22:22.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.607+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=MKW5VKIX2PNS type=del size=1713610 2024-09-14T11:22:22.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.610+0000 7f43cc561780 1 < suggested update operation key=BNNSFLYOU27F tag=Q9VHU3OZWCSV type=del size=1219670 2024-09-14T11:22:22.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.611+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=BDC7Z3X42UOI type=del size=2069233 2024-09-14T11:22:22.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.613+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~VNLKBPZT3FY3.0 size=1048576 2024-09-14T11:22:22.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.614+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~VNLKBPZT3FY3.1 size=318608 2024-09-14T11:22:22.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.616+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=VNLKBPZT3FY3 tag=V562B10ITBP0 type=write size=2415760 2024-09-14T11:22:22.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.618+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~3JIQ5GV6E5RM.0 size=1048576 2024-09-14T11:22:22.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.619+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~3JIQ5GV6E5RM.1 size=153836 2024-09-14T11:22:22.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.619+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=3JIQ5GV6E5RM tag=V6SBR64SYZ5V type=write size=2250988 2024-09-14T11:22:22.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.620+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=C64IIYTMD13S type=del 2024-09-14T11:22:22.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.622+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~M9J134396BWP.0 size=1048576 2024-09-14T11:22:22.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.623+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~M9J134396BWP.1 size=1024354 2024-09-14T11:22:22.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.623+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=M9J134396BWP tag=ZYKPQ5PFCG5I type=write size=3121506 2024-09-14T11:22:22.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.624+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=224IJ80HCCTU type=del 2024-09-14T11:22:22.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.627+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~B951V5RPMTJ5.0 size=2747 2024-09-14T11:22:22.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.627+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=B951V5RPMTJ5 tag=YIBGGCIR4MCK type=write size=1051323 2024-09-14T11:22:22.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.628+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=TTOV6UEVID0G type=del 2024-09-14T11:22:22.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.629+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=EG1JJZ75NC4D type=del size=3243381 2024-09-14T11:22:22.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.631+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=JCIVXZDCNEQB type=write size=543723 2024-09-14T11:22:22.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.633+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~WRE5YQ1ZH7EB.0 size=1048576 2024-09-14T11:22:22.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.634+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~WRE5YQ1ZH7EB.1 size=1048576 2024-09-14T11:22:22.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.635+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~WRE5YQ1ZH7EB.2 size=242694 2024-09-14T11:22:22.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.635+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=WRE5YQ1ZH7EB tag=8P3D3M2S0WV5 type=write size=3388422 2024-09-14T11:22:22.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.637+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=VWRTZB0HLN98 type=del 2024-09-14T11:22:22.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.639+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~M1B64JBAKPOS.0 size=1048576 2024-09-14T11:22:22.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.640+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~M1B64JBAKPOS.1 size=995158 2024-09-14T11:22:22.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.640+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=M1B64JBAKPOS tag=DRTBTAGAP5EN type=write size=3092310 2024-09-14T11:22:22.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.642+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~G6VGWHIM30H1.0 size=685618 2024-09-14T11:22:22.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.644+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=G6VGWHIM30H1 tag=7XF5GP88R5AJ type=write size=1734194 2024-09-14T11:22:22.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.645+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=TM49GMXEMYYK type=write size=690997 2024-09-14T11:22:22.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.646+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=HMMEVHFC32OJ type=del 2024-09-14T11:22:22.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.647+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=ZKUS163HXHH2 type=write size=475352 2024-09-14T11:22:22.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.649+0000 7f43cc561780 1 < canceled operation key=1M46U4U9MG1E tag=U5Y0LCLYD68O type=del size=1935482 2024-09-14T11:22:22.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.651+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~GQHDC2C7RO1U.0 size=1048576 2024-09-14T11:22:22.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.652+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~GQHDC2C7RO1U.1 size=1048576 2024-09-14T11:22:22.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.653+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~GQHDC2C7RO1U.2 size=302608 2024-09-14T11:22:22.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.653+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=GQHDC2C7RO1U tag=3QXH3D77AIZL type=write size=3448336 2024-09-14T11:22:22.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.654+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~H4QJFJESQLSJ.0 size=96107 2024-09-14T11:22:22.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.656+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=H4QJFJESQLSJ tag=KHIJWOPIST9W type=write size=1144683 2024-09-14T11:22:22.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.657+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=35I1UI4HU75R type=del size=2090837 2024-09-14T11:22:22.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.658+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=VAFKSJ89HN3N type=del 2024-09-14T11:22:22.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.660+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~NPLW7VPY2HHF.0 size=310461 2024-09-14T11:22:22.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.660+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=NPLW7VPY2HHF tag=RONHG8DYUBJX type=write size=1359037 2024-09-14T11:22:22.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.663+0000 7f43cc561780 1 < suggested update operation key=W679WIFVPVOH tag=MP7N3CH31KYQ type=del size=616116 2024-09-14T11:22:22.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.664+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=JGH2I4FAOC45 type=del size=238041 2024-09-14T11:22:22.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.665+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~Q9PYHG9VDH1T.0 size=1048576 2024-09-14T11:22:22.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.666+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~Q9PYHG9VDH1T.1 size=1048576 2024-09-14T11:22:22.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.667+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~Q9PYHG9VDH1T.2 size=702815 2024-09-14T11:22:22.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.669+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=Q9PYHG9VDH1T tag=V86TVEICEU12 type=write size=3848543 2024-09-14T11:22:22.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.671+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=TREHI4NF4YPS type=del size=2955596 2024-09-14T11:22:22.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.673+0000 7f43cc561780 1 < suggested remove operation key=OV4ATW747PY4 tag=VGHCRDZOL8BV type=del 2024-09-14T11:22:22.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.674+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=JS4AJXR18JOZ type=del size=3439887 2024-09-14T11:22:22.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.676+0000 7f43cc561780 1 < canceled operation key=D84127SVSIPL tag=MKW5VKIX2PNS type=del size=1713610 2024-09-14T11:22:22.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.678+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~IQGOLN0V7EH0.0 size=1048576 2024-09-14T11:22:22.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.679+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~IQGOLN0V7EH0.1 size=957565 2024-09-14T11:22:22.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.679+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=IQGOLN0V7EH0 tag=2Y64QXJEHHNT type=write size=3054717 2024-09-14T11:22:22.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.680+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=BDC7Z3X42UOI type=del size=2069233: (22) Invalid argument 2024-09-14T11:22:22.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.682+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=W3NYOIICRQRU type=del size=267351 2024-09-14T11:22:22.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.683+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~3JIQ5GV6E5RM.0 size=1048576 2024-09-14T11:22:22.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.684+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~3JIQ5GV6E5RM.1 size=153836 2024-09-14T11:22:22.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.686+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=3JIQ5GV6E5RM tag=V6SBR64SYZ5V type=write size=2250988 2024-09-14T11:22:22.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.689+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~7WF0CDWIHJ2I.0 size=1048576 2024-09-14T11:22:22.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.690+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~7WF0CDWIHJ2I.1 size=1048576 2024-09-14T11:22:22.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.691+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~7WF0CDWIHJ2I.2 size=66435 2024-09-14T11:22:22.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.691+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=7WF0CDWIHJ2I tag=KOFZOBNE4GAA type=write size=3212163 2024-09-14T11:22:22.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.692+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~M9J134396BWP.0 size=1048576 2024-09-14T11:22:22.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.693+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~M9J134396BWP.1 size=1024354 2024-09-14T11:22:22.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.697+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=M9J134396BWP tag=ZYKPQ5PFCG5I type=write size=3121506 2024-09-14T11:22:22.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.699+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~CB1COBINUZ2I.0 size=1048576 2024-09-14T11:22:22.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.700+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~CB1COBINUZ2I.1 size=1048576 2024-09-14T11:22:22.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.701+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~CB1COBINUZ2I.2 size=997980 2024-09-14T11:22:22.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.701+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=CB1COBINUZ2I tag=NYVPG1ODW7L3 type=write size=4143708 2024-09-14T11:22:22.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.702+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~B951V5RPMTJ5.0 size=2747 2024-09-14T11:22:22.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.705+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=B951V5RPMTJ5 tag=YIBGGCIR4MCK type=write size=1051323 2024-09-14T11:22:22.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.706+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=YU93XWX9QBHK type=write size=209749 2024-09-14T11:22:22.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.707+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=EG1JJZ75NC4D type=del 2024-09-14T11:22:22.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.708+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=Q4I21VC81SHH type=del size=1812464 2024-09-14T11:22:22.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.709+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~WRE5YQ1ZH7EB.0 size=1048576 2024-09-14T11:22:22.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.709+0000 7f43cc561780 1 < canceled part key=_multipart_WSFZN6JCWUXG.2~WRE5YQ1ZH7EB.1 size=1048576 2024-09-14T11:22:22.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.710+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~WRE5YQ1ZH7EB.2 size=242694 2024-09-14T11:22:22.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.712+0000 7f43cc561780 1 < canceled multipart upload key=WSFZN6JCWUXG upload=WRE5YQ1ZH7EB tag=8P3D3M2S0WV5 type=write size=3388422 2024-09-14T11:22:22.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.715+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~HTDRDXBTF4N0.0 size=1048576 2024-09-14T11:22:22.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.716+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~HTDRDXBTF4N0.1 size=1048576 2024-09-14T11:22:22.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.716+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~HTDRDXBTF4N0.2 size=686081 2024-09-14T11:22:22.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.716+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=HTDRDXBTF4N0 tag=Z8OS303T3KMK type=write size=3831809 2024-09-14T11:22:22.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.718+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~M1B64JBAKPOS.0 size=1048576 2024-09-14T11:22:22.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.719+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~M1B64JBAKPOS.1 size=995158 2024-09-14T11:22:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.721+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=M1B64JBAKPOS tag=DRTBTAGAP5EN type=write size=3092310 2024-09-14T11:22:22.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.722+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=WPT50XNTVQU6 type=del size=1947731 2024-09-14T11:22:22.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.723+0000 7f43cc561780 1 < completed write operation key=BRHP3DQEO3HZ tag=TM49GMXEMYYK type=write size=690997 2024-09-14T11:22:22.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.724+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=19V2GJ2J12ET type=del size=372647 2024-09-14T11:22:22.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.725+0000 7f43cc561780 -1 < failed to complete operation key=W679WIFVPVOH tag=ZKUS163HXHH2 type=write size=475352: (22) Invalid argument 2024-09-14T11:22:22.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.727+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=GXW03JOQ66T3 type=del size=3073946 2024-09-14T11:22:22.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.728+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~GQHDC2C7RO1U.0 size=1048576 2024-09-14T11:22:22.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.729+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~GQHDC2C7RO1U.1 size=1048576 2024-09-14T11:22:22.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.730+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~GQHDC2C7RO1U.2 size=302608 2024-09-14T11:22:22.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.732+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=GQHDC2C7RO1U tag=3QXH3D77AIZL type=write size=3448336 2024-09-14T11:22:22.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.733+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=8IRN6VVB2URH type=del size=1791062 2024-09-14T11:22:22.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.734+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=35I1UI4HU75R type=del 2024-09-14T11:22:22.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.737+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~T94F13WO01CI.0 size=1048576 2024-09-14T11:22:22.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.738+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~T94F13WO01CI.1 size=657784 2024-09-14T11:22:22.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.738+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=T94F13WO01CI tag=X973O7KSOVB0 type=write size=2754936 2024-09-14T11:22:22.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.739+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~NPLW7VPY2HHF.0 size=310461 2024-09-14T11:22:22.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.741+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=NPLW7VPY2HHF tag=RONHG8DYUBJX type=write size=1359037 2024-09-14T11:22:22.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.742+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=JAW9IH62A2BP type=del size=2177482 2024-09-14T11:22:22.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.743+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=JGH2I4FAOC45 type=del 2024-09-14T11:22:22.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.745+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=AYKFE2DU1BSH type=write size=820109 2024-09-14T11:22:22.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.746+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=TREHI4NF4YPS type=del 2024-09-14T11:22:22.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.747+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=P0PQ1AGY6CAK type=del size=3945523 2024-09-14T11:22:22.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.749+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=JS4AJXR18JOZ type=del 2024-09-14T11:22:22.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.751+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=ZRKW1IB05N73 type=del size=2403117 2024-09-14T11:22:22.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.752+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~IQGOLN0V7EH0.0 size=1048576 2024-09-14T11:22:22.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.753+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~IQGOLN0V7EH0.1 size=957565 2024-09-14T11:22:22.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.755+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=IQGOLN0V7EH0 tag=2Y64QXJEHHNT type=write size=3054717 2024-09-14T11:22:22.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.756+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=JG4IOA025565 type=write size=985135 2024-09-14T11:22:22.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.758+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=W3NYOIICRQRU type=del 2024-09-14T11:22:22.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.760+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~CEM99D3QDNSB.0 size=1048576 2024-09-14T11:22:22.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.761+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~CEM99D3QDNSB.1 size=1048576 2024-09-14T11:22:22.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.762+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~CEM99D3QDNSB.2 size=153391 2024-09-14T11:22:22.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.762+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=CEM99D3QDNSB tag=4NV8IQ5X29TP type=write size=3299119 2024-09-14T11:22:22.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.763+0000 7f43cc561780 1 < canceled part key=_multipart_MD14RGOQY0LK.2~7WF0CDWIHJ2I.0 size=1048576 2024-09-14T11:22:22.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.764+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~7WF0CDWIHJ2I.1 size=1048576 2024-09-14T11:22:22.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.765+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~7WF0CDWIHJ2I.2 size=66435 2024-09-14T11:22:22.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.767+0000 7f43cc561780 1 < canceled multipart upload key=MD14RGOQY0LK upload=7WF0CDWIHJ2I tag=KOFZOBNE4GAA type=write size=3212163 2024-09-14T11:22:22.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.768+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=YFE1LCMIM6LZ type=del size=756819 2024-09-14T11:22:22.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.770+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~CB1COBINUZ2I.0 size=1048576 2024-09-14T11:22:22.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.771+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~CB1COBINUZ2I.1 size=1048576 2024-09-14T11:22:22.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.772+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~CB1COBINUZ2I.2 size=997980 2024-09-14T11:22:22.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.774+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=CB1COBINUZ2I tag=NYVPG1ODW7L3 type=write size=4143708 2024-09-14T11:22:22.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.775+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=HDQAO6F0RQYS type=del size=4169664 2024-09-14T11:22:22.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.776+0000 7f43cc561780 1 < completed write operation key=A1B2LIZIPET3 tag=YU93XWX9QBHK type=write size=209749 2024-09-14T11:22:22.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.778+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=VE6UVGK9XJLU type=write size=249927 2024-09-14T11:22:22.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.779+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=Q4I21VC81SHH type=del 2024-09-14T11:22:22.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.780+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=0NRM7553UTRD type=del size=75467 2024-09-14T11:22:22.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.781+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~HTDRDXBTF4N0.0 size=1048576 2024-09-14T11:22:22.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.782+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~HTDRDXBTF4N0.1 size=1048576 2024-09-14T11:22:22.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.783+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~HTDRDXBTF4N0.2 size=686081 2024-09-14T11:22:22.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.785+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=HTDRDXBTF4N0 tag=Z8OS303T3KMK type=write size=3831809 2024-09-14T11:22:22.786 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.788+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WEK094Z23D31.0 size=801831 2024-09-14T11:22:22.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.788+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=WEK094Z23D31 tag=RXEHDKMS9LLH type=write size=1850407 2024-09-14T11:22:22.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.790+0000 7f43cc561780 1 < suggested remove operation key=W679WIFVPVOH tag=WPT50XNTVQU6 type=del 2024-09-14T11:22:22.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.792+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~27RW7W07UN6W.0 size=833902 2024-09-14T11:22:22.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.792+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=27RW7W07UN6W tag=H8EQZEFPQD0O type=write size=1882478 2024-09-14T11:22:22.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.793+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=19V2GJ2J12ET type=del 2024-09-14T11:22:22.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.795+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=21Q70EYDZX3S type=del size=2804389 2024-09-14T11:22:22.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.796+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=GXW03JOQ66T3 type=del 2024-09-14T11:22:22.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.797+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=1PNGS0VKLWUV type=del size=1013096 2024-09-14T11:22:22.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.799+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=8IRN6VVB2URH type=del 2024-09-14T11:22:22.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.800+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=PPZQ10O8XIXA type=del size=933643 2024-09-14T11:22:22.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.801+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~T94F13WO01CI.0 size=1048576 2024-09-14T11:22:22.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.802+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~T94F13WO01CI.1 size=657784 2024-09-14T11:22:22.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.804+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=T94F13WO01CI tag=X973O7KSOVB0 type=write size=2754936 2024-09-14T11:22:22.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.805+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=75LO6IKBA3Z4 type=write size=20043 2024-09-14T11:22:22.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.808+0000 7f43cc561780 1 < suggested update operation key=E6FDCACWGA2Y tag=JAW9IH62A2BP type=del size=2177482 2024-09-14T11:22:22.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.809+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=WMQ2T8PQ0CKX type=del size=3711313 2024-09-14T11:22:22.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.811+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=AYKFE2DU1BSH type=write size=820109 2024-09-14T11:22:22.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.812+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=959TG176E96W type=del size=813001 2024-09-14T11:22:22.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.813+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=P0PQ1AGY6CAK type=del 2024-09-14T11:22:22.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.815+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=J5G1XIUZE5T5 type=del size=1132497 2024-09-14T11:22:22.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.817+0000 7f43cc561780 1 < suggested update operation key=A1B2LIZIPET3 tag=ZRKW1IB05N73 type=del size=2403117 2024-09-14T11:22:22.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.818+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=02P9B3IQ1MW8 type=del size=3681724 2024-09-14T11:22:22.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.821+0000 7f43cc561780 1 < suggested remove operation key=D8EBH4NWN7SK tag=JG4IOA025565 type=write 2024-09-14T11:22:22.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.823+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~73W9JAJP7BEO.0 size=1048576 2024-09-14T11:22:22.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.824+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~73W9JAJP7BEO.1 size=1048576 2024-09-14T11:22:22.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.825+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~73W9JAJP7BEO.2 size=246326 2024-09-14T11:22:22.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.825+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=73W9JAJP7BEO tag=NPHMZUR32XVS type=write size=3392054 2024-09-14T11:22:22.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.826+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~CEM99D3QDNSB.0 size=1048576 2024-09-14T11:22:22.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.827+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~CEM99D3QDNSB.1 size=1048576 2024-09-14T11:22:22.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.828+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~CEM99D3QDNSB.2 size=153391 2024-09-14T11:22:22.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.829+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=CEM99D3QDNSB tag=4NV8IQ5X29TP type=write size=3299119 2024-09-14T11:22:22.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.831+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=03K1BAI2OOI8 type=del size=3878199 2024-09-14T11:22:22.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.832+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=YFE1LCMIM6LZ type=del 2024-09-14T11:22:22.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.834+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~N0QB4C2XGXOW.0 size=1048576 2024-09-14T11:22:22.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.835+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~N0QB4C2XGXOW.1 size=791283 2024-09-14T11:22:22.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.835+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=N0QB4C2XGXOW tag=9OEVY06M11FH type=write size=2888435 2024-09-14T11:22:22.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.836+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=HDQAO6F0RQYS type=del 2024-09-14T11:22:22.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.838+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=9M6NDUVBDGJL type=del size=1516054 2024-09-14T11:22:22.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.840+0000 7f43cc561780 1 < suggested update operation key=BNNSFLYOU27F tag=VE6UVGK9XJLU type=write size=249927 2024-09-14T11:22:22.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.841+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=MLVI2NDNU7JY type=del size=612554 2024-09-14T11:22:22.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.843+0000 7f43cc561780 -1 < failed to complete operation key=W679WIFVPVOH tag=0NRM7553UTRD type=del size=75467: (22) Invalid argument 2024-09-14T11:22:22.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.845+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~BWCUKB2E4UF1.0 size=1048576 2024-09-14T11:22:22.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.846+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~BWCUKB2E4UF1.1 size=488711 2024-09-14T11:22:22.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.846+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=BWCUKB2E4UF1 tag=JX7KW0L0S7ES type=write size=2585863 2024-09-14T11:22:22.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.847+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~WEK094Z23D31.0 size=801831 2024-09-14T11:22:22.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.849+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=WEK094Z23D31 tag=RXEHDKMS9LLH type=write size=1850407 2024-09-14T11:22:22.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.851+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=FZD0J9RWWA3F type=del size=2326837 2024-09-14T11:22:22.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.852+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~27RW7W07UN6W.0 size=833902 2024-09-14T11:22:22.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.854+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=27RW7W07UN6W tag=H8EQZEFPQD0O type=write size=1882478 2024-09-14T11:22:22.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.856+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~I783M1YKCDPK.0 size=1048576 2024-09-14T11:22:22.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.857+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~I783M1YKCDPK.1 size=1048576 2024-09-14T11:22:22.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.858+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~I783M1YKCDPK.2 size=909817 2024-09-14T11:22:22.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.858+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=I783M1YKCDPK tag=MSJPPW1R25NO type=write size=4055545 2024-09-14T11:22:22.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.861+0000 7f43cc561780 1 < suggested remove operation key=0TDWJO4AWOOF tag=21Q70EYDZX3S type=del 2024-09-14T11:22:22.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.862+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=D36S9BYWXIK6 type=del size=3732666 2024-09-14T11:22:22.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.863+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=1PNGS0VKLWUV type=del 2024-09-14T11:22:22.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.865+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~NRY1QH0PKN04.0 size=787365 2024-09-14T11:22:22.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.865+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=NRY1QH0PKN04 tag=J2FNFP5R1219 type=write size=1835941 2024-09-14T11:22:22.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.867+0000 7f43cc561780 -1 < failed to complete operation key=0TDWJO4AWOOF tag=PPZQ10O8XIXA type=del size=933643: (22) Invalid argument 2024-09-14T11:22:22.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.868+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=UISSVO3K91PO type=write size=170801 2024-09-14T11:22:22.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.869+0000 7f43cc561780 1 < canceled operation key=IG4QM506P41B tag=75LO6IKBA3Z4 type=write size=20043 2024-09-14T11:22:22.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.870+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=69A0TXKFHQMT type=del size=567573 2024-09-14T11:22:22.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.871+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=WMQ2T8PQ0CKX type=del 2024-09-14T11:22:22.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.874+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~YSA56I3PGNX2.0 size=752711 2024-09-14T11:22:22.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.874+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=YSA56I3PGNX2 tag=M1JPBN02849B type=write size=1801287 2024-09-14T11:22:22.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.875+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=959TG176E96W type=del 2024-09-14T11:22:22.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.877+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~1W9HZ0TJUMVI.0 size=1048576 2024-09-14T11:22:22.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.878+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~1W9HZ0TJUMVI.1 size=1048576 2024-09-14T11:22:22.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.879+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~1W9HZ0TJUMVI.2 size=296969 2024-09-14T11:22:22.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.879+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=1W9HZ0TJUMVI tag=PURT35A88M2Y type=write size=3442697 2024-09-14T11:22:22.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.881+0000 7f43cc561780 1 < suggested remove operation key=CXP2PUIXR2PA tag=J5G1XIUZE5T5 type=del 2024-09-14T11:22:22.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.883+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=DQ25T9KRERGB type=del size=564450 2024-09-14T11:22:22.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.884+0000 7f43cc561780 -1 < failed to complete operation key=D8EBH4NWN7SK tag=02P9B3IQ1MW8 type=del size=3681724: (22) Invalid argument 2024-09-14T11:22:22.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.885+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=Q42T7XNRAIL9 type=del size=252026 2024-09-14T11:22:22.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.886+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~73W9JAJP7BEO.0 size=1048576 2024-09-14T11:22:22.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.887+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~73W9JAJP7BEO.1 size=1048576 2024-09-14T11:22:22.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.888+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~73W9JAJP7BEO.2 size=246326 2024-09-14T11:22:22.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.890+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=73W9JAJP7BEO tag=NPHMZUR32XVS type=write size=3392054 2024-09-14T11:22:22.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.892+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=8LIUSBTSFRL8 type=del size=2337617 2024-09-14T11:22:22.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.893+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=03K1BAI2OOI8 type=del 2024-09-14T11:22:22.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.894+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=KU8U13XPPHWQ type=write size=719092 2024-09-14T11:22:22.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.896+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~N0QB4C2XGXOW.0 size=1048576 2024-09-14T11:22:22.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.896+0000 7f43cc561780 1 < canceled part key=_multipart_15F3ZZAAKT9B.2~N0QB4C2XGXOW.1 size=791283 2024-09-14T11:22:22.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.898+0000 7f43cc561780 1 < canceled multipart upload key=15F3ZZAAKT9B upload=N0QB4C2XGXOW tag=9OEVY06M11FH type=write size=2888435 2024-09-14T11:22:22.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.900+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~Z9W9YDMULUMF.0 size=574140 2024-09-14T11:22:22.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.900+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=Z9W9YDMULUMF tag=544ZRH5XDABE type=write size=1622716 2024-09-14T11:22:22.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.902+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=9M6NDUVBDGJL type=del 2024-09-14T11:22:22.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.903+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=L6RO1W85K95Z type=del size=1599029 2024-09-14T11:22:22.903 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.904+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=MLVI2NDNU7JY type=del 2024-09-14T11:22:22.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.907+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~211SIIE8FMX1.0 size=1048576 2024-09-14T11:22:22.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.907+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~211SIIE8FMX1.1 size=1048576 2024-09-14T11:22:22.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.909+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~211SIIE8FMX1.2 size=278804 2024-09-14T11:22:22.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.909+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=211SIIE8FMX1 tag=6IUPCZOZXKF1 type=write size=3424532 2024-09-14T11:22:22.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.910+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~BWCUKB2E4UF1.0 size=1048576 2024-09-14T11:22:22.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.911+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~BWCUKB2E4UF1.1 size=488711 2024-09-14T11:22:22.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.913+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=BWCUKB2E4UF1 tag=JX7KW0L0S7ES type=write size=2585863 2024-09-14T11:22:22.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.915+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~P5IMGJCRV40E.0 size=1048576 2024-09-14T11:22:22.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.916+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~P5IMGJCRV40E.1 size=1048576 2024-09-14T11:22:22.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.917+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~P5IMGJCRV40E.2 size=491979 2024-09-14T11:22:22.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.917+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=P5IMGJCRV40E tag=W49OGW4D6JD2 type=write size=3637707 2024-09-14T11:22:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.920+0000 7f43cc561780 1 < suggested update operation key=UWES4CQZ8XW6 tag=FZD0J9RWWA3F type=del size=2326837 2024-09-14T11:22:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.921+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=4DW1ZUTIGDJB type=write size=1042812 2024-09-14T11:22:22.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.922+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~I783M1YKCDPK.0 size=1048576 2024-09-14T11:22:22.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.923+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~I783M1YKCDPK.1 size=1048576 2024-09-14T11:22:22.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.925+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~I783M1YKCDPK.2 size=909817 2024-09-14T11:22:22.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.928+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=I783M1YKCDPK tag=MSJPPW1R25NO type=write size=4055545 2024-09-14T11:22:22.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.929+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=ZYGLRBLGONHF type=del size=1174191 2024-09-14T11:22:22.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.930+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=D36S9BYWXIK6 type=del 2024-09-14T11:22:22.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.932+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=MXBFPDYFKIS0 type=del size=121365 2024-09-14T11:22:22.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.933+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~NRY1QH0PKN04.0 size=787365 2024-09-14T11:22:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.935+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=NRY1QH0PKN04 tag=J2FNFP5R1219 type=write size=1835941 2024-09-14T11:22:22.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.937+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~N7CE5T3LSK53.0 size=1048576 2024-09-14T11:22:22.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.938+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~N7CE5T3LSK53.1 size=807128 2024-09-14T11:22:22.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.938+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=N7CE5T3LSK53 tag=ZS6P30SYWXEK type=write size=2904280 2024-09-14T11:22:22.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.939+0000 7f43cc561780 1 < canceled operation key=BRHP3DQEO3HZ tag=UISSVO3K91PO type=write size=170801 2024-09-14T11:22:22.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.941+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=NC9KSVWTS3O9 type=del size=1693201 2024-09-14T11:22:22.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.942+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=69A0TXKFHQMT type=del 2024-09-14T11:22:22.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.943+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=9YUPI6HY602Z type=del size=3491068 2024-09-14T11:22:22.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.945+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~YSA56I3PGNX2.0 size=752711 2024-09-14T11:22:22.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.947+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=YSA56I3PGNX2 tag=M1JPBN02849B type=write size=1801287 2024-09-14T11:22:22.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.949+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~91JQA7RB24XL.0 size=296306 2024-09-14T11:22:22.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.949+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=91JQA7RB24XL tag=WEPUZJCG6YM4 type=write size=1344882 2024-09-14T11:22:22.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.950+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~1W9HZ0TJUMVI.0 size=1048576 2024-09-14T11:22:22.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.951+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~1W9HZ0TJUMVI.1 size=1048576 2024-09-14T11:22:22.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.952+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~1W9HZ0TJUMVI.2 size=296969 2024-09-14T11:22:22.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.954+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=1W9HZ0TJUMVI tag=PURT35A88M2Y type=write size=3442697 2024-09-14T11:22:22.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.956+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~Q5DMNFOA1BRK.0 size=1048576 2024-09-14T11:22:22.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.957+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~Q5DMNFOA1BRK.1 size=721789 2024-09-14T11:22:22.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.957+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=Q5DMNFOA1BRK tag=ZGW7DS6HD2EG type=write size=2818941 2024-09-14T11:22:22.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.958+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=DQ25T9KRERGB type=del 2024-09-14T11:22:22.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.960+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=0SUBYR4J3FT9 type=del size=2897822 2024-09-14T11:22:22.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.962+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=Q42T7XNRAIL9 type=del size=252026 2024-09-14T11:22:22.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.964+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~ZJSEXAL9FZXZ.0 size=269163 2024-09-14T11:22:22.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.964+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=ZJSEXAL9FZXZ tag=1SDODV1EWM00 type=write size=1317739 2024-09-14T11:22:22.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.966+0000 7f43cc561780 1 < canceled operation key=S3NOACTF4K2W tag=8LIUSBTSFRL8 type=del size=2337617 2024-09-14T11:22:22.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.968+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~AAA3CIX241PX.0 size=714937 2024-09-14T11:22:22.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.968+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=AAA3CIX241PX tag=2CT7PX73V90H type=write size=1763513 2024-09-14T11:22:22.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.970+0000 7f43cc561780 1 < completed write operation key=683ZFW0BWMT7 tag=KU8U13XPPHWQ type=write size=719092 2024-09-14T11:22:22.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.971+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=PAMFE439R4J4 type=del size=289339 2024-09-14T11:22:22.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.972+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~Z9W9YDMULUMF.0 size=574140 2024-09-14T11:22:22.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.974+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=Z9W9YDMULUMF tag=544ZRH5XDABE type=write size=1622716 2024-09-14T11:22:22.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.975+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=ZS0JRKQ242LL type=del size=1853593 2024-09-14T11:22:22.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.977+0000 7f43cc561780 1 < canceled operation key=0TDWJO4AWOOF tag=L6RO1W85K95Z type=del size=1599029 2024-09-14T11:22:22.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.979+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~ZWD5N7GXSZQO.0 size=1048576 2024-09-14T11:22:22.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.980+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~ZWD5N7GXSZQO.1 size=1048576 2024-09-14T11:22:22.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.981+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~ZWD5N7GXSZQO.2 size=258129 2024-09-14T11:22:22.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.981+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=ZWD5N7GXSZQO tag=UDE45I7GECTW type=write size=3403857 2024-09-14T11:22:22.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.982+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~211SIIE8FMX1.0 size=1048576 2024-09-14T11:22:22.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.983+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~211SIIE8FMX1.1 size=1048576 2024-09-14T11:22:22.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.984+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~211SIIE8FMX1.2 size=278804 2024-09-14T11:22:22.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.986+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=211SIIE8FMX1 tag=6IUPCZOZXKF1 type=write size=3424532 2024-09-14T11:22:22.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.988+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~TZNDEIVQPR3N.0 size=736133 2024-09-14T11:22:22.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.988+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=TZNDEIVQPR3N tag=LNK7LM8MS3RN type=write size=1784709 2024-09-14T11:22:22.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.989+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~P5IMGJCRV40E.0 size=1048576 2024-09-14T11:22:22.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.990+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~P5IMGJCRV40E.1 size=1048576 2024-09-14T11:22:22.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.991+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~P5IMGJCRV40E.2 size=491979 2024-09-14T11:22:22.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.993+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=P5IMGJCRV40E tag=W49OGW4D6JD2 type=write size=3637707 2024-09-14T11:22:22.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.995+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~OYS04VHEH9TX.0 size=1048576 2024-09-14T11:22:22.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.996+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~OYS04VHEH9TX.1 size=413453 2024-09-14T11:22:22.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.996+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=OYS04VHEH9TX tag=D1AE13SKCJJ3 type=write size=2510605 2024-09-14T11:22:22.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.998+0000 7f43cc561780 1 < completed write operation key=3YHEZHW0RS1W tag=4DW1ZUTIGDJB type=write size=1042812 2024-09-14T11:22:22.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:22.999+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=63O9HYSVCQO1 type=write size=298194 2024-09-14T11:22:22.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.001+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=ZYGLRBLGONHF type=del 2024-09-14T11:22:23.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.003+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~F2TDJS8ODSDA.0 size=1048576 2024-09-14T11:22:23.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.004+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~F2TDJS8ODSDA.1 size=1048576 2024-09-14T11:22:23.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.005+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~F2TDJS8ODSDA.2 size=906999 2024-09-14T11:22:23.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.005+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=F2TDJS8ODSDA tag=N80CE3JFGSJW type=write size=4052727 2024-09-14T11:22:23.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.006+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=MXBFPDYFKIS0 type=del 2024-09-14T11:22:23.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.007+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=JMSCMI3ZFYIM type=del size=371715 2024-09-14T11:22:23.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.008+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~N7CE5T3LSK53.0 size=1048576 2024-09-14T11:22:23.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.010+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~N7CE5T3LSK53.1 size=807128 2024-09-14T11:22:23.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.012+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=N7CE5T3LSK53 tag=ZS6P30SYWXEK type=write size=2904280 2024-09-14T11:22:23.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.014+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~QKS5STD9E1L4.0 size=1048576 2024-09-14T11:22:23.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.015+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~QKS5STD9E1L4.1 size=244956 2024-09-14T11:22:23.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.015+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=QKS5STD9E1L4 tag=9SFT5QKNGKK0 type=write size=2342108 2024-09-14T11:22:23.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.016+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=NC9KSVWTS3O9 type=del 2024-09-14T11:22:23.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.017+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=MQ8B17MILJGK type=del size=1354251 2024-09-14T11:22:23.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.018+0000 7f43cc561780 1 < canceled operation key=3YHEZHW0RS1W tag=9YUPI6HY602Z type=del size=3491068 2024-09-14T11:22:23.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.020+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=K4184LEM7GJR type=del size=1960664 2024-09-14T11:22:23.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.021+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~91JQA7RB24XL.0 size=296306 2024-09-14T11:22:23.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.023+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=91JQA7RB24XL tag=WEPUZJCG6YM4 type=write size=1344882 2024-09-14T11:22:23.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.026+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~KVKAKOIPW5YR.0 size=110783 2024-09-14T11:22:23.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.026+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=KVKAKOIPW5YR tag=9EVCYDHVXJF2 type=write size=1159359 2024-09-14T11:22:23.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.027+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~Q5DMNFOA1BRK.0 size=1048576 2024-09-14T11:22:23.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.028+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~Q5DMNFOA1BRK.1 size=721789 2024-09-14T11:22:23.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.030+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=Q5DMNFOA1BRK tag=ZGW7DS6HD2EG type=write size=2818941 2024-09-14T11:22:23.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.032+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~75H5AYUMEEQR.0 size=1048576 2024-09-14T11:22:23.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.033+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~75H5AYUMEEQR.1 size=1048576 2024-09-14T11:22:23.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.034+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~75H5AYUMEEQR.2 size=161962 2024-09-14T11:22:23.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.034+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=75H5AYUMEEQR tag=M4FFRWQ9AXIQ type=write size=3307690 2024-09-14T11:22:23.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.035+0000 7f43cc561780 -1 < failed to complete operation key=D84127SVSIPL tag=0SUBYR4J3FT9 type=del size=2897822: (22) Invalid argument 2024-09-14T11:22:23.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.036+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=QCS4F5TV4KF5 type=del size=1220515 2024-09-14T11:22:23.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.037+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~ZJSEXAL9FZXZ.0 size=269163 2024-09-14T11:22:23.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.040+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=ZJSEXAL9FZXZ tag=1SDODV1EWM00 type=write size=1317739 2024-09-14T11:22:23.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.042+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~SD13C6M73A49.0 size=1048576 2024-09-14T11:22:23.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.043+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~SD13C6M73A49.1 size=1048576 2024-09-14T11:22:23.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.044+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~SD13C6M73A49.2 size=151149 2024-09-14T11:22:23.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.044+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=SD13C6M73A49 tag=OEU1NAY87EHK type=write size=3296877 2024-09-14T11:22:23.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.045+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~AAA3CIX241PX.0 size=714937 2024-09-14T11:22:23.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.047+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=AAA3CIX241PX tag=2CT7PX73V90H type=write size=1763513 2024-09-14T11:22:23.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.050+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~9FL8YX8VOEZA.0 size=1048576 2024-09-14T11:22:23.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.051+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~9FL8YX8VOEZA.1 size=1048576 2024-09-14T11:22:23.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.052+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~9FL8YX8VOEZA.2 size=334869 2024-09-14T11:22:23.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.052+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=9FL8YX8VOEZA tag=N1OLDJDZWC1O type=write size=3480597 2024-09-14T11:22:23.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.053+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=PAMFE439R4J4 type=del 2024-09-14T11:22:23.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.055+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~7MMCD7AN8J3M.0 size=1048576 2024-09-14T11:22:23.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.056+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~7MMCD7AN8J3M.1 size=48862 2024-09-14T11:22:23.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.056+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=7MMCD7AN8J3M tag=JDBGU9U7IL6C type=write size=2146014 2024-09-14T11:22:23.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.057+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=ZS0JRKQ242LL type=del 2024-09-14T11:22:23.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.059+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=65SXF30VOFQQ type=write size=527994 2024-09-14T11:22:23.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.060+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~ZWD5N7GXSZQO.0 size=1048576 2024-09-14T11:22:23.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.061+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~ZWD5N7GXSZQO.1 size=1048576 2024-09-14T11:22:23.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.062+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~ZWD5N7GXSZQO.2 size=258129 2024-09-14T11:22:23.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.064+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=ZWD5N7GXSZQO tag=UDE45I7GECTW type=write size=3403857 2024-09-14T11:22:23.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.066+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~BHX49UI7SION.0 size=1048576 2024-09-14T11:22:23.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.067+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~BHX49UI7SION.1 size=6954 2024-09-14T11:22:23.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.067+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=BHX49UI7SION tag=OL8AQUUVJQK9 type=write size=2104106 2024-09-14T11:22:23.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.069+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~TZNDEIVQPR3N.0 size=736133 2024-09-14T11:22:23.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.071+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=TZNDEIVQPR3N tag=LNK7LM8MS3RN type=write size=1784709 2024-09-14T11:22:23.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.073+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~BLI62SU3K585.0 size=949300 2024-09-14T11:22:23.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.073+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=BLI62SU3K585 tag=IUL6L8UOXYAQ type=write size=1997876 2024-09-14T11:22:23.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.074+0000 7f43cc561780 1 < canceled part key=_multipart_D84127SVSIPL.2~OYS04VHEH9TX.0 size=1048576 2024-09-14T11:22:23.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.074+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~OYS04VHEH9TX.1 size=413453 2024-09-14T11:22:23.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.076+0000 7f43cc561780 1 < canceled multipart upload key=D84127SVSIPL upload=OYS04VHEH9TX tag=D1AE13SKCJJ3 type=write size=2510605 2024-09-14T11:22:23.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.077+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=6DGM7MTJY2OZ type=write size=986288 2024-09-14T11:22:23.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.079+0000 7f43cc561780 1 < completed write operation key=E6FDCACWGA2Y tag=63O9HYSVCQO1 type=write size=298194 2024-09-14T11:22:23.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.081+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~5CW96T5YHNUP.0 size=1048576 2024-09-14T11:22:23.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.081+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~5CW96T5YHNUP.1 size=932055 2024-09-14T11:22:23.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.081+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=5CW96T5YHNUP tag=V4T7LJP1F7RR type=write size=3029207 2024-09-14T11:22:23.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.083+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~F2TDJS8ODSDA.0 size=1048576 2024-09-14T11:22:23.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.084+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~F2TDJS8ODSDA.1 size=1048576 2024-09-14T11:22:23.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.084+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~F2TDJS8ODSDA.2 size=906999 2024-09-14T11:22:23.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.093+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=F2TDJS8ODSDA tag=N80CE3JFGSJW type=write size=4052727 2024-09-14T11:22:23.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.095+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=VNTCMPOXFT3O type=del size=178947 2024-09-14T11:22:23.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.096+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=JMSCMI3ZFYIM type=del 2024-09-14T11:22:23.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.097+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=EODJJZMRK36G type=write size=955745 2024-09-14T11:22:23.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.099+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~QKS5STD9E1L4.0 size=1048576 2024-09-14T11:22:23.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.100+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~QKS5STD9E1L4.1 size=244956 2024-09-14T11:22:23.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.102+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=QKS5STD9E1L4 tag=9SFT5QKNGKK0 type=write size=2342108 2024-09-14T11:22:23.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.104+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=UNXGCLS9LDZD type=del size=753545 2024-09-14T11:22:23.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.105+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=MQ8B17MILJGK type=del 2024-09-14T11:22:23.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.107+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=143VXZX5FDX8 type=del size=1004231 2024-09-14T11:22:23.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.109+0000 7f43cc561780 1 < suggested update operation key=CXP2PUIXR2PA tag=K4184LEM7GJR type=del size=1960664 2024-09-14T11:22:23.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.112+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~F8G615NJGCLE.0 size=1048576 2024-09-14T11:22:23.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.113+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~F8G615NJGCLE.1 size=289848 2024-09-14T11:22:23.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.113+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=F8G615NJGCLE tag=FMYHL339X4PT type=write size=2387000 2024-09-14T11:22:23.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.114+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~KVKAKOIPW5YR.0 size=110783 2024-09-14T11:22:23.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.116+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=KVKAKOIPW5YR tag=9EVCYDHVXJF2 type=write size=1159359 2024-09-14T11:22:23.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.117+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=99HMOE6PHMCA type=del size=729973 2024-09-14T11:22:23.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.118+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~75H5AYUMEEQR.0 size=1048576 2024-09-14T11:22:23.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.119+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~75H5AYUMEEQR.1 size=1048576 2024-09-14T11:22:23.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.120+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~75H5AYUMEEQR.2 size=161962 2024-09-14T11:22:23.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.122+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=75H5AYUMEEQR tag=M4FFRWQ9AXIQ type=write size=3307690 2024-09-14T11:22:23.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.123+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=D5IXQUU2SVR2 type=del size=1153510 2024-09-14T11:22:23.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.126+0000 7f43cc561780 1 < suggested update operation key=S3NOACTF4K2W tag=QCS4F5TV4KF5 type=del size=1220515 2024-09-14T11:22:23.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.127+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=2KSB7LV457OI type=del size=1127860 2024-09-14T11:22:23.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.128+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~SD13C6M73A49.0 size=1048576 2024-09-14T11:22:23.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.128+0000 7f43cc561780 1 < canceled part key=_multipart_OV4ATW747PY4.2~SD13C6M73A49.1 size=1048576 2024-09-14T11:22:23.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.129+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~SD13C6M73A49.2 size=151149 2024-09-14T11:22:23.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.131+0000 7f43cc561780 1 < canceled multipart upload key=OV4ATW747PY4 upload=SD13C6M73A49 tag=OEU1NAY87EHK type=write size=3296877 2024-09-14T11:22:23.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.132+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=KKEC08G5F824 type=del size=3810715 2024-09-14T11:22:23.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.132+0000 7f43cc561780 1 < canceled part key=_multipart_UWES4CQZ8XW6.2~9FL8YX8VOEZA.0 size=1048576 2024-09-14T11:22:23.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.132+0000 7f43cc561780 1 < canceled part key=_multipart_UWES4CQZ8XW6.2~9FL8YX8VOEZA.1 size=1048576 2024-09-14T11:22:23.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.132+0000 7f43cc561780 1 < canceled part key=_multipart_UWES4CQZ8XW6.2~9FL8YX8VOEZA.2 size=334869 2024-09-14T11:22:23.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.134+0000 7f43cc561780 1 < canceled multipart upload key=UWES4CQZ8XW6 upload=9FL8YX8VOEZA tag=N1OLDJDZWC1O type=write size=3480597 2024-09-14T11:22:23.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.136+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~4M1Q1GLAP7F7.0 size=658035 2024-09-14T11:22:23.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.136+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=4M1Q1GLAP7F7 tag=Q7JGCHM4W0GN type=write size=1706611 2024-09-14T11:22:23.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.137+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~7MMCD7AN8J3M.0 size=1048576 2024-09-14T11:22:23.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.138+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~7MMCD7AN8J3M.1 size=48862 2024-09-14T11:22:23.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.140+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=7MMCD7AN8J3M tag=JDBGU9U7IL6C type=write size=2146014 2024-09-14T11:22:23.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.142+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~WBMW1F4YINRW.0 size=589599 2024-09-14T11:22:23.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.142+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=WBMW1F4YINRW tag=HPP35UC18OVR type=write size=1638175 2024-09-14T11:22:23.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.144+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=65SXF30VOFQQ type=write size=527994 2024-09-14T11:22:23.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.146+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~SPKJ478N4IWO.0 size=1048576 2024-09-14T11:22:23.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.147+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~SPKJ478N4IWO.1 size=1048576 2024-09-14T11:22:23.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.148+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~SPKJ478N4IWO.2 size=14919 2024-09-14T11:22:23.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.148+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=SPKJ478N4IWO tag=MW9H1NVTQR0B type=write size=3160647 2024-09-14T11:22:23.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.149+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~BHX49UI7SION.0 size=1048576 2024-09-14T11:22:23.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.150+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~BHX49UI7SION.1 size=6954 2024-09-14T11:22:23.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.152+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=BHX49UI7SION tag=OL8AQUUVJQK9 type=write size=2104106 2024-09-14T11:22:23.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.153+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=SQGGLW5R3192 type=del size=3259127 2024-09-14T11:22:23.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.155+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~BLI62SU3K585.0 size=949300 2024-09-14T11:22:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.157+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=BLI62SU3K585 tag=IUL6L8UOXYAQ type=write size=1997876 2024-09-14T11:22:23.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.160+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~C3MLWC9FLG36.0 size=1048576 2024-09-14T11:22:23.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.161+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~C3MLWC9FLG36.1 size=1048576 2024-09-14T11:22:23.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.162+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~C3MLWC9FLG36.2 size=623904 2024-09-14T11:22:23.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.162+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=C3MLWC9FLG36 tag=S5G0RVI3ST64 type=write size=3769632 2024-09-14T11:22:23.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.163+0000 7f43cc561780 1 < completed write operation key=IG4QM506P41B tag=6DGM7MTJY2OZ type=write size=986288 2024-09-14T11:22:23.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.164+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=3VQU5NBXZK8D type=write size=943679 2024-09-14T11:22:23.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.164+0000 7f43cc561780 1 < canceled part key=_multipart_3YHEZHW0RS1W.2~5CW96T5YHNUP.0 size=1048576 2024-09-14T11:22:23.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.165+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~5CW96T5YHNUP.1 size=932055 2024-09-14T11:22:23.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.167+0000 7f43cc561780 1 < canceled multipart upload key=3YHEZHW0RS1W upload=5CW96T5YHNUP tag=V4T7LJP1F7RR type=write size=3029207 2024-09-14T11:22:23.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.170+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~CM6XJVRE14VO.0 size=1048576 2024-09-14T11:22:23.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.171+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~CM6XJVRE14VO.1 size=816138 2024-09-14T11:22:23.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.171+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=CM6XJVRE14VO tag=RLHJFEF4HUZR type=write size=2913290 2024-09-14T11:22:23.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.172+0000 7f43cc561780 1 < canceled operation key=D8EBH4NWN7SK tag=VNTCMPOXFT3O type=del size=178947 2024-09-14T11:22:23.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.173+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=LOC6Z2IL0CXR type=del size=3513447 2024-09-14T11:22:23.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.175+0000 7f43cc561780 1 < suggested remove operation key=WSFZN6JCWUXG tag=EODJJZMRK36G type=write 2024-09-14T11:22:23.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.176+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=61UH4LZ8G049 type=del size=1364686 2024-09-14T11:22:23.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.177+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=UNXGCLS9LDZD type=del 2024-09-14T11:22:23.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.180+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~KEMV11IUC0WD.0 size=1048576 2024-09-14T11:22:23.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.180+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~KEMV11IUC0WD.1 size=1048576 2024-09-14T11:22:23.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.181+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~KEMV11IUC0WD.2 size=489108 2024-09-14T11:22:23.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.181+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=KEMV11IUC0WD tag=0GJC2EKF26EO type=write size=3634836 2024-09-14T11:22:23.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.183+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=143VXZX5FDX8 type=del 2024-09-14T11:22:23.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.185+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~S49WFI69K0ZU.0 size=1048576 2024-09-14T11:22:23.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.186+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~S49WFI69K0ZU.1 size=906349 2024-09-14T11:22:23.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.186+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=S49WFI69K0ZU tag=2RHSWI6981VV type=write size=3003501 2024-09-14T11:22:23.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.187+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~F8G615NJGCLE.0 size=1048576 2024-09-14T11:22:23.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.188+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~F8G615NJGCLE.1 size=289848 2024-09-14T11:22:23.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.190+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=F8G615NJGCLE tag=FMYHL339X4PT type=write size=2387000 2024-09-14T11:22:23.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.191+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=5PJ6FSF6X4MD type=del size=1527035 2024-09-14T11:22:23.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.192+0000 7f43cc561780 1 < canceled operation key=BNNSFLYOU27F tag=99HMOE6PHMCA type=del size=729973 2024-09-14T11:22:23.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.194+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=CK6KA9JE5CQ7 type=del size=372915 2024-09-14T11:22:23.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.195+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=D5IXQUU2SVR2 type=del 2024-09-14T11:22:23.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.197+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~BDT8I3Y4W0K5.0 size=220275 2024-09-14T11:22:23.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.197+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=BDT8I3Y4W0K5 tag=YVCRIWHHFOXQ type=write size=1268851 2024-09-14T11:22:23.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.198+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=2KSB7LV457OI type=del 2024-09-14T11:22:23.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.200+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~GZLUIFHU5TSH.0 size=1048576 2024-09-14T11:22:23.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.201+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~GZLUIFHU5TSH.1 size=1048576 2024-09-14T11:22:23.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.202+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~GZLUIFHU5TSH.2 size=1043857 2024-09-14T11:22:23.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.202+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=GZLUIFHU5TSH tag=99T9AWQZ4MCX type=write size=4189585 2024-09-14T11:22:23.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.204+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=KKEC08G5F824 type=del 2024-09-14T11:22:23.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.206+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~VPPH78WTUSQA.0 size=167375 2024-09-14T11:22:23.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.206+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=VPPH78WTUSQA tag=LKA7BNDZ1KSN type=write size=1215951 2024-09-14T11:22:23.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.207+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~4M1Q1GLAP7F7.0 size=658035 2024-09-14T11:22:23.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.209+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=4M1Q1GLAP7F7 tag=Q7JGCHM4W0GN type=write size=1706611 2024-09-14T11:22:23.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.211+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=E42WDCSFZ3B6 type=write size=94110 2024-09-14T11:22:23.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.212+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~WBMW1F4YINRW.0 size=589599 2024-09-14T11:22:23.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.214+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=WBMW1F4YINRW tag=HPP35UC18OVR type=write size=1638175 2024-09-14T11:22:23.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.216+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=HGMCFUDWYKCB type=del size=731500 2024-09-14T11:22:23.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.217+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~SPKJ478N4IWO.0 size=1048576 2024-09-14T11:22:23.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.218+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~SPKJ478N4IWO.1 size=1048576 2024-09-14T11:22:23.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.219+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~SPKJ478N4IWO.2 size=14919 2024-09-14T11:22:23.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.221+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=SPKJ478N4IWO tag=MW9H1NVTQR0B type=write size=3160647 2024-09-14T11:22:23.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.224+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~BU0H703H0YV1.0 size=43829 2024-09-14T11:22:23.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.224+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=BU0H703H0YV1 tag=XEI3175F9LZS type=write size=1092405 2024-09-14T11:22:23.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.225+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=SQGGLW5R3192 type=del 2024-09-14T11:22:23.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.226+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=352QH6W8JOAL type=del size=1355341 2024-09-14T11:22:23.226 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.227+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~C3MLWC9FLG36.0 size=1048576 2024-09-14T11:22:23.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.228+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~C3MLWC9FLG36.1 size=1048576 2024-09-14T11:22:23.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.229+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~C3MLWC9FLG36.2 size=623904 2024-09-14T11:22:23.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.231+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=C3MLWC9FLG36 tag=S5G0RVI3ST64 type=write size=3769632 2024-09-14T11:22:23.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.233+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=EYUNKOBT7TI8 type=del size=3729707 2024-09-14T11:22:23.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.235+0000 7f43cc561780 1 < suggested update operation key=1M46U4U9MG1E tag=3VQU5NBXZK8D type=write size=943679 2024-09-14T11:22:23.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.236+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=R4FFFGS7ODYB type=write size=386049 2024-09-14T11:22:23.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.237+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~CM6XJVRE14VO.0 size=1048576 2024-09-14T11:22:23.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.238+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~CM6XJVRE14VO.1 size=816138 2024-09-14T11:22:23.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.240+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=CM6XJVRE14VO tag=RLHJFEF4HUZR type=write size=2913290 2024-09-14T11:22:23.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.241+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=N0SBDZA9P7O2 type=del size=366207 2024-09-14T11:22:23.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.242+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=LOC6Z2IL0CXR type=del 2024-09-14T11:22:23.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.244+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=QAEFCMC5F56E type=del size=2324787 2024-09-14T11:22:23.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.245+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=61UH4LZ8G049 type=del 2024-09-14T11:22:23.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.246+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=WO03ICC7QUBY type=del size=1625298 2024-09-14T11:22:23.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.246+0000 7f43cc561780 1 < canceled part key=_multipart_BNNSFLYOU27F.2~KEMV11IUC0WD.0 size=1048576 2024-09-14T11:22:23.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.248+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~KEMV11IUC0WD.1 size=1048576 2024-09-14T11:22:23.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.248+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~KEMV11IUC0WD.2 size=489108 2024-09-14T11:22:23.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.251+0000 7f43cc561780 1 < canceled multipart upload key=BNNSFLYOU27F upload=KEMV11IUC0WD tag=0GJC2EKF26EO type=write size=3634836 2024-09-14T11:22:23.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.253+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WU7S1SEQQCG3.0 size=1048576 2024-09-14T11:22:23.253 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.254+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WU7S1SEQQCG3.1 size=694776 2024-09-14T11:22:23.253 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.254+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=WU7S1SEQQCG3 tag=820ZQ6FL7UG2 type=write size=2791928 2024-09-14T11:22:23.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.255+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~S49WFI69K0ZU.0 size=1048576 2024-09-14T11:22:23.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.256+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~S49WFI69K0ZU.1 size=906349 2024-09-14T11:22:23.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.258+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=S49WFI69K0ZU tag=2RHSWI6981VV type=write size=3003501 2024-09-14T11:22:23.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.259+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=QVVSGX6I1OR1 type=del size=1695453 2024-09-14T11:22:23.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.261+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=5PJ6FSF6X4MD type=del 2024-09-14T11:22:23.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.262+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=W5KMK9TEDL5R type=del size=2860110 2024-09-14T11:22:23.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.263+0000 7f43cc561780 -1 < failed to complete operation key=1M46U4U9MG1E tag=CK6KA9JE5CQ7 type=del size=372915: (22) Invalid argument 2024-09-14T11:22:23.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.266+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~19DDXTVFRNV2.0 size=1048576 2024-09-14T11:22:23.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.267+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~19DDXTVFRNV2.1 size=613501 2024-09-14T11:22:23.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.267+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=19DDXTVFRNV2 tag=EIT9N3S1O49V type=write size=2710653 2024-09-14T11:22:23.267 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.268+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~BDT8I3Y4W0K5.0 size=220275 2024-09-14T11:22:23.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.270+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=BDT8I3Y4W0K5 tag=YVCRIWHHFOXQ type=write size=1268851 2024-09-14T11:22:23.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.273+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~RFRY510ZBLBU.0 size=1048576 2024-09-14T11:22:23.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.274+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~RFRY510ZBLBU.1 size=1048576 2024-09-14T11:22:23.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.275+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~RFRY510ZBLBU.2 size=708555 2024-09-14T11:22:23.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.275+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=RFRY510ZBLBU tag=85WVH9IVI2CL type=write size=3854283 2024-09-14T11:22:23.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.276+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~GZLUIFHU5TSH.0 size=1048576 2024-09-14T11:22:23.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.277+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~GZLUIFHU5TSH.1 size=1048576 2024-09-14T11:22:23.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.277+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~GZLUIFHU5TSH.2 size=1043857 2024-09-14T11:22:23.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.279+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=GZLUIFHU5TSH tag=99T9AWQZ4MCX type=write size=4189585 2024-09-14T11:22:23.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.280+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=YO8G047KDTVY type=del size=1812186 2024-09-14T11:22:23.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.281+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~VPPH78WTUSQA.0 size=167375 2024-09-14T11:22:23.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.283+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=VPPH78WTUSQA tag=LKA7BNDZ1KSN type=write size=1215951 2024-09-14T11:22:23.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.285+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~9XGZFZP0ARD3.0 size=1048576 2024-09-14T11:22:23.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.286+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~9XGZFZP0ARD3.1 size=1048576 2024-09-14T11:22:23.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.287+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~9XGZFZP0ARD3.2 size=299146 2024-09-14T11:22:23.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.287+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=9XGZFZP0ARD3 tag=6CG0P2OUIXI9 type=write size=3444874 2024-09-14T11:22:23.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.288+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=E42WDCSFZ3B6 type=write size=94110 2024-09-14T11:22:23.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.290+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=3179Q4UTJKZC type=del size=1676558 2024-09-14T11:22:23.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.291+0000 7f43cc561780 1 < canceled operation key=MD14RGOQY0LK tag=HGMCFUDWYKCB type=del size=731500 2024-09-14T11:22:23.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.292+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=1KWX16T6PZDL type=write size=225845 2024-09-14T11:22:23.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.293+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~BU0H703H0YV1.0 size=43829 2024-09-14T11:22:23.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.295+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=BU0H703H0YV1 tag=XEI3175F9LZS type=write size=1092405 2024-09-14T11:22:23.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.297+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~ZYNW07RQ8R3L.0 size=1048576 2024-09-14T11:22:23.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.298+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~ZYNW07RQ8R3L.1 size=266629 2024-09-14T11:22:23.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.298+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=ZYNW07RQ8R3L tag=EF63YIB1VXM5 type=write size=2363781 2024-09-14T11:22:23.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.299+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=352QH6W8JOAL type=del 2024-09-14T11:22:23.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.300+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=1BCVRKGTA8YY type=del size=1981652 2024-09-14T11:22:23.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.303+0000 7f43cc561780 1 < suggested update operation key=AWBBRU4C8RDQ tag=EYUNKOBT7TI8 type=del size=3729707 2024-09-14T11:22:23.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.304+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=U70Z57LY2JVY type=del size=1201170 2024-09-14T11:22:23.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.306+0000 7f43cc561780 1 < completed write operation key=CXP2PUIXR2PA tag=R4FFFGS7ODYB type=write size=386049 2024-09-14T11:22:23.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.308+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HBJ37JVWAIED.0 size=1048576 2024-09-14T11:22:23.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.309+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HBJ37JVWAIED.1 size=860690 2024-09-14T11:22:23.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.309+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=HBJ37JVWAIED tag=RMKGCA2RVKQT type=write size=2957842 2024-09-14T11:22:23.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.311+0000 7f43cc561780 1 < suggested remove operation key=UWES4CQZ8XW6 tag=N0SBDZA9P7O2 type=del 2024-09-14T11:22:23.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.312+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=Z4SZATHJV1CB type=write size=325017 2024-09-14T11:22:23.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.313+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=QAEFCMC5F56E type=del 2024-09-14T11:22:23.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.315+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=N53UI03QED5C type=del size=175595 2024-09-14T11:22:23.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.317+0000 7f43cc561780 1 < suggested remove operation key=FISMBWPDPCTA tag=WO03ICC7QUBY type=del 2024-09-14T11:22:23.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.318+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=KRX0PPDKC8NV type=del size=923306 2024-09-14T11:22:23.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.320+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~WU7S1SEQQCG3.0 size=1048576 2024-09-14T11:22:23.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.321+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~WU7S1SEQQCG3.1 size=694776 2024-09-14T11:22:23.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.323+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=WU7S1SEQQCG3 tag=820ZQ6FL7UG2 type=write size=2791928 2024-09-14T11:22:23.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.324+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=HSSABJCHKUPJ type=write size=746523 2024-09-14T11:22:23.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.325+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=QVVSGX6I1OR1 type=del 2024-09-14T11:22:23.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.326+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=JL15VE92I8RV type=write size=890974 2024-09-14T11:22:23.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.328+0000 7f43cc561780 1 < suggested remove operation key=AY7JGVM96MO7 tag=W5KMK9TEDL5R type=del 2024-09-14T11:22:23.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.331+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~FA1QWKK0LFK4.0 size=1048576 2024-09-14T11:22:23.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.332+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~FA1QWKK0LFK4.1 size=73564 2024-09-14T11:22:23.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.332+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=FA1QWKK0LFK4 tag=2FQISD7FNWTE type=write size=2170716 2024-09-14T11:22:23.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.333+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~19DDXTVFRNV2.0 size=1048576 2024-09-14T11:22:23.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.334+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~19DDXTVFRNV2.1 size=613501 2024-09-14T11:22:23.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.336+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=19DDXTVFRNV2 tag=EIT9N3S1O49V type=write size=2710653 2024-09-14T11:22:23.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.337+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=FF22OI0CYRKT type=del size=2167509 2024-09-14T11:22:23.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.339+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~RFRY510ZBLBU.0 size=1048576 2024-09-14T11:22:23.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.340+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~RFRY510ZBLBU.1 size=1048576 2024-09-14T11:22:23.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.341+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~RFRY510ZBLBU.2 size=708555 2024-09-14T11:22:23.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.343+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=RFRY510ZBLBU tag=85WVH9IVI2CL type=write size=3854283 2024-09-14T11:22:23.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.345+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=9L7G3R8X8UNX type=del size=1287961 2024-09-14T11:22:23.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.346+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=YO8G047KDTVY type=del 2024-09-14T11:22:23.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.347+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=14R2QRR6GE1N type=del size=3071905 2024-09-14T11:22:23.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.349+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~9XGZFZP0ARD3.0 size=1048576 2024-09-14T11:22:23.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.350+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~9XGZFZP0ARD3.1 size=1048576 2024-09-14T11:22:23.350 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.351+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~9XGZFZP0ARD3.2 size=299146 2024-09-14T11:22:23.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.354+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=9XGZFZP0ARD3 tag=6CG0P2OUIXI9 type=write size=3444874 2024-09-14T11:22:23.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.355+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=5PA9GZNC8HPG type=del size=3260683 2024-09-14T11:22:23.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.357+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=3179Q4UTJKZC type=del 2024-09-14T11:22:23.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.358+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=TKK2ULHG7P6F type=write size=127697 2024-09-14T11:22:23.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.359+0000 7f43cc561780 1 < completed write operation key=BRHP3DQEO3HZ tag=1KWX16T6PZDL type=write size=225845 2024-09-14T11:22:23.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.361+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=DA943TSZKFUV type=del size=3245541 2024-09-14T11:22:23.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.362+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~ZYNW07RQ8R3L.0 size=1048576 2024-09-14T11:22:23.362 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.363+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~ZYNW07RQ8R3L.1 size=266629 2024-09-14T11:22:23.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.366+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=ZYNW07RQ8R3L tag=EF63YIB1VXM5 type=write size=2363781 2024-09-14T11:22:23.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.367+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=8J2E3F5W1WX8 type=del size=3909455 2024-09-14T11:22:23.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.369+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=1BCVRKGTA8YY type=del 2024-09-14T11:22:23.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.371+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~GF822GKULHSH.0 size=1048576 2024-09-14T11:22:23.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.372+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~GF822GKULHSH.1 size=1048576 2024-09-14T11:22:23.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.373+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~GF822GKULHSH.2 size=1002269 2024-09-14T11:22:23.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.373+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=GF822GKULHSH tag=NCCDW1ZJKLC5 type=write size=4147997 2024-09-14T11:22:23.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.375+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=U70Z57LY2JVY type=del 2024-09-14T11:22:23.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.377+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~8U2VJE7QT6O6.0 size=1048576 2024-09-14T11:22:23.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.378+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~8U2VJE7QT6O6.1 size=1048576 2024-09-14T11:22:23.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.379+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~8U2VJE7QT6O6.2 size=498871 2024-09-14T11:22:23.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.379+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=8U2VJE7QT6O6 tag=VEVF6L9WMJA4 type=write size=3644599 2024-09-14T11:22:23.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.381+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HBJ37JVWAIED.0 size=1048576 2024-09-14T11:22:23.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.382+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HBJ37JVWAIED.1 size=860690 2024-09-14T11:22:23.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.384+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=HBJ37JVWAIED tag=RMKGCA2RVKQT type=write size=2957842 2024-09-14T11:22:23.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.385+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=PSVE1Y9M7HY0 type=del size=3080439 2024-09-14T11:22:23.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.386+0000 7f43cc561780 1 < completed write operation key=BZDW69C3Z97G tag=Z4SZATHJV1CB type=write size=325017 2024-09-14T11:22:23.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.388+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~BINJR6TKPMDC.0 size=1048576 2024-09-14T11:22:23.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.390+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~BINJR6TKPMDC.1 size=141129 2024-09-14T11:22:23.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.390+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=BINJR6TKPMDC tag=UNFVZ1TSQJFL type=write size=2238281 2024-09-14T11:22:23.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.392+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=N53UI03QED5C type=del 2024-09-14T11:22:23.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.393+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=ZDU010ZZ2K48 type=del size=1577485 2024-09-14T11:22:23.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.394+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=KRX0PPDKC8NV type=del 2024-09-14T11:22:23.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.396+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=16B3RG2ERRRW type=del size=1267115 2024-09-14T11:22:23.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.397+0000 7f43cc561780 1 < completed write operation key=BZDW69C3Z97G tag=HSSABJCHKUPJ type=write size=746523 2024-09-14T11:22:23.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.399+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~BGQU096K4S85.0 size=1048576 2024-09-14T11:22:23.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.400+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~BGQU096K4S85.1 size=172168 2024-09-14T11:22:23.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.400+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=BGQU096K4S85 tag=E9J5GRL56MMA type=write size=2269320 2024-09-14T11:22:23.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.401+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=JL15VE92I8RV type=write size=890974 2024-09-14T11:22:23.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.402+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=37PKEU73042C type=del size=3145675 2024-09-14T11:22:23.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.403+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~FA1QWKK0LFK4.0 size=1048576 2024-09-14T11:22:23.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.404+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~FA1QWKK0LFK4.1 size=73564 2024-09-14T11:22:23.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.406+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=FA1QWKK0LFK4 tag=2FQISD7FNWTE type=write size=2170716 2024-09-14T11:22:23.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.409+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~SNJUZB195G4T.0 size=650576 2024-09-14T11:22:23.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.409+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=SNJUZB195G4T tag=29MDSIL8WLHU type=write size=1699152 2024-09-14T11:22:23.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.410+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=FF22OI0CYRKT type=del 2024-09-14T11:22:23.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.413+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~6ZIGJXOQWQ8D.0 size=634233 2024-09-14T11:22:23.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.413+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=6ZIGJXOQWQ8D tag=IYNTAG1GYODE type=write size=1682809 2024-09-14T11:22:23.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.414+0000 7f43cc561780 1 < canceled operation key=END3SHHS0FSA tag=9L7G3R8X8UNX type=del size=1287961 2024-09-14T11:22:23.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.415+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=1T251V74JAX4 type=del size=1541863 2024-09-14T11:22:23.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.416+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=14R2QRR6GE1N type=del 2024-09-14T11:22:23.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.418+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=J710N7X1GP73 type=del size=677149 2024-09-14T11:22:23.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.420+0000 7f43cc561780 1 < suggested update operation key=IFHWMI5YO5L5 tag=5PA9GZNC8HPG type=del size=3260683 2024-09-14T11:22:23.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.421+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=G0SVH5WEZ51V type=del size=587922 2024-09-14T11:22:23.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.424+0000 7f43cc561780 1 < suggested remove operation key=AWBBRU4C8RDQ tag=TKK2ULHG7P6F type=write 2024-09-14T11:22:23.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.425+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=3SWATRZTNHOQ type=write size=1034077 2024-09-14T11:22:23.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.426+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=DA943TSZKFUV type=del 2024-09-14T11:22:23.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.428+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=TSFIGNR6MVHF type=del size=3331136 2024-09-14T11:22:23.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.430+0000 7f43cc561780 1 < suggested update operation key=9XIAGZKIUBGH tag=8J2E3F5W1WX8 type=del size=3909455 2024-09-14T11:22:23.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.432+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~H2D6W2SNL6GN.0 size=921196 2024-09-14T11:22:23.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.432+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=H2D6W2SNL6GN tag=N06TV9TCUDAA type=write size=1969772 2024-09-14T11:22:23.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.433+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~GF822GKULHSH.0 size=1048576 2024-09-14T11:22:23.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.434+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~GF822GKULHSH.1 size=1048576 2024-09-14T11:22:23.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.435+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~GF822GKULHSH.2 size=1002269 2024-09-14T11:22:23.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.437+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=GF822GKULHSH tag=NCCDW1ZJKLC5 type=write size=4147997 2024-09-14T11:22:23.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.438+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=B6NF0TQN3GM0 type=del size=2363255 2024-09-14T11:22:23.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.440+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~8U2VJE7QT6O6.0 size=1048576 2024-09-14T11:22:23.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.441+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~8U2VJE7QT6O6.1 size=1048576 2024-09-14T11:22:23.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.442+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~8U2VJE7QT6O6.2 size=498871 2024-09-14T11:22:23.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.444+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=8U2VJE7QT6O6 tag=VEVF6L9WMJA4 type=write size=3644599 2024-09-14T11:22:23.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.446+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~FXEKJOTELDL6.0 size=790518 2024-09-14T11:22:23.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.446+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=FXEKJOTELDL6 tag=HCZ9FOXY8XTZ type=write size=1839094 2024-09-14T11:22:23.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.448+0000 7f43cc561780 -1 < failed to complete operation key=IFHWMI5YO5L5 tag=PSVE1Y9M7HY0 type=del size=3080439: (22) Invalid argument 2024-09-14T11:22:23.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.449+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=NWT9HZFS9TTO type=del size=2201641 2024-09-14T11:22:23.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.450+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~BINJR6TKPMDC.0 size=1048576 2024-09-14T11:22:23.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.451+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~BINJR6TKPMDC.1 size=141129 2024-09-14T11:22:23.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.453+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=BINJR6TKPMDC tag=UNFVZ1TSQJFL type=write size=2238281 2024-09-14T11:22:23.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.455+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~6N29AXJP3RSQ.0 size=1048576 2024-09-14T11:22:23.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.456+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~6N29AXJP3RSQ.1 size=186969 2024-09-14T11:22:23.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.456+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=6N29AXJP3RSQ tag=BECS1FZEN042 type=write size=2284121 2024-09-14T11:22:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.457+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=ZDU010ZZ2K48 type=del 2024-09-14T11:22:23.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.458+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=MKJBS1JOFQRR type=write size=273476 2024-09-14T11:22:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.460+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=16B3RG2ERRRW type=del 2024-09-14T11:22:23.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.461+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=B73EX59KA20E type=write size=590158 2024-09-14T11:22:23.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.462+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~BGQU096K4S85.0 size=1048576 2024-09-14T11:22:23.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.463+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~BGQU096K4S85.1 size=172168 2024-09-14T11:22:23.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.465+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=BGQU096K4S85 tag=E9J5GRL56MMA type=write size=2269320 2024-09-14T11:22:23.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.467+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=GGVSUHJ02Y5O type=del size=1601981 2024-09-14T11:22:23.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.468+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=37PKEU73042C type=del 2024-09-14T11:22:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.469+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=9IKFVOWIWTVY type=del size=1375894 2024-09-14T11:22:23.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.470+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~SNJUZB195G4T.0 size=650576 2024-09-14T11:22:23.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.473+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=SNJUZB195G4T tag=29MDSIL8WLHU type=write size=1699152 2024-09-14T11:22:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.474+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=F5HSQKAU8SDJ type=del size=1447274 2024-09-14T11:22:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.474+0000 7f43cc561780 1 < canceled part key=_multipart_IFHWMI5YO5L5.2~6ZIGJXOQWQ8D.0 size=634233 2024-09-14T11:22:23.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.476+0000 7f43cc561780 1 < canceled multipart upload key=IFHWMI5YO5L5 upload=6ZIGJXOQWQ8D tag=IYNTAG1GYODE type=write size=1682809 2024-09-14T11:22:23.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.477+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=DTYLKWBYQ0L1 type=write size=434984 2024-09-14T11:22:23.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.479+0000 7f43cc561780 -1 < failed to complete operation key=IFHWMI5YO5L5 tag=1T251V74JAX4 type=del size=1541863: (22) Invalid argument 2024-09-14T11:22:23.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.480+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=6DM1BNEPX1GP type=del size=4092632 2024-09-14T11:22:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.481+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=J710N7X1GP73 type=del 2024-09-14T11:22:23.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.482+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=4WVTTCBABIXX type=write size=750027 2024-09-14T11:22:23.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.484+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=G0SVH5WEZ51V type=del 2024-09-14T11:22:23.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.485+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=FOD7LBX886G0 type=del size=3417340 2024-09-14T11:22:23.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.486+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=3SWATRZTNHOQ type=write size=1034077 2024-09-14T11:22:23.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.487+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=UI82ZI41TT5J type=del size=1034634 2024-09-14T11:22:23.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.489+0000 7f43cc561780 -1 < failed to complete operation key=9XIAGZKIUBGH tag=TSFIGNR6MVHF type=del size=3331136: (22) Invalid argument 2024-09-14T11:22:23.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.490+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=336RBHPL6W5F type=del size=990576 2024-09-14T11:22:23.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.491+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~H2D6W2SNL6GN.0 size=921196 2024-09-14T11:22:23.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.493+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=H2D6W2SNL6GN tag=N06TV9TCUDAA type=write size=1969772 2024-09-14T11:22:23.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.495+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~J7MJHICVDFLP.0 size=883620 2024-09-14T11:22:23.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.495+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=J7MJHICVDFLP tag=U1YZGV79ZZ5H type=write size=1932196 2024-09-14T11:22:23.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.497+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=B6NF0TQN3GM0 type=del 2024-09-14T11:22:23.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.498+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=7YTS6D379LXI type=del size=825947 2024-09-14T11:22:23.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.499+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~FXEKJOTELDL6.0 size=790518 2024-09-14T11:22:23.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.501+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=FXEKJOTELDL6 tag=HCZ9FOXY8XTZ type=write size=1839094 2024-09-14T11:22:23.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.502+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=MMJ5F29AQGS2 type=del size=3183972 2024-09-14T11:22:23.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.504+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=NWT9HZFS9TTO type=del 2024-09-14T11:22:23.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.505+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=QR51A6C7XDP4 type=write size=645674 2024-09-14T11:22:23.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.506+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~6N29AXJP3RSQ.0 size=1048576 2024-09-14T11:22:23.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.508+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~6N29AXJP3RSQ.1 size=186969 2024-09-14T11:22:23.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.510+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=6N29AXJP3RSQ tag=BECS1FZEN042 type=write size=2284121 2024-09-14T11:22:23.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.511+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=Z7DHOZ0VKVW9 type=write size=564583 2024-09-14T11:22:23.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.513+0000 7f43cc561780 1 < completed write operation key=683ZFW0BWMT7 tag=MKJBS1JOFQRR type=write size=273476 2024-09-14T11:22:23.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.514+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=W2BMDD3YQIXT type=write size=305360 2024-09-14T11:22:23.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.516+0000 7f43cc561780 1 < suggested remove operation key=FISMBWPDPCTA tag=B73EX59KA20E type=write 2024-09-14T11:22:23.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.517+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=2A0337JMS14P type=del size=1211770 2024-09-14T11:22:23.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.520+0000 7f43cc561780 1 < suggested update operation key=END3SHHS0FSA tag=GGVSUHJ02Y5O type=del size=1601981 2024-09-14T11:22:23.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.521+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=U4YI1RCDHWUS type=del size=2999544 2024-09-14T11:22:23.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.523+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=9IKFVOWIWTVY type=del 2024-09-14T11:22:23.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.525+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~JTOH46K8KFE1.0 size=806337 2024-09-14T11:22:23.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.525+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=JTOH46K8KFE1 tag=7YBGO6I2CKVM type=write size=1854913 2024-09-14T11:22:23.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.526+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=F5HSQKAU8SDJ type=del 2024-09-14T11:22:23.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.528+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~U1L3GEGOF4VM.0 size=1048576 2024-09-14T11:22:23.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.529+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~U1L3GEGOF4VM.1 size=1048576 2024-09-14T11:22:23.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.530+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~U1L3GEGOF4VM.2 size=714331 2024-09-14T11:22:23.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.530+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=U1L3GEGOF4VM tag=D181P03U2B4B type=write size=3860059 2024-09-14T11:22:23.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.531+0000 7f43cc561780 1 < completed write operation key=683ZFW0BWMT7 tag=DTYLKWBYQ0L1 type=write size=434984 2024-09-14T11:22:23.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.534+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~XTY7GIR27CQE.0 size=161934 2024-09-14T11:22:23.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.534+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=XTY7GIR27CQE tag=ZO6XU0RFYZY1 type=write size=1210510 2024-09-14T11:22:23.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.536+0000 7f43cc561780 1 < suggested update operation key=E6FDCACWGA2Y tag=6DM1BNEPX1GP type=del size=4092632 2024-09-14T11:22:23.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.537+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=M8NU3X5ED0UT type=del size=3012 2024-09-14T11:22:23.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.539+0000 7f43cc561780 1 < canceled operation key=UWES4CQZ8XW6 tag=4WVTTCBABIXX type=write size=750027 2024-09-14T11:22:23.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.541+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~BHLM9031KOPC.0 size=1048576 2024-09-14T11:22:23.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.542+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~BHLM9031KOPC.1 size=1048576 2024-09-14T11:22:23.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.543+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~BHLM9031KOPC.2 size=374896 2024-09-14T11:22:23.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.543+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=BHLM9031KOPC tag=PFKV40AZIE3X type=write size=3520624 2024-09-14T11:22:23.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.544+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=FOD7LBX886G0 type=del 2024-09-14T11:22:23.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.546+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~9LO6S0MMIRSE.0 size=308063 2024-09-14T11:22:23.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.546+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=9LO6S0MMIRSE tag=RVRR9VIX6W28 type=write size=1356639 2024-09-14T11:22:23.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.548+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=UI82ZI41TT5J type=del 2024-09-14T11:22:23.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.550+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~I720WC238NS8.0 size=1048576 2024-09-14T11:22:23.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.551+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~I720WC238NS8.1 size=1048576 2024-09-14T11:22:23.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.551+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~I720WC238NS8.2 size=60565 2024-09-14T11:22:23.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.551+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=I720WC238NS8 tag=J0DCWELNU7O4 type=write size=3206293 2024-09-14T11:22:23.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.553+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=336RBHPL6W5F type=del 2024-09-14T11:22:23.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.556+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~J8U98L7SB8QH.0 size=1048576 2024-09-14T11:22:23.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.557+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~J8U98L7SB8QH.1 size=562987 2024-09-14T11:22:23.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.557+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=J8U98L7SB8QH tag=QZRZA1FWSROY type=write size=2660139 2024-09-14T11:22:23.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.558+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~J7MJHICVDFLP.0 size=883620 2024-09-14T11:22:23.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.560+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=J7MJHICVDFLP tag=U1YZGV79ZZ5H type=write size=1932196 2024-09-14T11:22:23.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.562+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=41BCDHHFMLAA type=write size=645100 2024-09-14T11:22:23.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.563+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=7YTS6D379LXI type=del 2024-09-14T11:22:23.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.565+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~22AMGSHMRXPS.0 size=1048576 2024-09-14T11:22:23.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.567+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~22AMGSHMRXPS.1 size=386471 2024-09-14T11:22:23.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.567+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=22AMGSHMRXPS tag=H9MORKWA2HK0 type=write size=2483623 2024-09-14T11:22:23.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.568+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=MMJ5F29AQGS2 type=del 2024-09-14T11:22:23.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.569+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=0RKMTXUJROOQ type=del size=3849811 2024-09-14T11:22:23.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.570+0000 7f43cc561780 1 < completed write operation key=D84127SVSIPL tag=QR51A6C7XDP4 type=write size=645674 2024-09-14T11:22:23.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.573+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~PEERBZYVBBFX.0 size=1048576 2024-09-14T11:22:23.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.574+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~PEERBZYVBBFX.1 size=242112 2024-09-14T11:22:23.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.574+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=PEERBZYVBBFX tag=AICB9MKEPBVB type=write size=2339264 2024-09-14T11:22:23.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.575+0000 7f43cc561780 1 < completed write operation key=OV4ATW747PY4 tag=Z7DHOZ0VKVW9 type=write size=564583 2024-09-14T11:22:23.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.578+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~DFZETUQ3E6EY.0 size=1048576 2024-09-14T11:22:23.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.579+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~DFZETUQ3E6EY.1 size=1048576 2024-09-14T11:22:23.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.579+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~DFZETUQ3E6EY.2 size=751093 2024-09-14T11:22:23.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.579+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=DFZETUQ3E6EY tag=IJ1JHBZ8QYC2 type=write size=3896821 2024-09-14T11:22:23.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.581+0000 7f43cc561780 1 < completed write operation key=D8EBH4NWN7SK tag=W2BMDD3YQIXT type=write size=305360 2024-09-14T11:22:23.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.582+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=N3VNKBTKWNRE type=write size=389681 2024-09-14T11:22:23.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.583+0000 7f43cc561780 -1 < failed to complete operation key=END3SHHS0FSA tag=2A0337JMS14P type=del size=1211770: (22) Invalid argument 2024-09-14T11:22:23.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.585+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~V0WP70RC5YR6.0 size=1048576 2024-09-14T11:22:23.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.586+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~V0WP70RC5YR6.1 size=1048576 2024-09-14T11:22:23.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.587+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~V0WP70RC5YR6.2 size=735827 2024-09-14T11:22:23.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.587+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=V0WP70RC5YR6 tag=1WEDI8L4ZCE4 type=write size=3881555 2024-09-14T11:22:23.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.589+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=U4YI1RCDHWUS type=del 2024-09-14T11:22:23.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.590+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=OAUUR05CR4PU type=del size=543578 2024-09-14T11:22:23.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.591+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~JTOH46K8KFE1.0 size=806337 2024-09-14T11:22:23.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.593+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=JTOH46K8KFE1 tag=7YBGO6I2CKVM type=write size=1854913 2024-09-14T11:22:23.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.594+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=E9OWA6TUWWLF type=write size=137797 2024-09-14T11:22:23.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.594+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~U1L3GEGOF4VM.0 size=1048576 2024-09-14T11:22:23.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.595+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~U1L3GEGOF4VM.1 size=1048576 2024-09-14T11:22:23.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.596+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~U1L3GEGOF4VM.2 size=714331 2024-09-14T11:22:23.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.598+0000 7f43cc561780 1 < canceled multipart upload key=A1B2LIZIPET3 upload=U1L3GEGOF4VM tag=D181P03U2B4B type=write size=3860059 2024-09-14T11:22:23.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.600+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=SPH8P17H82ZL type=del size=810934 2024-09-14T11:22:23.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.601+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~XTY7GIR27CQE.0 size=161934 2024-09-14T11:22:23.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.603+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=XTY7GIR27CQE tag=ZO6XU0RFYZY1 type=write size=1210510 2024-09-14T11:22:23.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.605+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~UVEY7A167CIZ.0 size=1048576 2024-09-14T11:22:23.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.606+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~UVEY7A167CIZ.1 size=1048576 2024-09-14T11:22:23.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.607+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~UVEY7A167CIZ.2 size=829791 2024-09-14T11:22:23.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.607+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=UVEY7A167CIZ tag=61NCKZ8RZIOJ type=write size=3975519 2024-09-14T11:22:23.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.609+0000 7f43cc561780 1 < suggested update operation key=3YHEZHW0RS1W tag=M8NU3X5ED0UT type=del size=3012 2024-09-14T11:22:23.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.611+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~JXVMJQ6IP4AQ.0 size=358566 2024-09-14T11:22:23.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.611+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=JXVMJQ6IP4AQ tag=KJFZPU4BLT3N type=write size=1407142 2024-09-14T11:22:23.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.613+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~BHLM9031KOPC.0 size=1048576 2024-09-14T11:22:23.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.613+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~BHLM9031KOPC.1 size=1048576 2024-09-14T11:22:23.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.613+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~BHLM9031KOPC.2 size=374896 2024-09-14T11:22:23.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.615+0000 7f43cc561780 1 < canceled multipart upload key=A1B2LIZIPET3 upload=BHLM9031KOPC tag=PFKV40AZIE3X type=write size=3520624 2024-09-14T11:22:23.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.616+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=NTDWCY2Q8PCJ type=del size=1198948 2024-09-14T11:22:23.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.617+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~9LO6S0MMIRSE.0 size=308063 2024-09-14T11:22:23.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.619+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=9LO6S0MMIRSE tag=RVRR9VIX6W28 type=write size=1356639 2024-09-14T11:22:23.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.621+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~J9MBFC5NDK26.0 size=1048576 2024-09-14T11:22:23.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.624+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~J9MBFC5NDK26.1 size=1048576 2024-09-14T11:22:23.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.624+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~J9MBFC5NDK26.2 size=37842 2024-09-14T11:22:23.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.624+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=J9MBFC5NDK26 tag=6CSB3NKOZ3ME type=write size=3183570 2024-09-14T11:22:23.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.626+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~I720WC238NS8.0 size=1048576 2024-09-14T11:22:23.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.626+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~I720WC238NS8.1 size=1048576 2024-09-14T11:22:23.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.627+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~I720WC238NS8.2 size=60565 2024-09-14T11:22:23.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.629+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=I720WC238NS8 tag=J0DCWELNU7O4 type=write size=3206293 2024-09-14T11:22:23.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.630+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=ZNE8UDFY6P9H type=del size=2453913 2024-09-14T11:22:23.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.632+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~J8U98L7SB8QH.0 size=1048576 2024-09-14T11:22:23.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.632+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~J8U98L7SB8QH.1 size=562987 2024-09-14T11:22:23.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.634+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=J8U98L7SB8QH tag=QZRZA1FWSROY type=write size=2660139 2024-09-14T11:22:23.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.635+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=9G9H0QR8RVL0 type=del size=2956617 2024-09-14T11:22:23.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.637+0000 7f43cc561780 1 < completed write operation key=0TDWJO4AWOOF tag=41BCDHHFMLAA type=write size=645100 2024-09-14T11:22:23.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.639+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~9UQF9U0W89OL.0 size=873522 2024-09-14T11:22:23.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.639+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=9UQF9U0W89OL tag=2AHGWMT31EQN type=write size=1922098 2024-09-14T11:22:23.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.640+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~22AMGSHMRXPS.0 size=1048576 2024-09-14T11:22:23.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.641+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~22AMGSHMRXPS.1 size=386471 2024-09-14T11:22:23.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.643+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=22AMGSHMRXPS tag=H9MORKWA2HK0 type=write size=2483623 2024-09-14T11:22:23.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.645+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~OKBPW5YPE3VL.0 size=1048576 2024-09-14T11:22:23.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.646+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~OKBPW5YPE3VL.1 size=72458 2024-09-14T11:22:23.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.646+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=OKBPW5YPE3VL tag=DC46132T0P6M type=write size=2169610 2024-09-14T11:22:23.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.647+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=0RKMTXUJROOQ type=del 2024-09-14T11:22:23.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.648+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=WD74F6HZPROG type=del size=3891128 2024-09-14T11:22:23.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.649+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~PEERBZYVBBFX.0 size=1048576 2024-09-14T11:22:23.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.650+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~PEERBZYVBBFX.1 size=242112 2024-09-14T11:22:23.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.652+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=PEERBZYVBBFX tag=AICB9MKEPBVB type=write size=2339264 2024-09-14T11:22:23.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.653+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=KJ0WRZE1QV9L type=del size=985637 2024-09-14T11:22:23.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.654+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~DFZETUQ3E6EY.0 size=1048576 2024-09-14T11:22:23.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.655+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~DFZETUQ3E6EY.1 size=1048576 2024-09-14T11:22:23.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.656+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~DFZETUQ3E6EY.2 size=751093 2024-09-14T11:22:23.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.658+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=DFZETUQ3E6EY tag=IJ1JHBZ8QYC2 type=write size=3896821 2024-09-14T11:22:23.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.659+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=VDHWDU7IHNFZ type=del size=3915742 2024-09-14T11:22:23.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.661+0000 7f43cc561780 1 < suggested update operation key=A1B2LIZIPET3 tag=N3VNKBTKWNRE type=write size=389681 2024-09-14T11:22:23.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.663+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~EKF77RYNO88W.0 size=1048576 2024-09-14T11:22:23.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.664+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~EKF77RYNO88W.1 size=1048576 2024-09-14T11:22:23.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.665+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~EKF77RYNO88W.2 size=961513 2024-09-14T11:22:23.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.665+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=EKF77RYNO88W tag=66D2PLPWT7BU type=write size=4107241 2024-09-14T11:22:23.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.666+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~V0WP70RC5YR6.0 size=1048576 2024-09-14T11:22:23.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.667+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~V0WP70RC5YR6.1 size=1048576 2024-09-14T11:22:23.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.668+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~V0WP70RC5YR6.2 size=735827 2024-09-14T11:22:23.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.670+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=V0WP70RC5YR6 tag=1WEDI8L4ZCE4 type=write size=3881555 2024-09-14T11:22:23.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.672+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=WLND12MD9Z36 type=write size=823125 2024-09-14T11:22:23.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.673+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=OAUUR05CR4PU type=del 2024-09-14T11:22:23.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.675+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~C3652Y3P669Z.0 size=1048576 2024-09-14T11:22:23.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.676+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~C3652Y3P669Z.1 size=1048576 2024-09-14T11:22:23.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.677+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~C3652Y3P669Z.2 size=854262 2024-09-14T11:22:23.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.677+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=C3652Y3P669Z tag=SI536KXWTIF4 type=write size=3999990 2024-09-14T11:22:23.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.679+0000 7f43cc561780 1 < canceled operation key=15F3ZZAAKT9B tag=E9OWA6TUWWLF type=write size=137797 2024-09-14T11:22:23.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.680+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=ZJHZT487QEQ4 type=write size=1043652 2024-09-14T11:22:23.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.681+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=SPH8P17H82ZL type=del 2024-09-14T11:22:23.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.684+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~42JLJ1RMEC2D.0 size=1048576 2024-09-14T11:22:23.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.685+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~42JLJ1RMEC2D.1 size=1048576 2024-09-14T11:22:23.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.686+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~42JLJ1RMEC2D.2 size=263300 2024-09-14T11:22:23.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.686+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=42JLJ1RMEC2D tag=990E1YKMSHL2 type=write size=3409028 2024-09-14T11:22:23.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.687+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~UVEY7A167CIZ.0 size=1048576 2024-09-14T11:22:23.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.688+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~UVEY7A167CIZ.1 size=1048576 2024-09-14T11:22:23.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.689+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~UVEY7A167CIZ.2 size=829791 2024-09-14T11:22:23.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.692+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=UVEY7A167CIZ tag=61NCKZ8RZIOJ type=write size=3975519 2024-09-14T11:22:23.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.694+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~7Q02GSYJAX3W.0 size=1048576 2024-09-14T11:22:23.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.695+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~7Q02GSYJAX3W.1 size=1048576 2024-09-14T11:22:23.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.696+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~7Q02GSYJAX3W.2 size=488919 2024-09-14T11:22:23.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.696+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=7Q02GSYJAX3W tag=FJ5RAZNFRWEA type=write size=3634647 2024-09-14T11:22:23.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.698+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~JXVMJQ6IP4AQ.0 size=358566 2024-09-14T11:22:23.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.700+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=JXVMJQ6IP4AQ tag=KJFZPU4BLT3N type=write size=1407142 2024-09-14T11:22:23.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.702+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=H0AV1ARRA6M3 type=del size=1704817 2024-09-14T11:22:23.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.703+0000 7f43cc561780 1 < canceled operation key=G6B4CGUBFSOT tag=NTDWCY2Q8PCJ type=del size=1198948 2024-09-14T11:22:23.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.704+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=CCEXN3CG0H9G type=write size=880929 2024-09-14T11:22:23.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.704+0000 7f43cc561780 1 < canceled part key=_multipart_OJOJZBG1WEGI.2~J9MBFC5NDK26.0 size=1048576 2024-09-14T11:22:23.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.706+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~J9MBFC5NDK26.1 size=1048576 2024-09-14T11:22:23.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.707+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~J9MBFC5NDK26.2 size=37842 2024-09-14T11:22:23.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.709+0000 7f43cc561780 1 < canceled multipart upload key=OJOJZBG1WEGI upload=J9MBFC5NDK26 tag=6CSB3NKOZ3ME type=write size=3183570 2024-09-14T11:22:23.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.710+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=2I2BEL5VTYF3 type=del size=2066475 2024-09-14T11:22:23.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.712+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=ZNE8UDFY6P9H type=del 2024-09-14T11:22:23.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.713+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=8I5WJ0SAX45A type=del size=3780161 2024-09-14T11:22:23.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.714+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=9G9H0QR8RVL0 type=del 2024-09-14T11:22:23.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.717+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~1EI93TGL1Y5C.0 size=1048576 2024-09-14T11:22:23.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.718+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~1EI93TGL1Y5C.1 size=1048576 2024-09-14T11:22:23.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.719+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~1EI93TGL1Y5C.2 size=347096 2024-09-14T11:22:23.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.719+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=1EI93TGL1Y5C tag=NZS76X9HNCQF type=write size=3492824 2024-09-14T11:22:23.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.721+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~9UQF9U0W89OL.0 size=873522 2024-09-14T11:22:23.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.723+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=9UQF9U0W89OL tag=2AHGWMT31EQN type=write size=1922098 2024-09-14T11:22:23.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.725+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~1D6SA0KKW3BA.0 size=284551 2024-09-14T11:22:23.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.725+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=1D6SA0KKW3BA tag=1OVCCMYI5H19 type=write size=1333127 2024-09-14T11:22:23.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.726+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~OKBPW5YPE3VL.0 size=1048576 2024-09-14T11:22:23.726 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.727+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~OKBPW5YPE3VL.1 size=72458 2024-09-14T11:22:23.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.730+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=OKBPW5YPE3VL tag=DC46132T0P6M type=write size=2169610 2024-09-14T11:22:23.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.732+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~B13353W6EAQS.0 size=1048576 2024-09-14T11:22:23.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.733+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~B13353W6EAQS.1 size=1048576 2024-09-14T11:22:23.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.734+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~B13353W6EAQS.2 size=310840 2024-09-14T11:22:23.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.734+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=B13353W6EAQS tag=OO0TJ7949LEO type=write size=3456568 2024-09-14T11:22:23.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.736+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=WD74F6HZPROG type=del 2024-09-14T11:22:23.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.737+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=0L48YNK09RPS type=del size=1449657 2024-09-14T11:22:23.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.738+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=KJ0WRZE1QV9L type=del 2024-09-14T11:22:23.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.740+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~RNPFDRUX0A71.0 size=1048576 2024-09-14T11:22:23.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.741+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~RNPFDRUX0A71.1 size=1048576 2024-09-14T11:22:23.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.742+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~RNPFDRUX0A71.2 size=265273 2024-09-14T11:22:23.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.742+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=RNPFDRUX0A71 tag=XJZ7W5JN2Q2T type=write size=3411001 2024-09-14T11:22:23.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.743+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=VDHWDU7IHNFZ type=del 2024-09-14T11:22:23.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.744+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=HRLEG8UHTCLW type=write size=230835 2024-09-14T11:22:23.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.745+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~EKF77RYNO88W.0 size=1048576 2024-09-14T11:22:23.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.746+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~EKF77RYNO88W.1 size=1048576 2024-09-14T11:22:23.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.747+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~EKF77RYNO88W.2 size=961513 2024-09-14T11:22:23.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.749+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=EKF77RYNO88W tag=66D2PLPWT7BU type=write size=4107241 2024-09-14T11:22:23.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.750+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=2CVKYDM2OBF9 type=del size=3104314 2024-09-14T11:22:23.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.752+0000 7f43cc561780 1 < canceled operation key=WHIZ2GREK1FE tag=WLND12MD9Z36 type=write size=823125 2024-09-14T11:22:23.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.754+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~DO995HY9UB74.0 size=1048576 2024-09-14T11:22:23.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.755+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~DO995HY9UB74.1 size=1048576 2024-09-14T11:22:23.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.756+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~DO995HY9UB74.2 size=613167 2024-09-14T11:22:23.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.756+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=DO995HY9UB74 tag=8XY65QO19TNE type=write size=3758895 2024-09-14T11:22:23.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.757+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~C3652Y3P669Z.0 size=1048576 2024-09-14T11:22:23.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.758+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~C3652Y3P669Z.1 size=1048576 2024-09-14T11:22:23.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.759+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~C3652Y3P669Z.2 size=854262 2024-09-14T11:22:23.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.761+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=C3652Y3P669Z tag=SI536KXWTIF4 type=write size=3999990 2024-09-14T11:22:23.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.763+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~BDB14JELL0O1.0 size=1048576 2024-09-14T11:22:23.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.764+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~BDB14JELL0O1.1 size=124790 2024-09-14T11:22:23.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.764+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=BDB14JELL0O1 tag=OATT8G2EFJIK type=write size=2221942 2024-09-14T11:22:23.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.766+0000 7f43cc561780 1 < suggested update operation key=2975CNBC43ST tag=ZJHZT487QEQ4 type=write size=1043652 2024-09-14T11:22:23.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.768+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~2KV0NKC3WU9H.0 size=1048576 2024-09-14T11:22:23.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.769+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~2KV0NKC3WU9H.1 size=1048576 2024-09-14T11:22:23.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.770+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~2KV0NKC3WU9H.2 size=651358 2024-09-14T11:22:23.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.770+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=2KV0NKC3WU9H tag=Q8368SFI3FG6 type=write size=3797086 2024-09-14T11:22:23.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.771+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~42JLJ1RMEC2D.0 size=1048576 2024-09-14T11:22:23.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.772+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~42JLJ1RMEC2D.1 size=1048576 2024-09-14T11:22:23.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.773+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~42JLJ1RMEC2D.2 size=263300 2024-09-14T11:22:23.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.775+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=42JLJ1RMEC2D tag=990E1YKMSHL2 type=write size=3409028 2024-09-14T11:22:23.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.777+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~GPKUROWQ31QK.0 size=369016 2024-09-14T11:22:23.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.777+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=GPKUROWQ31QK tag=0UOTVXNDT9Q2 type=write size=1417592 2024-09-14T11:22:23.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.779+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~7Q02GSYJAX3W.0 size=1048576 2024-09-14T11:22:23.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.780+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~7Q02GSYJAX3W.1 size=1048576 2024-09-14T11:22:23.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.780+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~7Q02GSYJAX3W.2 size=488919 2024-09-14T11:22:23.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.782+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=7Q02GSYJAX3W tag=FJ5RAZNFRWEA type=write size=3634647 2024-09-14T11:22:23.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.785+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~JILDQK6A935P.0 size=1048576 2024-09-14T11:22:23.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.786+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~JILDQK6A935P.1 size=852922 2024-09-14T11:22:23.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.786+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=JILDQK6A935P tag=QIH4SPA2YPYU type=write size=2950074 2024-09-14T11:22:23.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.788+0000 7f43cc561780 1 < suggested update operation key=9XIAGZKIUBGH tag=H0AV1ARRA6M3 type=del size=1704817 2024-09-14T11:22:23.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.790+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~3HQX8BCI37VS.0 size=1048576 2024-09-14T11:22:23.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.791+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~3HQX8BCI37VS.1 size=980251 2024-09-14T11:22:23.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.791+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=3HQX8BCI37VS tag=3667HOITYX1I type=write size=3077403 2024-09-14T11:22:23.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.792+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=CCEXN3CG0H9G type=write size=880929 2024-09-14T11:22:23.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.794+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~98SPF63NAYLJ.0 size=1048576 2024-09-14T11:22:23.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.795+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~98SPF63NAYLJ.1 size=1048576 2024-09-14T11:22:23.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.796+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~98SPF63NAYLJ.2 size=1037941 2024-09-14T11:22:23.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.796+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=98SPF63NAYLJ tag=B4PA8D2N02G3 type=write size=4183669 2024-09-14T11:22:23.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.797+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=2I2BEL5VTYF3 type=del 2024-09-14T11:22:23.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.798+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=B8713CTNTEAQ type=del size=728831 2024-09-14T11:22:23.798 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.800+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=8I5WJ0SAX45A type=del 2024-09-14T11:22:23.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.801+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=J8BYAXCMIZ55 type=del size=1364161 2024-09-14T11:22:23.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.802+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~1EI93TGL1Y5C.0 size=1048576 2024-09-14T11:22:23.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.802+0000 7f43cc561780 1 < canceled part key=_multipart_OJOJZBG1WEGI.2~1EI93TGL1Y5C.1 size=1048576 2024-09-14T11:22:23.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.803+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~1EI93TGL1Y5C.2 size=347096 2024-09-14T11:22:23.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.805+0000 7f43cc561780 1 < canceled multipart upload key=OJOJZBG1WEGI upload=1EI93TGL1Y5C tag=NZS76X9HNCQF type=write size=3492824 2024-09-14T11:22:23.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.807+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~NPDPYMP3PGBI.0 size=1048576 2024-09-14T11:22:23.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.808+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~NPDPYMP3PGBI.1 size=1048576 2024-09-14T11:22:23.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.809+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~NPDPYMP3PGBI.2 size=715046 2024-09-14T11:22:23.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.809+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=NPDPYMP3PGBI tag=FB0U2X8Z0A09 type=write size=3860774 2024-09-14T11:22:23.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.810+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~1D6SA0KKW3BA.0 size=284551 2024-09-14T11:22:23.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.812+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=1D6SA0KKW3BA tag=1OVCCMYI5H19 type=write size=1333127 2024-09-14T11:22:23.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.813+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=3D53K3W9Q1Z2 type=write size=955326 2024-09-14T11:22:23.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.815+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~B13353W6EAQS.0 size=1048576 2024-09-14T11:22:23.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.816+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~B13353W6EAQS.1 size=1048576 2024-09-14T11:22:23.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.817+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~B13353W6EAQS.2 size=310840 2024-09-14T11:22:23.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.819+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=B13353W6EAQS tag=OO0TJ7949LEO type=write size=3456568 2024-09-14T11:22:23.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.821+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~1VOPZTYD9DAF.0 size=600919 2024-09-14T11:22:23.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.821+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=1VOPZTYD9DAF tag=1KDF3MNSOLMU type=write size=1649495 2024-09-14T11:22:23.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.822+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=0L48YNK09RPS type=del 2024-09-14T11:22:23.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.823+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=NB8WHHDUBD78 type=del size=2323322 2024-09-14T11:22:23.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.824+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~RNPFDRUX0A71.0 size=1048576 2024-09-14T11:22:23.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.825+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~RNPFDRUX0A71.1 size=1048576 2024-09-14T11:22:23.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.827+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~RNPFDRUX0A71.2 size=265273 2024-09-14T11:22:23.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.829+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=RNPFDRUX0A71 tag=XJZ7W5JN2Q2T type=write size=3411001 2024-09-14T11:22:23.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.831+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~JJJWAZUTX1C6.0 size=1048576 2024-09-14T11:22:23.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.832+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~JJJWAZUTX1C6.1 size=1044696 2024-09-14T11:22:23.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.832+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=JJJWAZUTX1C6 tag=2P88VKSW0Q5S type=write size=3141848 2024-09-14T11:22:23.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.834+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=HRLEG8UHTCLW type=write size=230835 2024-09-14T11:22:23.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.835+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=CYXKN7B9WJPW type=del size=3426816 2024-09-14T11:22:23.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.837+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=2CVKYDM2OBF9 type=del 2024-09-14T11:22:23.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.838+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=871JF0R24YP5 type=del size=3723358 2024-09-14T11:22:23.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.840+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~DO995HY9UB74.0 size=1048576 2024-09-14T11:22:23.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.841+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~DO995HY9UB74.1 size=1048576 2024-09-14T11:22:23.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.842+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~DO995HY9UB74.2 size=613167 2024-09-14T11:22:23.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.844+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=DO995HY9UB74 tag=8XY65QO19TNE type=write size=3758895 2024-09-14T11:22:23.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.845+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=GTBEPQBYVCBY type=write size=624205 2024-09-14T11:22:23.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.847+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~BDB14JELL0O1.0 size=1048576 2024-09-14T11:22:23.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.848+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~BDB14JELL0O1.1 size=124790 2024-09-14T11:22:23.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.850+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=BDB14JELL0O1 tag=OATT8G2EFJIK type=write size=2221942 2024-09-14T11:22:23.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.851+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=MOR2BUF1X07Y type=del size=3324096 2024-09-14T11:22:23.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.852+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~2KV0NKC3WU9H.0 size=1048576 2024-09-14T11:22:23.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.852+0000 7f43cc561780 1 < canceled part key=_multipart_S3NOACTF4K2W.2~2KV0NKC3WU9H.1 size=1048576 2024-09-14T11:22:23.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.853+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~2KV0NKC3WU9H.2 size=651358 2024-09-14T11:22:23.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.855+0000 7f43cc561780 1 < canceled multipart upload key=S3NOACTF4K2W upload=2KV0NKC3WU9H tag=Q8368SFI3FG6 type=write size=3797086 2024-09-14T11:22:23.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.857+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~ERO4IQ8LMEUL.0 size=1048576 2024-09-14T11:22:23.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.858+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~ERO4IQ8LMEUL.1 size=676463 2024-09-14T11:22:23.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.858+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=ERO4IQ8LMEUL tag=IWTF6AE1HL20 type=write size=2773615 2024-09-14T11:22:23.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.860+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~GPKUROWQ31QK.0 size=369016 2024-09-14T11:22:23.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.861+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=GPKUROWQ31QK tag=0UOTVXNDT9Q2 type=write size=1417592 2024-09-14T11:22:23.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.863+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=1SE69ASN8NOF type=del size=3909918 2024-09-14T11:22:23.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.864+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~JILDQK6A935P.0 size=1048576 2024-09-14T11:22:23.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.865+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~JILDQK6A935P.1 size=852922 2024-09-14T11:22:23.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.867+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=JILDQK6A935P tag=QIH4SPA2YPYU type=write size=2950074 2024-09-14T11:22:23.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.869+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~NAWOUAN47W97.0 size=953245 2024-09-14T11:22:23.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.869+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=NAWOUAN47W97 tag=Y1EDPOD02FWK type=write size=2001821 2024-09-14T11:22:23.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.870+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~3HQX8BCI37VS.0 size=1048576 2024-09-14T11:22:23.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.871+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~3HQX8BCI37VS.1 size=980251 2024-09-14T11:22:23.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.873+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=3HQX8BCI37VS tag=3667HOITYX1I type=write size=3077403 2024-09-14T11:22:23.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.875+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~PT8TRST1KYVH.0 size=1048576 2024-09-14T11:22:23.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.876+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~PT8TRST1KYVH.1 size=350032 2024-09-14T11:22:23.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.876+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=PT8TRST1KYVH tag=7EOL1KNZU1EI type=write size=2447184 2024-09-14T11:22:23.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.877+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~98SPF63NAYLJ.0 size=1048576 2024-09-14T11:22:23.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.878+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~98SPF63NAYLJ.1 size=1048576 2024-09-14T11:22:23.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.879+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~98SPF63NAYLJ.2 size=1037941 2024-09-14T11:22:23.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.881+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=98SPF63NAYLJ tag=B4PA8D2N02G3 type=write size=4183669 2024-09-14T11:22:23.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.883+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~54YTJCQJIJUD.0 size=37298 2024-09-14T11:22:23.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.883+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=54YTJCQJIJUD tag=4ULICNXVLKSX type=write size=1085874 2024-09-14T11:22:23.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.884+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=B8713CTNTEAQ type=del 2024-09-14T11:22:23.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.885+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=EMEC9Z21AS87 type=write size=395800 2024-09-14T11:22:23.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.886+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=J8BYAXCMIZ55 type=del 2024-09-14T11:22:23.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.888+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~CTMXCV4ZZ716.0 size=1048576 2024-09-14T11:22:23.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.889+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~CTMXCV4ZZ716.1 size=1048576 2024-09-14T11:22:23.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.890+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~CTMXCV4ZZ716.2 size=9088 2024-09-14T11:22:23.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.890+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=CTMXCV4ZZ716 tag=ZXCV4COBZXJ5 type=write size=3154816 2024-09-14T11:22:23.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.891+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~NPDPYMP3PGBI.0 size=1048576 2024-09-14T11:22:23.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.891+0000 7f43cc561780 1 < canceled part key=_multipart_BZDW69C3Z97G.2~NPDPYMP3PGBI.1 size=1048576 2024-09-14T11:22:23.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.892+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~NPDPYMP3PGBI.2 size=715046 2024-09-14T11:22:23.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.894+0000 7f43cc561780 1 < canceled multipart upload key=BZDW69C3Z97G upload=NPDPYMP3PGBI tag=FB0U2X8Z0A09 type=write size=3860774 2024-09-14T11:22:23.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.896+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~0Z29XJYU31KI.0 size=1048576 2024-09-14T11:22:23.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.897+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~0Z29XJYU31KI.1 size=494907 2024-09-14T11:22:23.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.897+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=0Z29XJYU31KI tag=K8PA1QCLTJEZ type=write size=2592059 2024-09-14T11:22:23.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.898+0000 7f43cc561780 1 < completed write operation key=AY7JGVM96MO7 tag=3D53K3W9Q1Z2 type=write size=955326 2024-09-14T11:22:23.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.900+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=K9ALS2EHNI9P type=write size=535893 2024-09-14T11:22:23.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.901+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~1VOPZTYD9DAF.0 size=600919 2024-09-14T11:22:23.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.903+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=1VOPZTYD9DAF tag=1KDF3MNSOLMU type=write size=1649495 2024-09-14T11:22:23.903 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.904+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=UTWU6HR8FE4W type=del size=702686 2024-09-14T11:22:23.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.906+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=NB8WHHDUBD78 type=del 2024-09-14T11:22:23.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.909+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~5I6DM48AUSMB.0 size=1048576 2024-09-14T11:22:23.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.910+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~5I6DM48AUSMB.1 size=231199 2024-09-14T11:22:23.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.910+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=5I6DM48AUSMB tag=69QF05B2WG92 type=write size=2328351 2024-09-14T11:22:23.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.911+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~JJJWAZUTX1C6.0 size=1048576 2024-09-14T11:22:23.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.912+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~JJJWAZUTX1C6.1 size=1044696 2024-09-14T11:22:23.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.914+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=JJJWAZUTX1C6 tag=2P88VKSW0Q5S type=write size=3141848 2024-09-14T11:22:23.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.916+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~Y8WFON1BE220.0 size=1048576 2024-09-14T11:22:23.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.917+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~Y8WFON1BE220.1 size=945421 2024-09-14T11:22:23.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.917+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=Y8WFON1BE220 tag=1E9ICZ4BMGC1 type=write size=3042573 2024-09-14T11:22:23.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.918+0000 7f43cc561780 1 < canceled operation key=AY7JGVM96MO7 tag=CYXKN7B9WJPW type=del size=3426816 2024-09-14T11:22:23.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.920+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=0W7HWSE6NTVN type=del size=2999395 2024-09-14T11:22:23.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.921+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=871JF0R24YP5 type=del 2024-09-14T11:22:23.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.922+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=5FUJ8Q90RE0F type=del size=97856 2024-09-14T11:22:23.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.923+0000 7f43cc561780 1 < completed write operation key=AWBBRU4C8RDQ tag=GTBEPQBYVCBY type=write size=624205 2024-09-14T11:22:23.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.924+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=IU6FNCQ4VKUF type=del size=2598286 2024-09-14T11:22:23.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.927+0000 7f43cc561780 1 < suggested remove operation key=CXP2PUIXR2PA tag=MOR2BUF1X07Y type=del 2024-09-14T11:22:23.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.928+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=ER2R1B8XGJUH type=del size=400907 2024-09-14T11:22:23.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.929+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~ERO4IQ8LMEUL.0 size=1048576 2024-09-14T11:22:23.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.930+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~ERO4IQ8LMEUL.1 size=676463 2024-09-14T11:22:23.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.932+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=ERO4IQ8LMEUL tag=IWTF6AE1HL20 type=write size=2773615 2024-09-14T11:22:23.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.933+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=0BVZ19Q7KNTW type=del size=1340218 2024-09-14T11:22:23.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.934+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=1SE69ASN8NOF type=del 2024-09-14T11:22:23.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.937+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~UV7PYA1M7MJR.0 size=886084 2024-09-14T11:22:23.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.937+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=UV7PYA1M7MJR tag=AP21M0YBIR4L type=write size=1934660 2024-09-14T11:22:23.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.938+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~NAWOUAN47W97.0 size=953245 2024-09-14T11:22:23.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.940+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=NAWOUAN47W97 tag=Y1EDPOD02FWK type=write size=2001821 2024-09-14T11:22:23.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.941+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=RJJPSN6ZBR24 type=write size=156445 2024-09-14T11:22:23.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.942+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~PT8TRST1KYVH.0 size=1048576 2024-09-14T11:22:23.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.943+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~PT8TRST1KYVH.1 size=350032 2024-09-14T11:22:23.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.945+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=PT8TRST1KYVH tag=7EOL1KNZU1EI type=write size=2447184 2024-09-14T11:22:23.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.946+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=SMFY50R8ZPVU type=del size=222520 2024-09-14T11:22:23.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.947+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~54YTJCQJIJUD.0 size=37298 2024-09-14T11:22:23.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.949+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=54YTJCQJIJUD tag=4ULICNXVLKSX type=write size=1085874 2024-09-14T11:22:23.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.952+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=1P0FWVY6PNGG type=del size=2351833 2024-09-14T11:22:23.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.953+0000 7f43cc561780 1 < completed write operation key=BRHP3DQEO3HZ tag=EMEC9Z21AS87 type=write size=395800 2024-09-14T11:22:23.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.955+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~BK99MFWYDGA6.0 size=1048576 2024-09-14T11:22:23.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.956+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~BK99MFWYDGA6.1 size=91186 2024-09-14T11:22:23.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.956+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=BK99MFWYDGA6 tag=OSHYP0K1SXF5 type=write size=2188338 2024-09-14T11:22:23.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.957+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~CTMXCV4ZZ716.0 size=1048576 2024-09-14T11:22:23.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.958+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~CTMXCV4ZZ716.1 size=1048576 2024-09-14T11:22:23.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.959+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~CTMXCV4ZZ716.2 size=9088 2024-09-14T11:22:23.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.961+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=CTMXCV4ZZ716 tag=ZXCV4COBZXJ5 type=write size=3154816 2024-09-14T11:22:23.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.963+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~W9AA6UQZTQE4.0 size=1048576 2024-09-14T11:22:23.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.964+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~W9AA6UQZTQE4.1 size=406490 2024-09-14T11:22:23.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.964+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=W9AA6UQZTQE4 tag=IYDASB6OVE9K type=write size=2503642 2024-09-14T11:22:23.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.965+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~0Z29XJYU31KI.0 size=1048576 2024-09-14T11:22:23.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.967+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~0Z29XJYU31KI.1 size=494907 2024-09-14T11:22:23.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.969+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=0Z29XJYU31KI tag=K8PA1QCLTJEZ type=write size=2592059 2024-09-14T11:22:23.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.970+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=5TXHHB2Y76J0 type=del size=2459340 2024-09-14T11:22:23.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.971+0000 7f43cc561780 1 < completed write operation key=3YHEZHW0RS1W tag=K9ALS2EHNI9P type=write size=535893 2024-09-14T11:22:23.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.973+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~UNLV6977AK8A.0 size=71148 2024-09-14T11:22:23.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.973+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=UNLV6977AK8A tag=OFDJUOPLMF1U type=write size=1119724 2024-09-14T11:22:23.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.974+0000 7f43cc561780 1 < canceled operation key=FISMBWPDPCTA tag=UTWU6HR8FE4W type=del size=702686 2024-09-14T11:22:23.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.977+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~8Z6IO0SIE7OW.0 size=1048576 2024-09-14T11:22:23.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.977+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~8Z6IO0SIE7OW.1 size=989672 2024-09-14T11:22:23.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.977+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=8Z6IO0SIE7OW tag=M6MK4D64QG4M type=write size=3086824 2024-09-14T11:22:23.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.978+0000 7f43cc561780 1 < canceled part key=_multipart_IFHWMI5YO5L5.2~5I6DM48AUSMB.0 size=1048576 2024-09-14T11:22:23.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.979+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~5I6DM48AUSMB.1 size=231199 2024-09-14T11:22:23.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.981+0000 7f43cc561780 1 < canceled multipart upload key=IFHWMI5YO5L5 upload=5I6DM48AUSMB tag=69QF05B2WG92 type=write size=2328351 2024-09-14T11:22:23.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.982+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=WXJO6JEAE0F8 type=del size=3817085 2024-09-14T11:22:23.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.983+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~Y8WFON1BE220.0 size=1048576 2024-09-14T11:22:23.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.984+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~Y8WFON1BE220.1 size=945421 2024-09-14T11:22:23.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.986+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=Y8WFON1BE220 tag=1E9ICZ4BMGC1 type=write size=3042573 2024-09-14T11:22:23.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.987+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=8RX3TZBBYC9N type=del size=1029209 2024-09-14T11:22:23.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.988+0000 7f43cc561780 1 < canceled operation key=0TDWJO4AWOOF tag=0W7HWSE6NTVN type=del size=2999395 2024-09-14T11:22:23.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.990+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=SIPK0KKET77Z type=del size=262301 2024-09-14T11:22:23.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.991+0000 7f43cc561780 1 < canceled operation key=15F3ZZAAKT9B tag=5FUJ8Q90RE0F type=del size=97856 2024-09-14T11:22:23.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.993+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=YXM5XEBZB10B type=del size=722241 2024-09-14T11:22:23.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.994+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=IU6FNCQ4VKUF type=del 2024-09-14T11:22:23.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.995+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=DW02L9B5P1W7 type=del size=2299494 2024-09-14T11:22:23.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.997+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=ER2R1B8XGJUH type=del 2024-09-14T11:22:23.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:23.998+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=98S9SCN39ZGU type=del size=457677 2024-09-14T11:22:23.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.000+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=0BVZ19Q7KNTW type=del 2024-09-14T11:22:24.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.001+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=I2IC94A7LI9V type=del size=3643682 2024-09-14T11:22:24.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.001+0000 7f43cc561780 1 < canceled part key=_multipart_BRHP3DQEO3HZ.2~UV7PYA1M7MJR.0 size=886084 2024-09-14T11:22:24.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.004+0000 7f43cc561780 1 < canceled multipart upload key=BRHP3DQEO3HZ upload=UV7PYA1M7MJR tag=AP21M0YBIR4L type=write size=1934660 2024-09-14T11:22:24.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.005+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=6MB9XZ0M2IH1 type=del size=3523941 2024-09-14T11:22:24.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.008+0000 7f43cc561780 1 < suggested remove operation key=CXP2PUIXR2PA tag=RJJPSN6ZBR24 type=write 2024-09-14T11:22:24.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.009+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=ND18XEBGP8J1 type=del size=4121966 2024-09-14T11:22:24.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.010+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=SMFY50R8ZPVU type=del 2024-09-14T11:22:24.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.011+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=N3R76B4FZCPM type=del size=1993935 2024-09-14T11:22:24.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.014+0000 7f43cc561780 1 < suggested remove operation key=AY7JGVM96MO7 tag=1P0FWVY6PNGG type=del 2024-09-14T11:22:24.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.015+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=VGGDZNY3B1AL type=del size=1979214 2024-09-14T11:22:24.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.016+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~BK99MFWYDGA6.0 size=1048576 2024-09-14T11:22:24.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.017+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~BK99MFWYDGA6.1 size=91186 2024-09-14T11:22:24.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.019+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=BK99MFWYDGA6 tag=OSHYP0K1SXF5 type=write size=2188338 2024-09-14T11:22:24.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.020+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=IPJRB3DED8SB type=del size=3032383 2024-09-14T11:22:24.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.022+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~W9AA6UQZTQE4.0 size=1048576 2024-09-14T11:22:24.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.023+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~W9AA6UQZTQE4.1 size=406490 2024-09-14T11:22:24.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.025+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=W9AA6UQZTQE4 tag=IYDASB6OVE9K type=write size=2503642 2024-09-14T11:22:24.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.026+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=CZZ03STE8DXV type=del size=1768108 2024-09-14T11:22:24.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.028+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=5TXHHB2Y76J0 type=del size=2459340 2024-09-14T11:22:24.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.029+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=CJ83O4TN75UO type=del size=1141197 2024-09-14T11:22:24.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.030+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~UNLV6977AK8A.0 size=71148 2024-09-14T11:22:24.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.032+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=UNLV6977AK8A tag=OFDJUOPLMF1U type=write size=1119724 2024-09-14T11:22:24.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.033+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=6BNDTWID4JOF type=del size=2872277 2024-09-14T11:22:24.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.034+0000 7f43cc561780 1 < canceled part key=_multipart_CXP2PUIXR2PA.2~8Z6IO0SIE7OW.0 size=1048576 2024-09-14T11:22:24.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.035+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~8Z6IO0SIE7OW.1 size=989672 2024-09-14T11:22:24.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.037+0000 7f43cc561780 1 < canceled multipart upload key=CXP2PUIXR2PA upload=8Z6IO0SIE7OW tag=M6MK4D64QG4M type=write size=3086824 2024-09-14T11:22:24.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.038+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=0OOKMEEP908M type=write size=443953 2024-09-14T11:22:24.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.039+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=WXJO6JEAE0F8 type=del 2024-09-14T11:22:24.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.040+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=YCHCSY52YOSO type=del size=1114310 2024-09-14T11:22:24.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.041+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=8RX3TZBBYC9N type=del 2024-09-14T11:22:24.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.043+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=83WBMLPZHKYO type=del size=2788621 2024-09-14T11:22:24.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.044+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=SIPK0KKET77Z type=del 2024-09-14T11:22:24.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.045+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=Y2VA2344FI72 type=write size=970216 2024-09-14T11:22:24.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.047+0000 7f43cc561780 1 < suggested update operation key=3YHEZHW0RS1W tag=YXM5XEBZB10B type=del size=722241 2024-09-14T11:22:24.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.050+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~O1WL33BKTSMU.0 size=1048576 2024-09-14T11:22:24.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.050+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~O1WL33BKTSMU.1 size=1048576 2024-09-14T11:22:24.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.051+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~O1WL33BKTSMU.2 size=993078 2024-09-14T11:22:24.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.051+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=O1WL33BKTSMU tag=ZDB503RYMAO6 type=write size=4138806 2024-09-14T11:22:24.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.054+0000 7f43cc561780 1 < suggested remove operation key=E6FDCACWGA2Y tag=DW02L9B5P1W7 type=del 2024-09-14T11:22:24.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.055+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=X1V8Y7RGWCGC type=del size=1693125 2024-09-14T11:22:24.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.057+0000 7f43cc561780 1 < suggested remove operation key=AY7JGVM96MO7 tag=98S9SCN39ZGU type=del 2024-09-14T11:22:24.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.058+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=GOSZBVY2AAQP type=del size=3516563 2024-09-14T11:22:24.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.060+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=I2IC94A7LI9V type=del 2024-09-14T11:22:24.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.061+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=GVLALIMDLDC8 type=del size=1412699 2024-09-14T11:22:24.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.062+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=6MB9XZ0M2IH1 type=del 2024-09-14T11:22:24.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.063+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=8JYGW3KMCIOU type=del size=1517932 2024-09-14T11:22:24.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.064+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=ND18XEBGP8J1 type=del 2024-09-14T11:22:24.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.068+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~IL886FHUOVAP.0 size=1048576 2024-09-14T11:22:24.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.069+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~IL886FHUOVAP.1 size=1048576 2024-09-14T11:22:24.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.069+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~IL886FHUOVAP.2 size=326205 2024-09-14T11:22:24.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.069+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=IL886FHUOVAP tag=NC9W2EBU5WKN type=write size=3471933 2024-09-14T11:22:24.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.072+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=N3R76B4FZCPM type=del 2024-09-14T11:22:24.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.073+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=6239K4LMWWPH type=del size=3849941 2024-09-14T11:22:24.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.074+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=VGGDZNY3B1AL type=del 2024-09-14T11:22:24.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.075+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=P15WNA6DGOMP type=del size=794979 2024-09-14T11:22:24.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.076+0000 7f43cc561780 -1 < failed to complete operation key=3YHEZHW0RS1W tag=IPJRB3DED8SB type=del size=3032383: (22) Invalid argument 2024-09-14T11:22:24.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.078+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~9MIFPZK2KUKX.0 size=404591 2024-09-14T11:22:24.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.078+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=9MIFPZK2KUKX tag=TBP6HON2LL1X type=write size=1453167 2024-09-14T11:22:24.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.080+0000 7f43cc561780 -1 < failed to complete operation key=AY7JGVM96MO7 tag=CZZ03STE8DXV type=del size=1768108: (22) Invalid argument 2024-09-14T11:22:24.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.081+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=FRMGMTRD0215 type=del size=998921 2024-09-14T11:22:24.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.082+0000 7f43cc561780 -1 < failed to complete operation key=3YHEZHW0RS1W tag=CJ83O4TN75UO type=del size=1141197: (22) Invalid argument 2024-09-14T11:22:24.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.084+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=Z8TAWJD2CFIM type=del size=3000588 2024-09-14T11:22:24.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.086+0000 7f43cc561780 1 < suggested update operation key=80ZYEEE1EE78 tag=6BNDTWID4JOF type=del size=2872277 2024-09-14T11:22:24.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.087+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=2Q08POS038L7 type=del size=635877 2024-09-14T11:22:24.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.089+0000 7f43cc561780 1 < canceled operation key=9XIAGZKIUBGH tag=0OOKMEEP908M type=write size=443953 2024-09-14T11:22:24.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.092+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H6AZNYTQF9YE.0 size=1048576 2024-09-14T11:22:24.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.093+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H6AZNYTQF9YE.1 size=1048576 2024-09-14T11:22:24.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.094+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H6AZNYTQF9YE.2 size=394577 2024-09-14T11:22:24.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.094+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=H6AZNYTQF9YE tag=EVV2B97FACZ6 type=write size=3540305 2024-09-14T11:22:24.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.095+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=YCHCSY52YOSO type=del 2024-09-14T11:22:24.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.097+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=ZQYB6YWI4TVJ type=del size=3285534 2024-09-14T11:22:24.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.098+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=83WBMLPZHKYO type=del 2024-09-14T11:22:24.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.099+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=REVZ9ISRLI3L type=del size=2411210 2024-09-14T11:22:24.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.100+0000 7f43cc561780 1 < canceled operation key=UWES4CQZ8XW6 tag=Y2VA2344FI72 type=write size=970216 2024-09-14T11:22:24.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.101+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=COOAJAPB7L4P type=del size=4058219 2024-09-14T11:22:24.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.102+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~O1WL33BKTSMU.0 size=1048576 2024-09-14T11:22:24.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.103+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~O1WL33BKTSMU.1 size=1048576 2024-09-14T11:22:24.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.104+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~O1WL33BKTSMU.2 size=993078 2024-09-14T11:22:24.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.106+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=O1WL33BKTSMU tag=ZDB503RYMAO6 type=write size=4138806 2024-09-14T11:22:24.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.108+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=A75RSOYBMDK4 type=del size=393230 2024-09-14T11:22:24.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.109+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=X1V8Y7RGWCGC type=del 2024-09-14T11:22:24.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.110+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=7C2TPRHQKAT0 type=del size=2806845 2024-09-14T11:22:24.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.111+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=GOSZBVY2AAQP type=del 2024-09-14T11:22:24.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.112+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=NVNAPN2KN59L type=del size=278753 2024-09-14T11:22:24.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.113+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=GVLALIMDLDC8 type=del 2024-09-14T11:22:24.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.115+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=CRUFMFU8HJVS type=del size=2129871 2024-09-14T11:22:24.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.116+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=8JYGW3KMCIOU type=del 2024-09-14T11:22:24.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.117+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=GXN1QITQUC5E type=del size=1544589 2024-09-14T11:22:24.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.118+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~IL886FHUOVAP.0 size=1048576 2024-09-14T11:22:24.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.119+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~IL886FHUOVAP.1 size=1048576 2024-09-14T11:22:24.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.120+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~IL886FHUOVAP.2 size=326205 2024-09-14T11:22:24.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.122+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=IL886FHUOVAP tag=NC9W2EBU5WKN type=write size=3471933 2024-09-14T11:22:24.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.123+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=U6VHGNVFUPZT type=del size=2582000 2024-09-14T11:22:24.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.126+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=6239K4LMWWPH type=del size=3849941 2024-09-14T11:22:24.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.127+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=K9HITDR5IXT3 type=del size=246862 2024-09-14T11:22:24.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.129+0000 7f43cc561780 1 < suggested remove operation key=OJOJZBG1WEGI tag=P15WNA6DGOMP type=del 2024-09-14T11:22:24.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.130+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=WXHVKZ9SUONN type=write size=795997 2024-09-14T11:22:24.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.132+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~9MIFPZK2KUKX.0 size=404591 2024-09-14T11:22:24.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.134+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=9MIFPZK2KUKX tag=TBP6HON2LL1X type=write size=1453167 2024-09-14T11:22:24.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.135+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=NRQGRH2BPG3J type=del size=4176252 2024-09-14T11:22:24.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.136+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=FRMGMTRD0215 type=del 2024-09-14T11:22:24.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.137+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=PPKB05KOVOUI type=del size=2838246 2024-09-14T11:22:24.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.138+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=Z8TAWJD2CFIM type=del 2024-09-14T11:22:24.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.139+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=7UP05Q0SE7XC type=write size=159789 2024-09-14T11:22:24.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.141+0000 7f43cc561780 1 < canceled operation key=LKY30XYUG2QW tag=2Q08POS038L7 type=del size=635877 2024-09-14T11:22:24.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.143+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~R6VR840UWPX6.0 size=154041 2024-09-14T11:22:24.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.143+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=R6VR840UWPX6 tag=DPXPK49AFCM3 type=write size=1202617 2024-09-14T11:22:24.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.144+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H6AZNYTQF9YE.0 size=1048576 2024-09-14T11:22:24.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.145+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H6AZNYTQF9YE.1 size=1048576 2024-09-14T11:22:24.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.146+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H6AZNYTQF9YE.2 size=394577 2024-09-14T11:22:24.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.148+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=H6AZNYTQF9YE tag=EVV2B97FACZ6 type=write size=3540305 2024-09-14T11:22:24.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.149+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=OQKQFZIXGFV6 type=write size=414055 2024-09-14T11:22:24.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.150+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=ZQYB6YWI4TVJ type=del 2024-09-14T11:22:24.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.153+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~C59QN9I2M0KA.0 size=1048576 2024-09-14T11:22:24.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.154+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~C59QN9I2M0KA.1 size=532185 2024-09-14T11:22:24.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.154+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=C59QN9I2M0KA tag=FGYZ19B8ZWVI type=write size=2629337 2024-09-14T11:22:24.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.155+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=REVZ9ISRLI3L type=del 2024-09-14T11:22:24.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.157+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~KH0PE1X5DN79.0 size=829015 2024-09-14T11:22:24.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.157+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=KH0PE1X5DN79 tag=2YTU62MT4OHG type=write size=1877591 2024-09-14T11:22:24.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.158+0000 7f43cc561780 1 < canceled operation key=3YHEZHW0RS1W tag=COOAJAPB7L4P type=del size=4058219 2024-09-14T11:22:24.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.160+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=06HCQS5GU5G7 type=del size=2346434 2024-09-14T11:22:24.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.161+0000 7f43cc561780 1 < canceled operation key=D8EBH4NWN7SK tag=A75RSOYBMDK4 type=del size=393230 2024-09-14T11:22:24.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.165+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~ECVFFL0SVCPX.0 size=1048576 2024-09-14T11:22:24.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.166+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~ECVFFL0SVCPX.1 size=252526 2024-09-14T11:22:24.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.166+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=ECVFFL0SVCPX tag=M0OZ7SIT7YFG type=write size=2349678 2024-09-14T11:22:24.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.167+0000 7f43cc561780 1 < canceled operation key=WHIZ2GREK1FE tag=7C2TPRHQKAT0 type=del size=2806845 2024-09-14T11:22:24.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.170+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~JQJFWIDWTRI2.0 size=1048576 2024-09-14T11:22:24.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.171+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~JQJFWIDWTRI2.1 size=1013599 2024-09-14T11:22:24.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.171+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=JQJFWIDWTRI2 tag=O8G75JS0NOCB type=write size=3110751 2024-09-14T11:22:24.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.172+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=NVNAPN2KN59L type=del size=278753: (22) Invalid argument 2024-09-14T11:22:24.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.174+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=ZD3O3WPQ9LT1 type=del size=1576293 2024-09-14T11:22:24.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.175+0000 7f43cc561780 1 < canceled operation key=BNNSFLYOU27F tag=CRUFMFU8HJVS type=del size=2129871 2024-09-14T11:22:24.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.178+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~6O96WMMUZ8M8.0 size=509315 2024-09-14T11:22:24.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.178+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=6O96WMMUZ8M8 tag=IKYP10ZPZQK6 type=write size=1557891 2024-09-14T11:22:24.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.179+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=GXN1QITQUC5E type=del 2024-09-14T11:22:24.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.181+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=P47WE38YGEA5 type=del size=2682931 2024-09-14T11:22:24.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.182+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=U6VHGNVFUPZT type=del 2024-09-14T11:22:24.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.183+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=O5K23AQ0VIBP type=write size=401574 2024-09-14T11:22:24.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.184+0000 7f43cc561780 1 < canceled operation key=BRHP3DQEO3HZ tag=K9HITDR5IXT3 type=del size=246862 2024-09-14T11:22:24.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.187+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~7OJA9PC885YR.0 size=573760 2024-09-14T11:22:24.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.187+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=7OJA9PC885YR tag=KH0AHPD5908X type=write size=1622336 2024-09-14T11:22:24.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.190+0000 7f43cc561780 1 < suggested update operation key=3YHEZHW0RS1W tag=WXHVKZ9SUONN type=write size=795997 2024-09-14T11:22:24.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.191+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=EUE3IBK9LLYN type=del size=2301647 2024-09-14T11:22:24.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.192+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=NRQGRH2BPG3J type=del 2024-09-14T11:22:24.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.193+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=6MKSP8NH0F13 type=del size=693924 2024-09-14T11:22:24.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.196+0000 7f43cc561780 1 < suggested update operation key=A1B2LIZIPET3 tag=PPKB05KOVOUI type=del size=2838246 2024-09-14T11:22:24.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.198+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~U1PDBDLXCMNH.0 size=1048576 2024-09-14T11:22:24.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.199+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~U1PDBDLXCMNH.1 size=1048576 2024-09-14T11:22:24.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.200+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~U1PDBDLXCMNH.2 size=1004581 2024-09-14T11:22:24.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.200+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=U1PDBDLXCMNH tag=A6BMJD2JW1Y1 type=write size=4150309 2024-09-14T11:22:24.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.202+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=7UP05Q0SE7XC type=write 2024-09-14T11:22:24.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.204+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~NTDDHDNH2Y32.0 size=1048576 2024-09-14T11:22:24.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.205+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~NTDDHDNH2Y32.1 size=709197 2024-09-14T11:22:24.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.205+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=NTDDHDNH2Y32 tag=TNKC5QP4HJHO type=write size=2806349 2024-09-14T11:22:24.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.206+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~R6VR840UWPX6.0 size=154041 2024-09-14T11:22:24.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.209+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=R6VR840UWPX6 tag=DPXPK49AFCM3 type=write size=1202617 2024-09-14T11:22:24.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.210+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=692PNAG4NOVN type=del size=3742233 2024-09-14T11:22:24.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.212+0000 7f43cc561780 1 < suggested remove operation key=15F3ZZAAKT9B tag=OQKQFZIXGFV6 type=write 2024-09-14T11:22:24.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.213+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=D53GEXGASHUT type=write size=568417 2024-09-14T11:22:24.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.215+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~C59QN9I2M0KA.0 size=1048576 2024-09-14T11:22:24.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.216+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~C59QN9I2M0KA.1 size=532185 2024-09-14T11:22:24.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.218+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=C59QN9I2M0KA tag=FGYZ19B8ZWVI type=write size=2629337 2024-09-14T11:22:24.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.219+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=8CI60UCUFBQ7 type=write size=19825 2024-09-14T11:22:24.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.220+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~KH0PE1X5DN79.0 size=829015 2024-09-14T11:22:24.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.222+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=KH0PE1X5DN79 tag=2YTU62MT4OHG type=write size=1877591 2024-09-14T11:22:24.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.224+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HMGUI5RTOUPX.0 size=1048576 2024-09-14T11:22:24.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.225+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HMGUI5RTOUPX.1 size=1048576 2024-09-14T11:22:24.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.226+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HMGUI5RTOUPX.2 size=409000 2024-09-14T11:22:24.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.226+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=HMGUI5RTOUPX tag=8Z8FCRTAS952 type=write size=3554728 2024-09-14T11:22:24.226 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.227+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=06HCQS5GU5G7 type=del 2024-09-14T11:22:24.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.229+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=45VX41R4HICI type=write size=128844 2024-09-14T11:22:24.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.230+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~ECVFFL0SVCPX.0 size=1048576 2024-09-14T11:22:24.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.231+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~ECVFFL0SVCPX.1 size=252526 2024-09-14T11:22:24.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.233+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=ECVFFL0SVCPX tag=M0OZ7SIT7YFG type=write size=2349678 2024-09-14T11:22:24.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.234+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=GFRAHF6HTNDO type=del size=4088417 2024-09-14T11:22:24.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.235+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~JQJFWIDWTRI2.0 size=1048576 2024-09-14T11:22:24.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.235+0000 7f43cc561780 1 < canceled part key=_multipart_CXP2PUIXR2PA.2~JQJFWIDWTRI2.1 size=1013599 2024-09-14T11:22:24.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.237+0000 7f43cc561780 1 < canceled multipart upload key=CXP2PUIXR2PA upload=JQJFWIDWTRI2 tag=O8G75JS0NOCB type=write size=3110751 2024-09-14T11:22:24.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.239+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~VART20H4BUH4.0 size=1048576 2024-09-14T11:22:24.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.240+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~VART20H4BUH4.1 size=1048576 2024-09-14T11:22:24.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.241+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~VART20H4BUH4.2 size=663894 2024-09-14T11:22:24.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.241+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=VART20H4BUH4 tag=S3AKJ7U0K2MV type=write size=3809622 2024-09-14T11:22:24.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.243+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=ZD3O3WPQ9LT1 type=del 2024-09-14T11:22:24.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.245+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~SB8SKQGK0BFJ.0 size=724212 2024-09-14T11:22:24.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.245+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=SB8SKQGK0BFJ tag=10BPHFDLS58Y type=write size=1772788 2024-09-14T11:22:24.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.246+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~6O96WMMUZ8M8.0 size=509315 2024-09-14T11:22:24.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.248+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=6O96WMMUZ8M8 tag=IKYP10ZPZQK6 type=write size=1557891 2024-09-14T11:22:24.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.251+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~H94CZ18M79ZP.0 size=1007916 2024-09-14T11:22:24.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.251+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=H94CZ18M79ZP tag=UEA047PVQ601 type=write size=2056492 2024-09-14T11:22:24.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.252+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=P47WE38YGEA5 type=del 2024-09-14T11:22:24.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.253+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=SA1Y5O68C5YX type=del size=2452983 2024-09-14T11:22:24.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.256+0000 7f43cc561780 1 < suggested update operation key=WHIZ2GREK1FE tag=O5K23AQ0VIBP type=write size=401574 2024-09-14T11:22:24.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.257+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=USJ79QL3X246 type=del size=3841635 2024-09-14T11:22:24.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.259+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~7OJA9PC885YR.0 size=573760 2024-09-14T11:22:24.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.260+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=7OJA9PC885YR tag=KH0AHPD5908X type=write size=1622336 2024-09-14T11:22:24.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.263+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~DQ9QZL2TTPIZ.0 size=1048576 2024-09-14T11:22:24.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.264+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~DQ9QZL2TTPIZ.1 size=1048576 2024-09-14T11:22:24.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.265+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~DQ9QZL2TTPIZ.2 size=161305 2024-09-14T11:22:24.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.265+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=DQ9QZL2TTPIZ tag=KJ9GFLVVYC0G type=write size=3307033 2024-09-14T11:22:24.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.266+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=EUE3IBK9LLYN type=del 2024-09-14T11:22:24.267 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.268+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~JLX2SFP8B7T2.0 size=1048576 2024-09-14T11:22:24.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.269+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~JLX2SFP8B7T2.1 size=833295 2024-09-14T11:22:24.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.269+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=JLX2SFP8B7T2 tag=9E7NNQPKQIA9 type=write size=2930447 2024-09-14T11:22:24.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.271+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=6MKSP8NH0F13 type=del 2024-09-14T11:22:24.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.273+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~8X26FV8Y3G7Z.0 size=664456 2024-09-14T11:22:24.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.273+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=8X26FV8Y3G7Z tag=XKPH9E21YZQE type=write size=1713032 2024-09-14T11:22:24.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.274+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~U1PDBDLXCMNH.0 size=1048576 2024-09-14T11:22:24.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.275+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~U1PDBDLXCMNH.1 size=1048576 2024-09-14T11:22:24.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.276+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~U1PDBDLXCMNH.2 size=1004581 2024-09-14T11:22:24.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.279+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=U1PDBDLXCMNH tag=A6BMJD2JW1Y1 type=write size=4150309 2024-09-14T11:22:24.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.281+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~4WL58A28VMES.0 size=625532 2024-09-14T11:22:24.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.281+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=4WL58A28VMES tag=8FHPAL6ZY50H type=write size=1674108 2024-09-14T11:22:24.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.282+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~NTDDHDNH2Y32.0 size=1048576 2024-09-14T11:22:24.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.283+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~NTDDHDNH2Y32.1 size=709197 2024-09-14T11:22:24.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.285+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=NTDDHDNH2Y32 tag=TNKC5QP4HJHO type=write size=2806349 2024-09-14T11:22:24.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.286+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=OBN9IBC5OGU0 type=del size=2494523 2024-09-14T11:22:24.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.288+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=692PNAG4NOVN type=del 2024-09-14T11:22:24.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.291+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~MCGT6VJH09R1.0 size=1048576 2024-09-14T11:22:24.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.292+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~MCGT6VJH09R1.1 size=1048576 2024-09-14T11:22:24.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.293+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~MCGT6VJH09R1.2 size=268751 2024-09-14T11:22:24.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.293+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=MCGT6VJH09R1 tag=4CPMQ1UI9EF3 type=write size=3414479 2024-09-14T11:22:24.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.294+0000 7f43cc561780 1 < completed write operation key=9XIAGZKIUBGH tag=D53GEXGASHUT type=write size=568417 2024-09-14T11:22:24.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.295+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=UNHON4IGW6B6 type=write size=704996 2024-09-14T11:22:24.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.296+0000 7f43cc561780 1 < completed write operation key=E6FDCACWGA2Y tag=8CI60UCUFBQ7 type=write size=19825 2024-09-14T11:22:24.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.297+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=T2697125RZ0T type=del size=3399901 2024-09-14T11:22:24.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.299+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HMGUI5RTOUPX.0 size=1048576 2024-09-14T11:22:24.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.300+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HMGUI5RTOUPX.1 size=1048576 2024-09-14T11:22:24.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.301+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HMGUI5RTOUPX.2 size=409000 2024-09-14T11:22:24.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.303+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=HMGUI5RTOUPX tag=8Z8FCRTAS952 type=write size=3554728 2024-09-14T11:22:24.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.304+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=6GGDPZ1BDPKR type=del size=2679846 2024-09-14T11:22:24.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.306+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=45VX41R4HICI type=write size=128844 2024-09-14T11:22:24.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.307+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=LZ0C0YD2YSOG type=del size=3689243 2024-09-14T11:22:24.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.309+0000 7f43cc561780 1 < suggested remove operation key=683ZFW0BWMT7 tag=GFRAHF6HTNDO type=del 2024-09-14T11:22:24.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.310+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=MOOTDQHUJU1F type=del size=2674231 2024-09-14T11:22:24.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.312+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~VART20H4BUH4.0 size=1048576 2024-09-14T11:22:24.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.313+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~VART20H4BUH4.1 size=1048576 2024-09-14T11:22:24.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.314+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~VART20H4BUH4.2 size=663894 2024-09-14T11:22:24.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.316+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=VART20H4BUH4 tag=S3AKJ7U0K2MV type=write size=3809622 2024-09-14T11:22:24.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.317+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=WRF1ZCJWQ5KX type=del size=53653 2024-09-14T11:22:24.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.318+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~SB8SKQGK0BFJ.0 size=724212 2024-09-14T11:22:24.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.320+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=SB8SKQGK0BFJ tag=10BPHFDLS58Y type=write size=1772788 2024-09-14T11:22:24.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.322+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~D911SMDGZ8BN.0 size=1048576 2024-09-14T11:22:24.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.323+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~D911SMDGZ8BN.1 size=538072 2024-09-14T11:22:24.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.323+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=D911SMDGZ8BN tag=8YJVF9T0NFUX type=write size=2635224 2024-09-14T11:22:24.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.324+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~H94CZ18M79ZP.0 size=1007916 2024-09-14T11:22:24.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.326+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=H94CZ18M79ZP tag=UEA047PVQ601 type=write size=2056492 2024-09-14T11:22:24.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.327+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=KZV7BYUVLCF9 type=del size=1355661 2024-09-14T11:22:24.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.329+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=SA1Y5O68C5YX type=del 2024-09-14T11:22:24.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.330+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=0W4EIAH6AHB6 type=write size=56787 2024-09-14T11:22:24.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.332+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=USJ79QL3X246 type=del size=3841635 2024-09-14T11:22:24.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.333+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=TN8LW7QSY55J type=del size=3513906 2024-09-14T11:22:24.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.334+0000 7f43cc561780 1 < canceled part key=_multipart_MD14RGOQY0LK.2~DQ9QZL2TTPIZ.0 size=1048576 2024-09-14T11:22:24.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.335+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~DQ9QZL2TTPIZ.1 size=1048576 2024-09-14T11:22:24.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.336+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~DQ9QZL2TTPIZ.2 size=161305 2024-09-14T11:22:24.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.338+0000 7f43cc561780 1 < canceled multipart upload key=MD14RGOQY0LK upload=DQ9QZL2TTPIZ tag=KJ9GFLVVYC0G type=write size=3307033 2024-09-14T11:22:24.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.339+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=40T0RRFA0J4X type=del size=2853419 2024-09-14T11:22:24.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.341+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~JLX2SFP8B7T2.0 size=1048576 2024-09-14T11:22:24.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.342+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~JLX2SFP8B7T2.1 size=833295 2024-09-14T11:22:24.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.344+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=JLX2SFP8B7T2 tag=9E7NNQPKQIA9 type=write size=2930447 2024-09-14T11:22:24.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.345+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=H0B9CL2F7AJO type=del size=1886051 2024-09-14T11:22:24.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.347+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~8X26FV8Y3G7Z.0 size=664456 2024-09-14T11:22:24.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.349+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=8X26FV8Y3G7Z tag=XKPH9E21YZQE type=write size=1713032 2024-09-14T11:22:24.350 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.352+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~13Q6034S6EW9.0 size=1048576 2024-09-14T11:22:24.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.353+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~13Q6034S6EW9.1 size=762042 2024-09-14T11:22:24.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.353+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=13Q6034S6EW9 tag=VRQF8GG0T3N5 type=write size=2859194 2024-09-14T11:22:24.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.354+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~4WL58A28VMES.0 size=625532 2024-09-14T11:22:24.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.357+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=4WL58A28VMES tag=8FHPAL6ZY50H type=write size=1674108 2024-09-14T11:22:24.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.358+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=43O67B2W5T9U type=del size=438272 2024-09-14T11:22:24.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.360+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=OBN9IBC5OGU0 type=del 2024-09-14T11:22:24.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.362+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~3JHMK2G8L1Y8.0 size=1048576 2024-09-14T11:22:24.362 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.363+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~3JHMK2G8L1Y8.1 size=1048576 2024-09-14T11:22:24.363 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.364+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~3JHMK2G8L1Y8.2 size=396198 2024-09-14T11:22:24.363 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.364+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=3JHMK2G8L1Y8 tag=DNP22M45DZ99 type=write size=3541926 2024-09-14T11:22:24.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.366+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~MCGT6VJH09R1.0 size=1048576 2024-09-14T11:22:24.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.366+0000 7f43cc561780 1 < canceled part key=_multipart_WSFZN6JCWUXG.2~MCGT6VJH09R1.1 size=1048576 2024-09-14T11:22:24.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.366+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~MCGT6VJH09R1.2 size=268751 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.368+0000 7f43cc561780 1 < canceled multipart upload key=WSFZN6JCWUXG upload=MCGT6VJH09R1 tag=4CPMQ1UI9EF3 type=write size=3414479 2024-09-14T11:22:24.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.370+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=PG2CBJ4E6QRX type=del size=4092858 2024-09-14T11:22:24.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.371+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=UNHON4IGW6B6 type=write size=704996 2024-09-14T11:22:24.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.372+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=XT7PSQ60MMFW type=del size=1478761 2024-09-14T11:22:24.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.373+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=T2697125RZ0T type=del 2024-09-14T11:22:24.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.376+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~2Y5CMXKXEU0D.0 size=1048576 2024-09-14T11:22:24.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.377+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~2Y5CMXKXEU0D.1 size=505221 2024-09-14T11:22:24.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.377+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=2Y5CMXKXEU0D tag=YRE4FFZHNW9I type=write size=2602373 2024-09-14T11:22:24.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.378+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=6GGDPZ1BDPKR type=del 2024-09-14T11:22:24.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.380+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~5DYHWMSRHL3G.0 size=1048576 2024-09-14T11:22:24.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.381+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~5DYHWMSRHL3G.1 size=1048576 2024-09-14T11:22:24.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.382+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~5DYHWMSRHL3G.2 size=555478 2024-09-14T11:22:24.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.382+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=5DYHWMSRHL3G tag=DBFCVU0B1ZNL type=write size=3701206 2024-09-14T11:22:24.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.384+0000 7f43cc561780 1 < suggested update operation key=IG4QM506P41B tag=LZ0C0YD2YSOG type=del size=3689243 2024-09-14T11:22:24.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.385+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=C2BD3MCNNC9L type=del size=1076982 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.388+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=MOOTDQHUJU1F type=del size=2674231 2024-09-14T11:22:24.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.390+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~BS9KEGQ01B73.0 size=1048576 2024-09-14T11:22:24.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.391+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~BS9KEGQ01B73.1 size=841989 2024-09-14T11:22:24.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.391+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=BS9KEGQ01B73 tag=PM3SQGQBCGBQ type=write size=2939141 2024-09-14T11:22:24.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.392+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=WRF1ZCJWQ5KX type=del 2024-09-14T11:22:24.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.394+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~E73X7485824L.0 size=257150 2024-09-14T11:22:24.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.394+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=E73X7485824L tag=0OBN1AN1MGA1 type=write size=1305726 2024-09-14T11:22:24.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.396+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~D911SMDGZ8BN.0 size=1048576 2024-09-14T11:22:24.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.396+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~D911SMDGZ8BN.1 size=538072 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.398+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=D911SMDGZ8BN tag=8YJVF9T0NFUX type=write size=2635224 2024-09-14T11:22:24.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.400+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=3X9QWMH2K89X type=del size=3772276 2024-09-14T11:22:24.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.401+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=KZV7BYUVLCF9 type=del 2024-09-14T11:22:24.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.402+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=E861UETON1RW type=del size=79986 2024-09-14T11:22:24.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.403+0000 7f43cc561780 1 < completed write operation key=IFHWMI5YO5L5 tag=0W4EIAH6AHB6 type=write size=56787 2024-09-14T11:22:24.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.405+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=LCIUHBQO17MM type=del size=1765351 2024-09-14T11:22:24.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.407+0000 7f43cc561780 1 < suggested update operation key=OV4ATW747PY4 tag=TN8LW7QSY55J type=del size=3513906 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.409+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~EJFTC3UFSPDQ.0 size=1012496 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.409+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=EJFTC3UFSPDQ tag=YGSK2KVDLIRT type=write size=2061072 2024-09-14T11:22:24.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.411+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=40T0RRFA0J4X type=del 2024-09-14T11:22:24.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.413+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~VDM8Z4QSI24Z.0 size=1048576 2024-09-14T11:22:24.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.414+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~VDM8Z4QSI24Z.1 size=1048576 2024-09-14T11:22:24.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.416+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~VDM8Z4QSI24Z.2 size=800218 2024-09-14T11:22:24.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.416+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=VDM8Z4QSI24Z tag=8UA2KUSAVOTG type=write size=3945946 2024-09-14T11:22:24.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.418+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=H0B9CL2F7AJO type=del 2024-09-14T11:22:24.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.420+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~8YQQOVDT7UQ0.0 size=1048576 2024-09-14T11:22:24.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.421+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~8YQQOVDT7UQ0.1 size=786335 2024-09-14T11:22:24.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.421+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=8YQQOVDT7UQ0 tag=8UMF63Y69TQA type=write size=2883487 2024-09-14T11:22:24.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.422+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~13Q6034S6EW9.0 size=1048576 2024-09-14T11:22:24.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.423+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~13Q6034S6EW9.1 size=762042 2024-09-14T11:22:24.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.426+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=13Q6034S6EW9 tag=VRQF8GG0T3N5 type=write size=2859194 2024-09-14T11:22:24.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.428+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~VU15IL15W3AG.0 size=371626 2024-09-14T11:22:24.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.428+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=VU15IL15W3AG tag=08YJ6Y7VNH7C type=write size=1420202 2024-09-14T11:22:24.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.429+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=43O67B2W5T9U type=del 2024-09-14T11:22:24.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.432+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~4QQOGKH0MRIN.0 size=586318 2024-09-14T11:22:24.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.432+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=4QQOGKH0MRIN tag=DNH0WIDVEHHN type=write size=1634894 2024-09-14T11:22:24.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.433+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~3JHMK2G8L1Y8.0 size=1048576 2024-09-14T11:22:24.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.434+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~3JHMK2G8L1Y8.1 size=1048576 2024-09-14T11:22:24.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.435+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~3JHMK2G8L1Y8.2 size=396198 2024-09-14T11:22:24.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.437+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=3JHMK2G8L1Y8 tag=DNP22M45DZ99 type=write size=3541926 2024-09-14T11:22:24.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.438+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=NJZP4K3X40B3 type=del size=1743082 2024-09-14T11:22:24.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.439+0000 7f43cc561780 1 < canceled operation key=1M46U4U9MG1E tag=PG2CBJ4E6QRX type=del size=4092858 2024-09-14T11:22:24.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.441+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=ZLOHP17QS5PO type=del size=3217989 2024-09-14T11:22:24.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.442+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=XT7PSQ60MMFW type=del 2024-09-14T11:22:24.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.443+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=KQV8BUCMX9E6 type=del size=2388982 2024-09-14T11:22:24.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.445+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~2Y5CMXKXEU0D.0 size=1048576 2024-09-14T11:22:24.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.446+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~2Y5CMXKXEU0D.1 size=505221 2024-09-14T11:22:24.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.448+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=2Y5CMXKXEU0D tag=YRE4FFZHNW9I type=write size=2602373 2024-09-14T11:22:24.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.449+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=MG06ZVFEODCD type=write size=435650 2024-09-14T11:22:24.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.451+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~5DYHWMSRHL3G.0 size=1048576 2024-09-14T11:22:24.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.452+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~5DYHWMSRHL3G.1 size=1048576 2024-09-14T11:22:24.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.453+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~5DYHWMSRHL3G.2 size=555478 2024-09-14T11:22:24.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.455+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=5DYHWMSRHL3G tag=DBFCVU0B1ZNL type=write size=3701206 2024-09-14T11:22:24.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.456+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=27A56BFPG12K type=write size=790003 2024-09-14T11:22:24.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.458+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=C2BD3MCNNC9L type=del 2024-09-14T11:22:24.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.459+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=V058KEOZE4Y3 type=del size=1301963 2024-09-14T11:22:24.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.461+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~BS9KEGQ01B73.0 size=1048576 2024-09-14T11:22:24.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.462+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~BS9KEGQ01B73.1 size=841989 2024-09-14T11:22:24.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.464+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=BS9KEGQ01B73 tag=PM3SQGQBCGBQ type=write size=2939141 2024-09-14T11:22:24.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.465+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=AOQA7IUN5WRP type=write size=673323 2024-09-14T11:22:24.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.467+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~E73X7485824L.0 size=257150 2024-09-14T11:22:24.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.469+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=E73X7485824L tag=0OBN1AN1MGA1 type=write size=1305726 2024-09-14T11:22:24.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.471+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~J9PROQX3G1CU.0 size=1048576 2024-09-14T11:22:24.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.472+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~J9PROQX3G1CU.1 size=1048576 2024-09-14T11:22:24.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.474+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~J9PROQX3G1CU.2 size=502953 2024-09-14T11:22:24.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.474+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=J9PROQX3G1CU tag=QJLBKZWFGY12 type=write size=3648681 2024-09-14T11:22:24.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.475+0000 7f43cc561780 1 < canceled operation key=1M46U4U9MG1E tag=3X9QWMH2K89X type=del size=3772276 2024-09-14T11:22:24.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.476+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=SIN1THR553MG type=del size=3880006 2024-09-14T11:22:24.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.478+0000 7f43cc561780 1 < suggested remove operation key=3YHEZHW0RS1W tag=E861UETON1RW type=del 2024-09-14T11:22:24.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.481+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~GUA7PQDTI2AF.0 size=1048576 2024-09-14T11:22:24.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.482+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~GUA7PQDTI2AF.1 size=1048576 2024-09-14T11:22:24.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.483+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~GUA7PQDTI2AF.2 size=583563 2024-09-14T11:22:24.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.483+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=GUA7PQDTI2AF tag=G8B3E4JIPUK3 type=write size=3729291 2024-09-14T11:22:24.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.484+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=LCIUHBQO17MM type=del 2024-09-14T11:22:24.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.486+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~6F0O6KO92V7Q.0 size=1048576 2024-09-14T11:22:24.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.487+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~6F0O6KO92V7Q.1 size=1048576 2024-09-14T11:22:24.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.488+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~6F0O6KO92V7Q.2 size=607993 2024-09-14T11:22:24.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.488+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=6F0O6KO92V7Q tag=6E3WUKBSU22X type=write size=3753721 2024-09-14T11:22:24.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.489+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~EJFTC3UFSPDQ.0 size=1012496 2024-09-14T11:22:24.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.491+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=EJFTC3UFSPDQ tag=YGSK2KVDLIRT type=write size=2061072 2024-09-14T11:22:24.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.492+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=ZH735A3ZC691 type=del size=900609 2024-09-14T11:22:24.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.494+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~VDM8Z4QSI24Z.0 size=1048576 2024-09-14T11:22:24.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.494+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~VDM8Z4QSI24Z.1 size=1048576 2024-09-14T11:22:24.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.495+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~VDM8Z4QSI24Z.2 size=800218 2024-09-14T11:22:24.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.497+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=VDM8Z4QSI24Z tag=8UA2KUSAVOTG type=write size=3945946 2024-09-14T11:22:24.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.499+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=WNF3TNW9QDRI type=del size=3811904 2024-09-14T11:22:24.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.500+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~8YQQOVDT7UQ0.0 size=1048576 2024-09-14T11:22:24.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.501+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~8YQQOVDT7UQ0.1 size=786335 2024-09-14T11:22:24.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.503+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=8YQQOVDT7UQ0 tag=8UMF63Y69TQA type=write size=2883487 2024-09-14T11:22:24.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.505+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~FCY219OYTXNT.0 size=163637 2024-09-14T11:22:24.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.505+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=FCY219OYTXNT tag=5AVX48PV59M2 type=write size=1212213 2024-09-14T11:22:24.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.506+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~VU15IL15W3AG.0 size=371626 2024-09-14T11:22:24.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.509+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=VU15IL15W3AG tag=08YJ6Y7VNH7C type=write size=1420202 2024-09-14T11:22:24.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.510+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=HB6UFK5O5UMM type=del size=1324227 2024-09-14T11:22:24.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.511+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~4QQOGKH0MRIN.0 size=586318 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.514+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=4QQOGKH0MRIN tag=DNH0WIDVEHHN type=write size=1634894 2024-09-14T11:22:24.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.515+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=OD6QMSOR8ZMC type=del size=3123932 2024-09-14T11:22:24.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.516+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=NJZP4K3X40B3 type=del 2024-09-14T11:22:24.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.518+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=PK02FBY5JCUX type=del size=2461907 2024-09-14T11:22:24.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.519+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=ZLOHP17QS5PO type=del 2024-09-14T11:22:24.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.520+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=76FMRMBON0JD type=del size=83917 2024-09-14T11:22:24.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.521+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=KQV8BUCMX9E6 type=del 2024-09-14T11:22:24.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.522+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=FGE7B1NQ0RCV type=del size=1391963 2024-09-14T11:22:24.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.524+0000 7f43cc561780 1 < completed write operation key=W679WIFVPVOH tag=MG06ZVFEODCD type=write size=435650 2024-09-14T11:22:24.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.526+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~O09V16YQAXGG.0 size=1048576 2024-09-14T11:22:24.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.527+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~O09V16YQAXGG.1 size=715640 2024-09-14T11:22:24.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.527+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=O09V16YQAXGG tag=L2P254J4F75Y type=write size=2812792 2024-09-14T11:22:24.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.529+0000 7f43cc561780 1 < suggested update operation key=W679WIFVPVOH tag=27A56BFPG12K type=write size=790003 2024-09-14T11:22:24.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.531+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=TTR7X7PDH8GY type=write size=402421 2024-09-14T11:22:24.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.532+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=V058KEOZE4Y3 type=del 2024-09-14T11:22:24.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.534+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=IRC132LMJ4FS type=del size=2013828 2024-09-14T11:22:24.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.535+0000 7f43cc561780 1 < completed write operation key=15F3ZZAAKT9B tag=AOQA7IUN5WRP type=write size=673323 2024-09-14T11:22:24.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.538+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~HPCGASLK9J5A.0 size=925459 2024-09-14T11:22:24.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.538+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=HPCGASLK9J5A tag=WNLIHL4NH5VY type=write size=1974035 2024-09-14T11:22:24.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.539+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~J9PROQX3G1CU.0 size=1048576 2024-09-14T11:22:24.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.540+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~J9PROQX3G1CU.1 size=1048576 2024-09-14T11:22:24.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.541+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~J9PROQX3G1CU.2 size=502953 2024-09-14T11:22:24.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.543+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=J9PROQX3G1CU tag=QJLBKZWFGY12 type=write size=3648681 2024-09-14T11:22:24.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.544+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=3LENVQCTLA5P type=del size=399772 2024-09-14T11:22:24.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.545+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=SIN1THR553MG type=del 2024-09-14T11:22:24.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.546+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=7EVNKP415CGT type=write size=593181 2024-09-14T11:22:24.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.547+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~GUA7PQDTI2AF.0 size=1048576 2024-09-14T11:22:24.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.548+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~GUA7PQDTI2AF.1 size=1048576 2024-09-14T11:22:24.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.549+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~GUA7PQDTI2AF.2 size=583563 2024-09-14T11:22:24.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.551+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=GUA7PQDTI2AF tag=G8B3E4JIPUK3 type=write size=3729291 2024-09-14T11:22:24.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.553+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=TS7NDAW16428 type=del size=1886943 2024-09-14T11:22:24.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.554+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~6F0O6KO92V7Q.0 size=1048576 2024-09-14T11:22:24.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.555+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~6F0O6KO92V7Q.1 size=1048576 2024-09-14T11:22:24.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.556+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~6F0O6KO92V7Q.2 size=607993 2024-09-14T11:22:24.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.558+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=6F0O6KO92V7Q tag=6E3WUKBSU22X type=write size=3753721 2024-09-14T11:22:24.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.559+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=1BU2PNVCCIA3 type=del size=2539716 2024-09-14T11:22:24.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.560+0000 7f43cc561780 1 < canceled operation key=A1B2LIZIPET3 tag=ZH735A3ZC691 type=del size=900609 2024-09-14T11:22:24.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.561+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=WKU3TYBAWHXQ type=del size=2444906 2024-09-14T11:22:24.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.563+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=WNF3TNW9QDRI type=del 2024-09-14T11:22:24.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.564+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=1M7HP739FMA0 type=del size=149175 2024-09-14T11:22:24.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.565+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~FCY219OYTXNT.0 size=163637 2024-09-14T11:22:24.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.567+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=FCY219OYTXNT tag=5AVX48PV59M2 type=write size=1212213 2024-09-14T11:22:24.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.569+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~A6V069B3D3MC.0 size=1048576 2024-09-14T11:22:24.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.570+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~A6V069B3D3MC.1 size=845330 2024-09-14T11:22:24.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.570+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=A6V069B3D3MC tag=G2RVBPUGNNCO type=write size=2942482 2024-09-14T11:22:24.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.571+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=HB6UFK5O5UMM type=del 2024-09-14T11:22:24.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.572+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=2V109EVE3API type=write size=83226 2024-09-14T11:22:24.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.573+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=OD6QMSOR8ZMC type=del 2024-09-14T11:22:24.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.575+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~DYIZUXBWNTCS.0 size=1048576 2024-09-14T11:22:24.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.576+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~DYIZUXBWNTCS.1 size=1048576 2024-09-14T11:22:24.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.577+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~DYIZUXBWNTCS.2 size=551660 2024-09-14T11:22:24.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.577+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=DYIZUXBWNTCS tag=C69FSS2TDO1S type=write size=3697388 2024-09-14T11:22:24.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.579+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=PK02FBY5JCUX type=del 2024-09-14T11:22:24.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.581+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~0VQS1XAV7QT2.0 size=1048576 2024-09-14T11:22:24.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.582+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~0VQS1XAV7QT2.1 size=1048576 2024-09-14T11:22:24.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.583+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~0VQS1XAV7QT2.2 size=601944 2024-09-14T11:22:24.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.583+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=0VQS1XAV7QT2 tag=1RRRTGXGZ9C6 type=write size=3747672 2024-09-14T11:22:24.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.584+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=76FMRMBON0JD type=del 2024-09-14T11:22:24.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.586+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~Q9QZGHRO90CA.0 size=1048576 2024-09-14T11:22:24.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.587+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~Q9QZGHRO90CA.1 size=1048576 2024-09-14T11:22:24.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.588+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~Q9QZGHRO90CA.2 size=342346 2024-09-14T11:22:24.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.588+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=Q9QZGHRO90CA tag=HEPKAWH8XSZG type=write size=3488074 2024-09-14T11:22:24.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.589+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=FGE7B1NQ0RCV type=del 2024-09-14T11:22:24.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.590+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=UR8XNY9LNW8V type=write size=578480 2024-09-14T11:22:24.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.592+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~O09V16YQAXGG.0 size=1048576 2024-09-14T11:22:24.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.593+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~O09V16YQAXGG.1 size=715640 2024-09-14T11:22:24.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.595+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=O09V16YQAXGG tag=L2P254J4F75Y type=write size=2812792 2024-09-14T11:22:24.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.596+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=LVSZEP8I09MG type=del size=3151806 2024-09-14T11:22:24.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.597+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=TTR7X7PDH8GY type=write size=402421 2024-09-14T11:22:24.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.598+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=CNNVKFT77D4P type=del size=1563292 2024-09-14T11:22:24.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.600+0000 7f43cc561780 1 < canceled operation key=WHIZ2GREK1FE tag=IRC132LMJ4FS type=del size=2013828 2024-09-14T11:22:24.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.601+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=CMUOUPNSH86I type=del size=671766 2024-09-14T11:22:24.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.602+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~HPCGASLK9J5A.0 size=925459 2024-09-14T11:22:24.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.604+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=HPCGASLK9J5A tag=WNLIHL4NH5VY type=write size=1974035 2024-09-14T11:22:24.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.605+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=EPE3933TJEYX type=del size=1751997 2024-09-14T11:22:24.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.606+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=3LENVQCTLA5P type=del 2024-09-14T11:22:24.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.608+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~OFZUFUJ6W701.0 size=1048576 2024-09-14T11:22:24.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.609+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~OFZUFUJ6W701.1 size=1048576 2024-09-14T11:22:24.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.610+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~OFZUFUJ6W701.2 size=833678 2024-09-14T11:22:24.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.610+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=OFZUFUJ6W701 tag=GWWCTS441W55 type=write size=3979406 2024-09-14T11:22:24.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.611+0000 7f43cc561780 1 < completed write operation key=OV4ATW747PY4 tag=7EVNKP415CGT type=write size=593181 2024-09-14T11:22:24.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.614+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~KN5QBVNV41SB.0 size=1048576 2024-09-14T11:22:24.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.615+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~KN5QBVNV41SB.1 size=1048576 2024-09-14T11:22:24.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.615+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~KN5QBVNV41SB.2 size=214422 2024-09-14T11:22:24.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.615+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=KN5QBVNV41SB tag=K96PREF7PGUW type=write size=3360150 2024-09-14T11:22:24.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.618+0000 7f43cc561780 1 < suggested update operation key=A1B2LIZIPET3 tag=TS7NDAW16428 type=del size=1886943 2024-09-14T11:22:24.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.620+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~EQTX383CP2U4.0 size=1048576 2024-09-14T11:22:24.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.621+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~EQTX383CP2U4.1 size=1048576 2024-09-14T11:22:24.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.622+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~EQTX383CP2U4.2 size=968835 2024-09-14T11:22:24.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.622+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=EQTX383CP2U4 tag=33H51I6UHWL0 type=write size=4114563 2024-09-14T11:22:24.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.624+0000 7f43cc561780 1 < suggested remove operation key=OJOJZBG1WEGI tag=1BU2PNVCCIA3 type=del 2024-09-14T11:22:24.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.626+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~THG3VEF6QIS9.0 size=1048576 2024-09-14T11:22:24.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.627+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~THG3VEF6QIS9.1 size=1048576 2024-09-14T11:22:24.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.628+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~THG3VEF6QIS9.2 size=690120 2024-09-14T11:22:24.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.628+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=THG3VEF6QIS9 tag=9S1LDL1Q4Y67 type=write size=3835848 2024-09-14T11:22:24.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.630+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=WKU3TYBAWHXQ type=del 2024-09-14T11:22:24.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.631+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=SLGC2B55SMUF type=del size=3037454 2024-09-14T11:22:24.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.632+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=1M7HP739FMA0 type=del 2024-09-14T11:22:24.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.634+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~48B3QDMOJ91B.0 size=1048576 2024-09-14T11:22:24.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.635+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~48B3QDMOJ91B.1 size=1048576 2024-09-14T11:22:24.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.636+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~48B3QDMOJ91B.2 size=73913 2024-09-14T11:22:24.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.636+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=48B3QDMOJ91B tag=OC956664MK4S type=write size=3219641 2024-09-14T11:22:24.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.637+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~A6V069B3D3MC.0 size=1048576 2024-09-14T11:22:24.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.638+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~A6V069B3D3MC.1 size=845330 2024-09-14T11:22:24.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.640+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=A6V069B3D3MC tag=G2RVBPUGNNCO type=write size=2942482 2024-09-14T11:22:24.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.642+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=01S9RMIPHATJ type=del size=3562517 2024-09-14T11:22:24.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.644+0000 7f43cc561780 1 < completed write operation key=AWBBRU4C8RDQ tag=2V109EVE3API type=write size=83226 2024-09-14T11:22:24.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.646+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~F91MCXC9QCEI.0 size=1048576 2024-09-14T11:22:24.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.647+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~F91MCXC9QCEI.1 size=238243 2024-09-14T11:22:24.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.647+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=F91MCXC9QCEI tag=SOEJKDCXIEA5 type=write size=2335395 2024-09-14T11:22:24.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.649+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~DYIZUXBWNTCS.0 size=1048576 2024-09-14T11:22:24.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.650+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~DYIZUXBWNTCS.1 size=1048576 2024-09-14T11:22:24.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.651+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~DYIZUXBWNTCS.2 size=551660 2024-09-14T11:22:24.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.653+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=DYIZUXBWNTCS tag=C69FSS2TDO1S type=write size=3697388 2024-09-14T11:22:24.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.654+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=94I96FS9BY0O type=del size=1796915 2024-09-14T11:22:24.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.655+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~0VQS1XAV7QT2.0 size=1048576 2024-09-14T11:22:24.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.656+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~0VQS1XAV7QT2.1 size=1048576 2024-09-14T11:22:24.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.657+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~0VQS1XAV7QT2.2 size=601944 2024-09-14T11:22:24.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.659+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=0VQS1XAV7QT2 tag=1RRRTGXGZ9C6 type=write size=3747672 2024-09-14T11:22:24.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.661+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~W84LXSJWYSZL.0 size=1048576 2024-09-14T11:22:24.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.662+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~W84LXSJWYSZL.1 size=1048576 2024-09-14T11:22:24.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.663+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~W84LXSJWYSZL.2 size=215530 2024-09-14T11:22:24.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.663+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=W84LXSJWYSZL tag=QX055WUAR3DI type=write size=3361258 2024-09-14T11:22:24.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.664+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~Q9QZGHRO90CA.0 size=1048576 2024-09-14T11:22:24.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.665+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~Q9QZGHRO90CA.1 size=1048576 2024-09-14T11:22:24.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.666+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~Q9QZGHRO90CA.2 size=342346 2024-09-14T11:22:24.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.668+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=Q9QZGHRO90CA tag=HEPKAWH8XSZG type=write size=3488074 2024-09-14T11:22:24.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.670+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~PPIQHB7KBLGQ.0 size=1048576 2024-09-14T11:22:24.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.671+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~PPIQHB7KBLGQ.1 size=1048576 2024-09-14T11:22:24.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.672+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~PPIQHB7KBLGQ.2 size=571575 2024-09-14T11:22:24.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.672+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=PPIQHB7KBLGQ tag=MHQZFBVSMEMY type=write size=3717303 2024-09-14T11:22:24.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.673+0000 7f43cc561780 1 < completed write operation key=UWES4CQZ8XW6 tag=UR8XNY9LNW8V type=write size=578480 2024-09-14T11:22:24.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.674+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=H43X1R8AALC3 type=write size=497945 2024-09-14T11:22:24.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.675+0000 7f43cc561780 -1 < failed to complete operation key=OJOJZBG1WEGI tag=LVSZEP8I09MG type=del size=3151806: (22) Invalid argument 2024-09-14T11:22:24.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.678+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~7A53SPWQEVCV.0 size=968705 2024-09-14T11:22:24.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.678+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=7A53SPWQEVCV tag=E1G4FTICTI6Z type=write size=2017281 2024-09-14T11:22:24.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.679+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=CNNVKFT77D4P type=del 2024-09-14T11:22:24.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.681+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~B7H4PXQD23SW.0 size=1048576 2024-09-14T11:22:24.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.682+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~B7H4PXQD23SW.1 size=220427 2024-09-14T11:22:24.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.682+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=B7H4PXQD23SW tag=NL76UO88YH9Q type=write size=2317579 2024-09-14T11:22:24.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.684+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=CMUOUPNSH86I type=del 2024-09-14T11:22:24.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.685+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=BA4ZW12C1O34 type=del size=1812943 2024-09-14T11:22:24.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.686+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=EPE3933TJEYX type=del 2024-09-14T11:22:24.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.689+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~BWR7NKDWG1P6.0 size=1048576 2024-09-14T11:22:24.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.689+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~BWR7NKDWG1P6.1 size=200585 2024-09-14T11:22:24.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.689+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=BWR7NKDWG1P6 tag=V6DVQ4QWR0ZK type=write size=2297737 2024-09-14T11:22:24.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.691+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~OFZUFUJ6W701.0 size=1048576 2024-09-14T11:22:24.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.692+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~OFZUFUJ6W701.1 size=1048576 2024-09-14T11:22:24.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.693+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~OFZUFUJ6W701.2 size=833678 2024-09-14T11:22:24.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.695+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=OFZUFUJ6W701 tag=GWWCTS441W55 type=write size=3979406 2024-09-14T11:22:24.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.697+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~SPMYP5ITUA8S.0 size=1048576 2024-09-14T11:22:24.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.698+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~SPMYP5ITUA8S.1 size=1048576 2024-09-14T11:22:24.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.699+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~SPMYP5ITUA8S.2 size=90580 2024-09-14T11:22:24.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.699+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=SPMYP5ITUA8S tag=4V12S0VGZL55 type=write size=3236308 2024-09-14T11:22:24.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.700+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~KN5QBVNV41SB.0 size=1048576 2024-09-14T11:22:24.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.701+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~KN5QBVNV41SB.1 size=1048576 2024-09-14T11:22:24.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.702+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~KN5QBVNV41SB.2 size=214422 2024-09-14T11:22:24.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.704+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=KN5QBVNV41SB tag=K96PREF7PGUW type=write size=3360150 2024-09-14T11:22:24.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.705+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=Y8CPZ3MCYD11 type=del size=2118436 2024-09-14T11:22:24.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.707+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~EQTX383CP2U4.0 size=1048576 2024-09-14T11:22:24.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.707+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~EQTX383CP2U4.1 size=1048576 2024-09-14T11:22:24.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.708+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~EQTX383CP2U4.2 size=968835 2024-09-14T11:22:24.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.710+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=EQTX383CP2U4 tag=33H51I6UHWL0 type=write size=4114563 2024-09-14T11:22:24.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.712+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=J682O6MVQGQ4 type=del size=419945 2024-09-14T11:22:24.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.713+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~THG3VEF6QIS9.0 size=1048576 2024-09-14T11:22:24.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.714+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~THG3VEF6QIS9.1 size=1048576 2024-09-14T11:22:24.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.715+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~THG3VEF6QIS9.2 size=690120 2024-09-14T11:22:24.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.717+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=THG3VEF6QIS9 tag=9S1LDL1Q4Y67 type=write size=3835848 2024-09-14T11:22:24.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.719+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~R7BO0E15JXOZ.0 size=391286 2024-09-14T11:22:24.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.719+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=R7BO0E15JXOZ tag=EP1A4DFJRZF0 type=write size=1439862 2024-09-14T11:22:24.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.720+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=SLGC2B55SMUF type=del 2024-09-14T11:22:24.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.721+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=5F2D3WJ4DAEO type=write size=374537 2024-09-14T11:22:24.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.722+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~48B3QDMOJ91B.0 size=1048576 2024-09-14T11:22:24.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.723+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~48B3QDMOJ91B.1 size=1048576 2024-09-14T11:22:24.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.724+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~48B3QDMOJ91B.2 size=73913 2024-09-14T11:22:24.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.726+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=48B3QDMOJ91B tag=OC956664MK4S type=write size=3219641 2024-09-14T11:22:24.726 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.727+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=QD13LQ3ZYAL2 type=del size=2839449 2024-09-14T11:22:24.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.728+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=01S9RMIPHATJ type=del 2024-09-14T11:22:24.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.729+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=MMK23PORK0YL type=write size=329071 2024-09-14T11:22:24.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.730+0000 7f43cc561780 1 < canceled part key=_multipart_IFHWMI5YO5L5.2~F91MCXC9QCEI.0 size=1048576 2024-09-14T11:22:24.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.730+0000 7f43cc561780 1 < canceled part key=_multipart_IFHWMI5YO5L5.2~F91MCXC9QCEI.1 size=238243 2024-09-14T11:22:24.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.732+0000 7f43cc561780 1 < canceled multipart upload key=IFHWMI5YO5L5 upload=F91MCXC9QCEI tag=SOEJKDCXIEA5 type=write size=2335395 2024-09-14T11:22:24.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.733+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=CAVNUJHBDVLV type=del size=2509549 2024-09-14T11:22:24.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.734+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=94I96FS9BY0O type=del 2024-09-14T11:22:24.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.736+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~D6L2O0KT6WDX.0 size=1048576 2024-09-14T11:22:24.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.737+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~D6L2O0KT6WDX.1 size=1048576 2024-09-14T11:22:24.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.738+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~D6L2O0KT6WDX.2 size=995622 2024-09-14T11:22:24.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.738+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=D6L2O0KT6WDX tag=GSAAHMGDO0UG type=write size=4141350 2024-09-14T11:22:24.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.739+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~W84LXSJWYSZL.0 size=1048576 2024-09-14T11:22:24.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.740+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~W84LXSJWYSZL.1 size=1048576 2024-09-14T11:22:24.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.741+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~W84LXSJWYSZL.2 size=215530 2024-09-14T11:22:24.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.743+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=W84LXSJWYSZL tag=QX055WUAR3DI type=write size=3361258 2024-09-14T11:22:24.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.745+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=MMCWA953JJZJ type=del size=3222091 2024-09-14T11:22:24.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.745+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~PPIQHB7KBLGQ.0 size=1048576 2024-09-14T11:22:24.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.746+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~PPIQHB7KBLGQ.1 size=1048576 2024-09-14T11:22:24.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.747+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~PPIQHB7KBLGQ.2 size=571575 2024-09-14T11:22:24.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.749+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=PPIQHB7KBLGQ tag=MHQZFBVSMEMY type=write size=3717303 2024-09-14T11:22:24.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.752+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~JXRWXFDJK4RW.0 size=1048576 2024-09-14T11:22:24.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.753+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~JXRWXFDJK4RW.1 size=671901 2024-09-14T11:22:24.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.753+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=JXRWXFDJK4RW tag=IFQQUFDJ6SBH type=write size=2769053 2024-09-14T11:22:24.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.755+0000 7f43cc561780 1 < suggested remove operation key=AY7JGVM96MO7 tag=H43X1R8AALC3 type=write 2024-09-14T11:22:24.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.757+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~D4OM9M426U3N.0 size=1048576 2024-09-14T11:22:24.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.758+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~D4OM9M426U3N.1 size=229747 2024-09-14T11:22:24.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.758+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=D4OM9M426U3N tag=W617TOI2FOSU type=write size=2326899 2024-09-14T11:22:24.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.759+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~7A53SPWQEVCV.0 size=968705 2024-09-14T11:22:24.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.761+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=7A53SPWQEVCV tag=E1G4FTICTI6Z type=write size=2017281 2024-09-14T11:22:24.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.762+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=6WKJXJ4SUWRL type=del size=416529 2024-09-14T11:22:24.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.763+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~B7H4PXQD23SW.0 size=1048576 2024-09-14T11:22:24.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.764+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~B7H4PXQD23SW.1 size=220427 2024-09-14T11:22:24.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.766+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=B7H4PXQD23SW tag=NL76UO88YH9Q type=write size=2317579 2024-09-14T11:22:24.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.768+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=83S008FSL9CS type=del size=1307120 2024-09-14T11:22:24.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.769+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=BA4ZW12C1O34 type=del 2024-09-14T11:22:24.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.771+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~EDTKBDBN902G.0 size=1048576 2024-09-14T11:22:24.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.772+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~EDTKBDBN902G.1 size=579908 2024-09-14T11:22:24.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.772+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=EDTKBDBN902G tag=08NUZ9UBATAP type=write size=2677060 2024-09-14T11:22:24.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.773+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~BWR7NKDWG1P6.0 size=1048576 2024-09-14T11:22:24.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.775+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~BWR7NKDWG1P6.1 size=200585 2024-09-14T11:22:24.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.777+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=BWR7NKDWG1P6 tag=V6DVQ4QWR0ZK type=write size=2297737 2024-09-14T11:22:24.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.778+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=VYK8JT1T5W0M type=del size=2208409 2024-09-14T11:22:24.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.779+0000 7f43cc561780 1 < canceled part key=_multipart_9XIAGZKIUBGH.2~SPMYP5ITUA8S.0 size=1048576 2024-09-14T11:22:24.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.780+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~SPMYP5ITUA8S.1 size=1048576 2024-09-14T11:22:24.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.780+0000 7f43cc561780 1 < canceled part key=_multipart_9XIAGZKIUBGH.2~SPMYP5ITUA8S.2 size=90580 2024-09-14T11:22:24.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.781+0000 7f43cc561780 1 < canceled multipart upload key=9XIAGZKIUBGH upload=SPMYP5ITUA8S tag=4V12S0VGZL55 type=write size=3236308 2024-09-14T11:22:24.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.784+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~YXOHIR077JHJ.0 size=871355 2024-09-14T11:22:24.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.784+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=YXOHIR077JHJ tag=1AJ8T5PV2O3V type=write size=1919931 2024-09-14T11:22:24.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.785+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=Y8CPZ3MCYD11 type=del 2024-09-14T11:22:24.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.786+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=NB67UHYZTA3V type=del size=219361 2024-09-14T11:22:24.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.788+0000 7f43cc561780 1 < suggested remove operation key=BRHP3DQEO3HZ tag=J682O6MVQGQ4 type=del 2024-09-14T11:22:24.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.791+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~F1SSSJY44S1L.0 size=1048576 2024-09-14T11:22:24.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.792+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~F1SSSJY44S1L.1 size=547571 2024-09-14T11:22:24.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.792+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=F1SSSJY44S1L tag=0FNZRZJ7D3H0 type=write size=2644723 2024-09-14T11:22:24.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.793+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~R7BO0E15JXOZ.0 size=391286 2024-09-14T11:22:24.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.795+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=R7BO0E15JXOZ tag=EP1A4DFJRZF0 type=write size=1439862 2024-09-14T11:22:24.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.796+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=3PNU7FEZLDPW type=del size=2601475 2024-09-14T11:22:24.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.798+0000 7f43cc561780 -1 < failed to complete operation key=BRHP3DQEO3HZ tag=5F2D3WJ4DAEO type=write size=374537: (22) Invalid argument 2024-09-14T11:22:24.798 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.799+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=DUM0NRY93EU5 type=del size=4063097 2024-09-14T11:22:24.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.800+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=QD13LQ3ZYAL2 type=del 2024-09-14T11:22:24.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.801+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=ZKHFCW12BPRI type=del size=993281 2024-09-14T11:22:24.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.803+0000 7f43cc561780 1 < completed write operation key=MD14RGOQY0LK tag=MMK23PORK0YL type=write size=329071 2024-09-14T11:22:24.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.804+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=G4FH21D2BIV7 type=write size=962963 2024-09-14T11:22:24.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.806+0000 7f43cc561780 1 < suggested update operation key=IG4QM506P41B tag=CAVNUJHBDVLV type=del size=2509549 2024-09-14T11:22:24.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.808+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=IWLAMIXXZS6N type=write size=856644 2024-09-14T11:22:24.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.809+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~D6L2O0KT6WDX.0 size=1048576 2024-09-14T11:22:24.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.810+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~D6L2O0KT6WDX.1 size=1048576 2024-09-14T11:22:24.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.811+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~D6L2O0KT6WDX.2 size=995622 2024-09-14T11:22:24.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.813+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=D6L2O0KT6WDX tag=GSAAHMGDO0UG type=write size=4141350 2024-09-14T11:22:24.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.815+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~VZKDUVY12M1I.0 size=305258 2024-09-14T11:22:24.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.815+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=VZKDUVY12M1I tag=V5WJW9BZHBLS type=write size=1353834 2024-09-14T11:22:24.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.816+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=MMCWA953JJZJ type=del 2024-09-14T11:22:24.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.818+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=ZAYJEZJJ1AOU type=del size=1968889 2024-09-14T11:22:24.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.819+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~JXRWXFDJK4RW.0 size=1048576 2024-09-14T11:22:24.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.820+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~JXRWXFDJK4RW.1 size=671901 2024-09-14T11:22:24.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.822+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=JXRWXFDJK4RW tag=IFQQUFDJ6SBH type=write size=2769053 2024-09-14T11:22:24.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.823+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=9KB7IVM6MERL type=del size=31716 2024-09-14T11:22:24.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.824+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~D4OM9M426U3N.0 size=1048576 2024-09-14T11:22:24.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.825+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~D4OM9M426U3N.1 size=229747 2024-09-14T11:22:24.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.827+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=D4OM9M426U3N tag=W617TOI2FOSU type=write size=2326899 2024-09-14T11:22:24.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.828+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=7C8M60U7UBPW type=write size=959544 2024-09-14T11:22:24.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.830+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=6WKJXJ4SUWRL type=del 2024-09-14T11:22:24.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.831+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=L12NAW5KBR64 type=del size=3990345 2024-09-14T11:22:24.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.832+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=83S008FSL9CS type=del 2024-09-14T11:22:24.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.834+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~2J3UD3LSDFDT.0 size=1048576 2024-09-14T11:22:24.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.835+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~2J3UD3LSDFDT.1 size=581170 2024-09-14T11:22:24.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.835+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=2J3UD3LSDFDT tag=J5PATUT0YFAG type=write size=2678322 2024-09-14T11:22:24.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.837+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~EDTKBDBN902G.0 size=1048576 2024-09-14T11:22:24.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.837+0000 7f43cc561780 1 < canceled part key=_multipart_0TDWJO4AWOOF.2~EDTKBDBN902G.1 size=579908 2024-09-14T11:22:24.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.839+0000 7f43cc561780 1 < canceled multipart upload key=0TDWJO4AWOOF upload=EDTKBDBN902G tag=08NUZ9UBATAP type=write size=2677060 2024-09-14T11:22:24.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.841+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~CVHBACY19QFA.0 size=1048576 2024-09-14T11:22:24.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.842+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~CVHBACY19QFA.1 size=143579 2024-09-14T11:22:24.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.842+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=CVHBACY19QFA tag=U4HUPNRNH98L type=write size=2240731 2024-09-14T11:22:24.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.844+0000 7f43cc561780 1 < suggested remove operation key=BNNSFLYOU27F tag=VYK8JT1T5W0M type=del 2024-09-14T11:22:24.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.847+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~O9PLMOXIIR3U.0 size=1048576 2024-09-14T11:22:24.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.848+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~O9PLMOXIIR3U.1 size=152925 2024-09-14T11:22:24.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.848+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=O9PLMOXIIR3U tag=JIV0MK6KAAY0 type=write size=2250077 2024-09-14T11:22:24.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.849+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~YXOHIR077JHJ.0 size=871355 2024-09-14T11:22:24.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.851+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=YXOHIR077JHJ tag=1AJ8T5PV2O3V type=write size=1919931 2024-09-14T11:22:24.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.853+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~EKVZJV2LRHT0.0 size=1048576 2024-09-14T11:22:24.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.854+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~EKVZJV2LRHT0.1 size=1048576 2024-09-14T11:22:24.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.855+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~EKVZJV2LRHT0.2 size=235496 2024-09-14T11:22:24.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.855+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=EKVZJV2LRHT0 tag=T0Z22W8E8E6V type=write size=3381224 2024-09-14T11:22:24.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.856+0000 7f43cc561780 -1 < failed to complete operation key=BNNSFLYOU27F tag=NB67UHYZTA3V type=del size=219361: (22) Invalid argument 2024-09-14T11:22:24.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.859+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~NWOK7M0XCMW3.0 size=881939 2024-09-14T11:22:24.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.859+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=NWOK7M0XCMW3 tag=J8D5Q0974LP2 type=write size=1930515 2024-09-14T11:22:24.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.860+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~F1SSSJY44S1L.0 size=1048576 2024-09-14T11:22:24.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.861+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~F1SSSJY44S1L.1 size=547571 2024-09-14T11:22:24.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.863+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=F1SSSJY44S1L tag=0FNZRZJ7D3H0 type=write size=2644723 2024-09-14T11:22:24.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.866+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~6JJCGKQWY2EJ.0 size=1048576 2024-09-14T11:22:24.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.867+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~6JJCGKQWY2EJ.1 size=703875 2024-09-14T11:22:24.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.867+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=6JJCGKQWY2EJ tag=0PDBGHBM6RDW type=write size=2801027 2024-09-14T11:22:24.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.868+0000 7f43cc561780 1 < canceled operation key=LKY30XYUG2QW tag=3PNU7FEZLDPW type=del size=2601475 2024-09-14T11:22:24.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.869+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=WR4HC0449OVY type=write size=847982 2024-09-14T11:22:24.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.871+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=DUM0NRY93EU5 type=del 2024-09-14T11:22:24.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.872+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=HLR1RLWLM00E type=del size=480377 2024-09-14T11:22:24.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.875+0000 7f43cc561780 1 < suggested update operation key=WHIZ2GREK1FE tag=ZKHFCW12BPRI type=del size=993281 2024-09-14T11:22:24.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.876+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=M02WZMQ4ZIJU type=write size=747123 2024-09-14T11:22:24.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.877+0000 7f43cc561780 1 < completed write operation key=MD14RGOQY0LK tag=G4FH21D2BIV7 type=write size=962963 2024-09-14T11:22:24.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.879+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=V3SCCG6ZZZCP type=del size=2699594 2024-09-14T11:22:24.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.880+0000 7f43cc561780 1 < completed write operation key=OV4ATW747PY4 tag=IWLAMIXXZS6N type=write size=856644 2024-09-14T11:22:24.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.881+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=0MARQ23UD6EI type=del size=2302061 2024-09-14T11:22:24.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.883+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~VZKDUVY12M1I.0 size=305258 2024-09-14T11:22:24.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.884+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=VZKDUVY12M1I tag=V5WJW9BZHBLS type=write size=1353834 2024-09-14T11:22:24.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.886+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=4N6D6K1SWVV3 type=del size=3975859 2024-09-14T11:22:24.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.887+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=ZAYJEZJJ1AOU type=del 2024-09-14T11:22:24.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.889+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~YNMQ1071YFUQ.0 size=1048576 2024-09-14T11:22:24.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.890+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~YNMQ1071YFUQ.1 size=777421 2024-09-14T11:22:24.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.890+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=YNMQ1071YFUQ tag=AD9FR5W5RJHW type=write size=2874573 2024-09-14T11:22:24.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.892+0000 7f43cc561780 1 < suggested remove operation key=UWES4CQZ8XW6 tag=9KB7IVM6MERL type=del 2024-09-14T11:22:24.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.893+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=52BQ9131RMOC type=del size=3763633 2024-09-14T11:22:24.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.895+0000 7f43cc561780 1 < completed write operation key=OV4ATW747PY4 tag=7C8M60U7UBPW type=write size=959544 2024-09-14T11:22:24.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.897+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~IV75BA6GKHKC.0 size=1048576 2024-09-14T11:22:24.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.898+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~IV75BA6GKHKC.1 size=862498 2024-09-14T11:22:24.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.898+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=IV75BA6GKHKC tag=3NBHKB76KU0W type=write size=2959650 2024-09-14T11:22:24.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.899+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=L12NAW5KBR64 type=del 2024-09-14T11:22:24.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.901+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~D6ZTUY9B4URF.0 size=608372 2024-09-14T11:22:24.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.901+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=D6ZTUY9B4URF tag=V114X41S7Q4K type=write size=1656948 2024-09-14T11:22:24.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.902+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~2J3UD3LSDFDT.0 size=1048576 2024-09-14T11:22:24.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.903+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~2J3UD3LSDFDT.1 size=581170 2024-09-14T11:22:24.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.905+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=2J3UD3LSDFDT tag=J5PATUT0YFAG type=write size=2678322 2024-09-14T11:22:24.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.906+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=OVAAA2ZF4PNN type=del size=3853215 2024-09-14T11:22:24.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.907+0000 7f43cc561780 1 < canceled part key=_multipart_BZDW69C3Z97G.2~CVHBACY19QFA.0 size=1048576 2024-09-14T11:22:24.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.908+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~CVHBACY19QFA.1 size=143579 2024-09-14T11:22:24.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.909+0000 7f43cc561780 1 < canceled multipart upload key=BZDW69C3Z97G upload=CVHBACY19QFA tag=U4HUPNRNH98L type=write size=2240731 2024-09-14T11:22:24.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.911+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=I7CUG0OC31KA type=del size=4173510 2024-09-14T11:22:24.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.911+0000 7f43cc561780 1 < canceled part key=_multipart_1M46U4U9MG1E.2~O9PLMOXIIR3U.0 size=1048576 2024-09-14T11:22:24.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.912+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~O9PLMOXIIR3U.1 size=152925 2024-09-14T11:22:24.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.914+0000 7f43cc561780 1 < canceled multipart upload key=1M46U4U9MG1E upload=O9PLMOXIIR3U tag=JIV0MK6KAAY0 type=write size=2250077 2024-09-14T11:22:24.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.915+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=608XCVCX2121 type=del size=1648224 2024-09-14T11:22:24.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.917+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~EKVZJV2LRHT0.0 size=1048576 2024-09-14T11:22:24.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.918+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~EKVZJV2LRHT0.1 size=1048576 2024-09-14T11:22:24.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.918+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~EKVZJV2LRHT0.2 size=235496 2024-09-14T11:22:24.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.920+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=EKVZJV2LRHT0 tag=T0Z22W8E8E6V type=write size=3381224 2024-09-14T11:22:24.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.922+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=U0HXXM42LJX8 type=del size=2409826 2024-09-14T11:22:24.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.923+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~NWOK7M0XCMW3.0 size=881939 2024-09-14T11:22:24.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.925+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=NWOK7M0XCMW3 tag=J8D5Q0974LP2 type=write size=1930515 2024-09-14T11:22:24.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.926+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=L3DI6KW25XDX type=write size=813644 2024-09-14T11:22:24.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.927+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~6JJCGKQWY2EJ.0 size=1048576 2024-09-14T11:22:24.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.927+0000 7f43cc561780 1 < canceled part key=_multipart_D8EBH4NWN7SK.2~6JJCGKQWY2EJ.1 size=703875 2024-09-14T11:22:24.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.929+0000 7f43cc561780 1 < canceled multipart upload key=D8EBH4NWN7SK upload=6JJCGKQWY2EJ tag=0PDBGHBM6RDW type=write size=2801027 2024-09-14T11:22:24.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.931+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~MSJDY2ABZXRE.0 size=280459 2024-09-14T11:22:24.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.931+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=MSJDY2ABZXRE tag=ZV2XEB04JJ1R type=write size=1329035 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.933+0000 7f43cc561780 1 < suggested update operation key=0TDWJO4AWOOF tag=WR4HC0449OVY type=write size=847982 2024-09-14T11:22:24.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.935+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=AB9UBA07LP3T type=del size=3178246 2024-09-14T11:22:24.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.936+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=HLR1RLWLM00E type=del 2024-09-14T11:22:24.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.938+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~68Q4OIJEHO4S.0 size=863854 2024-09-14T11:22:24.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.938+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=68Q4OIJEHO4S tag=2BOQ3AT2TV41 type=write size=1912430 2024-09-14T11:22:24.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.939+0000 7f43cc561780 1 < completed write operation key=15F3ZZAAKT9B tag=M02WZMQ4ZIJU type=write size=747123 2024-09-14T11:22:24.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.941+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~OR5FT785YVGL.0 size=369766 2024-09-14T11:22:24.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.941+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=OR5FT785YVGL tag=X7YJSVI7OFSH type=write size=1418342 2024-09-14T11:22:24.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.943+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=V3SCCG6ZZZCP type=del 2024-09-14T11:22:24.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.944+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=PQK23WTRSL1G type=write size=389275 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.945+0000 7f43cc561780 -1 < failed to complete operation key=UWES4CQZ8XW6 tag=0MARQ23UD6EI type=del size=2302061: (22) Invalid argument 2024-09-14T11:22:24.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.946+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=C6KYA2KWAZ4X type=del size=692483 2024-09-14T11:22:24.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.948+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=4N6D6K1SWVV3 type=del 2024-09-14T11:22:24.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.949+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=NGRA5YYO91F1 type=del size=2878267 2024-09-14T11:22:24.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.950+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~YNMQ1071YFUQ.0 size=1048576 2024-09-14T11:22:24.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.951+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~YNMQ1071YFUQ.1 size=777421 2024-09-14T11:22:24.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.953+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=YNMQ1071YFUQ tag=AD9FR5W5RJHW type=write size=2874573 2024-09-14T11:22:24.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.955+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=5D0A5V2DD5C1 type=del size=2781288 2024-09-14T11:22:24.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.957+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=52BQ9131RMOC type=del size=3763633 2024-09-14T11:22:24.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.958+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=BS6PRUKBHRWX type=del size=2589541 2024-09-14T11:22:24.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.960+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~IV75BA6GKHKC.0 size=1048576 2024-09-14T11:22:24.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.961+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~IV75BA6GKHKC.1 size=862498 2024-09-14T11:22:24.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.963+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=IV75BA6GKHKC tag=3NBHKB76KU0W type=write size=2959650 2024-09-14T11:22:24.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.964+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=4AH8MQN9PSWF type=write size=399183 2024-09-14T11:22:24.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.965+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~D6ZTUY9B4URF.0 size=608372 2024-09-14T11:22:24.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.967+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=D6ZTUY9B4URF tag=V114X41S7Q4K type=write size=1656948 2024-09-14T11:22:24.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.969+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~NTI76H4T8N9A.0 size=1048576 2024-09-14T11:22:24.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.970+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~NTI76H4T8N9A.1 size=970481 2024-09-14T11:22:24.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.970+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=NTI76H4T8N9A tag=P9EECO34J4HU type=write size=3067633 2024-09-14T11:22:24.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.971+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=OVAAA2ZF4PNN type=del 2024-09-14T11:22:24.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.973+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~JFDDLU9ENQEO.0 size=1048576 2024-09-14T11:22:24.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.974+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~JFDDLU9ENQEO.1 size=1048576 2024-09-14T11:22:24.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.975+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~JFDDLU9ENQEO.2 size=998500 2024-09-14T11:22:24.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.975+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=JFDDLU9ENQEO tag=SAI4VY1GM2OT type=write size=4144228 2024-09-14T11:22:24.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.977+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=I7CUG0OC31KA type=del 2024-09-14T11:22:24.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.978+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=8C2W1H1BVXTP type=del size=3096843 2024-09-14T11:22:24.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.981+0000 7f43cc561780 1 < suggested update operation key=CXP2PUIXR2PA tag=608XCVCX2121 type=del size=1648224 2024-09-14T11:22:24.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.982+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=4SDU4WXIITQF type=del size=2181760 2024-09-14T11:22:24.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.983+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=U0HXXM42LJX8 type=del 2024-09-14T11:22:24.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.984+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=OKSUOH4B7KV6 type=write size=353350 2024-09-14T11:22:24.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.987+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=L3DI6KW25XDX type=write size=813644 2024-09-14T11:22:24.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.988+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=U3OFSNU3OUVW type=del size=1638425 2024-09-14T11:22:24.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.989+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~MSJDY2ABZXRE.0 size=280459 2024-09-14T11:22:24.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.991+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=MSJDY2ABZXRE tag=ZV2XEB04JJ1R type=write size=1329035 2024-09-14T11:22:24.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.993+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~Y67KUEQI0NF0.0 size=1048576 2024-09-14T11:22:24.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.994+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~Y67KUEQI0NF0.1 size=1048576 2024-09-14T11:22:24.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.995+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~Y67KUEQI0NF0.2 size=826599 2024-09-14T11:22:24.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.995+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=Y67KUEQI0NF0 tag=54CLKQPQN6H1 type=write size=3972327 2024-09-14T11:22:24.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.997+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=AB9UBA07LP3T type=del 2024-09-14T11:22:24.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.998+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=QGLAK33710OQ type=write size=32285 2024-09-14T11:22:24.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:24.999+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~68Q4OIJEHO4S.0 size=863854 2024-09-14T11:22:25.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.001+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=68Q4OIJEHO4S tag=2BOQ3AT2TV41 type=write size=1912430 2024-09-14T11:22:25.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.002+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=W89ZFKL1DQIA type=del size=3861349 2024-09-14T11:22:25.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.004+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~OR5FT785YVGL.0 size=369766 2024-09-14T11:22:25.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.005+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=OR5FT785YVGL tag=X7YJSVI7OFSH type=write size=1418342 2024-09-14T11:22:25.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.008+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~1M0WDZ4L287R.0 size=1048576 2024-09-14T11:22:25.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.009+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~1M0WDZ4L287R.1 size=1048576 2024-09-14T11:22:25.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.010+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~1M0WDZ4L287R.2 size=352281 2024-09-14T11:22:25.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.010+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=1M0WDZ4L287R tag=UW2Y0IWQDXCD type=write size=3498009 2024-09-14T11:22:25.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.011+0000 7f43cc561780 1 < completed write operation key=D8EBH4NWN7SK tag=PQK23WTRSL1G type=write size=389275 2024-09-14T11:22:25.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.013+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~XK0NL1AN9W26.0 size=1048576 2024-09-14T11:22:25.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.014+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~XK0NL1AN9W26.1 size=112077 2024-09-14T11:22:25.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.014+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=XK0NL1AN9W26 tag=VNEPR19QZ33L type=write size=2209229 2024-09-14T11:22:25.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.016+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=C6KYA2KWAZ4X type=del 2024-09-14T11:22:25.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.017+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=93R43NEBWWLA type=del size=3847784 2024-09-14T11:22:25.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.018+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=NGRA5YYO91F1 type=del 2024-09-14T11:22:25.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.019+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=0HFRC32G73YO type=del size=2646492 2024-09-14T11:22:25.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.020+0000 7f43cc561780 1 < canceled operation key=MD14RGOQY0LK tag=5D0A5V2DD5C1 type=del size=2781288 2024-09-14T11:22:25.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.022+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=S168IVX7OGZM type=write size=153385 2024-09-14T11:22:25.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.023+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=BS6PRUKBHRWX type=del 2024-09-14T11:22:25.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.025+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~F0K4YBINA70T.0 size=656733 2024-09-14T11:22:25.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.025+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=F0K4YBINA70T tag=JYS1WN43170I type=write size=1705309 2024-09-14T11:22:25.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.026+0000 7f43cc561780 1 < completed write operation key=A1B2LIZIPET3 tag=4AH8MQN9PSWF type=write size=399183 2024-09-14T11:22:25.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.027+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=WV91FJ32FEW2 type=del size=1718297 2024-09-14T11:22:25.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.029+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~NTI76H4T8N9A.0 size=1048576 2024-09-14T11:22:25.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.030+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~NTI76H4T8N9A.1 size=970481 2024-09-14T11:22:25.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.032+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=NTI76H4T8N9A tag=P9EECO34J4HU type=write size=3067633 2024-09-14T11:22:25.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.033+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=4EDAQBN8CIT3 type=del size=867633 2024-09-14T11:22:25.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.034+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~JFDDLU9ENQEO.0 size=1048576 2024-09-14T11:22:25.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.035+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~JFDDLU9ENQEO.1 size=1048576 2024-09-14T11:22:25.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.036+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~JFDDLU9ENQEO.2 size=998500 2024-09-14T11:22:25.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.038+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=JFDDLU9ENQEO tag=SAI4VY1GM2OT type=write size=4144228 2024-09-14T11:22:25.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.041+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~XI3EXHZBDEV1.0 size=1048576 2024-09-14T11:22:25.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.042+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~XI3EXHZBDEV1.1 size=248943 2024-09-14T11:22:25.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.042+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=XI3EXHZBDEV1 tag=0GJ76GKI0FEZ type=write size=2346095 2024-09-14T11:22:25.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.043+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=8C2W1H1BVXTP type=del 2024-09-14T11:22:25.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.045+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~W7BKJQ9O0FJG.0 size=980028 2024-09-14T11:22:25.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.045+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=W7BKJQ9O0FJG tag=274U1GY3XA7V type=write size=2028604 2024-09-14T11:22:25.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.046+0000 7f43cc561780 -1 < failed to complete operation key=D84127SVSIPL tag=4SDU4WXIITQF type=del size=2181760: (22) Invalid argument 2024-09-14T11:22:25.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.048+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=U0GCAMYOB1BV type=del size=2580389 2024-09-14T11:22:25.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.049+0000 7f43cc561780 1 < completed write operation key=AY7JGVM96MO7 tag=OKSUOH4B7KV6 type=write size=353350 2024-09-14T11:22:25.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.050+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=WVJX9JRK6GS4 type=del size=3727864 2024-09-14T11:22:25.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.051+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=U3OFSNU3OUVW type=del 2024-09-14T11:22:25.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.053+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=H30BUMCN329G type=del size=3001198 2024-09-14T11:22:25.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.054+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~Y67KUEQI0NF0.0 size=1048576 2024-09-14T11:22:25.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.055+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~Y67KUEQI0NF0.1 size=1048576 2024-09-14T11:22:25.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.056+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~Y67KUEQI0NF0.2 size=826599 2024-09-14T11:22:25.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.058+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=Y67KUEQI0NF0 tag=54CLKQPQN6H1 type=write size=3972327 2024-09-14T11:22:25.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.059+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=PHTMNBVE5Z71 type=write size=322456 2024-09-14T11:22:25.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.060+0000 7f43cc561780 1 < completed write operation key=BZDW69C3Z97G tag=QGLAK33710OQ type=write size=32285 2024-09-14T11:22:25.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.062+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=AUET135Z66C5 type=del size=2964339 2024-09-14T11:22:25.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.064+0000 7f43cc561780 1 < suggested remove operation key=AY7JGVM96MO7 tag=W89ZFKL1DQIA type=del 2024-09-14T11:22:25.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.065+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=2LWKB38TMCQI type=del size=2007860 2024-09-14T11:22:25.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.067+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~1M0WDZ4L287R.0 size=1048576 2024-09-14T11:22:25.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.068+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~1M0WDZ4L287R.1 size=1048576 2024-09-14T11:22:25.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.069+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~1M0WDZ4L287R.2 size=352281 2024-09-14T11:22:25.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.071+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=1M0WDZ4L287R tag=UW2Y0IWQDXCD type=write size=3498009 2024-09-14T11:22:25.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.073+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~RK7J2E2OXIHY.0 size=1048576 2024-09-14T11:22:25.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.074+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~RK7J2E2OXIHY.1 size=1048576 2024-09-14T11:22:25.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.075+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~RK7J2E2OXIHY.2 size=997139 2024-09-14T11:22:25.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.075+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=RK7J2E2OXIHY tag=08SABYBPWPCJ type=write size=4142867 2024-09-14T11:22:25.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.076+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~XK0NL1AN9W26.0 size=1048576 2024-09-14T11:22:25.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.077+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~XK0NL1AN9W26.1 size=112077 2024-09-14T11:22:25.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.079+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=XK0NL1AN9W26 tag=VNEPR19QZ33L type=write size=2209229 2024-09-14T11:22:25.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.080+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=A35GYQ102ZKA type=del size=3129785 2024-09-14T11:22:25.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.081+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=93R43NEBWWLA type=del 2024-09-14T11:22:25.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.083+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=0EKRO8ZE2XGF type=del size=1055320 2024-09-14T11:22:25.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.084+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=0HFRC32G73YO type=del 2024-09-14T11:22:25.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.085+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=ZBB1MZDBO4HE type=del size=2076705 2024-09-14T11:22:25.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.086+0000 7f43cc561780 1 < completed write operation key=IFHWMI5YO5L5 tag=S168IVX7OGZM type=write size=153385 2024-09-14T11:22:25.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.087+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=EG560ZK9RK45 type=del size=4165567 2024-09-14T11:22:25.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.089+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~F0K4YBINA70T.0 size=656733 2024-09-14T11:22:25.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.091+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=F0K4YBINA70T tag=JYS1WN43170I type=write size=1705309 2024-09-14T11:22:25.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.094+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~HDZTYRH3B241.0 size=851802 2024-09-14T11:22:25.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.094+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=HDZTYRH3B241 tag=6OC6YUAL7KLR type=write size=1900378 2024-09-14T11:22:25.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.097+0000 7f43cc561780 1 < suggested update operation key=WSFZN6JCWUXG tag=WV91FJ32FEW2 type=del size=1718297 2024-09-14T11:22:25.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.098+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=XPLUTIYLRVX0 type=del size=485640 2024-09-14T11:22:25.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.101+0000 7f43cc561780 1 < suggested remove operation key=2975CNBC43ST tag=4EDAQBN8CIT3 type=del 2024-09-14T11:22:25.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.103+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~T4FQ6DXBCC3F.0 size=1048576 2024-09-14T11:22:25.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.104+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~T4FQ6DXBCC3F.1 size=1048576 2024-09-14T11:22:25.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.105+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~T4FQ6DXBCC3F.2 size=327369 2024-09-14T11:22:25.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.105+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=T4FQ6DXBCC3F tag=0SZPCN3NUS35 type=write size=3473097 2024-09-14T11:22:25.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.106+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~XI3EXHZBDEV1.0 size=1048576 2024-09-14T11:22:25.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.107+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~XI3EXHZBDEV1.1 size=248943 2024-09-14T11:22:25.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.109+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=XI3EXHZBDEV1 tag=0GJ76GKI0FEZ type=write size=2346095 2024-09-14T11:22:25.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.111+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~69UYK90J1OPR.0 size=1048576 2024-09-14T11:22:25.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.112+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~69UYK90J1OPR.1 size=1048576 2024-09-14T11:22:25.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.113+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~69UYK90J1OPR.2 size=514175 2024-09-14T11:22:25.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.113+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=69UYK90J1OPR tag=O0ZTYFK3FVDR type=write size=3659903 2024-09-14T11:22:25.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.114+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~W7BKJQ9O0FJG.0 size=980028 2024-09-14T11:22:25.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.116+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=W7BKJQ9O0FJG tag=274U1GY3XA7V type=write size=2028604 2024-09-14T11:22:25.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.117+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=WKI083ANR4FJ type=del size=3572162 2024-09-14T11:22:25.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.119+0000 7f43cc561780 1 < canceled operation key=BZDW69C3Z97G tag=U0GCAMYOB1BV type=del size=2580389 2024-09-14T11:22:25.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.121+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~BV0VZM10UJMQ.0 size=1048576 2024-09-14T11:22:25.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.122+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~BV0VZM10UJMQ.1 size=1048576 2024-09-14T11:22:25.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.122+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~BV0VZM10UJMQ.2 size=908548 2024-09-14T11:22:25.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.122+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=BV0VZM10UJMQ tag=ZOKK4Q8FF8H5 type=write size=4054276 2024-09-14T11:22:25.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.125+0000 7f43cc561780 1 < suggested update operation key=D8EBH4NWN7SK tag=WVJX9JRK6GS4 type=del size=3727864 2024-09-14T11:22:25.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.127+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~ZMU253BSJI6Y.0 size=1048576 2024-09-14T11:22:25.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.128+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~ZMU253BSJI6Y.1 size=1048576 2024-09-14T11:22:25.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.129+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~ZMU253BSJI6Y.2 size=611708 2024-09-14T11:22:25.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.129+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=ZMU253BSJI6Y tag=JSEILANPTBZI type=write size=3757436 2024-09-14T11:22:25.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.130+0000 7f43cc561780 1 < canceled operation key=3YHEZHW0RS1W tag=H30BUMCN329G type=del size=3001198 2024-09-14T11:22:25.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.131+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=0ZX9NHWE39ET type=del size=1423101 2024-09-14T11:22:25.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.133+0000 7f43cc561780 -1 < failed to complete operation key=D8EBH4NWN7SK tag=PHTMNBVE5Z71 type=write size=322456: (22) Invalid argument 2024-09-14T11:22:25.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.135+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~2OLOQHZHVWXS.0 size=1048576 2024-09-14T11:22:25.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.135+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~2OLOQHZHVWXS.1 size=383 2024-09-14T11:22:25.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.135+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=2OLOQHZHVWXS tag=WH13RZRN1DR3 type=write size=2097535 2024-09-14T11:22:25.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.137+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=AUET135Z66C5 type=del 2024-09-14T11:22:25.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.139+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~2VLSUW707VRD.0 size=34716 2024-09-14T11:22:25.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.139+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=2VLSUW707VRD tag=J0A6T1UHGBXC type=write size=1083292 2024-09-14T11:22:25.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.140+0000 7f43cc561780 -1 < failed to complete operation key=WSFZN6JCWUXG tag=2LWKB38TMCQI type=del size=2007860: (22) Invalid argument 2024-09-14T11:22:25.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.142+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=X3Z39GW7YPFQ type=del size=1819058 2024-09-14T11:22:25.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.143+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~RK7J2E2OXIHY.0 size=1048576 2024-09-14T11:22:25.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.144+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~RK7J2E2OXIHY.1 size=1048576 2024-09-14T11:22:25.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.145+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~RK7J2E2OXIHY.2 size=997139 2024-09-14T11:22:25.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.147+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=RK7J2E2OXIHY tag=08SABYBPWPCJ type=write size=4142867 2024-09-14T11:22:25.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.150+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~LPFEFA5YZE2V.0 size=1048576 2024-09-14T11:22:25.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.151+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~LPFEFA5YZE2V.1 size=1048576 2024-09-14T11:22:25.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.152+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~LPFEFA5YZE2V.2 size=960732 2024-09-14T11:22:25.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.152+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=LPFEFA5YZE2V tag=U25SK43M4Q92 type=write size=4106460 2024-09-14T11:22:25.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.153+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=A35GYQ102ZKA type=del 2024-09-14T11:22:25.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.155+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=K2IBS82C7GFX type=del size=1974171 2024-09-14T11:22:25.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.157+0000 7f43cc561780 1 < suggested remove operation key=END3SHHS0FSA tag=0EKRO8ZE2XGF type=del 2024-09-14T11:22:25.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.159+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~NOZ2S0FXTIMY.0 size=1048576 2024-09-14T11:22:25.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.161+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~NOZ2S0FXTIMY.1 size=1048576 2024-09-14T11:22:25.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.162+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~NOZ2S0FXTIMY.2 size=512263 2024-09-14T11:22:25.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.162+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=NOZ2S0FXTIMY tag=Q3XP9WMYHMEP type=write size=3657991 2024-09-14T11:22:25.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.163+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=ZBB1MZDBO4HE type=del 2024-09-14T11:22:25.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.164+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=EGZWL8J4ISCO type=del size=3921028 2024-09-14T11:22:25.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.167+0000 7f43cc561780 1 < suggested remove operation key=WSFZN6JCWUXG tag=EG560ZK9RK45 type=del 2024-09-14T11:22:25.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.168+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=JYCGAP242M9M type=del size=3284862 2024-09-14T11:22:25.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.168+0000 7f43cc561780 1 < canceled part key=_multipart_683ZFW0BWMT7.2~HDZTYRH3B241.0 size=851802 2024-09-14T11:22:25.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.170+0000 7f43cc561780 1 < canceled multipart upload key=683ZFW0BWMT7 upload=HDZTYRH3B241 tag=6OC6YUAL7KLR type=write size=1900378 2024-09-14T11:22:25.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.172+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=FUTV0PU2OZ6A type=del size=2802813 2024-09-14T11:22:25.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.174+0000 7f43cc561780 1 < suggested remove operation key=D8EBH4NWN7SK tag=XPLUTIYLRVX0 type=del 2024-09-14T11:22:25.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.176+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=3498S82HO1OA type=del size=616818 2024-09-14T11:22:25.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.177+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~T4FQ6DXBCC3F.0 size=1048576 2024-09-14T11:22:25.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.177+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~T4FQ6DXBCC3F.1 size=1048576 2024-09-14T11:22:25.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.177+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~T4FQ6DXBCC3F.2 size=327369 2024-09-14T11:22:25.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.179+0000 7f43cc561780 1 < canceled multipart upload key=A1B2LIZIPET3 upload=T4FQ6DXBCC3F tag=0SZPCN3NUS35 type=write size=3473097 2024-09-14T11:22:25.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.180+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=UGJ5FVIF8X74 type=del size=957681 2024-09-14T11:22:25.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.181+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~69UYK90J1OPR.0 size=1048576 2024-09-14T11:22:25.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.182+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~69UYK90J1OPR.1 size=1048576 2024-09-14T11:22:25.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.182+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~69UYK90J1OPR.2 size=514175 2024-09-14T11:22:25.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.184+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=69UYK90J1OPR tag=O0ZTYFK3FVDR type=write size=3659903 2024-09-14T11:22:25.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.186+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=9BF2XOOYSMY2 type=write size=662378 2024-09-14T11:22:25.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.187+0000 7f43cc561780 -1 < failed to complete operation key=END3SHHS0FSA tag=WKI083ANR4FJ type=del size=3572162: (22) Invalid argument 2024-09-14T11:22:25.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.188+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=1RRPF8AAZT1W type=write size=172767 2024-09-14T11:22:25.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.190+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~BV0VZM10UJMQ.0 size=1048576 2024-09-14T11:22:25.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.191+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~BV0VZM10UJMQ.1 size=1048576 2024-09-14T11:22:25.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.191+0000 7f43cc561780 1 < canceled part key=_multipart_WSFZN6JCWUXG.2~BV0VZM10UJMQ.2 size=908548 2024-09-14T11:22:25.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.193+0000 7f43cc561780 1 < canceled multipart upload key=WSFZN6JCWUXG upload=BV0VZM10UJMQ tag=ZOKK4Q8FF8H5 type=write size=4054276 2024-09-14T11:22:25.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.194+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=T14HCNW4KCJU type=del size=1624026 2024-09-14T11:22:25.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.196+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~ZMU253BSJI6Y.0 size=1048576 2024-09-14T11:22:25.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.197+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~ZMU253BSJI6Y.1 size=1048576 2024-09-14T11:22:25.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.197+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~ZMU253BSJI6Y.2 size=611708 2024-09-14T11:22:25.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.200+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=ZMU253BSJI6Y tag=JSEILANPTBZI type=write size=3757436 2024-09-14T11:22:25.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.202+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~7D7DRVDZ9CD4.0 size=1048576 2024-09-14T11:22:25.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.203+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~7D7DRVDZ9CD4.1 size=1048576 2024-09-14T11:22:25.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.204+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~7D7DRVDZ9CD4.2 size=533052 2024-09-14T11:22:25.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.204+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=7D7DRVDZ9CD4 tag=1LTXIWM736XB type=write size=3678780 2024-09-14T11:22:25.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.205+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=0ZX9NHWE39ET type=del 2024-09-14T11:22:25.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.206+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=8ZVUH3HT6SI5 type=del size=2403671 2024-09-14T11:22:25.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.208+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~2OLOQHZHVWXS.0 size=1048576 2024-09-14T11:22:25.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.208+0000 7f43cc561780 1 < canceled part key=_multipart_3YHEZHW0RS1W.2~2OLOQHZHVWXS.1 size=383 2024-09-14T11:22:25.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.210+0000 7f43cc561780 1 < canceled multipart upload key=3YHEZHW0RS1W upload=2OLOQHZHVWXS tag=WH13RZRN1DR3 type=write size=2097535 2024-09-14T11:22:25.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.211+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=G4E9MBJE32R2 type=del size=1101086 2024-09-14T11:22:25.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.213+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~2VLSUW707VRD.0 size=34716 2024-09-14T11:22:25.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.215+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=2VLSUW707VRD tag=J0A6T1UHGBXC type=write size=1083292 2024-09-14T11:22:25.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.217+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~4MK2T133SB6Z.0 size=524333 2024-09-14T11:22:25.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.217+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=4MK2T133SB6Z tag=CMJGYBCWM0XL type=write size=1572909 2024-09-14T11:22:25.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.218+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=X3Z39GW7YPFQ type=del 2024-09-14T11:22:25.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.219+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=K0QQQ0CY9USG type=write size=119219 2024-09-14T11:22:25.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.220+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~LPFEFA5YZE2V.0 size=1048576 2024-09-14T11:22:25.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.221+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~LPFEFA5YZE2V.1 size=1048576 2024-09-14T11:22:25.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.222+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~LPFEFA5YZE2V.2 size=960732 2024-09-14T11:22:25.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.224+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=LPFEFA5YZE2V tag=U25SK43M4Q92 type=write size=4106460 2024-09-14T11:22:25.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.226+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=TMQ9FKFJC9MX type=write size=207497 2024-09-14T11:22:25.226 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.227+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=K2IBS82C7GFX type=del 2024-09-14T11:22:25.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.228+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=1JA0VP3R36XN type=del size=1868278 2024-09-14T11:22:25.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.229+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~NOZ2S0FXTIMY.0 size=1048576 2024-09-14T11:22:25.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.230+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~NOZ2S0FXTIMY.1 size=1048576 2024-09-14T11:22:25.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.231+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~NOZ2S0FXTIMY.2 size=512263 2024-09-14T11:22:25.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.233+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=NOZ2S0FXTIMY tag=Q3XP9WMYHMEP type=write size=3657991 2024-09-14T11:22:25.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.234+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=33VC5INA6BOK type=del size=3074578 2024-09-14T11:22:25.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.236+0000 7f43cc561780 -1 < failed to complete operation key=D8EBH4NWN7SK tag=EGZWL8J4ISCO type=del size=3921028: (22) Invalid argument 2024-09-14T11:22:25.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.237+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=AX0392A9CB70 type=del size=3745684 2024-09-14T11:22:25.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.238+0000 7f43cc561780 1 < canceled operation key=683ZFW0BWMT7 tag=JYCGAP242M9M type=del size=3284862 2024-09-14T11:22:25.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.239+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=6X80QYG4YQV1 type=del size=2919582 2024-09-14T11:22:25.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.242+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=FUTV0PU2OZ6A type=del 2024-09-14T11:22:25.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.244+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~WHG4BEXPH2FB.0 size=1048576 2024-09-14T11:22:25.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.245+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~WHG4BEXPH2FB.1 size=4804 2024-09-14T11:22:25.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.245+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=WHG4BEXPH2FB tag=7T8QV6JWVXOF type=write size=2101956 2024-09-14T11:22:25.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.248+0000 7f43cc561780 1 < suggested remove operation key=S3NOACTF4K2W tag=3498S82HO1OA type=del 2024-09-14T11:22:25.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.251+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~9OHW9ZTQ5ZYS.0 size=1048576 2024-09-14T11:22:25.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.252+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~9OHW9ZTQ5ZYS.1 size=1048576 2024-09-14T11:22:25.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.253+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~9OHW9ZTQ5ZYS.2 size=289216 2024-09-14T11:22:25.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.253+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=9OHW9ZTQ5ZYS tag=7LG0L9RBR61U type=write size=3434944 2024-09-14T11:22:25.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.255+0000 7f43cc561780 1 < suggested remove operation key=15F3ZZAAKT9B tag=UGJ5FVIF8X74 type=del 2024-09-14T11:22:25.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.257+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=ZEOVNUYNU7Y3 type=del size=207022 2024-09-14T11:22:25.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.258+0000 7f43cc561780 1 < completed write operation key=683ZFW0BWMT7 tag=9BF2XOOYSMY2 type=write size=662378 2024-09-14T11:22:25.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.259+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=ALZM70CQTR45 type=del size=493520 2024-09-14T11:22:25.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.260+0000 7f43cc561780 -1 < failed to complete operation key=15F3ZZAAKT9B tag=1RRPF8AAZT1W type=write size=172767: (22) Invalid argument 2024-09-14T11:22:25.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.262+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=LT57LZ3CXB6K type=del size=3846528 2024-09-14T11:22:25.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.263+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=T14HCNW4KCJU type=del 2024-09-14T11:22:25.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.265+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=AJC7Q2SMM302 type=del size=3177027 2024-09-14T11:22:25.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.266+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~7D7DRVDZ9CD4.0 size=1048576 2024-09-14T11:22:25.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.267+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~7D7DRVDZ9CD4.1 size=1048576 2024-09-14T11:22:25.267 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.268+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~7D7DRVDZ9CD4.2 size=533052 2024-09-14T11:22:25.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.271+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=7D7DRVDZ9CD4 tag=1LTXIWM736XB type=write size=3678780 2024-09-14T11:22:25.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.273+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~TXO0N5SGW4OV.0 size=1048576 2024-09-14T11:22:25.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.274+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~TXO0N5SGW4OV.1 size=1048576 2024-09-14T11:22:25.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.275+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~TXO0N5SGW4OV.2 size=112328 2024-09-14T11:22:25.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.275+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=TXO0N5SGW4OV tag=Y3OISRQ1ZEC4 type=write size=3258056 2024-09-14T11:22:25.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.276+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=8ZVUH3HT6SI5 type=del 2024-09-14T11:22:25.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.277+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=4Y62W73D5AEK type=del size=3957489 2024-09-14T11:22:25.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.279+0000 7f43cc561780 1 < canceled operation key=OV4ATW747PY4 tag=G4E9MBJE32R2 type=del size=1101086 2024-09-14T11:22:25.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.280+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=Z3FIY062DXZH type=del size=883810 2024-09-14T11:22:25.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.281+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~4MK2T133SB6Z.0 size=524333 2024-09-14T11:22:25.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.283+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=4MK2T133SB6Z tag=CMJGYBCWM0XL type=write size=1572909 2024-09-14T11:22:25.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.284+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=ZZ58XGGX8ON0 type=del size=856832 2024-09-14T11:22:25.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.285+0000 7f43cc561780 1 < completed write operation key=AY7JGVM96MO7 tag=K0QQQ0CY9USG type=write size=119219 2024-09-14T11:22:25.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.287+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=5B80F88MS38H type=del size=4066282 2024-09-14T11:22:25.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.289+0000 7f43cc561780 1 < suggested update operation key=BRHP3DQEO3HZ tag=TMQ9FKFJC9MX type=write size=207497 2024-09-14T11:22:25.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.290+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=EBDKGJ93WKKT type=del size=487391 2024-09-14T11:22:25.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.293+0000 7f43cc561780 1 < suggested remove operation key=MD14RGOQY0LK tag=1JA0VP3R36XN type=del 2024-09-14T11:22:25.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.294+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=EQXOZIJXUJXX type=write size=389982 2024-09-14T11:22:25.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.295+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=33VC5INA6BOK type=del 2024-09-14T11:22:25.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.297+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~JVVWM552G4U5.0 size=1048576 2024-09-14T11:22:25.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.298+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~JVVWM552G4U5.1 size=1048576 2024-09-14T11:22:25.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.299+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~JVVWM552G4U5.2 size=198818 2024-09-14T11:22:25.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.299+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=JVVWM552G4U5 tag=FSN57FLZRVYZ type=write size=3344546 2024-09-14T11:22:25.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.301+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=AX0392A9CB70 type=del 2024-09-14T11:22:25.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.302+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=XFWCTAXUBDNP type=del size=1550441 2024-09-14T11:22:25.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.303+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=6X80QYG4YQV1 type=del 2024-09-14T11:22:25.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.304+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=HDASH1N2VXGA type=del size=1137141 2024-09-14T11:22:25.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.306+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~WHG4BEXPH2FB.0 size=1048576 2024-09-14T11:22:25.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.307+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~WHG4BEXPH2FB.1 size=4804 2024-09-14T11:22:25.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.309+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=WHG4BEXPH2FB tag=7T8QV6JWVXOF type=write size=2101956 2024-09-14T11:22:25.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.311+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~TCQNEF9JNKJF.0 size=1048576 2024-09-14T11:22:25.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.312+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~TCQNEF9JNKJF.1 size=538016 2024-09-14T11:22:25.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.312+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=TCQNEF9JNKJF tag=K19KSQ5DZF29 type=write size=2635168 2024-09-14T11:22:25.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.313+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~9OHW9ZTQ5ZYS.0 size=1048576 2024-09-14T11:22:25.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.314+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~9OHW9ZTQ5ZYS.1 size=1048576 2024-09-14T11:22:25.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.315+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~9OHW9ZTQ5ZYS.2 size=289216 2024-09-14T11:22:25.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.317+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=9OHW9ZTQ5ZYS tag=7LG0L9RBR61U type=write size=3434944 2024-09-14T11:22:25.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.318+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=PSSQ7VYDEYBY type=write size=528240 2024-09-14T11:22:25.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.319+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=ZEOVNUYNU7Y3 type=del 2024-09-14T11:22:25.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.321+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=NSG2Y6ACA7GE type=del size=2901404 2024-09-14T11:22:25.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.322+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=ALZM70CQTR45 type=del 2024-09-14T11:22:25.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.325+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~K7U1DPHV5XEQ.0 size=578559 2024-09-14T11:22:25.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.325+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=K7U1DPHV5XEQ tag=81L08B902SIO type=write size=1627135 2024-09-14T11:22:25.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.326+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=LT57LZ3CXB6K type=del 2024-09-14T11:22:25.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.328+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~2523VOPLIKHV.0 size=160093 2024-09-14T11:22:25.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.328+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=2523VOPLIKHV tag=UNZUDM6STQZ3 type=write size=1208669 2024-09-14T11:22:25.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.329+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=AJC7Q2SMM302 type=del 2024-09-14T11:22:25.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.330+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=9MRR77UI0A8L type=del size=510752 2024-09-14T11:22:25.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.331+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~TXO0N5SGW4OV.0 size=1048576 2024-09-14T11:22:25.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.332+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~TXO0N5SGW4OV.1 size=1048576 2024-09-14T11:22:25.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.333+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~TXO0N5SGW4OV.2 size=112328 2024-09-14T11:22:25.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.335+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=TXO0N5SGW4OV tag=Y3OISRQ1ZEC4 type=write size=3258056 2024-09-14T11:22:25.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.336+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=986UI9F1BQQ1 type=del size=2752490 2024-09-14T11:22:25.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.337+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=4Y62W73D5AEK type=del 2024-09-14T11:22:25.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.339+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=BGSXYPYMATYR type=del size=3367953 2024-09-14T11:22:25.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.340+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=Z3FIY062DXZH type=del 2024-09-14T11:22:25.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.341+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=1DJI9OVP7FGJ type=del size=490901 2024-09-14T11:22:25.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.343+0000 7f43cc561780 1 < suggested remove operation key=W679WIFVPVOH tag=ZZ58XGGX8ON0 type=del 2024-09-14T11:22:25.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.344+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=LIRNBEQ1PWEY type=del size=1928725 2024-09-14T11:22:25.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.345+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=5B80F88MS38H type=del 2024-09-14T11:22:25.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.348+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~KOYVEPGX1G2O.0 size=1048576 2024-09-14T11:22:25.347 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.348+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~KOYVEPGX1G2O.1 size=806382 2024-09-14T11:22:25.347 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.348+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=KOYVEPGX1G2O tag=8FGV2HZBOVT0 type=write size=2903534 2024-09-14T11:22:25.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.350+0000 7f43cc561780 1 < canceled operation key=683ZFW0BWMT7 tag=EBDKGJ93WKKT type=del size=487391 2024-09-14T11:22:25.350 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.351+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=I11UNK90IH80 type=del size=166582 2024-09-14T11:22:25.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.353+0000 7f43cc561780 1 < suggested remove operation key=END3SHHS0FSA tag=EQXOZIJXUJXX type=write 2024-09-14T11:22:25.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.354+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=KYDO2H9ON7CZ type=del size=1548190 2024-09-14T11:22:25.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.356+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~JVVWM552G4U5.0 size=1048576 2024-09-14T11:22:25.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.356+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~JVVWM552G4U5.1 size=1048576 2024-09-14T11:22:25.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.357+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~JVVWM552G4U5.2 size=198818 2024-09-14T11:22:25.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.359+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=JVVWM552G4U5 tag=FSN57FLZRVYZ type=write size=3344546 2024-09-14T11:22:25.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.362+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~5YAR0DTK1B7J.0 size=20725 2024-09-14T11:22:25.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.362+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=5YAR0DTK1B7J tag=TOMMLKSCHY6G type=write size=1069301 2024-09-14T11:22:25.362 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.363+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=XFWCTAXUBDNP type=del 2024-09-14T11:22:25.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.365+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~M8WM1SYG13GG.0 size=1048576 2024-09-14T11:22:25.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.366+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~M8WM1SYG13GG.1 size=901019 2024-09-14T11:22:25.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.366+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=M8WM1SYG13GG tag=OA8KTQT564R7 type=write size=2998171 2024-09-14T11:22:25.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.367+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=HDASH1N2VXGA type=del 2024-09-14T11:22:25.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.369+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=HBCVL4NOC928 type=del size=1059819 2024-09-14T11:22:25.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.370+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~TCQNEF9JNKJF.0 size=1048576 2024-09-14T11:22:25.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.371+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~TCQNEF9JNKJF.1 size=538016 2024-09-14T11:22:25.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.373+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=TCQNEF9JNKJF tag=K19KSQ5DZF29 type=write size=2635168 2024-09-14T11:22:25.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.374+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=RQ8QB04PZA9W type=del size=648058 2024-09-14T11:22:25.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.375+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=PSSQ7VYDEYBY type=write size=528240 2024-09-14T11:22:25.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.378+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~8DKBB21QPM6P.0 size=1048576 2024-09-14T11:22:25.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.379+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~8DKBB21QPM6P.1 size=1048576 2024-09-14T11:22:25.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.380+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~8DKBB21QPM6P.2 size=556260 2024-09-14T11:22:25.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.380+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=8DKBB21QPM6P tag=QIGYLCH32QAP type=write size=3701988 2024-09-14T11:22:25.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.382+0000 7f43cc561780 1 < suggested remove operation key=G6B4CGUBFSOT tag=NSG2Y6ACA7GE type=del 2024-09-14T11:22:25.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.384+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=V0QXSTA8V0ZM type=del size=118756 2024-09-14T11:22:25.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.385+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~K7U1DPHV5XEQ.0 size=578559 2024-09-14T11:22:25.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.387+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=K7U1DPHV5XEQ tag=81L08B902SIO type=write size=1627135 2024-09-14T11:22:25.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.389+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=ZBK14W7AT0R2 type=write size=899415 2024-09-14T11:22:25.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.389+0000 7f43cc561780 1 < canceled part key=_multipart_683ZFW0BWMT7.2~2523VOPLIKHV.0 size=160093 2024-09-14T11:22:25.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.391+0000 7f43cc561780 1 < canceled multipart upload key=683ZFW0BWMT7 upload=2523VOPLIKHV tag=UNZUDM6STQZ3 type=write size=1208669 2024-09-14T11:22:25.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.392+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=4DEMKVH7HIZT type=del size=2384208 2024-09-14T11:22:25.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.394+0000 7f43cc561780 1 < suggested update operation key=IG4QM506P41B tag=9MRR77UI0A8L type=del size=510752 2024-09-14T11:22:25.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.396+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=VJ7I677V3ZF5 type=del size=2311211 2024-09-14T11:22:25.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.398+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=986UI9F1BQQ1 type=del size=2752490 2024-09-14T11:22:25.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.399+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=PVWMCPRGEHEM type=write size=283735 2024-09-14T11:22:25.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.401+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=BGSXYPYMATYR type=del 2024-09-14T11:22:25.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.402+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=ON53U1RTJM8O type=del size=179047 2024-09-14T11:22:25.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.403+0000 7f43cc561780 1 < canceled operation key=683ZFW0BWMT7 tag=1DJI9OVP7FGJ type=del size=490901 2024-09-14T11:22:25.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.404+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=3QRSP6WUS5BU type=write size=192258 2024-09-14T11:22:25.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.406+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=LIRNBEQ1PWEY type=del 2024-09-14T11:22:25.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.407+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=CWZLECN43VGW type=del size=4148109 2024-09-14T11:22:25.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.408+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~KOYVEPGX1G2O.0 size=1048576 2024-09-14T11:22:25.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.408+0000 7f43cc561780 1 < canceled part key=_multipart_OV4ATW747PY4.2~KOYVEPGX1G2O.1 size=806382 2024-09-14T11:22:25.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.410+0000 7f43cc561780 1 < canceled multipart upload key=OV4ATW747PY4 upload=KOYVEPGX1G2O tag=8FGV2HZBOVT0 type=write size=2903534 2024-09-14T11:22:25.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.412+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=18F6Q8PNX9XB type=del size=740339 2024-09-14T11:22:25.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.413+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=I11UNK90IH80 type=del 2024-09-14T11:22:25.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.415+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~UZO070BV32JE.0 size=834954 2024-09-14T11:22:25.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.415+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=UZO070BV32JE tag=SMVBBTYRMRTI type=write size=1883530 2024-09-14T11:22:25.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.416+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=KYDO2H9ON7CZ type=del 2024-09-14T11:22:25.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.418+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=EK13DT56LJAH type=del size=1170908 2024-09-14T11:22:25.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.419+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~5YAR0DTK1B7J.0 size=20725 2024-09-14T11:22:25.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.421+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=5YAR0DTK1B7J tag=TOMMLKSCHY6G type=write size=1069301 2024-09-14T11:22:25.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.422+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=RQ5513MEFXAC type=del size=1306674 2024-09-14T11:22:25.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.423+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~M8WM1SYG13GG.0 size=1048576 2024-09-14T11:22:25.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.423+0000 7f43cc561780 1 < canceled part key=_multipart_S3NOACTF4K2W.2~M8WM1SYG13GG.1 size=901019 2024-09-14T11:22:25.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.425+0000 7f43cc561780 1 < canceled multipart upload key=S3NOACTF4K2W upload=M8WM1SYG13GG tag=OA8KTQT564R7 type=write size=2998171 2024-09-14T11:22:25.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.427+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~NGZA24MSP805.0 size=804027 2024-09-14T11:22:25.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.427+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=NGZA24MSP805 tag=FOEE86HT3RUP type=write size=1852603 2024-09-14T11:22:25.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.428+0000 7f43cc561780 1 < canceled operation key=OV4ATW747PY4 tag=HBCVL4NOC928 type=del size=1059819 2024-09-14T11:22:25.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.429+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=XJ2BPK4Q62NO type=del size=479562 2024-09-14T11:22:25.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.430+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=RQ8QB04PZA9W type=del 2024-09-14T11:22:25.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.432+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~F1FT7B3FAV1G.0 size=1048576 2024-09-14T11:22:25.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.433+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~F1FT7B3FAV1G.1 size=1048576 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.434+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~F1FT7B3FAV1G.2 size=739263 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.434+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=F1FT7B3FAV1G tag=46IHIS6WUQL6 type=write size=3884991 2024-09-14T11:22:25.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.436+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~8DKBB21QPM6P.0 size=1048576 2024-09-14T11:22:25.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.437+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~8DKBB21QPM6P.1 size=1048576 2024-09-14T11:22:25.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.438+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~8DKBB21QPM6P.2 size=556260 2024-09-14T11:22:25.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.440+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=8DKBB21QPM6P tag=QIGYLCH32QAP type=write size=3701988 2024-09-14T11:22:25.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.442+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=T1YNM0XVYRVS type=del size=1258325 2024-09-14T11:22:25.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.443+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=V0QXSTA8V0ZM type=del 2024-09-14T11:22:25.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.446+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~UBF0IQQ0S3VY.0 size=203991 2024-09-14T11:22:25.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.446+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=UBF0IQQ0S3VY tag=5NA0YB77TL2D type=write size=1252567 2024-09-14T11:22:25.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.447+0000 7f43cc561780 -1 < failed to complete operation key=AY7JGVM96MO7 tag=ZBK14W7AT0R2 type=write size=899415: (22) Invalid argument 2024-09-14T11:22:25.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.449+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~LLLPLZQ0LWA5.0 size=751747 2024-09-14T11:22:25.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.449+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=LLLPLZQ0LWA5 tag=AMI2Q83CI3H0 type=write size=1800323 2024-09-14T11:22:25.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.450+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=4DEMKVH7HIZT type=del 2024-09-14T11:22:25.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.453+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~8GXFU0W31KSJ.0 size=1048576 2024-09-14T11:22:25.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.454+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~8GXFU0W31KSJ.1 size=1048576 2024-09-14T11:22:25.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.455+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~8GXFU0W31KSJ.2 size=986616 2024-09-14T11:22:25.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.455+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=8GXFU0W31KSJ tag=2KEKHGBT3HM5 type=write size=4132344 2024-09-14T11:22:25.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.456+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=VJ7I677V3ZF5 type=del 2024-09-14T11:22:25.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.458+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~7GPHO7EDM24Z.0 size=1048576 2024-09-14T11:22:25.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.459+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~7GPHO7EDM24Z.1 size=1048576 2024-09-14T11:22:25.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.460+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~7GPHO7EDM24Z.2 size=1046715 2024-09-14T11:22:25.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.460+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=7GPHO7EDM24Z tag=OHCPP2DCJEWV type=write size=4192443 2024-09-14T11:22:25.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.462+0000 7f43cc561780 1 < completed write operation key=OJOJZBG1WEGI tag=PVWMCPRGEHEM type=write size=283735 2024-09-14T11:22:25.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.463+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=R652H4W4P1J1 type=del size=3453423 2024-09-14T11:22:25.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.465+0000 7f43cc561780 1 < suggested update operation key=0TDWJO4AWOOF tag=ON53U1RTJM8O type=del size=179047 2024-09-14T11:22:25.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.467+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=H7I6Z66RSYOL type=del size=999689 2024-09-14T11:22:25.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.468+0000 7f43cc561780 1 < canceled operation key=AY7JGVM96MO7 tag=3QRSP6WUS5BU type=write size=192258 2024-09-14T11:22:25.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.470+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~DNBAV36CKYX0.0 size=1048576 2024-09-14T11:22:25.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.471+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~DNBAV36CKYX0.1 size=571764 2024-09-14T11:22:25.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.471+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=DNBAV36CKYX0 tag=BEM83L3DP877 type=write size=2668916 2024-09-14T11:22:25.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.472+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=CWZLECN43VGW type=del 2024-09-14T11:22:25.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.474+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=00FJP4XFSA1R type=del size=1399919 2024-09-14T11:22:25.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.475+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=18F6Q8PNX9XB type=del 2024-09-14T11:22:25.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.476+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=WTC7MTBHJCTW type=del size=1760717 2024-09-14T11:22:25.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.477+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~UZO070BV32JE.0 size=834954 2024-09-14T11:22:25.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.479+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=UZO070BV32JE tag=SMVBBTYRMRTI type=write size=1883530 2024-09-14T11:22:25.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.480+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=27T16JJFREYT type=del size=2408388 2024-09-14T11:22:25.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.481+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=EK13DT56LJAH type=del 2024-09-14T11:22:25.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.484+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~8Z4U1CQ13HU9.0 size=1048576 2024-09-14T11:22:25.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.485+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~8Z4U1CQ13HU9.1 size=1048576 2024-09-14T11:22:25.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.486+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~8Z4U1CQ13HU9.2 size=841701 2024-09-14T11:22:25.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.486+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=8Z4U1CQ13HU9 tag=JDPYD284VYAL type=write size=3987429 2024-09-14T11:22:25.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.487+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=RQ5513MEFXAC type=del 2024-09-14T11:22:25.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.488+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=4MV8T3D60O46 type=del size=2277714 2024-09-14T11:22:25.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.489+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~NGZA24MSP805.0 size=804027 2024-09-14T11:22:25.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.491+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=NGZA24MSP805 tag=FOEE86HT3RUP type=write size=1852603 2024-09-14T11:22:25.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.493+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~UHAIAZZMHTNT.0 size=1048576 2024-09-14T11:22:25.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.494+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~UHAIAZZMHTNT.1 size=1048576 2024-09-14T11:22:25.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.495+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~UHAIAZZMHTNT.2 size=680702 2024-09-14T11:22:25.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.495+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=UHAIAZZMHTNT tag=JP8WOT6VQKZK type=write size=3826430 2024-09-14T11:22:25.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.496+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=XJ2BPK4Q62NO type=del 2024-09-14T11:22:25.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.498+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~U7C8GGHN2EST.0 size=1048576 2024-09-14T11:22:25.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.499+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~U7C8GGHN2EST.1 size=1048576 2024-09-14T11:22:25.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.500+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~U7C8GGHN2EST.2 size=892967 2024-09-14T11:22:25.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.500+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=U7C8GGHN2EST tag=4I0O8KED8N8E type=write size=4038695 2024-09-14T11:22:25.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.501+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~F1FT7B3FAV1G.0 size=1048576 2024-09-14T11:22:25.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.502+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~F1FT7B3FAV1G.1 size=1048576 2024-09-14T11:22:25.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.503+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~F1FT7B3FAV1G.2 size=739263 2024-09-14T11:22:25.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.504+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=F1FT7B3FAV1G tag=46IHIS6WUQL6 type=write size=3884991 2024-09-14T11:22:25.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.506+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=XR064R3ODVSJ type=del size=2381468 2024-09-14T11:22:25.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.508+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=T1YNM0XVYRVS type=del size=1258325 2024-09-14T11:22:25.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.510+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~1GWU0VCVRU0O.0 size=1048576 2024-09-14T11:22:25.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.511+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~1GWU0VCVRU0O.1 size=1048576 2024-09-14T11:22:25.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.512+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~1GWU0VCVRU0O.2 size=250922 2024-09-14T11:22:25.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.512+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=1GWU0VCVRU0O tag=3BC0589RXB5K type=write size=3396650 2024-09-14T11:22:25.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.513+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~UBF0IQQ0S3VY.0 size=203991 2024-09-14T11:22:25.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.515+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=UBF0IQQ0S3VY tag=5NA0YB77TL2D type=write size=1252567 2024-09-14T11:22:25.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.517+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~R2EHT9N65W9X.0 size=78751 2024-09-14T11:22:25.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.517+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=R2EHT9N65W9X tag=VX5C189KLHSL type=write size=1127327 2024-09-14T11:22:25.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.518+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~LLLPLZQ0LWA5.0 size=751747 2024-09-14T11:22:25.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.520+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=LLLPLZQ0LWA5 tag=AMI2Q83CI3H0 type=write size=1800323 2024-09-14T11:22:25.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.521+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=EVCXFXEYQK2S type=del size=2633978 2024-09-14T11:22:25.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.522+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~8GXFU0W31KSJ.0 size=1048576 2024-09-14T11:22:25.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.523+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~8GXFU0W31KSJ.1 size=1048576 2024-09-14T11:22:25.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.524+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~8GXFU0W31KSJ.2 size=986616 2024-09-14T11:22:25.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.526+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=8GXFU0W31KSJ tag=2KEKHGBT3HM5 type=write size=4132344 2024-09-14T11:22:25.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.527+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=D8AT9ACEMD54 type=del size=579001 2024-09-14T11:22:25.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.528+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~7GPHO7EDM24Z.0 size=1048576 2024-09-14T11:22:25.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.529+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~7GPHO7EDM24Z.1 size=1048576 2024-09-14T11:22:25.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.530+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~7GPHO7EDM24Z.2 size=1046715 2024-09-14T11:22:25.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.532+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=7GPHO7EDM24Z tag=OHCPP2DCJEWV type=write size=4192443 2024-09-14T11:22:25.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.533+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=THCPE6XVDS4B type=write size=103574 2024-09-14T11:22:25.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.536+0000 7f43cc561780 1 < suggested remove operation key=UWES4CQZ8XW6 tag=R652H4W4P1J1 type=del 2024-09-14T11:22:25.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.537+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=34NCWLLOOHF9 type=write size=549467 2024-09-14T11:22:25.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.539+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=H7I6Z66RSYOL type=del 2024-09-14T11:22:25.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.540+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=C4OK3MMIUG3W type=write size=927880 2024-09-14T11:22:25.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.541+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~DNBAV36CKYX0.0 size=1048576 2024-09-14T11:22:25.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.542+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~DNBAV36CKYX0.1 size=571764 2024-09-14T11:22:25.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.544+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=DNBAV36CKYX0 tag=BEM83L3DP877 type=write size=2668916 2024-09-14T11:22:25.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.546+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=V4A51CPNRXQ7 type=del size=1853065 2024-09-14T11:22:25.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.547+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=00FJP4XFSA1R type=del 2024-09-14T11:22:25.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.549+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=ABX3MZ9I3PF4 type=del size=2259455 2024-09-14T11:22:25.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.551+0000 7f43cc561780 1 < suggested update operation key=G6B4CGUBFSOT tag=WTC7MTBHJCTW type=del size=1760717 2024-09-14T11:22:25.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.552+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=VRL94EGHWAWW type=del size=2962236 2024-09-14T11:22:25.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.553+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=27T16JJFREYT type=del 2024-09-14T11:22:25.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.556+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~7EQYABADMJ1O.0 size=255262 2024-09-14T11:22:25.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.556+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=7EQYABADMJ1O tag=D4EO22HOAL68 type=write size=1303838 2024-09-14T11:22:25.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.557+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~8Z4U1CQ13HU9.0 size=1048576 2024-09-14T11:22:25.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.558+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~8Z4U1CQ13HU9.1 size=1048576 2024-09-14T11:22:25.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.558+0000 7f43cc561780 1 < canceled part key=_multipart_LKY30XYUG2QW.2~8Z4U1CQ13HU9.2 size=841701 2024-09-14T11:22:25.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.559+0000 7f43cc561780 1 < canceled multipart upload key=LKY30XYUG2QW upload=8Z4U1CQ13HU9 tag=JDPYD284VYAL type=write size=3987429 2024-09-14T11:22:25.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.562+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~OFD5G7IZ3KX2.0 size=1048576 2024-09-14T11:22:25.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.562+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~OFD5G7IZ3KX2.1 size=1048576 2024-09-14T11:22:25.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.563+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~OFD5G7IZ3KX2.2 size=574509 2024-09-14T11:22:25.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.563+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=OFD5G7IZ3KX2 tag=22ZEAEV9835Z type=write size=3720237 2024-09-14T11:22:25.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.566+0000 7f43cc561780 1 < suggested remove operation key=80ZYEEE1EE78 tag=4MV8T3D60O46 type=del 2024-09-14T11:22:25.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.567+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=WQQ4RPM9S3PT type=del size=1285818 2024-09-14T11:22:25.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.568+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~UHAIAZZMHTNT.0 size=1048576 2024-09-14T11:22:25.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.569+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~UHAIAZZMHTNT.1 size=1048576 2024-09-14T11:22:25.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.569+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~UHAIAZZMHTNT.2 size=680702 2024-09-14T11:22:25.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.571+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=UHAIAZZMHTNT tag=JP8WOT6VQKZK type=write size=3826430 2024-09-14T11:22:25.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.573+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=ZR7WTD19F7CQ type=del size=1820639 2024-09-14T11:22:25.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.574+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~U7C8GGHN2EST.0 size=1048576 2024-09-14T11:22:25.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.575+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~U7C8GGHN2EST.1 size=1048576 2024-09-14T11:22:25.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.576+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~U7C8GGHN2EST.2 size=892967 2024-09-14T11:22:25.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.578+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=U7C8GGHN2EST tag=4I0O8KED8N8E type=write size=4038695 2024-09-14T11:22:25.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.580+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~1QBVEN0KCDU2.0 size=245120 2024-09-14T11:22:25.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.580+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=1QBVEN0KCDU2 tag=C5BABR682SGT type=write size=1293696 2024-09-14T11:22:25.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.581+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=XR064R3ODVSJ type=del 2024-09-14T11:22:25.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.583+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~2MVHEX6Y10WN.0 size=1048576 2024-09-14T11:22:25.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.584+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~2MVHEX6Y10WN.1 size=1048576 2024-09-14T11:22:25.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.585+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~2MVHEX6Y10WN.2 size=883270 2024-09-14T11:22:25.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.585+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=2MVHEX6Y10WN tag=EPOHY1EDO46I type=write size=4028998 2024-09-14T11:22:25.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.585+0000 7f43cc561780 1 < canceled part key=_multipart_FISMBWPDPCTA.2~1GWU0VCVRU0O.0 size=1048576 2024-09-14T11:22:25.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.586+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~1GWU0VCVRU0O.1 size=1048576 2024-09-14T11:22:25.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.587+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~1GWU0VCVRU0O.2 size=250922 2024-09-14T11:22:25.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.589+0000 7f43cc561780 1 < canceled multipart upload key=FISMBWPDPCTA upload=1GWU0VCVRU0O tag=3BC0589RXB5K type=write size=3396650 2024-09-14T11:22:25.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.591+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~VYJWCRPURBIK.0 size=1048576 2024-09-14T11:22:25.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.592+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~VYJWCRPURBIK.1 size=1048576 2024-09-14T11:22:25.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.593+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~VYJWCRPURBIK.2 size=220539 2024-09-14T11:22:25.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.593+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=VYJWCRPURBIK tag=IEVGQE0PAEUD type=write size=3366267 2024-09-14T11:22:25.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.594+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~R2EHT9N65W9X.0 size=78751 2024-09-14T11:22:25.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.596+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=R2EHT9N65W9X tag=VX5C189KLHSL type=write size=1127327 2024-09-14T11:22:25.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.598+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~A42LTWXE8BNU.0 size=867472 2024-09-14T11:22:25.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.598+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=A42LTWXE8BNU tag=ULKQPEXNBNLL type=write size=1916048 2024-09-14T11:22:25.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.600+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=EVCXFXEYQK2S type=del 2024-09-14T11:22:25.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.601+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=TZCCETCNLFD8 type=del size=3043493 2024-09-14T11:22:25.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.602+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=D8AT9ACEMD54 type=del 2024-09-14T11:22:25.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.603+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=W8NNV9VI3LRK type=del size=249776 2024-09-14T11:22:25.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.605+0000 7f43cc561780 1 < completed write operation key=OJOJZBG1WEGI tag=THCPE6XVDS4B type=write size=103574 2024-09-14T11:22:25.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.607+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~ZINBCB9Y3HAM.0 size=1048576 2024-09-14T11:22:25.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.608+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~ZINBCB9Y3HAM.1 size=220266 2024-09-14T11:22:25.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.608+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=ZINBCB9Y3HAM tag=9GUPQZZJ28EY type=write size=2317418 2024-09-14T11:22:25.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.609+0000 7f43cc561780 1 < completed write operation key=AWBBRU4C8RDQ tag=34NCWLLOOHF9 type=write size=549467 2024-09-14T11:22:25.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.610+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=BZU654CMVYBC type=del size=2272483 2024-09-14T11:22:25.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.612+0000 7f43cc561780 1 < suggested remove operation key=IFHWMI5YO5L5 tag=C4OK3MMIUG3W type=write 2024-09-14T11:22:25.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.614+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=1U3BFL2IJ003 type=del size=2378879 2024-09-14T11:22:25.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.615+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=V4A51CPNRXQ7 type=del 2024-09-14T11:22:25.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.616+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=A3CC0LL5FI06 type=del size=4045706 2024-09-14T11:22:25.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.617+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=ABX3MZ9I3PF4 type=del 2024-09-14T11:22:25.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.619+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=9YBW5JYKBW3V type=del size=2667191 2024-09-14T11:22:25.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.620+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=VRL94EGHWAWW type=del 2024-09-14T11:22:25.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.622+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~BZI2DBLUAXAV.0 size=1048576 2024-09-14T11:22:25.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.623+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~BZI2DBLUAXAV.1 size=409091 2024-09-14T11:22:25.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.623+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=BZI2DBLUAXAV tag=3WROCLNYYT4L type=write size=2506243 2024-09-14T11:22:25.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.624+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~7EQYABADMJ1O.0 size=255262 2024-09-14T11:22:25.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.626+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=7EQYABADMJ1O tag=D4EO22HOAL68 type=write size=1303838 2024-09-14T11:22:25.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.628+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=90WPLB481W0K type=write size=825394 2024-09-14T11:22:25.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.629+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~OFD5G7IZ3KX2.0 size=1048576 2024-09-14T11:22:25.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.630+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~OFD5G7IZ3KX2.1 size=1048576 2024-09-14T11:22:25.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.631+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~OFD5G7IZ3KX2.2 size=574509 2024-09-14T11:22:25.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.633+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=OFD5G7IZ3KX2 tag=22ZEAEV9835Z type=write size=3720237 2024-09-14T11:22:25.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.635+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~4U8D1MY6B0IL.0 size=841194 2024-09-14T11:22:25.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.635+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=4U8D1MY6B0IL tag=AF05JZKGPMU2 type=write size=1889770 2024-09-14T11:22:25.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.636+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=WQQ4RPM9S3PT type=del 2024-09-14T11:22:25.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.639+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~CBJ1NI0ED8YA.0 size=686790 2024-09-14T11:22:25.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.639+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=CBJ1NI0ED8YA tag=WPDKCG4CTS6I type=write size=1735366 2024-09-14T11:22:25.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.641+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=ZR7WTD19F7CQ type=del 2024-09-14T11:22:25.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.643+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~NGUN61SY3FKY.0 size=1048576 2024-09-14T11:22:25.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.644+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~NGUN61SY3FKY.1 size=1048576 2024-09-14T11:22:25.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.645+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~NGUN61SY3FKY.2 size=688937 2024-09-14T11:22:25.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.645+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=NGUN61SY3FKY tag=HF4C8U8K1KJU type=write size=3834665 2024-09-14T11:22:25.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.646+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~1QBVEN0KCDU2.0 size=245120 2024-09-14T11:22:25.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.648+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=1QBVEN0KCDU2 tag=C5BABR682SGT type=write size=1293696 2024-09-14T11:22:25.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.651+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~UI8EUEQCUOSE.0 size=1048576 2024-09-14T11:22:25.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.652+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~UI8EUEQCUOSE.1 size=1048576 2024-09-14T11:22:25.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.652+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~UI8EUEQCUOSE.2 size=844614 2024-09-14T11:22:25.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.653+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=UI8EUEQCUOSE tag=E5H4X7WN42G8 type=write size=3990342 2024-09-14T11:22:25.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.654+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~2MVHEX6Y10WN.0 size=1048576 2024-09-14T11:22:25.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.655+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~2MVHEX6Y10WN.1 size=1048576 2024-09-14T11:22:25.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.656+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~2MVHEX6Y10WN.2 size=883270 2024-09-14T11:22:25.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.659+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=2MVHEX6Y10WN tag=EPOHY1EDO46I type=write size=4028998 2024-09-14T11:22:25.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.660+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=2X1DJWLF03NR type=del size=477132 2024-09-14T11:22:25.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.662+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~VYJWCRPURBIK.0 size=1048576 2024-09-14T11:22:25.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.663+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~VYJWCRPURBIK.1 size=1048576 2024-09-14T11:22:25.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.664+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~VYJWCRPURBIK.2 size=220539 2024-09-14T11:22:25.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.666+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=VYJWCRPURBIK tag=IEVGQE0PAEUD type=write size=3366267 2024-09-14T11:22:25.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.667+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=HK4ZH32S8Y2W type=del size=2438873 2024-09-14T11:22:25.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.668+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~A42LTWXE8BNU.0 size=867472 2024-09-14T11:22:25.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.670+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=A42LTWXE8BNU tag=ULKQPEXNBNLL type=write size=1916048 2024-09-14T11:22:25.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.671+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=2M2V5U8ETRHJ type=del size=1817786 2024-09-14T11:22:25.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.672+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=TZCCETCNLFD8 type=del 2024-09-14T11:22:25.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.673+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=XX39JC4JNL8P type=write size=30614 2024-09-14T11:22:25.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.675+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=W8NNV9VI3LRK type=del 2024-09-14T11:22:25.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.677+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~K3K1DYF4VIPO.0 size=1048576 2024-09-14T11:22:25.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.678+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~K3K1DYF4VIPO.1 size=1048576 2024-09-14T11:22:25.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.679+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~K3K1DYF4VIPO.2 size=177310 2024-09-14T11:22:25.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.679+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=K3K1DYF4VIPO tag=ISZLPW81Y2Y6 type=write size=3323038 2024-09-14T11:22:25.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.680+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~ZINBCB9Y3HAM.0 size=1048576 2024-09-14T11:22:25.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.681+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~ZINBCB9Y3HAM.1 size=220266 2024-09-14T11:22:25.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.683+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=ZINBCB9Y3HAM tag=9GUPQZZJ28EY type=write size=2317418 2024-09-14T11:22:25.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.685+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~PTWCCNXOKOYO.0 size=606087 2024-09-14T11:22:25.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.685+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=PTWCCNXOKOYO tag=PSHSDDE1V0CW type=write size=1654663 2024-09-14T11:22:25.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.686+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=BZU654CMVYBC type=del 2024-09-14T11:22:25.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.689+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~GH3AGX8LH2C0.0 size=281469 2024-09-14T11:22:25.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.689+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=GH3AGX8LH2C0 tag=26IT0KG5HG5E type=write size=1330045 2024-09-14T11:22:25.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.691+0000 7f43cc561780 1 < suggested remove operation key=CXP2PUIXR2PA tag=1U3BFL2IJ003 type=del 2024-09-14T11:22:25.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.692+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=L2J01GP7ZV0X type=del size=2013477 2024-09-14T11:22:25.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.693+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=A3CC0LL5FI06 type=del 2024-09-14T11:22:25.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.694+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=JPGC1HW85973 type=del size=1220925 2024-09-14T11:22:25.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.696+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=9YBW5JYKBW3V type=del 2024-09-14T11:22:25.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.698+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~U48OT1U4KZ71.0 size=507301 2024-09-14T11:22:25.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.698+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=U48OT1U4KZ71 tag=XC85TVG2DLKZ type=write size=1555877 2024-09-14T11:22:25.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.699+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~BZI2DBLUAXAV.0 size=1048576 2024-09-14T11:22:25.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.700+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~BZI2DBLUAXAV.1 size=409091 2024-09-14T11:22:25.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.702+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=BZI2DBLUAXAV tag=3WROCLNYYT4L type=write size=2506243 2024-09-14T11:22:25.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.704+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~X3BDI0ECHHZ6.0 size=857300 2024-09-14T11:22:25.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.704+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=X3BDI0ECHHZ6 tag=1DEIP986BIK2 type=write size=1905876 2024-09-14T11:22:25.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.705+0000 7f43cc561780 -1 < no bi entry to suggest for operation key=CXP2PUIXR2PA tag=90WPLB481W0K type=write size=825394: (2) No such file or directory 2024-09-14T11:22:25.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.707+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~Q5K58E6QK4KQ.0 size=1048576 2024-09-14T11:22:25.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.708+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~Q5K58E6QK4KQ.1 size=651554 2024-09-14T11:22:25.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.708+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=Q5K58E6QK4KQ tag=USFLLJO47VS6 type=write size=2748706 2024-09-14T11:22:25.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.709+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~4U8D1MY6B0IL.0 size=841194 2024-09-14T11:22:25.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.711+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=4U8D1MY6B0IL tag=AF05JZKGPMU2 type=write size=1889770 2024-09-14T11:22:25.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.712+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=ZFK8P609B92L type=write size=1028478 2024-09-14T11:22:25.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.713+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~CBJ1NI0ED8YA.0 size=686790 2024-09-14T11:22:25.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.716+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=CBJ1NI0ED8YA tag=WPDKCG4CTS6I type=write size=1735366 2024-09-14T11:22:25.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.717+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=VNYM1LG2SQOY type=del size=681271 2024-09-14T11:22:25.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.718+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~NGUN61SY3FKY.0 size=1048576 2024-09-14T11:22:25.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.718+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~NGUN61SY3FKY.1 size=1048576 2024-09-14T11:22:25.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.719+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~NGUN61SY3FKY.2 size=688937 2024-09-14T11:22:25.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.721+0000 7f43cc561780 1 < canceled multipart upload key=A1B2LIZIPET3 upload=NGUN61SY3FKY tag=HF4C8U8K1KJU type=write size=3834665 2024-09-14T11:22:25.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.723+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~Q9NRAQLR5750.0 size=1048576 2024-09-14T11:22:25.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.724+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~Q9NRAQLR5750.1 size=1048576 2024-09-14T11:22:25.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.725+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~Q9NRAQLR5750.2 size=845405 2024-09-14T11:22:25.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.725+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=Q9NRAQLR5750 tag=YHQ0003KWJY3 type=write size=3991133 2024-09-14T11:22:25.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.727+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~UI8EUEQCUOSE.0 size=1048576 2024-09-14T11:22:25.726 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.727+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~UI8EUEQCUOSE.1 size=1048576 2024-09-14T11:22:25.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.728+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~UI8EUEQCUOSE.2 size=844614 2024-09-14T11:22:25.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.730+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=UI8EUEQCUOSE tag=E5H4X7WN42G8 type=write size=3990342 2024-09-14T11:22:25.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.732+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~1KJZTE87N02I.0 size=1048576 2024-09-14T11:22:25.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.733+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~1KJZTE87N02I.1 size=1048576 2024-09-14T11:22:25.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.734+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~1KJZTE87N02I.2 size=883004 2024-09-14T11:22:25.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.734+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=1KJZTE87N02I tag=Q01WZBIGPHST type=write size=4028732 2024-09-14T11:22:25.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.736+0000 7f43cc561780 1 < canceled operation key=D84127SVSIPL tag=2X1DJWLF03NR type=del size=477132 2024-09-14T11:22:25.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.737+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=9CE2RUY02RPZ type=del size=1047159 2024-09-14T11:22:25.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.738+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=HK4ZH32S8Y2W type=del 2024-09-14T11:22:25.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.740+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~39VKB0FIGG4I.0 size=1048576 2024-09-14T11:22:25.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.741+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~39VKB0FIGG4I.1 size=16680 2024-09-14T11:22:25.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.741+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=39VKB0FIGG4I tag=1MJ7QDMFKXKY type=write size=2113832 2024-09-14T11:22:25.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.743+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=2M2V5U8ETRHJ type=del 2024-09-14T11:22:25.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.744+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=2M3B3INAED3S type=del size=1293803 2024-09-14T11:22:25.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.746+0000 7f43cc561780 1 < suggested remove operation key=BRHP3DQEO3HZ tag=XX39JC4JNL8P type=write 2024-09-14T11:22:25.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.749+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~CCEA2ORW193H.0 size=1048576 2024-09-14T11:22:25.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.750+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~CCEA2ORW193H.1 size=336567 2024-09-14T11:22:25.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.750+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=CCEA2ORW193H tag=X9TN1DBX19VR type=write size=2433719 2024-09-14T11:22:25.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.751+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~K3K1DYF4VIPO.0 size=1048576 2024-09-14T11:22:25.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.751+0000 7f43cc561780 1 < canceled part key=_multipart_LKY30XYUG2QW.2~K3K1DYF4VIPO.1 size=1048576 2024-09-14T11:22:25.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.752+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~K3K1DYF4VIPO.2 size=177310 2024-09-14T11:22:25.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.754+0000 7f43cc561780 1 < canceled multipart upload key=LKY30XYUG2QW upload=K3K1DYF4VIPO tag=ISZLPW81Y2Y6 type=write size=3323038 2024-09-14T11:22:25.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.755+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=3Y11Z7FY4034 type=write size=516736 2024-09-14T11:22:25.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.756+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~PTWCCNXOKOYO.0 size=606087 2024-09-14T11:22:25.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.758+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=PTWCCNXOKOYO tag=PSHSDDE1V0CW type=write size=1654663 2024-09-14T11:22:25.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.760+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~NI59JGBGG6QS.0 size=1048576 2024-09-14T11:22:25.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.761+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~NI59JGBGG6QS.1 size=1048576 2024-09-14T11:22:25.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.762+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~NI59JGBGG6QS.2 size=1001549 2024-09-14T11:22:25.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.762+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=NI59JGBGG6QS tag=02BLAHZSKTC0 type=write size=4147277 2024-09-14T11:22:25.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.762+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~GH3AGX8LH2C0.0 size=281469 2024-09-14T11:22:25.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.764+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=GH3AGX8LH2C0 tag=26IT0KG5HG5E type=write size=1330045 2024-09-14T11:22:25.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.766+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~RK6RHTX70GIK.0 size=1048576 2024-09-14T11:22:25.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.768+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~RK6RHTX70GIK.1 size=1048576 2024-09-14T11:22:25.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.769+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~RK6RHTX70GIK.2 size=211379 2024-09-14T11:22:25.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.769+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=RK6RHTX70GIK tag=775FVJU3ESJE type=write size=3357107 2024-09-14T11:22:25.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.770+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=L2J01GP7ZV0X type=del 2024-09-14T11:22:25.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.773+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~OX9WPVYFLH8L.0 size=1048576 2024-09-14T11:22:25.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.774+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~OX9WPVYFLH8L.1 size=1048576 2024-09-14T11:22:25.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.775+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~OX9WPVYFLH8L.2 size=522237 2024-09-14T11:22:25.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.775+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=OX9WPVYFLH8L tag=3XYA9DHULNMQ type=write size=3667965 2024-09-14T11:22:25.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.777+0000 7f43cc561780 1 < suggested update operation key=3YHEZHW0RS1W tag=JPGC1HW85973 type=del size=1220925 2024-09-14T11:22:25.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.778+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=QOAZBE83OQS8 type=del size=4084 2024-09-14T11:22:25.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.779+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~U48OT1U4KZ71.0 size=507301 2024-09-14T11:22:25.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.781+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=U48OT1U4KZ71 tag=XC85TVG2DLKZ type=write size=1555877 2024-09-14T11:22:25.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.783+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=PONTSU0I0LQF type=del size=458501 2024-09-14T11:22:25.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.784+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~X3BDI0ECHHZ6.0 size=857300 2024-09-14T11:22:25.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.786+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=X3BDI0ECHHZ6 tag=1DEIP986BIK2 type=write size=1905876 2024-09-14T11:22:25.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.788+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~AM4Y2GG1E35I.0 size=1048576 2024-09-14T11:22:25.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.789+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~AM4Y2GG1E35I.1 size=464890 2024-09-14T11:22:25.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.789+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=AM4Y2GG1E35I tag=JTLYBSWFKQ4A type=write size=2562042 2024-09-14T11:22:25.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.790+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~Q5K58E6QK4KQ.0 size=1048576 2024-09-14T11:22:25.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.790+0000 7f43cc561780 1 < canceled part key=_multipart_S3NOACTF4K2W.2~Q5K58E6QK4KQ.1 size=651554 2024-09-14T11:22:25.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.792+0000 7f43cc561780 1 < canceled multipart upload key=S3NOACTF4K2W upload=Q5K58E6QK4KQ tag=USFLLJO47VS6 type=write size=2748706 2024-09-14T11:22:25.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.793+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=94HSNM70DQZW type=del size=3426858 2024-09-14T11:22:25.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.795+0000 7f43cc561780 -1 < failed to complete operation key=3YHEZHW0RS1W tag=ZFK8P609B92L type=write size=1028478: (22) Invalid argument 2024-09-14T11:22:25.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.797+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~DF74IU2HDAJU.0 size=1048576 2024-09-14T11:22:25.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.798+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~DF74IU2HDAJU.1 size=1048576 2024-09-14T11:22:25.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.799+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~DF74IU2HDAJU.2 size=893973 2024-09-14T11:22:25.798 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.799+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=DF74IU2HDAJU tag=IF4Q3IPWNRC8 type=write size=4039701 2024-09-14T11:22:25.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.800+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=VNYM1LG2SQOY type=del 2024-09-14T11:22:25.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.801+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=DBFWYP1A0NOX type=del size=814958 2024-09-14T11:22:25.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.803+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~Q9NRAQLR5750.0 size=1048576 2024-09-14T11:22:25.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.804+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~Q9NRAQLR5750.1 size=1048576 2024-09-14T11:22:25.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.805+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~Q9NRAQLR5750.2 size=845405 2024-09-14T11:22:25.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.806+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=Q9NRAQLR5750 tag=YHQ0003KWJY3 type=write size=3991133 2024-09-14T11:22:25.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.808+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=3W1E4F47KH58 type=write size=228433 2024-09-14T11:22:25.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.809+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~1KJZTE87N02I.0 size=1048576 2024-09-14T11:22:25.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.810+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~1KJZTE87N02I.1 size=1048576 2024-09-14T11:22:25.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.811+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~1KJZTE87N02I.2 size=883004 2024-09-14T11:22:25.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.813+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=1KJZTE87N02I tag=Q01WZBIGPHST type=write size=4028732 2024-09-14T11:22:25.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.816+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~D8B9C48ILDS1.0 size=1048576 2024-09-14T11:22:25.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.817+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~D8B9C48ILDS1.1 size=1048576 2024-09-14T11:22:25.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.818+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~D8B9C48ILDS1.2 size=158193 2024-09-14T11:22:25.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.818+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=D8B9C48ILDS1 tag=Q1FUGEJOB0DC type=write size=3303921 2024-09-14T11:22:25.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.820+0000 7f43cc561780 1 < suggested remove operation key=END3SHHS0FSA tag=9CE2RUY02RPZ type=del 2024-09-14T11:22:25.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.822+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=XYRB0V4B0F53 type=del size=451058 2024-09-14T11:22:25.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.823+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~39VKB0FIGG4I.0 size=1048576 2024-09-14T11:22:25.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.824+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~39VKB0FIGG4I.1 size=16680 2024-09-14T11:22:25.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.826+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=39VKB0FIGG4I tag=1MJ7QDMFKXKY type=write size=2113832 2024-09-14T11:22:25.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.828+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=2X0NS6TAGXOJ type=write size=261065 2024-09-14T11:22:25.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.829+0000 7f43cc561780 1 < canceled operation key=0TDWJO4AWOOF tag=2M3B3INAED3S type=del size=1293803 2024-09-14T11:22:25.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.832+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~UT9KP2X4DHI9.0 size=581126 2024-09-14T11:22:25.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.832+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=UT9KP2X4DHI9 tag=5HJSP0Q79I3I type=write size=1629702 2024-09-14T11:22:25.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.833+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~CCEA2ORW193H.0 size=1048576 2024-09-14T11:22:25.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.834+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~CCEA2ORW193H.1 size=336567 2024-09-14T11:22:25.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.836+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=CCEA2ORW193H tag=X9TN1DBX19VR type=write size=2433719 2024-09-14T11:22:25.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.838+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~078O8KIDII91.0 size=55866 2024-09-14T11:22:25.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.838+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=078O8KIDII91 tag=07HJ6F857PQI type=write size=1104442 2024-09-14T11:22:25.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.839+0000 7f43cc561780 1 < completed write operation key=MD14RGOQY0LK tag=3Y11Z7FY4034 type=write size=516736 2024-09-14T11:22:25.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.841+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=GG6G2KVCQVM7 type=write size=238739 2024-09-14T11:22:25.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.842+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~NI59JGBGG6QS.0 size=1048576 2024-09-14T11:22:25.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.843+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~NI59JGBGG6QS.1 size=1048576 2024-09-14T11:22:25.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.843+0000 7f43cc561780 1 < canceled part key=_multipart_9XIAGZKIUBGH.2~NI59JGBGG6QS.2 size=1001549 2024-09-14T11:22:25.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.845+0000 7f43cc561780 1 < canceled multipart upload key=9XIAGZKIUBGH upload=NI59JGBGG6QS tag=02BLAHZSKTC0 type=write size=4147277 2024-09-14T11:22:25.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.847+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~BLU2CFYGZ2S1.0 size=1048576 2024-09-14T11:22:25.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.848+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~BLU2CFYGZ2S1.1 size=171582 2024-09-14T11:22:25.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.848+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=BLU2CFYGZ2S1 tag=RJZWGRDU2BW6 type=write size=2268734 2024-09-14T11:22:25.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.849+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~RK6RHTX70GIK.0 size=1048576 2024-09-14T11:22:25.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.850+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~RK6RHTX70GIK.1 size=1048576 2024-09-14T11:22:25.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.851+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~RK6RHTX70GIK.2 size=211379 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.853+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=RK6RHTX70GIK tag=775FVJU3ESJE type=write size=3357107 2024-09-14T11:22:25.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.855+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~IPVDL1JM5GH1.0 size=1048576 2024-09-14T11:22:25.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.856+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~IPVDL1JM5GH1.1 size=1048576 2024-09-14T11:22:25.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.857+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~IPVDL1JM5GH1.2 size=808629 2024-09-14T11:22:25.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.857+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=IPVDL1JM5GH1 tag=CBUP0QZV1FG0 type=write size=3954357 2024-09-14T11:22:25.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.858+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~OX9WPVYFLH8L.0 size=1048576 2024-09-14T11:22:25.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.859+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~OX9WPVYFLH8L.1 size=1048576 2024-09-14T11:22:25.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.860+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~OX9WPVYFLH8L.2 size=522237 2024-09-14T11:22:25.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.862+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=OX9WPVYFLH8L tag=3XYA9DHULNMQ type=write size=3667965 2024-09-14T11:22:25.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.863+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=OBX96Q9OLHAQ type=write size=189657 2024-09-14T11:22:25.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.865+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=QOAZBE83OQS8 type=del 2024-09-14T11:22:25.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.866+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=IUKA8WEWF54P type=del size=2873191 2024-09-14T11:22:25.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.867+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=PONTSU0I0LQF type=del 2024-09-14T11:22:25.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.868+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=1BHT31HWENPA type=del size=2430307 2024-09-14T11:22:25.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.870+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~AM4Y2GG1E35I.0 size=1048576 2024-09-14T11:22:25.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.871+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~AM4Y2GG1E35I.1 size=464890 2024-09-14T11:22:25.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.873+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=AM4Y2GG1E35I tag=JTLYBSWFKQ4A type=write size=2562042 2024-09-14T11:22:25.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.874+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=EM437XZV1H4A type=write size=986405 2024-09-14T11:22:25.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.875+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=94HSNM70DQZW type=del 2024-09-14T11:22:25.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.876+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=HWZ1PO6IGNZO type=del size=2549268 2024-09-14T11:22:25.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.877+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~DF74IU2HDAJU.0 size=1048576 2024-09-14T11:22:25.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.878+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~DF74IU2HDAJU.1 size=1048576 2024-09-14T11:22:25.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.880+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~DF74IU2HDAJU.2 size=893973 2024-09-14T11:22:25.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.882+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=DF74IU2HDAJU tag=IF4Q3IPWNRC8 type=write size=4039701 2024-09-14T11:22:25.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.884+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~A60MIYHSTYOQ.0 size=548842 2024-09-14T11:22:25.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.884+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=A60MIYHSTYOQ tag=V0E8MDV4Y57A type=write size=1597418 2024-09-14T11:22:25.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.886+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=DBFWYP1A0NOX type=del 2024-09-14T11:22:25.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.887+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=87ZDIPPYUI4D type=del size=2858855 2024-09-14T11:22:25.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.888+0000 7f43cc561780 1 < completed write operation key=E6FDCACWGA2Y tag=3W1E4F47KH58 type=write size=228433 2024-09-14T11:22:25.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.889+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=Q8YV0XBTIV7T type=del size=2771726 2024-09-14T11:22:25.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.890+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~D8B9C48ILDS1.0 size=1048576 2024-09-14T11:22:25.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.892+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~D8B9C48ILDS1.1 size=1048576 2024-09-14T11:22:25.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.893+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~D8B9C48ILDS1.2 size=158193 2024-09-14T11:22:25.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.895+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=D8B9C48ILDS1 tag=Q1FUGEJOB0DC type=write size=3303921 2024-09-14T11:22:25.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.897+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~TZ29UP3CD59G.0 size=405064 2024-09-14T11:22:25.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.897+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=TZ29UP3CD59G tag=DZ53U303J01L type=write size=1453640 2024-09-14T11:22:25.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.898+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=XYRB0V4B0F53 type=del 2024-09-14T11:22:25.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.899+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=BEMM4DB0YVSZ type=del size=1375295 2024-09-14T11:22:25.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.902+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=2X0NS6TAGXOJ type=write size=261065 2024-09-14T11:22:25.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.903+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=ZFM3VFQK9V8D type=del size=779116 2024-09-14T11:22:25.903 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.904+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~UT9KP2X4DHI9.0 size=581126 2024-09-14T11:22:25.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.906+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=UT9KP2X4DHI9 tag=5HJSP0Q79I3I type=write size=1629702 2024-09-14T11:22:25.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.907+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=SAJVWSH3PZOK type=del size=699006 2024-09-14T11:22:25.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.908+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~078O8KIDII91.0 size=55866 2024-09-14T11:22:25.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.910+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=078O8KIDII91 tag=07HJ6F857PQI type=write size=1104442 2024-09-14T11:22:25.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.912+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~8JLCLQRCYID6.0 size=547184 2024-09-14T11:22:25.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.912+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=8JLCLQRCYID6 tag=6YLVOAHU3KY7 type=write size=1595760 2024-09-14T11:22:25.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.914+0000 7f43cc561780 1 < completed write operation key=S3NOACTF4K2W tag=GG6G2KVCQVM7 type=write size=238739 2024-09-14T11:22:25.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.915+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=11GTUIN4GL3C type=write size=203732 2024-09-14T11:22:25.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.916+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~BLU2CFYGZ2S1.0 size=1048576 2024-09-14T11:22:25.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.917+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~BLU2CFYGZ2S1.1 size=171582 2024-09-14T11:22:25.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.919+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=BLU2CFYGZ2S1 tag=RJZWGRDU2BW6 type=write size=2268734 2024-09-14T11:22:25.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.921+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~RI5DHL2CRW6K.0 size=1048576 2024-09-14T11:22:25.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.922+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~RI5DHL2CRW6K.1 size=856169 2024-09-14T11:22:25.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.922+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=RI5DHL2CRW6K tag=Q0O8UD780YGT type=write size=2953321 2024-09-14T11:22:25.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.923+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~IPVDL1JM5GH1.0 size=1048576 2024-09-14T11:22:25.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.924+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~IPVDL1JM5GH1.1 size=1048576 2024-09-14T11:22:25.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.924+0000 7f43cc561780 1 < canceled part key=_multipart_BRHP3DQEO3HZ.2~IPVDL1JM5GH1.2 size=808629 2024-09-14T11:22:25.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.926+0000 7f43cc561780 1 < canceled multipart upload key=BRHP3DQEO3HZ upload=IPVDL1JM5GH1 tag=CBUP0QZV1FG0 type=write size=3954357 2024-09-14T11:22:25.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.928+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~UWMR3OMHJP98.0 size=1048576 2024-09-14T11:22:25.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.929+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~UWMR3OMHJP98.1 size=85192 2024-09-14T11:22:25.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.929+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=UWMR3OMHJP98 tag=RB4ICJ3D7BF1 type=write size=2182344 2024-09-14T11:22:25.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.930+0000 7f43cc561780 1 < completed write operation key=80ZYEEE1EE78 tag=OBX96Q9OLHAQ type=write size=189657 2024-09-14T11:22:25.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.931+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=A9WS89FK79JV type=del size=3935679 2024-09-14T11:22:25.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.932+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=IUKA8WEWF54P type=del 2024-09-14T11:22:25.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.934+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~DX8VQ0G8YVPI.0 size=1048576 2024-09-14T11:22:25.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.935+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~DX8VQ0G8YVPI.1 size=1048576 2024-09-14T11:22:25.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.936+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~DX8VQ0G8YVPI.2 size=589373 2024-09-14T11:22:25.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.936+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=DX8VQ0G8YVPI tag=35XRGAENGAWQ type=write size=3735101 2024-09-14T11:22:25.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.937+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=1BHT31HWENPA type=del 2024-09-14T11:22:25.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.938+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=F1U0TT41EY4C type=del size=3568950 2024-09-14T11:22:25.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.941+0000 7f43cc561780 1 < suggested remove operation key=END3SHHS0FSA tag=EM437XZV1H4A type=write 2024-09-14T11:22:25.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.943+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~B1BKROGJOGV0.0 size=872452 2024-09-14T11:22:25.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.943+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=B1BKROGJOGV0 tag=5ZKXZVRDZTSO type=write size=1921028 2024-09-14T11:22:25.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.944+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=HWZ1PO6IGNZO type=del 2024-09-14T11:22:25.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.945+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=DD7OP66ULSBF type=del size=793309 2024-09-14T11:22:25.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.946+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~A60MIYHSTYOQ.0 size=548842 2024-09-14T11:22:25.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.948+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=A60MIYHSTYOQ tag=V0E8MDV4Y57A type=write size=1597418 2024-09-14T11:22:25.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.950+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~I23LKXL2E8EV.0 size=501398 2024-09-14T11:22:25.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.950+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=I23LKXL2E8EV tag=A4MDJG94BRRI type=write size=1549974 2024-09-14T11:22:25.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.951+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=87ZDIPPYUI4D type=del 2024-09-14T11:22:25.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.953+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=0QKTYTTA3INX type=del size=3550450 2024-09-14T11:22:25.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.955+0000 7f43cc561780 1 < suggested remove operation key=W679WIFVPVOH tag=Q8YV0XBTIV7T type=del 2024-09-14T11:22:25.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.957+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~ZUSBA8720YKW.0 size=1048576 2024-09-14T11:22:25.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.958+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~ZUSBA8720YKW.1 size=332041 2024-09-14T11:22:25.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.958+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=ZUSBA8720YKW tag=NRSOHRF8Q0GC type=write size=2429193 2024-09-14T11:22:25.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.959+0000 7f43cc561780 1 < canceled part key=_multipart_9XIAGZKIUBGH.2~TZ29UP3CD59G.0 size=405064 2024-09-14T11:22:25.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.961+0000 7f43cc561780 1 < canceled multipart upload key=9XIAGZKIUBGH upload=TZ29UP3CD59G tag=DZ53U303J01L type=write size=1453640 2024-09-14T11:22:25.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.964+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~4PR4FMWRJFJ7.0 size=141342 2024-09-14T11:22:25.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.964+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=4PR4FMWRJFJ7 tag=U696SM1UOU9Z type=write size=1189918 2024-09-14T11:22:25.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.965+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=BEMM4DB0YVSZ type=del 2024-09-14T11:22:25.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.967+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~I3GTR5733QO0.0 size=221464 2024-09-14T11:22:25.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.967+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=I3GTR5733QO0 tag=0K2QX1HO18VY type=write size=1270040 2024-09-14T11:22:25.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.969+0000 7f43cc561780 1 < suggested remove operation key=IFHWMI5YO5L5 tag=ZFM3VFQK9V8D type=del 2024-09-14T11:22:25.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.971+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~TDIMQZBW1V3C.0 size=44317 2024-09-14T11:22:25.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.971+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=TDIMQZBW1V3C tag=N6WUQ0FLB84L type=write size=1092893 2024-09-14T11:22:25.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.973+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=SAJVWSH3PZOK type=del 2024-09-14T11:22:25.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.975+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~DHUHZIHRM7VQ.0 size=193936 2024-09-14T11:22:25.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.975+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=DHUHZIHRM7VQ tag=ESHWF21TKMM5 type=write size=1242512 2024-09-14T11:22:25.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.976+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~8JLCLQRCYID6.0 size=547184 2024-09-14T11:22:25.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.978+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=8JLCLQRCYID6 tag=6YLVOAHU3KY7 type=write size=1595760 2024-09-14T11:22:25.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.981+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~0CI61DYAYX7F.0 size=1048576 2024-09-14T11:22:25.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.982+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~0CI61DYAYX7F.1 size=1048576 2024-09-14T11:22:25.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.983+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~0CI61DYAYX7F.2 size=700054 2024-09-14T11:22:25.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.983+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=0CI61DYAYX7F tag=TRUTKFKMCQK0 type=write size=3845782 2024-09-14T11:22:25.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.985+0000 7f43cc561780 1 < completed write operation key=AWBBRU4C8RDQ tag=11GTUIN4GL3C type=write size=203732 2024-09-14T11:22:25.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.986+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=SAAFZMBGMT6O type=del size=2796765 2024-09-14T11:22:25.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.986+0000 7f43cc561780 1 < canceled part key=_multipart_BZDW69C3Z97G.2~RI5DHL2CRW6K.0 size=1048576 2024-09-14T11:22:25.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.987+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~RI5DHL2CRW6K.1 size=856169 2024-09-14T11:22:25.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.989+0000 7f43cc561780 1 < canceled multipart upload key=BZDW69C3Z97G upload=RI5DHL2CRW6K tag=Q0O8UD780YGT type=write size=2953321 2024-09-14T11:22:25.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.991+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=DNHN52U525CW type=del size=1513210 2024-09-14T11:22:25.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.993+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~UWMR3OMHJP98.0 size=1048576 2024-09-14T11:22:25.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.993+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~UWMR3OMHJP98.1 size=85192 2024-09-14T11:22:25.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.995+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=UWMR3OMHJP98 tag=RB4ICJ3D7BF1 type=write size=2182344 2024-09-14T11:22:25.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.997+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=633KJV1IE7M3 type=del size=1683479 2024-09-14T11:22:25.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:25.998+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=A9WS89FK79JV type=del 2024-09-14T11:22:25.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.000+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~H0C3TTRKHOOE.0 size=1048576 2024-09-14T11:22:26.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.001+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~H0C3TTRKHOOE.1 size=1048576 2024-09-14T11:22:26.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.002+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~H0C3TTRKHOOE.2 size=453592 2024-09-14T11:22:26.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.002+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=H0C3TTRKHOOE tag=O1RVAXBW02NN type=write size=3599320 2024-09-14T11:22:26.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.003+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~DX8VQ0G8YVPI.0 size=1048576 2024-09-14T11:22:26.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.004+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~DX8VQ0G8YVPI.1 size=1048576 2024-09-14T11:22:26.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.005+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~DX8VQ0G8YVPI.2 size=589373 2024-09-14T11:22:26.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.007+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=DX8VQ0G8YVPI tag=35XRGAENGAWQ type=write size=3735101 2024-09-14T11:22:26.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.008+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=NGCFQ3UIZC95 type=write size=527405 2024-09-14T11:22:26.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.011+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=F1U0TT41EY4C type=del 2024-09-14T11:22:26.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.013+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~LBXFDKQAYC3L.0 size=1048576 2024-09-14T11:22:26.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.014+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~LBXFDKQAYC3L.1 size=1006523 2024-09-14T11:22:26.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.014+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=LBXFDKQAYC3L tag=88VYMQ5RRAZW type=write size=3103675 2024-09-14T11:22:26.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.015+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~B1BKROGJOGV0.0 size=872452 2024-09-14T11:22:26.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.017+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=B1BKROGJOGV0 tag=5ZKXZVRDZTSO type=write size=1921028 2024-09-14T11:22:26.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.018+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=Z0OJN8NPJO9A type=del size=1208211 2024-09-14T11:22:26.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.019+0000 7f43cc561780 -1 < failed to complete operation key=IFHWMI5YO5L5 tag=DD7OP66ULSBF type=del size=793309: (22) Invalid argument 2024-09-14T11:22:26.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.020+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=IRM35KZDCTXM type=del size=3372331 2024-09-14T11:22:26.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.022+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~I23LKXL2E8EV.0 size=501398 2024-09-14T11:22:26.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.024+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=I23LKXL2E8EV tag=A4MDJG94BRRI type=write size=1549974 2024-09-14T11:22:26.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.025+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=34OU8H445DPU type=del size=1685623 2024-09-14T11:22:26.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.028+0000 7f43cc561780 1 < suggested remove operation key=IG4QM506P41B tag=0QKTYTTA3INX type=del 2024-09-14T11:22:26.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.030+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~FUF1P99NCLBB.0 size=1004580 2024-09-14T11:22:26.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.030+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=FUF1P99NCLBB tag=HRD2B41NWGSQ type=write size=2053156 2024-09-14T11:22:26.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.031+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~ZUSBA8720YKW.0 size=1048576 2024-09-14T11:22:26.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.032+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~ZUSBA8720YKW.1 size=332041 2024-09-14T11:22:26.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.034+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=ZUSBA8720YKW tag=NRSOHRF8Q0GC type=write size=2429193 2024-09-14T11:22:26.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.036+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~FQ82J2CJ4ZIX.0 size=1048576 2024-09-14T11:22:26.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.038+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~FQ82J2CJ4ZIX.1 size=1048576 2024-09-14T11:22:26.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.039+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~FQ82J2CJ4ZIX.2 size=890809 2024-09-14T11:22:26.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.039+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=FQ82J2CJ4ZIX tag=QOSWD6S85ETX type=write size=4036537 2024-09-14T11:22:26.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.040+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~4PR4FMWRJFJ7.0 size=141342 2024-09-14T11:22:26.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.042+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=4PR4FMWRJFJ7 tag=U696SM1UOU9Z type=write size=1189918 2024-09-14T11:22:26.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.043+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=8PQW8ENB62FA type=del size=2173130 2024-09-14T11:22:26.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.044+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~I3GTR5733QO0.0 size=221464 2024-09-14T11:22:26.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.046+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=I3GTR5733QO0 tag=0K2QX1HO18VY type=write size=1270040 2024-09-14T11:22:26.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.047+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=U2RB95EIF6O6 type=del size=2538342 2024-09-14T11:22:26.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.048+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~TDIMQZBW1V3C.0 size=44317 2024-09-14T11:22:26.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.050+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=TDIMQZBW1V3C tag=N6WUQ0FLB84L type=write size=1092893 2024-09-14T11:22:26.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.051+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=27CDFX5S5QBD type=del size=1523967 2024-09-14T11:22:26.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.053+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~DHUHZIHRM7VQ.0 size=193936 2024-09-14T11:22:26.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.055+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=DHUHZIHRM7VQ tag=ESHWF21TKMM5 type=write size=1242512 2024-09-14T11:22:26.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.057+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~31NTPFKSCGAM.0 size=1048576 2024-09-14T11:22:26.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.058+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~31NTPFKSCGAM.1 size=1048576 2024-09-14T11:22:26.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.059+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~31NTPFKSCGAM.2 size=512797 2024-09-14T11:22:26.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.059+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=31NTPFKSCGAM tag=P1V1TP364G37 type=write size=3658525 2024-09-14T11:22:26.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.060+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~0CI61DYAYX7F.0 size=1048576 2024-09-14T11:22:26.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.061+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~0CI61DYAYX7F.1 size=1048576 2024-09-14T11:22:26.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.062+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~0CI61DYAYX7F.2 size=700054 2024-09-14T11:22:26.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.064+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=0CI61DYAYX7F tag=TRUTKFKMCQK0 type=write size=3845782 2024-09-14T11:22:26.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.066+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~77NAMHJQERZD.0 size=438485 2024-09-14T11:22:26.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.066+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=77NAMHJQERZD tag=BUUP2J0TTS19 type=write size=1487061 2024-09-14T11:22:26.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.069+0000 7f43cc561780 1 < suggested update operation key=9XIAGZKIUBGH tag=SAAFZMBGMT6O type=del size=2796765 2024-09-14T11:22:26.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.070+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=4FXH9MT8Y7AQ type=del size=2128441 2024-09-14T11:22:26.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.071+0000 7f43cc561780 -1 < no bi entry to suggest for operation key=1M46U4U9MG1E tag=DNHN52U525CW type=del size=1513210: (2) No such file or directory 2024-09-14T11:22:26.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.072+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=LV805OJU12OS type=del size=1876997 2024-09-14T11:22:26.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.074+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=633KJV1IE7M3 type=del 2024-09-14T11:22:26.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.076+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~8TMSGGIMFFR1.0 size=1048576 2024-09-14T11:22:26.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.077+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~8TMSGGIMFFR1.1 size=503299 2024-09-14T11:22:26.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.077+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=8TMSGGIMFFR1 tag=2GDVWWT45D8B type=write size=2600451 2024-09-14T11:22:26.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.078+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~H0C3TTRKHOOE.0 size=1048576 2024-09-14T11:22:26.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.079+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~H0C3TTRKHOOE.1 size=1048576 2024-09-14T11:22:26.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.080+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~H0C3TTRKHOOE.2 size=453592 2024-09-14T11:22:26.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.082+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=H0C3TTRKHOOE tag=O1RVAXBW02NN type=write size=3599320 2024-09-14T11:22:26.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.084+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~3XJP7KWKAD79.0 size=1048576 2024-09-14T11:22:26.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.085+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~3XJP7KWKAD79.1 size=971068 2024-09-14T11:22:26.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.085+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=3XJP7KWKAD79 tag=BJLKOII49QYO type=write size=3068220 2024-09-14T11:22:26.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.087+0000 7f43cc561780 1 < completed write operation key=BRHP3DQEO3HZ tag=NGCFQ3UIZC95 type=write size=527405 2024-09-14T11:22:26.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.088+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=GRXC3JNAOI2O type=del size=2892342 2024-09-14T11:22:26.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.089+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~LBXFDKQAYC3L.0 size=1048576 2024-09-14T11:22:26.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.090+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~LBXFDKQAYC3L.1 size=1006523 2024-09-14T11:22:26.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.092+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=LBXFDKQAYC3L tag=88VYMQ5RRAZW type=write size=3103675 2024-09-14T11:22:26.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.093+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=KXETZLD04TNJ type=del size=3661430 2024-09-14T11:22:26.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.095+0000 7f43cc561780 1 < canceled operation key=683ZFW0BWMT7 tag=Z0OJN8NPJO9A type=del size=1208211 2024-09-14T11:22:26.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.097+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~NKO7SPDSSRED.0 size=1048576 2024-09-14T11:22:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.098+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~NKO7SPDSSRED.1 size=1048576 2024-09-14T11:22:26.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.099+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~NKO7SPDSSRED.2 size=227686 2024-09-14T11:22:26.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.099+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=NKO7SPDSSRED tag=07XOJBHHEAKG type=write size=3373414 2024-09-14T11:22:26.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.102+0000 7f43cc561780 1 < suggested remove operation key=0TDWJO4AWOOF tag=IRM35KZDCTXM type=del 2024-09-14T11:22:26.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.103+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=8YZOFZ82XF63 type=del size=3130238 2024-09-14T11:22:26.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.104+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=34OU8H445DPU type=del 2024-09-14T11:22:26.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.107+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=8TFC5L73AZCN type=del size=2832313 2024-09-14T11:22:26.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.108+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~FUF1P99NCLBB.0 size=1004580 2024-09-14T11:22:26.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.110+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=FUF1P99NCLBB tag=HRD2B41NWGSQ type=write size=2053156 2024-09-14T11:22:26.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.111+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=3TN12EBJWC7O type=del size=142224 2024-09-14T11:22:26.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.113+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~FQ82J2CJ4ZIX.0 size=1048576 2024-09-14T11:22:26.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.114+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~FQ82J2CJ4ZIX.1 size=1048576 2024-09-14T11:22:26.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.115+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~FQ82J2CJ4ZIX.2 size=890809 2024-09-14T11:22:26.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.117+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=FQ82J2CJ4ZIX tag=QOSWD6S85ETX type=write size=4036537 2024-09-14T11:22:26.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.119+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~W6UGU3M7IHW3.0 size=1048576 2024-09-14T11:22:26.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.120+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~W6UGU3M7IHW3.1 size=1048576 2024-09-14T11:22:26.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.121+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~W6UGU3M7IHW3.2 size=105082 2024-09-14T11:22:26.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.121+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=W6UGU3M7IHW3 tag=AR0A32AOO64R type=write size=3250810 2024-09-14T11:22:26.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.122+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=8PQW8ENB62FA type=del 2024-09-14T11:22:26.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.123+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=2GLGWQOPYQPU type=del size=2689778 2024-09-14T11:22:26.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.125+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=U2RB95EIF6O6 type=del size=2538342 2024-09-14T11:22:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.127+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~ZXDBKZOIZUTL.0 size=772370 2024-09-14T11:22:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.127+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=ZXDBKZOIZUTL tag=UAD628B7TX7N type=write size=1820946 2024-09-14T11:22:26.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.128+0000 7f43cc561780 -1 < failed to complete operation key=9XIAGZKIUBGH tag=27CDFX5S5QBD type=del size=1523967: (22) Invalid argument 2024-09-14T11:22:26.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.131+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~S3PQJAUU4EZH.0 size=1048576 2024-09-14T11:22:26.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.131+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~S3PQJAUU4EZH.1 size=1048576 2024-09-14T11:22:26.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.132+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~S3PQJAUU4EZH.2 size=73357 2024-09-14T11:22:26.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.132+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=S3PQJAUU4EZH tag=YOORA0WV41MR type=write size=3219085 2024-09-14T11:22:26.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.133+0000 7f43cc561780 1 < canceled part key=_multipart_S3NOACTF4K2W.2~31NTPFKSCGAM.0 size=1048576 2024-09-14T11:22:26.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.134+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~31NTPFKSCGAM.1 size=1048576 2024-09-14T11:22:26.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.135+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~31NTPFKSCGAM.2 size=512797 2024-09-14T11:22:26.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.137+0000 7f43cc561780 1 < canceled multipart upload key=S3NOACTF4K2W upload=31NTPFKSCGAM tag=P1V1TP364G37 type=write size=3658525 2024-09-14T11:22:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.138+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=6GCGFXKGRE55 type=del size=893723 2024-09-14T11:22:26.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.139+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~77NAMHJQERZD.0 size=438485 2024-09-14T11:22:26.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.141+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=77NAMHJQERZD tag=BUUP2J0TTS19 type=write size=1487061 2024-09-14T11:22:26.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.143+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=41ZABXUZKD00 type=del size=840418 2024-09-14T11:22:26.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.144+0000 7f43cc561780 1 < canceled operation key=D84127SVSIPL tag=4FXH9MT8Y7AQ type=del size=2128441 2024-09-14T11:22:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.146+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~CK8LUF5W2QZL.0 size=1048576 2024-09-14T11:22:26.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.147+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~CK8LUF5W2QZL.1 size=1048576 2024-09-14T11:22:26.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.148+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~CK8LUF5W2QZL.2 size=393137 2024-09-14T11:22:26.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.148+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=CK8LUF5W2QZL tag=O4G7VX5EK8AN type=write size=3538865 2024-09-14T11:22:26.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.149+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=LV805OJU12OS type=del 2024-09-14T11:22:26.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.150+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=P563K6D3MKC5 type=del size=125821 2024-09-14T11:22:26.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.151+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~8TMSGGIMFFR1.0 size=1048576 2024-09-14T11:22:26.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.152+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~8TMSGGIMFFR1.1 size=503299 2024-09-14T11:22:26.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.154+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=8TMSGGIMFFR1 tag=2GDVWWT45D8B type=write size=2600451 2024-09-14T11:22:26.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.155+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=DVHUR5JUDIJO type=del size=1688739 2024-09-14T11:22:26.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.157+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~3XJP7KWKAD79.0 size=1048576 2024-09-14T11:22:26.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.158+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~3XJP7KWKAD79.1 size=971068 2024-09-14T11:22:26.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.160+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=3XJP7KWKAD79 tag=BJLKOII49QYO type=write size=3068220 2024-09-14T11:22:26.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.161+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=DSKGB3VN99Q9 type=del size=3628747 2024-09-14T11:22:26.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.162+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=GRXC3JNAOI2O type=del 2024-09-14T11:22:26.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.163+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=09XB8VSYR44P type=write size=578556 2024-09-14T11:22:26.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.164+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=KXETZLD04TNJ type=del 2024-09-14T11:22:26.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.166+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=3FKXT4NED44L type=del size=1139857 2024-09-14T11:22:26.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.167+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~NKO7SPDSSRED.0 size=1048576 2024-09-14T11:22:26.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.168+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~NKO7SPDSSRED.1 size=1048576 2024-09-14T11:22:26.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.168+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~NKO7SPDSSRED.2 size=227686 2024-09-14T11:22:26.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.170+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=NKO7SPDSSRED tag=07XOJBHHEAKG type=write size=3373414 2024-09-14T11:22:26.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.172+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=ZRH7Q9GCN0Y1 type=write size=407917 2024-09-14T11:22:26.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.173+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=8YZOFZ82XF63 type=del 2024-09-14T11:22:26.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.175+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=9UIN07Y9YFI5 type=del size=4133366 2024-09-14T11:22:26.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.176+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=8TFC5L73AZCN type=del 2024-09-14T11:22:26.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.177+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=0UOVVYVGI1X0 type=del size=1701814 2024-09-14T11:22:26.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.178+0000 7f43cc561780 1 < canceled operation key=WSFZN6JCWUXG tag=3TN12EBJWC7O type=del size=142224 2024-09-14T11:22:26.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.179+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=3EQ6TC9CT9AI type=del size=4020673 2024-09-14T11:22:26.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.181+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~W6UGU3M7IHW3.0 size=1048576 2024-09-14T11:22:26.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.181+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~W6UGU3M7IHW3.1 size=1048576 2024-09-14T11:22:26.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.181+0000 7f43cc561780 1 < canceled part key=_multipart_AY7JGVM96MO7.2~W6UGU3M7IHW3.2 size=105082 2024-09-14T11:22:26.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.183+0000 7f43cc561780 1 < canceled multipart upload key=AY7JGVM96MO7 upload=W6UGU3M7IHW3 tag=AR0A32AOO64R type=write size=3250810 2024-09-14T11:22:26.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.184+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=IKHQJQBHKFN3 type=write size=439229 2024-09-14T11:22:26.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.186+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=2GLGWQOPYQPU type=del 2024-09-14T11:22:26.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.187+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=U2M8VFF0Z6EW type=del size=1283196 2024-09-14T11:22:26.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.188+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~ZXDBKZOIZUTL.0 size=772370 2024-09-14T11:22:26.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.190+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=ZXDBKZOIZUTL tag=UAD628B7TX7N type=write size=1820946 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.191+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=LWHDGHWWYKQP type=del size=3849102 2024-09-14T11:22:26.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.192+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~S3PQJAUU4EZH.0 size=1048576 2024-09-14T11:22:26.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.193+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~S3PQJAUU4EZH.1 size=1048576 2024-09-14T11:22:26.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.194+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~S3PQJAUU4EZH.2 size=73357 2024-09-14T11:22:26.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.196+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=S3PQJAUU4EZH tag=YOORA0WV41MR type=write size=3219085 2024-09-14T11:22:26.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.197+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=XCFRXEVP0XIS type=del size=2995973 2024-09-14T11:22:26.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.199+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=6GCGFXKGRE55 type=del 2024-09-14T11:22:26.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.200+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=A160K4HYXT3A type=write size=679295 2024-09-14T11:22:26.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.201+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=41ZABXUZKD00 type=del 2024-09-14T11:22:26.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.202+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=T23333FHDR7Z type=del size=3577548 2024-09-14T11:22:26.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.203+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~CK8LUF5W2QZL.0 size=1048576 2024-09-14T11:22:26.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.203+0000 7f43cc561780 1 < canceled part key=_multipart_IFHWMI5YO5L5.2~CK8LUF5W2QZL.1 size=1048576 2024-09-14T11:22:26.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.204+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~CK8LUF5W2QZL.2 size=393137 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.206+0000 7f43cc561780 1 < canceled multipart upload key=IFHWMI5YO5L5 upload=CK8LUF5W2QZL tag=O4G7VX5EK8AN type=write size=3538865 2024-09-14T11:22:26.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.207+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=0D74LVQ34DUE type=del size=2584903 2024-09-14T11:22:26.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.208+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=P563K6D3MKC5 type=del 2024-09-14T11:22:26.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.210+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=YOUDZERMP33E type=write size=233633 2024-09-14T11:22:26.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.211+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=DVHUR5JUDIJO type=del 2024-09-14T11:22:26.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.213+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~OCY7EN44LSNK.0 size=1048576 2024-09-14T11:22:26.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.214+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~OCY7EN44LSNK.1 size=981242 2024-09-14T11:22:26.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.214+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=OCY7EN44LSNK tag=6E1S6BNUWO3R type=write size=3078394 2024-09-14T11:22:26.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.215+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=DSKGB3VN99Q9 type=del 2024-09-14T11:22:26.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.219+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~QSHC2ZJJGOSX.0 size=1048576 2024-09-14T11:22:26.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.220+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~QSHC2ZJJGOSX.1 size=971992 2024-09-14T11:22:26.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.220+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=QSHC2ZJJGOSX tag=I61DSL64T3DE type=write size=3069144 2024-09-14T11:22:26.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.221+0000 7f43cc561780 1 < completed write operation key=D84127SVSIPL tag=09XB8VSYR44P type=write size=578556 2024-09-14T11:22:26.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.223+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~1YUWGWD5LFB7.0 size=1048576 2024-09-14T11:22:26.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.224+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~1YUWGWD5LFB7.1 size=1048576 2024-09-14T11:22:26.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.225+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~1YUWGWD5LFB7.2 size=875539 2024-09-14T11:22:26.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.225+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=1YUWGWD5LFB7 tag=X9N9Z2WOI6PK type=write size=4021267 2024-09-14T11:22:26.226 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.227+0000 7f43cc561780 1 < suggested update operation key=2975CNBC43ST tag=3FKXT4NED44L type=del size=1139857 2024-09-14T11:22:26.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.229+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=FQ6N2VBR84W0 type=del size=933426 2024-09-14T11:22:26.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.230+0000 7f43cc561780 1 < canceled operation key=A1B2LIZIPET3 tag=ZRH7Q9GCN0Y1 type=write size=407917 2024-09-14T11:22:26.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.231+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=4APUM9IBSFCF type=write size=986357 2024-09-14T11:22:26.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.232+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=9UIN07Y9YFI5 type=del 2024-09-14T11:22:26.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.234+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~7XWRH6FK26KY.0 size=1047229 2024-09-14T11:22:26.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.234+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=7XWRH6FK26KY tag=1RLTRI70NNOG type=write size=2095805 2024-09-14T11:22:26.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.235+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=0UOVVYVGI1X0 type=del 2024-09-14T11:22:26.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.237+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~3YD0N8H8POIL.0 size=1048576 2024-09-14T11:22:26.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.238+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~3YD0N8H8POIL.1 size=1048576 2024-09-14T11:22:26.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.239+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~3YD0N8H8POIL.2 size=742324 2024-09-14T11:22:26.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.239+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=3YD0N8H8POIL tag=3QKCQT8WEGPS type=write size=3888052 2024-09-14T11:22:26.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.241+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=3EQ6TC9CT9AI type=del 2024-09-14T11:22:26.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.242+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=AF7EWN0QD2T6 type=del size=2695884 2024-09-14T11:22:26.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.243+0000 7f43cc561780 1 < completed write operation key=9XIAGZKIUBGH tag=IKHQJQBHKFN3 type=write size=439229 2024-09-14T11:22:26.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.246+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~U5B8T48SNMXL.0 size=1048576 2024-09-14T11:22:26.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.247+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~U5B8T48SNMXL.1 size=694555 2024-09-14T11:22:26.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.247+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=U5B8T48SNMXL tag=3T355Q8D05S7 type=write size=2791707 2024-09-14T11:22:26.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.249+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=U2M8VFF0Z6EW type=del 2024-09-14T11:22:26.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.251+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~ZK3H0YQMDQZD.0 size=1048576 2024-09-14T11:22:26.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.252+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~ZK3H0YQMDQZD.1 size=1048576 2024-09-14T11:22:26.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.254+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~ZK3H0YQMDQZD.2 size=269117 2024-09-14T11:22:26.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.254+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=ZK3H0YQMDQZD tag=CLJRD6SBJSYS type=write size=3414845 2024-09-14T11:22:26.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.255+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=LWHDGHWWYKQP type=del 2024-09-14T11:22:26.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.257+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=GZQKFSH41RPW type=write size=876975 2024-09-14T11:22:26.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.259+0000 7f43cc561780 1 < suggested remove operation key=2975CNBC43ST tag=XCFRXEVP0XIS type=del 2024-09-14T11:22:26.260 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.262+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~Y2B5V706UNMQ.0 size=979929 2024-09-14T11:22:26.260 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.262+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=Y2B5V706UNMQ tag=65MR44L8IIDU type=write size=2028505 2024-09-14T11:22:26.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.263+0000 7f43cc561780 1 < completed write operation key=S3NOACTF4K2W tag=A160K4HYXT3A type=write size=679295 2024-09-14T11:22:26.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.265+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~SYAHV1KOTBE5.0 size=1048576 2024-09-14T11:22:26.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.266+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~SYAHV1KOTBE5.1 size=178027 2024-09-14T11:22:26.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.266+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=SYAHV1KOTBE5 tag=8HJZJPGGXUDQ type=write size=2275179 2024-09-14T11:22:26.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.267+0000 7f43cc561780 1 < canceled operation key=BNNSFLYOU27F tag=T23333FHDR7Z type=del size=3577548 2024-09-14T11:22:26.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.270+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~ZLWL142FVUVK.0 size=194479 2024-09-14T11:22:26.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.270+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=ZLWL142FVUVK tag=4R9N1UYUKTO0 type=write size=1243055 2024-09-14T11:22:26.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.271+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=0D74LVQ34DUE type=del 2024-09-14T11:22:26.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.272+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=CZPTGD650CUA type=del size=2889092 2024-09-14T11:22:26.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.274+0000 7f43cc561780 1 < suggested remove operation key=BNNSFLYOU27F tag=YOUDZERMP33E type=write 2024-09-14T11:22:26.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.276+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=3OPWEL1R9QA2 type=write size=317361 2024-09-14T11:22:26.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.277+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~OCY7EN44LSNK.0 size=1048576 2024-09-14T11:22:26.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.278+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~OCY7EN44LSNK.1 size=981242 2024-09-14T11:22:26.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.280+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=OCY7EN44LSNK tag=6E1S6BNUWO3R type=write size=3078394 2024-09-14T11:22:26.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.282+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~3JA7VXOMEQNX.0 size=1048576 2024-09-14T11:22:26.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.283+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~3JA7VXOMEQNX.1 size=1048576 2024-09-14T11:22:26.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.284+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~3JA7VXOMEQNX.2 size=427157 2024-09-14T11:22:26.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.284+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=3JA7VXOMEQNX tag=70CXVYWPXMOU type=write size=3572885 2024-09-14T11:22:26.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.285+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~QSHC2ZJJGOSX.0 size=1048576 2024-09-14T11:22:26.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.286+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~QSHC2ZJJGOSX.1 size=971992 2024-09-14T11:22:26.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.288+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=QSHC2ZJJGOSX tag=I61DSL64T3DE type=write size=3069144 2024-09-14T11:22:26.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.290+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~MR71WAWJKTYM.0 size=215725 2024-09-14T11:22:26.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.290+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=MR71WAWJKTYM tag=QM0J2F1AWZS4 type=write size=1264301 2024-09-14T11:22:26.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.292+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~1YUWGWD5LFB7.0 size=1048576 2024-09-14T11:22:26.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.293+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~1YUWGWD5LFB7.1 size=1048576 2024-09-14T11:22:26.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.294+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~1YUWGWD5LFB7.2 size=875539 2024-09-14T11:22:26.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.295+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=1YUWGWD5LFB7 tag=X9N9Z2WOI6PK type=write size=4021267 2024-09-14T11:22:26.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.298+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~6FKXC2KWC756.0 size=961927 2024-09-14T11:22:26.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.298+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=6FKXC2KWC756 tag=ORT7RO28MO4M type=write size=2010503 2024-09-14T11:22:26.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.299+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=FQ6N2VBR84W0 type=del 2024-09-14T11:22:26.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.300+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=8X2AIELZ05KN type=write size=887495 2024-09-14T11:22:26.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.301+0000 7f43cc561780 -1 < failed to complete operation key=2975CNBC43ST tag=4APUM9IBSFCF type=write size=986357: (22) Invalid argument 2024-09-14T11:22:26.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.304+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~HXLG4EG3ZMUP.0 size=614062 2024-09-14T11:22:26.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.304+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=HXLG4EG3ZMUP tag=EXY0F5HCL90F type=write size=1662638 2024-09-14T11:22:26.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.305+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~7XWRH6FK26KY.0 size=1047229 2024-09-14T11:22:26.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.307+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=7XWRH6FK26KY tag=1RLTRI70NNOG type=write size=2095805 2024-09-14T11:22:26.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.309+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~UT2KNYGNFN88.0 size=1048576 2024-09-14T11:22:26.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.310+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~UT2KNYGNFN88.1 size=65916 2024-09-14T11:22:26.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.310+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=UT2KNYGNFN88 tag=ZMICSPBKZ0VO type=write size=2163068 2024-09-14T11:22:26.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.311+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~3YD0N8H8POIL.0 size=1048576 2024-09-14T11:22:26.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.312+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~3YD0N8H8POIL.1 size=1048576 2024-09-14T11:22:26.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.313+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~3YD0N8H8POIL.2 size=742324 2024-09-14T11:22:26.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.315+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=3YD0N8H8POIL tag=3QKCQT8WEGPS type=write size=3888052 2024-09-14T11:22:26.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.317+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~QDZ1FJ5G023Y.0 size=1048576 2024-09-14T11:22:26.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.318+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~QDZ1FJ5G023Y.1 size=82325 2024-09-14T11:22:26.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.318+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=QDZ1FJ5G023Y tag=0KG9BYJRXAEV type=write size=2179477 2024-09-14T11:22:26.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.320+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=AF7EWN0QD2T6 type=del 2024-09-14T11:22:26.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.321+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=5HE815UL48TH type=write size=83418 2024-09-14T11:22:26.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.322+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~U5B8T48SNMXL.0 size=1048576 2024-09-14T11:22:26.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.323+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~U5B8T48SNMXL.1 size=694555 2024-09-14T11:22:26.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.325+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=U5B8T48SNMXL tag=3T355Q8D05S7 type=write size=2791707 2024-09-14T11:22:26.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.327+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~XEFOUDYIDQ7N.0 size=1048576 2024-09-14T11:22:26.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.328+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~XEFOUDYIDQ7N.1 size=85108 2024-09-14T11:22:26.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.328+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=XEFOUDYIDQ7N tag=DPKATD6TDVB1 type=write size=2182260 2024-09-14T11:22:26.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.329+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~ZK3H0YQMDQZD.0 size=1048576 2024-09-14T11:22:26.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.331+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~ZK3H0YQMDQZD.1 size=1048576 2024-09-14T11:22:26.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.332+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~ZK3H0YQMDQZD.2 size=269117 2024-09-14T11:22:26.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.334+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=ZK3H0YQMDQZD tag=CLJRD6SBJSYS type=write size=3414845 2024-09-14T11:22:26.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.336+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=Z8H9EQGY2U2B type=del size=830443 2024-09-14T11:22:26.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.338+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=GZQKFSH41RPW type=write size=876975 2024-09-14T11:22:26.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.340+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=0MNC377NLL2Z type=write size=536829 2024-09-14T11:22:26.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.341+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~Y2B5V706UNMQ.0 size=979929 2024-09-14T11:22:26.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.343+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=Y2B5V706UNMQ tag=65MR44L8IIDU type=write size=2028505 2024-09-14T11:22:26.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.344+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=ZT0B4ZVIS5LN type=del size=629630 2024-09-14T11:22:26.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.345+0000 7f43cc561780 1 < canceled part key=_multipart_MD14RGOQY0LK.2~SYAHV1KOTBE5.0 size=1048576 2024-09-14T11:22:26.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.346+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~SYAHV1KOTBE5.1 size=178027 2024-09-14T11:22:26.347 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.348+0000 7f43cc561780 1 < canceled multipart upload key=MD14RGOQY0LK upload=SYAHV1KOTBE5 tag=8HJZJPGGXUDQ type=write size=2275179 2024-09-14T11:22:26.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.349+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=IVFVFLIF6H77 type=del size=2077154 2024-09-14T11:22:26.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.350+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~ZLWL142FVUVK.0 size=194479 2024-09-14T11:22:26.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.352+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=ZLWL142FVUVK tag=4R9N1UYUKTO0 type=write size=1243055 2024-09-14T11:22:26.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.353+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=MMYTYL8S8R20 type=del size=1994216 2024-09-14T11:22:26.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.355+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=CZPTGD650CUA type=del 2024-09-14T11:22:26.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.357+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~H33FHYLNXH23.0 size=1048576 2024-09-14T11:22:26.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.358+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~H33FHYLNXH23.1 size=901504 2024-09-14T11:22:26.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.358+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=H33FHYLNXH23 tag=8JJDCUOBJXUB type=write size=2998656 2024-09-14T11:22:26.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.359+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=3OPWEL1R9QA2 type=write size=317361 2024-09-14T11:22:26.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.360+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=0J9BMS52RBYK type=del size=3521894 2024-09-14T11:22:26.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.360+0000 7f43cc561780 1 < canceled part key=_multipart_OJOJZBG1WEGI.2~3JA7VXOMEQNX.0 size=1048576 2024-09-14T11:22:26.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.361+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~3JA7VXOMEQNX.1 size=1048576 2024-09-14T11:22:26.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.362+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~3JA7VXOMEQNX.2 size=427157 2024-09-14T11:22:26.363 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.364+0000 7f43cc561780 1 < canceled multipart upload key=OJOJZBG1WEGI upload=3JA7VXOMEQNX tag=70CXVYWPXMOU type=write size=3572885 2024-09-14T11:22:26.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.365+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=X3L5IS98C433 type=del size=432167 2024-09-14T11:22:26.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.366+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~MR71WAWJKTYM.0 size=215725 2024-09-14T11:22:26.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.368+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=MR71WAWJKTYM tag=QM0J2F1AWZS4 type=write size=1264301 2024-09-14T11:22:26.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.370+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=A8V88VZKXQ80 type=del size=3208249 2024-09-14T11:22:26.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.371+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~6FKXC2KWC756.0 size=961927 2024-09-14T11:22:26.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.373+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=6FKXC2KWC756 tag=ORT7RO28MO4M type=write size=2010503 2024-09-14T11:22:26.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.374+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=GV40VNOVZAKL type=del size=2323811 2024-09-14T11:22:26.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.375+0000 7f43cc561780 1 < completed write operation key=D8EBH4NWN7SK tag=8X2AIELZ05KN type=write size=887495 2024-09-14T11:22:26.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.376+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=AXVW5092EMWI type=del size=1056078 2024-09-14T11:22:26.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.378+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~HXLG4EG3ZMUP.0 size=614062 2024-09-14T11:22:26.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.379+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=HXLG4EG3ZMUP tag=EXY0F5HCL90F type=write size=1662638 2024-09-14T11:22:26.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.381+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=FX75HQNW0D3Y type=del size=336227 2024-09-14T11:22:26.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.382+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~UT2KNYGNFN88.0 size=1048576 2024-09-14T11:22:26.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.383+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~UT2KNYGNFN88.1 size=65916 2024-09-14T11:22:26.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.385+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=UT2KNYGNFN88 tag=ZMICSPBKZ0VO type=write size=2163068 2024-09-14T11:22:26.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.387+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~9GV6IT6UQIPT.0 size=413076 2024-09-14T11:22:26.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.387+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=9GV6IT6UQIPT tag=F4YJ2H9W7N1G type=write size=1461652 2024-09-14T11:22:26.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.388+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~QDZ1FJ5G023Y.0 size=1048576 2024-09-14T11:22:26.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.389+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~QDZ1FJ5G023Y.1 size=82325 2024-09-14T11:22:26.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.391+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=QDZ1FJ5G023Y tag=0KG9BYJRXAEV type=write size=2179477 2024-09-14T11:22:26.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.392+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=LTBCO0K23M1C type=del size=1016374 2024-09-14T11:22:26.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.393+0000 7f43cc561780 1 < completed write operation key=W679WIFVPVOH tag=5HE815UL48TH type=write size=83418 2024-09-14T11:22:26.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.395+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=5BQ8PX61RWR9 type=del size=22666 2024-09-14T11:22:26.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.396+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~XEFOUDYIDQ7N.0 size=1048576 2024-09-14T11:22:26.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.397+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~XEFOUDYIDQ7N.1 size=85108 2024-09-14T11:22:26.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.399+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=XEFOUDYIDQ7N tag=DPKATD6TDVB1 type=write size=2182260 2024-09-14T11:22:26.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.400+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=B41O0NOX06BR type=del size=2684615 2024-09-14T11:22:26.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.401+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=Z8H9EQGY2U2B type=del 2024-09-14T11:22:26.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.403+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~B7U2661JC9XC.0 size=1048576 2024-09-14T11:22:26.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.404+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~B7U2661JC9XC.1 size=1048576 2024-09-14T11:22:26.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.405+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~B7U2661JC9XC.2 size=428944 2024-09-14T11:22:26.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.405+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=B7U2661JC9XC tag=00FUWJ4K44D1 type=write size=3574672 2024-09-14T11:22:26.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.406+0000 7f43cc561780 1 < canceled operation key=S3NOACTF4K2W tag=0MNC377NLL2Z type=write size=536829 2024-09-14T11:22:26.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.407+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=NBYA1JFA26D0 type=write size=153372 2024-09-14T11:22:26.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.409+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=ZT0B4ZVIS5LN type=del 2024-09-14T11:22:26.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.410+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=OUIIY6E20GL4 type=del size=1736840 2024-09-14T11:22:26.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.411+0000 7f43cc561780 1 < canceled operation key=IFHWMI5YO5L5 tag=IVFVFLIF6H77 type=del size=2077154 2024-09-14T11:22:26.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.412+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=V7C90SX65Z6U type=del size=1758864 2024-09-14T11:22:26.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.414+0000 7f43cc561780 1 < suggested update operation key=END3SHHS0FSA tag=MMYTYL8S8R20 type=del size=1994216 2024-09-14T11:22:26.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.417+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~IFJ7648ONJBC.0 size=1048576 2024-09-14T11:22:26.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.418+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~IFJ7648ONJBC.1 size=1048576 2024-09-14T11:22:26.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.418+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~IFJ7648ONJBC.2 size=89504 2024-09-14T11:22:26.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.418+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=IFJ7648ONJBC tag=IZJ30WMAC1QK type=write size=3235232 2024-09-14T11:22:26.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.420+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~H33FHYLNXH23.0 size=1048576 2024-09-14T11:22:26.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.421+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~H33FHYLNXH23.1 size=901504 2024-09-14T11:22:26.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.423+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=H33FHYLNXH23 tag=8JJDCUOBJXUB type=write size=2998656 2024-09-14T11:22:26.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.424+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=246Q9WK70JQ6 type=del size=2793988 2024-09-14T11:22:26.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.425+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=0J9BMS52RBYK type=del 2024-09-14T11:22:26.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.426+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=RB12UZ52W3E0 type=write size=99700 2024-09-14T11:22:26.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.427+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=X3L5IS98C433 type=del 2024-09-14T11:22:26.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.428+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=Z1JLAUOKUAMI type=del size=720007 2024-09-14T11:22:26.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.430+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=A8V88VZKXQ80 type=del 2024-09-14T11:22:26.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.431+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=SULVUNZ0CULR type=del size=1456103 2024-09-14T11:22:26.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.432+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=GV40VNOVZAKL type=del 2024-09-14T11:22:26.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.433+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=9S0UMHKUDAIL type=del size=2879070 2024-09-14T11:22:26.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.435+0000 7f43cc561780 1 < suggested update operation key=OJOJZBG1WEGI tag=AXVW5092EMWI type=del size=1056078 2024-09-14T11:22:26.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.437+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~4Y8GLJ41EGS0.0 size=1048576 2024-09-14T11:22:26.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.438+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~4Y8GLJ41EGS0.1 size=353479 2024-09-14T11:22:26.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.438+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=4Y8GLJ41EGS0 tag=0N4B48KXY5HH type=write size=2450631 2024-09-14T11:22:26.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.439+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=FX75HQNW0D3Y type=del 2024-09-14T11:22:26.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.441+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=4S7PAL8MV8TI type=del size=3530299 2024-09-14T11:22:26.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.443+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~9GV6IT6UQIPT.0 size=413076 2024-09-14T11:22:26.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.445+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=9GV6IT6UQIPT tag=F4YJ2H9W7N1G type=write size=1461652 2024-09-14T11:22:26.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.446+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=BDUK6516GOID type=del size=1280104 2024-09-14T11:22:26.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.447+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=LTBCO0K23M1C type=del 2024-09-14T11:22:26.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.449+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~PIO0TG0661PU.0 size=662181 2024-09-14T11:22:26.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.449+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=PIO0TG0661PU tag=74XBQE36BC0H type=write size=1710757 2024-09-14T11:22:26.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.450+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=5BQ8PX61RWR9 type=del 2024-09-14T11:22:26.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.452+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~7FFD71RP5N6Y.0 size=1048576 2024-09-14T11:22:26.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.453+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~7FFD71RP5N6Y.1 size=1048576 2024-09-14T11:22:26.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.454+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~7FFD71RP5N6Y.2 size=961760 2024-09-14T11:22:26.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.454+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=7FFD71RP5N6Y tag=QGFHZPJZJZ8K type=write size=4107488 2024-09-14T11:22:26.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.455+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=B41O0NOX06BR type=del 2024-09-14T11:22:26.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.457+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~SSYI8MIRDI4O.0 size=629342 2024-09-14T11:22:26.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.457+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=SSYI8MIRDI4O tag=G4N1468CF2A7 type=write size=1677918 2024-09-14T11:22:26.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.458+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~B7U2661JC9XC.0 size=1048576 2024-09-14T11:22:26.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.459+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~B7U2661JC9XC.1 size=1048576 2024-09-14T11:22:26.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.459+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~B7U2661JC9XC.2 size=428944 2024-09-14T11:22:26.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.461+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=B7U2661JC9XC tag=00FUWJ4K44D1 type=write size=3574672 2024-09-14T11:22:26.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.463+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~3IX88YTUQLZE.0 size=1048576 2024-09-14T11:22:26.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.464+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~3IX88YTUQLZE.1 size=78428 2024-09-14T11:22:26.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.464+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=3IX88YTUQLZE tag=9H6DJGJ23994 type=write size=2175580 2024-09-14T11:22:26.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.466+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=NBYA1JFA26D0 type=write size=153372 2024-09-14T11:22:26.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.468+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~QDO7ANRGC1F8.0 size=1048576 2024-09-14T11:22:26.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.469+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~QDO7ANRGC1F8.1 size=702331 2024-09-14T11:22:26.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.469+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=QDO7ANRGC1F8 tag=YXH367G3GUY6 type=write size=2799483 2024-09-14T11:22:26.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.470+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=OUIIY6E20GL4 type=del 2024-09-14T11:22:26.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.472+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~GSR2IA7BVJHK.0 size=1048576 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.473+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~GSR2IA7BVJHK.1 size=583688 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.473+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=GSR2IA7BVJHK tag=73EOWTBHZQDT type=write size=2680840 2024-09-14T11:22:26.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.474+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=V7C90SX65Z6U type=del 2024-09-14T11:22:26.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.475+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=1K9WBDWAESW0 type=del size=3768745 2024-09-14T11:22:26.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.476+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~IFJ7648ONJBC.0 size=1048576 2024-09-14T11:22:26.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.476+0000 7f43cc561780 1 < canceled part key=_multipart_D84127SVSIPL.2~IFJ7648ONJBC.1 size=1048576 2024-09-14T11:22:26.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.477+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~IFJ7648ONJBC.2 size=89504 2024-09-14T11:22:26.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.479+0000 7f43cc561780 1 < canceled multipart upload key=D84127SVSIPL upload=IFJ7648ONJBC tag=IZJ30WMAC1QK type=write size=3235232 2024-09-14T11:22:26.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.480+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=DN240LEY7YVR type=del size=3317403 2024-09-14T11:22:26.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.482+0000 7f43cc561780 1 < suggested remove operation key=WSFZN6JCWUXG tag=246Q9WK70JQ6 type=del 2024-09-14T11:22:26.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.485+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~G7NFRQEATIZB.0 size=1048576 2024-09-14T11:22:26.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.485+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~G7NFRQEATIZB.1 size=1048576 2024-09-14T11:22:26.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.487+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~G7NFRQEATIZB.2 size=436272 2024-09-14T11:22:26.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.487+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=G7NFRQEATIZB tag=04076F5GUK92 type=write size=3582000 2024-09-14T11:22:26.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.488+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=RB12UZ52W3E0 type=write size=99700 2024-09-14T11:22:26.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.490+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~HUSZ3NQ1Q4SX.0 size=430051 2024-09-14T11:22:26.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.490+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=HUSZ3NQ1Q4SX tag=3ZGWGSY3AX38 type=write size=1478627 2024-09-14T11:22:26.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.491+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=Z1JLAUOKUAMI type=del 2024-09-14T11:22:26.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.492+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=A6J0WM3AJ9PW type=del size=4123080 2024-09-14T11:22:26.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.494+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=SULVUNZ0CULR type=del 2024-09-14T11:22:26.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.496+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NL3AOJGAMYG0.0 size=1048576 2024-09-14T11:22:26.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.497+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NL3AOJGAMYG0.1 size=1048576 2024-09-14T11:22:26.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.498+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NL3AOJGAMYG0.2 size=1031985 2024-09-14T11:22:26.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.498+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=NL3AOJGAMYG0 tag=X885VBCGX8XU type=write size=4177713 2024-09-14T11:22:26.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.499+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=9S0UMHKUDAIL type=del 2024-09-14T11:22:26.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.500+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=MWQ03IKM0003 type=del size=3636289 2024-09-14T11:22:26.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.502+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~4Y8GLJ41EGS0.0 size=1048576 2024-09-14T11:22:26.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.503+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~4Y8GLJ41EGS0.1 size=353479 2024-09-14T11:22:26.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.504+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=4Y8GLJ41EGS0 tag=0N4B48KXY5HH type=write size=2450631 2024-09-14T11:22:26.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.507+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~1L4GB3D6XAK5.0 size=1048576 2024-09-14T11:22:26.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.508+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~1L4GB3D6XAK5.1 size=1048576 2024-09-14T11:22:26.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.509+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~1L4GB3D6XAK5.2 size=110022 2024-09-14T11:22:26.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.509+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=1L4GB3D6XAK5 tag=MT2954OVX7PD type=write size=3255750 2024-09-14T11:22:26.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.510+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=4S7PAL8MV8TI type=del 2024-09-14T11:22:26.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.511+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=Z2Q7VPIH9H3D type=del size=3674410 2024-09-14T11:22:26.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.512+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=BDUK6516GOID type=del 2024-09-14T11:22:26.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.515+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~A58IQ8B2RL2A.0 size=1048576 2024-09-14T11:22:26.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.516+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~A58IQ8B2RL2A.1 size=1048576 2024-09-14T11:22:26.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.517+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~A58IQ8B2RL2A.2 size=866659 2024-09-14T11:22:26.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.517+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=A58IQ8B2RL2A tag=YDR4LYPCC87A type=write size=4012387 2024-09-14T11:22:26.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.518+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~PIO0TG0661PU.0 size=662181 2024-09-14T11:22:26.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.520+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=PIO0TG0661PU tag=74XBQE36BC0H type=write size=1710757 2024-09-14T11:22:26.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.521+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=8ODFY2C09XAJ type=del size=3507175 2024-09-14T11:22:26.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.523+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~7FFD71RP5N6Y.0 size=1048576 2024-09-14T11:22:26.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.523+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~7FFD71RP5N6Y.1 size=1048576 2024-09-14T11:22:26.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.524+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~7FFD71RP5N6Y.2 size=961760 2024-09-14T11:22:26.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.527+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=7FFD71RP5N6Y tag=QGFHZPJZJZ8K type=write size=4107488 2024-09-14T11:22:26.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.528+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=Q2ZMII670FRQ type=del size=2865135 2024-09-14T11:22:26.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.529+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~SSYI8MIRDI4O.0 size=629342 2024-09-14T11:22:26.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.531+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=SSYI8MIRDI4O tag=G4N1468CF2A7 type=write size=1677918 2024-09-14T11:22:26.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.533+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~R6GBG1DY13PD.0 size=1048576 2024-09-14T11:22:26.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.534+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~R6GBG1DY13PD.1 size=1048576 2024-09-14T11:22:26.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.535+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~R6GBG1DY13PD.2 size=145499 2024-09-14T11:22:26.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.535+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=R6GBG1DY13PD tag=S65T2NVQBATL type=write size=3291227 2024-09-14T11:22:26.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.536+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~3IX88YTUQLZE.0 size=1048576 2024-09-14T11:22:26.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.537+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~3IX88YTUQLZE.1 size=78428 2024-09-14T11:22:26.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.539+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=3IX88YTUQLZE tag=9H6DJGJ23994 type=write size=2175580 2024-09-14T11:22:26.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.540+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=LVEIAGKRS0VJ type=write size=726074 2024-09-14T11:22:26.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.541+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~QDO7ANRGC1F8.0 size=1048576 2024-09-14T11:22:26.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.542+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~QDO7ANRGC1F8.1 size=702331 2024-09-14T11:22:26.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.544+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=QDO7ANRGC1F8 tag=YXH367G3GUY6 type=write size=2799483 2024-09-14T11:22:26.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.547+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~NUN9QJYY84DN.0 size=1048576 2024-09-14T11:22:26.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.547+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~NUN9QJYY84DN.1 size=532689 2024-09-14T11:22:26.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.548+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=NUN9QJYY84DN tag=DBNY0OKUSZQ7 type=write size=2629841 2024-09-14T11:22:26.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.550+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~GSR2IA7BVJHK.0 size=1048576 2024-09-14T11:22:26.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.551+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~GSR2IA7BVJHK.1 size=583688 2024-09-14T11:22:26.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.553+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=GSR2IA7BVJHK tag=73EOWTBHZQDT type=write size=2680840 2024-09-14T11:22:26.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.555+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~T2ZHZHKS3MHN.0 size=1048576 2024-09-14T11:22:26.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.556+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~T2ZHZHKS3MHN.1 size=645330 2024-09-14T11:22:26.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.556+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=T2ZHZHKS3MHN tag=B7SIMJDCRB1K type=write size=2742482 2024-09-14T11:22:26.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.557+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=1K9WBDWAESW0 type=del 2024-09-14T11:22:26.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.558+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=IHBBRY4NZ16H type=del size=2193800 2024-09-14T11:22:26.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.559+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=DN240LEY7YVR type=del 2024-09-14T11:22:26.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.560+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=E2CI0I9C7ZQ8 type=write size=968072 2024-09-14T11:22:26.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.562+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~G7NFRQEATIZB.0 size=1048576 2024-09-14T11:22:26.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.563+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~G7NFRQEATIZB.1 size=1048576 2024-09-14T11:22:26.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.563+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~G7NFRQEATIZB.2 size=436272 2024-09-14T11:22:26.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.565+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=G7NFRQEATIZB tag=04076F5GUK92 type=write size=3582000 2024-09-14T11:22:26.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.567+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=BXAC3TN24YP4 type=del size=2711375 2024-09-14T11:22:26.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.568+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~HUSZ3NQ1Q4SX.0 size=430051 2024-09-14T11:22:26.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.570+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=HUSZ3NQ1Q4SX tag=3ZGWGSY3AX38 type=write size=1478627 2024-09-14T11:22:26.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.572+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~XLR0NTW0N2M8.0 size=548282 2024-09-14T11:22:26.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.572+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=XLR0NTW0N2M8 tag=SGDN068YYH07 type=write size=1596858 2024-09-14T11:22:26.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.574+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=A6J0WM3AJ9PW type=del 2024-09-14T11:22:26.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.576+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=13OHF41E4JIM type=del size=22612 2024-09-14T11:22:26.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.577+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NL3AOJGAMYG0.0 size=1048576 2024-09-14T11:22:26.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.578+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NL3AOJGAMYG0.1 size=1048576 2024-09-14T11:22:26.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.579+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NL3AOJGAMYG0.2 size=1031985 2024-09-14T11:22:26.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.581+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=NL3AOJGAMYG0 tag=X885VBCGX8XU type=write size=4177713 2024-09-14T11:22:26.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.583+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~77FVGJ7OFFTY.0 size=561500 2024-09-14T11:22:26.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.583+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=77FVGJ7OFFTY tag=WFGDYIE2PB9A type=write size=1610076 2024-09-14T11:22:26.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.585+0000 7f43cc561780 1 < suggested update operation key=15F3ZZAAKT9B tag=MWQ03IKM0003 type=del size=3636289 2024-09-14T11:22:26.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.586+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=K847USMKQA3F type=del size=2421592 2024-09-14T11:22:26.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.588+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~1L4GB3D6XAK5.0 size=1048576 2024-09-14T11:22:26.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.589+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~1L4GB3D6XAK5.1 size=1048576 2024-09-14T11:22:26.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.589+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~1L4GB3D6XAK5.2 size=110022 2024-09-14T11:22:26.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.591+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=1L4GB3D6XAK5 tag=MT2954OVX7PD type=write size=3255750 2024-09-14T11:22:26.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.594+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~PBRPUYQ4182G.0 size=1048576 2024-09-14T11:22:26.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.594+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~PBRPUYQ4182G.1 size=1033368 2024-09-14T11:22:26.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.594+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=PBRPUYQ4182G tag=81UR9H0PECRA type=write size=3130520 2024-09-14T11:22:26.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.596+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=Z2Q7VPIH9H3D type=del 2024-09-14T11:22:26.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.597+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=QKLTCQQRXN47 type=del size=1356988 2024-09-14T11:22:26.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.598+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~A58IQ8B2RL2A.0 size=1048576 2024-09-14T11:22:26.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.599+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~A58IQ8B2RL2A.1 size=1048576 2024-09-14T11:22:26.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.600+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~A58IQ8B2RL2A.2 size=866659 2024-09-14T11:22:26.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.602+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=A58IQ8B2RL2A tag=YDR4LYPCC87A type=write size=4012387 2024-09-14T11:22:26.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.603+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=OX6ECGV17RF3 type=write size=257869 2024-09-14T11:22:26.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.606+0000 7f43cc561780 1 < suggested remove operation key=OV4ATW747PY4 tag=8ODFY2C09XAJ type=del 2024-09-14T11:22:26.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.607+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=0B9C9T4N0CGD type=del size=3691014 2024-09-14T11:22:26.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.608+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=Q2ZMII670FRQ type=del 2024-09-14T11:22:26.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.610+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WUHUP6NVLH70.0 size=1048576 2024-09-14T11:22:26.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.611+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WUHUP6NVLH70.1 size=1048576 2024-09-14T11:22:26.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.612+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WUHUP6NVLH70.2 size=611410 2024-09-14T11:22:26.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.612+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=WUHUP6NVLH70 tag=F8471IC4H5BQ type=write size=3757138 2024-09-14T11:22:26.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.613+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~R6GBG1DY13PD.0 size=1048576 2024-09-14T11:22:26.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.613+0000 7f43cc561780 1 < canceled part key=_multipart_80ZYEEE1EE78.2~R6GBG1DY13PD.1 size=1048576 2024-09-14T11:22:26.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.614+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~R6GBG1DY13PD.2 size=145499 2024-09-14T11:22:26.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.616+0000 7f43cc561780 1 < canceled multipart upload key=80ZYEEE1EE78 upload=R6GBG1DY13PD tag=S65T2NVQBATL type=write size=3291227 2024-09-14T11:22:26.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.618+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=EQAX5UHMSW0N type=write size=693106 2024-09-14T11:22:26.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.619+0000 7f43cc561780 -1 < failed to complete operation key=D84127SVSIPL tag=LVEIAGKRS0VJ type=write size=726074: (22) Invalid argument 2024-09-14T11:22:26.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.620+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=PF8RQMA8U9JA type=del size=3914978 2024-09-14T11:22:26.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.620+0000 7f43cc561780 1 < canceled part key=_multipart_AWBBRU4C8RDQ.2~NUN9QJYY84DN.0 size=1048576 2024-09-14T11:22:26.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.621+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~NUN9QJYY84DN.1 size=532689 2024-09-14T11:22:26.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.623+0000 7f43cc561780 1 < canceled multipart upload key=AWBBRU4C8RDQ upload=NUN9QJYY84DN tag=DBNY0OKUSZQ7 type=write size=2629841 2024-09-14T11:22:26.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.624+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=R19ULJPRI6TE type=del size=3207662 2024-09-14T11:22:26.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.626+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~T2ZHZHKS3MHN.0 size=1048576 2024-09-14T11:22:26.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.627+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~T2ZHZHKS3MHN.1 size=645330 2024-09-14T11:22:26.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.629+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=T2ZHZHKS3MHN tag=B7SIMJDCRB1K type=write size=2742482 2024-09-14T11:22:26.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.630+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=3JCHG2TTH4QD type=del size=3463606 2024-09-14T11:22:26.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.631+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=IHBBRY4NZ16H type=del 2024-09-14T11:22:26.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.633+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~T6TD4P1A3LBL.0 size=36923 2024-09-14T11:22:26.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.633+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=T6TD4P1A3LBL tag=XLJN1NYMYK2S type=write size=1085499 2024-09-14T11:22:26.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.636+0000 7f43cc561780 1 < suggested remove operation key=IG4QM506P41B tag=E2CI0I9C7ZQ8 type=write 2024-09-14T11:22:26.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.637+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=7GSTZG7F1UIR type=del size=1577189 2024-09-14T11:22:26.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.638+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=BXAC3TN24YP4 type=del 2024-09-14T11:22:26.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.639+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=6H3GT6X38ZX5 type=del size=3461205 2024-09-14T11:22:26.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.641+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~XLR0NTW0N2M8.0 size=548282 2024-09-14T11:22:26.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.643+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=XLR0NTW0N2M8 tag=SGDN068YYH07 type=write size=1596858 2024-09-14T11:22:26.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.645+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~YKTHT1KIHG5Q.0 size=115190 2024-09-14T11:22:26.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.645+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=YKTHT1KIHG5Q tag=WNOFLVMXVJCS type=write size=1163766 2024-09-14T11:22:26.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.647+0000 7f43cc561780 1 < suggested remove operation key=683ZFW0BWMT7 tag=13OHF41E4JIM type=del 2024-09-14T11:22:26.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.649+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=YRBGG5OFG2T0 type=del size=1805610 2024-09-14T11:22:26.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.650+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~77FVGJ7OFFTY.0 size=561500 2024-09-14T11:22:26.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.652+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=77FVGJ7OFFTY tag=WFGDYIE2PB9A type=write size=1610076 2024-09-14T11:22:26.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.654+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~5W3QQZE4MPBZ.0 size=1048576 2024-09-14T11:22:26.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.655+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~5W3QQZE4MPBZ.1 size=1048576 2024-09-14T11:22:26.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.656+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~5W3QQZE4MPBZ.2 size=639594 2024-09-14T11:22:26.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.656+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=5W3QQZE4MPBZ tag=A1WQOYJ1NJI9 type=write size=3785322 2024-09-14T11:22:26.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.657+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=K847USMKQA3F type=del 2024-09-14T11:22:26.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.658+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=CO9Y9XIKHPZV type=del size=2226759 2024-09-14T11:22:26.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.661+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~PBRPUYQ4182G.0 size=1048576 2024-09-14T11:22:26.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.662+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~PBRPUYQ4182G.1 size=1033368 2024-09-14T11:22:26.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.663+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=PBRPUYQ4182G tag=81UR9H0PECRA type=write size=3130520 2024-09-14T11:22:26.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.666+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~9YMZBQDX869S.0 size=1048576 2024-09-14T11:22:26.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.666+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~9YMZBQDX869S.1 size=1048576 2024-09-14T11:22:26.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.667+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~9YMZBQDX869S.2 size=467488 2024-09-14T11:22:26.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.667+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=9YMZBQDX869S tag=K779IYK8CQBP type=write size=3613216 2024-09-14T11:22:26.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.670+0000 7f43cc561780 1 < suggested remove operation key=IFHWMI5YO5L5 tag=QKLTCQQRXN47 type=del 2024-09-14T11:22:26.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.672+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~NYC8EJ50ZBZW.0 size=1048576 2024-09-14T11:22:26.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.673+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~NYC8EJ50ZBZW.1 size=164613 2024-09-14T11:22:26.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.673+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=NYC8EJ50ZBZW tag=TTAQZIQ8HOUR type=write size=2261765 2024-09-14T11:22:26.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.674+0000 7f43cc561780 1 < completed write operation key=BZDW69C3Z97G tag=OX6ECGV17RF3 type=write size=257869 2024-09-14T11:22:26.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.675+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=GNGYX70760X5 type=del size=3085038 2024-09-14T11:22:26.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.676+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=0B9C9T4N0CGD type=del 2024-09-14T11:22:26.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.679+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~09KCZEMMYKW4.0 size=772777 2024-09-14T11:22:26.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.679+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=09KCZEMMYKW4 tag=4I4QVD606IYZ type=write size=1821353 2024-09-14T11:22:26.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.679+0000 7f43cc561780 1 < canceled part key=_multipart_0TDWJO4AWOOF.2~WUHUP6NVLH70.0 size=1048576 2024-09-14T11:22:26.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.680+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~WUHUP6NVLH70.1 size=1048576 2024-09-14T11:22:26.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.680+0000 7f43cc561780 1 < canceled part key=_multipart_0TDWJO4AWOOF.2~WUHUP6NVLH70.2 size=611410 2024-09-14T11:22:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.682+0000 7f43cc561780 1 < canceled multipart upload key=0TDWJO4AWOOF upload=WUHUP6NVLH70 tag=F8471IC4H5BQ type=write size=3757138 2024-09-14T11:22:26.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.683+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=UUGMQR52ML53 type=del size=1928057 2024-09-14T11:22:26.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.684+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=EQAX5UHMSW0N type=write size=693106 2024-09-14T11:22:26.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.685+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=SG2QUK8P7VNA type=del size=705963 2024-09-14T11:22:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.686+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=PF8RQMA8U9JA type=del 2024-09-14T11:22:26.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.687+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=SZ1XG6JBYHO4 type=del size=716386 2024-09-14T11:22:26.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.688+0000 7f43cc561780 1 < canceled operation key=BRHP3DQEO3HZ tag=R19ULJPRI6TE type=del size=3207662 2024-09-14T11:22:26.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.690+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~FWWY6EDG9WPC.0 size=1048576 2024-09-14T11:22:26.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.691+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~FWWY6EDG9WPC.1 size=462572 2024-09-14T11:22:26.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.691+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=FWWY6EDG9WPC tag=8U17MWR8WTER type=write size=2559724 2024-09-14T11:22:26.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.692+0000 7f43cc561780 1 < canceled operation key=G6B4CGUBFSOT tag=3JCHG2TTH4QD type=del size=3463606 2024-09-14T11:22:26.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.693+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=V3SSY3IC1OYQ type=del size=2830876 2024-09-14T11:22:26.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.695+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~T6TD4P1A3LBL.0 size=36923 2024-09-14T11:22:26.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.696+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=T6TD4P1A3LBL tag=XLJN1NYMYK2S type=write size=1085499 2024-09-14T11:22:26.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.698+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~QKU3ME0COQQ1.0 size=1048576 2024-09-14T11:22:26.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.699+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~QKU3ME0COQQ1.1 size=407743 2024-09-14T11:22:26.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.699+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=QKU3ME0COQQ1 tag=KCS9HQ100ICO type=write size=2504895 2024-09-14T11:22:26.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.701+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=7GSTZG7F1UIR type=del 2024-09-14T11:22:26.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.702+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=YMN7HINB7NWD type=del size=1239439 2024-09-14T11:22:26.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.703+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=6H3GT6X38ZX5 type=del 2024-09-14T11:22:26.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.705+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=WBT9T6C62GNZ type=del size=4157855 2024-09-14T11:22:26.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.706+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~YKTHT1KIHG5Q.0 size=115190 2024-09-14T11:22:26.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.708+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=YKTHT1KIHG5Q tag=WNOFLVMXVJCS type=write size=1163766 2024-09-14T11:22:26.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.709+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=SIHT7LRD1IMQ type=del size=3051870 2024-09-14T11:22:26.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.711+0000 7f43cc561780 1 < suggested remove operation key=UWES4CQZ8XW6 tag=YRBGG5OFG2T0 type=del 2024-09-14T11:22:26.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.712+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=VSZ2WYM3LLDP type=del size=2726367 2024-09-14T11:22:26.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.713+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~5W3QQZE4MPBZ.0 size=1048576 2024-09-14T11:22:26.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.714+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~5W3QQZE4MPBZ.1 size=1048576 2024-09-14T11:22:26.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.715+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~5W3QQZE4MPBZ.2 size=639594 2024-09-14T11:22:26.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.717+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=5W3QQZE4MPBZ tag=A1WQOYJ1NJI9 type=write size=3785322 2024-09-14T11:22:26.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.718+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=4OT654UB6RGS type=del size=4142562 2024-09-14T11:22:26.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.720+0000 7f43cc561780 1 < suggested remove operation key=CXP2PUIXR2PA tag=CO9Y9XIKHPZV type=del 2024-09-14T11:22:26.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.722+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=HB4CVZZQKKWN type=del size=282988 2024-09-14T11:22:26.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.723+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~9YMZBQDX869S.0 size=1048576 2024-09-14T11:22:26.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.724+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~9YMZBQDX869S.1 size=1048576 2024-09-14T11:22:26.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.725+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~9YMZBQDX869S.2 size=467488 2024-09-14T11:22:26.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.726+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=9YMZBQDX869S tag=K779IYK8CQBP type=write size=3613216 2024-09-14T11:22:26.726 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.728+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=RNFMZTH2KU62 type=write size=470591 2024-09-14T11:22:26.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.728+0000 7f43cc561780 1 < canceled part key=_multipart_9XIAGZKIUBGH.2~NYC8EJ50ZBZW.0 size=1048576 2024-09-14T11:22:26.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.729+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~NYC8EJ50ZBZW.1 size=164613 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.731+0000 7f43cc561780 1 < canceled multipart upload key=9XIAGZKIUBGH upload=NYC8EJ50ZBZW tag=TTAQZIQ8HOUR type=write size=2261765 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.732+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=0OZFY2H3H880 type=del size=860203 2024-09-14T11:22:26.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.734+0000 7f43cc561780 1 < suggested update operation key=0TDWJO4AWOOF tag=GNGYX70760X5 type=del size=3085038 2024-09-14T11:22:26.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.735+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=Y1EBR4BXP2ZF type=del size=2780206 2024-09-14T11:22:26.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.736+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~09KCZEMMYKW4.0 size=772777 2024-09-14T11:22:26.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.738+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=09KCZEMMYKW4 tag=4I4QVD606IYZ type=write size=1821353 2024-09-14T11:22:26.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.740+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~U4HWZCGZV4JD.0 size=254146 2024-09-14T11:22:26.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.740+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=U4HWZCGZV4JD tag=N62FWJN7BN7X type=write size=1302722 2024-09-14T11:22:26.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.742+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=UUGMQR52ML53 type=del 2024-09-14T11:22:26.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.744+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~BDUSTRCUXKXD.0 size=22919 2024-09-14T11:22:26.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.744+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=BDUSTRCUXKXD tag=6SVIW1IQF4O8 type=write size=1071495 2024-09-14T11:22:26.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.746+0000 7f43cc561780 1 < suggested remove operation key=BNNSFLYOU27F tag=SG2QUK8P7VNA type=del 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.748+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~G879OF9532FS.0 size=1048576 2024-09-14T11:22:26.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.749+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~G879OF9532FS.1 size=1048576 2024-09-14T11:22:26.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.750+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~G879OF9532FS.2 size=49626 2024-09-14T11:22:26.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.750+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=G879OF9532FS tag=N5UKEJBMYWS5 type=write size=3195354 2024-09-14T11:22:26.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.751+0000 7f43cc561780 1 < canceled operation key=IG4QM506P41B tag=SZ1XG6JBYHO4 type=del size=716386 2024-09-14T11:22:26.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.752+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=SDJEU5IR1LTE type=write size=439679 2024-09-14T11:22:26.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.753+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~FWWY6EDG9WPC.0 size=1048576 2024-09-14T11:22:26.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.754+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~FWWY6EDG9WPC.1 size=462572 2024-09-14T11:22:26.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.756+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=FWWY6EDG9WPC tag=8U17MWR8WTER type=write size=2559724 2024-09-14T11:22:26.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.759+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~MOJCMQKQW19P.0 size=456718 2024-09-14T11:22:26.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.759+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=MOJCMQKQW19P tag=63CCS754JLYT type=write size=1505294 2024-09-14T11:22:26.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.760+0000 7f43cc561780 1 < canceled operation key=S3NOACTF4K2W tag=V3SSY3IC1OYQ type=del size=2830876 2024-09-14T11:22:26.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.761+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=BLM7UO8SNUF5 type=del size=3527123 2024-09-14T11:22:26.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.762+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~QKU3ME0COQQ1.0 size=1048576 2024-09-14T11:22:26.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.763+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~QKU3ME0COQQ1.1 size=407743 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.765+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=QKU3ME0COQQ1 tag=KCS9HQ100ICO type=write size=2504895 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.769+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~XY38YP4042K6.0 size=1048576 2024-09-14T11:22:26.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.770+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~XY38YP4042K6.1 size=867357 2024-09-14T11:22:26.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.770+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=XY38YP4042K6 tag=IEEOU7Q8MKA4 type=write size=2964509 2024-09-14T11:22:26.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.771+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=YMN7HINB7NWD type=del 2024-09-14T11:22:26.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.772+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=03WTIJRTVC9E type=write size=702260 2024-09-14T11:22:26.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.773+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=WBT9T6C62GNZ type=del 2024-09-14T11:22:26.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.775+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=SWWHM6SLKXNZ type=write size=282314 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.776+0000 7f43cc561780 1 < canceled operation key=FISMBWPDPCTA tag=SIHT7LRD1IMQ type=del size=3051870 2024-09-14T11:22:26.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.777+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=XCE0IRLUUAX3 type=del size=951865 2024-09-14T11:22:26.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.778+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=VSZ2WYM3LLDP type=del 2024-09-14T11:22:26.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.780+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~VKT1WVB26POC.0 size=1048576 2024-09-14T11:22:26.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.781+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~VKT1WVB26POC.1 size=228244 2024-09-14T11:22:26.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.781+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=VKT1WVB26POC tag=HMDR1M3ZXW3N type=write size=2325396 2024-09-14T11:22:26.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.783+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=4OT654UB6RGS type=del 2024-09-14T11:22:26.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.784+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=6BJVHKP4L0HS type=del size=1641076 2024-09-14T11:22:26.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.786+0000 7f43cc561780 1 < suggested update operation key=0TDWJO4AWOOF tag=HB4CVZZQKKWN type=del size=282988 2024-09-14T11:22:26.786 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.788+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=38L3C7JYMHJ1 type=del size=2782187 2024-09-14T11:22:26.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.789+0000 7f43cc561780 1 < completed write operation key=END3SHHS0FSA tag=RNFMZTH2KU62 type=write size=470591 2024-09-14T11:22:26.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.790+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=UZVCG2CFSCSG type=del size=336049 2024-09-14T11:22:26.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.791+0000 7f43cc561780 -1 < failed to complete operation key=0TDWJO4AWOOF tag=0OZFY2H3H880 type=del size=860203: (22) Invalid argument 2024-09-14T11:22:26.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.792+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=7J9OTM6U0MC8 type=del size=924235 2024-09-14T11:22:26.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.795+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=Y1EBR4BXP2ZF type=del 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.796+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=HIBPGSFOGYU0 type=del size=2252765 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.797+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~U4HWZCGZV4JD.0 size=254146 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.799+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=U4HWZCGZV4JD tag=N62FWJN7BN7X type=write size=1302722 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.801+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=OKL1WCX5N4X2 type=del size=2603799 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.802+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~BDUSTRCUXKXD.0 size=22919 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.804+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=BDUSTRCUXKXD tag=6SVIW1IQF4O8 type=write size=1071495 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.806+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H0I01W7CS893.0 size=1048576 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.807+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~H0I01W7CS893.1 size=461047 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.807+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=H0I01W7CS893 tag=402B2URNYJP9 type=write size=2558199 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.808+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~G879OF9532FS.0 size=1048576 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.809+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~G879OF9532FS.1 size=1048576 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.810+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~G879OF9532FS.2 size=49626 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.812+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=G879OF9532FS tag=N5UKEJBMYWS5 type=write size=3195354 2024-09-14T11:22:26.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.814+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~2EZYG13O37EZ.0 size=172212 2024-09-14T11:22:26.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.814+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=2EZYG13O37EZ tag=S0TTF44YK69B type=write size=1220788 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.817+0000 7f43cc561780 1 < suggested remove operation key=MD14RGOQY0LK tag=SDJEU5IR1LTE type=write 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.818+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=ILWB0XTSH13W type=del size=1786698 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.820+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~MOJCMQKQW19P.0 size=456718 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.822+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=MOJCMQKQW19P tag=63CCS754JLYT type=write size=1505294 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.824+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~169DE9HBSB30.0 size=1048576 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.825+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~169DE9HBSB30.1 size=827613 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.825+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=169DE9HBSB30 tag=AL6VXHCOGSQD type=write size=2924765 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.827+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=BLM7UO8SNUF5 type=del 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.829+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~QJ1GAIYLX3PB.0 size=1048576 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.830+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~QJ1GAIYLX3PB.1 size=1048576 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.831+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~QJ1GAIYLX3PB.2 size=699489 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.831+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=QJ1GAIYLX3PB tag=UZX1RBPVJEBL type=write size=3845217 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.831+0000 7f43cc561780 1 < canceled part key=_multipart_BZDW69C3Z97G.2~XY38YP4042K6.0 size=1048576 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.832+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~XY38YP4042K6.1 size=867357 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.834+0000 7f43cc561780 1 < canceled multipart upload key=BZDW69C3Z97G upload=XY38YP4042K6 tag=IEEOU7Q8MKA4 type=write size=2964509 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.835+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=9ON4LYO4P8S4 type=del size=1846794 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.837+0000 7f43cc561780 1 < completed write operation key=WSFZN6JCWUXG tag=03WTIJRTVC9E type=write size=702260 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.838+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=FWXI0HH6X2MS type=del size=3300663 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.841+0000 7f43cc561780 1 < suggested remove operation key=OV4ATW747PY4 tag=SWWHM6SLKXNZ type=write 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.842+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=HKCURHMSWYRV type=del size=2807659 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.843+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=XCE0IRLUUAX3 type=del 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.844+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=866HJ5S2BDWR type=del size=1904786 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.846+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~VKT1WVB26POC.0 size=1048576 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.847+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~VKT1WVB26POC.1 size=228244 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.849+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=VKT1WVB26POC tag=HMDR1M3ZXW3N type=write size=2325396 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.850+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=WM52UMNHL3UU type=del size=3610750 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.851+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=6BJVHKP4L0HS type=del 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.854+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~LZHLLNDYKI69.0 size=1048576 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.854+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~LZHLLNDYKI69.1 size=1048576 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.855+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~LZHLLNDYKI69.2 size=412798 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.855+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=LZHLLNDYKI69 tag=U586QYTIVGYH type=write size=3558526 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.857+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=38L3C7JYMHJ1 type=del 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.858+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=Q3FYP0N63MOA type=write size=139631 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.859+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=UZVCG2CFSCSG type=del 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.861+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~C9U11ISBEH1H.0 size=719621 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.861+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=C9U11ISBEH1H tag=2ESJ1AQXSBZQ type=write size=1768197 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.863+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=7J9OTM6U0MC8 type=del 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.865+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~HPBIS5OCRAGX.0 size=195357 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.865+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=HPBIS5OCRAGX tag=9LLDCA0N34GQ type=write size=1243933 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.866+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=HIBPGSFOGYU0 type=del 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.867+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=FY63KRD08CSI type=del size=510364 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.869+0000 7f43cc561780 1 < canceled operation key=IFHWMI5YO5L5 tag=OKL1WCX5N4X2 type=del size=2603799 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.870+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=YGK56BFFXS2T type=write size=848898 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.871+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H0I01W7CS893.0 size=1048576 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.872+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~H0I01W7CS893.1 size=461047 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.874+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=H0I01W7CS893 tag=402B2URNYJP9 type=write size=2558199 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.875+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=11OABY34K83F type=write size=76098 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.877+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~2EZYG13O37EZ.0 size=172212 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.879+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=2EZYG13O37EZ tag=S0TTF44YK69B type=write size=1220788 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.880+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=JRHT6KNMBTNF type=del size=2746583 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.881+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=ILWB0XTSH13W type=del 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.882+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=7XDQ55VQHCC0 type=del size=229205 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.884+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~169DE9HBSB30.0 size=1048576 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.886+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~169DE9HBSB30.1 size=827613 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.888+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=169DE9HBSB30 tag=AL6VXHCOGSQD type=write size=2924765 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.890+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~SJZDP37KRYMH.0 size=790605 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.890+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=SJZDP37KRYMH tag=U3B01VNJXB3L type=write size=1839181 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.891+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~QJ1GAIYLX3PB.0 size=1048576 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.892+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~QJ1GAIYLX3PB.1 size=1048576 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.893+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~QJ1GAIYLX3PB.2 size=699489 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.895+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=QJ1GAIYLX3PB tag=UZX1RBPVJEBL type=write size=3845217 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.897+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=0PQ1NHYW4RRP type=del size=3575188 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.899+0000 7f43cc561780 1 < suggested update operation key=LKY30XYUG2QW tag=9ON4LYO4P8S4 type=del size=1846794 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.902+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~LM5JH6QIK8QT.0 size=1048576 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.903+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~LM5JH6QIK8QT.1 size=564330 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.903+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=LM5JH6QIK8QT tag=33PZ2QDM4L13 type=write size=2661482 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.904+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=FWXI0HH6X2MS type=del 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.905+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=0PNGWBF2Q6GR type=del size=986638 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.906+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=HKCURHMSWYRV type=del 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.908+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=LH0SUUCQYE8Z type=write size=45337 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.909+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=866HJ5S2BDWR type=del 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.910+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=OJ6BMZSHXO2L type=del size=238913 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.911+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=WM52UMNHL3UU type=del 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.914+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~ZUIIJRRU5X9H.0 size=1048576 2024-09-14T11:22:26.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.915+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~ZUIIJRRU5X9H.1 size=1048576 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.916+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~ZUIIJRRU5X9H.2 size=1026495 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.916+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=ZUIIJRRU5X9H tag=I79G8QH1CJDH type=write size=4172223 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.917+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~LZHLLNDYKI69.0 size=1048576 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.918+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~LZHLLNDYKI69.1 size=1048576 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.919+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~LZHLLNDYKI69.2 size=412798 2024-09-14T11:22:26.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.921+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=LZHLLNDYKI69 tag=U586QYTIVGYH type=write size=3558526 2024-09-14T11:22:26.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.922+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=4WNIIIJUXP3R type=del size=2905367 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.923+0000 7f43cc561780 1 < completed write operation key=IFHWMI5YO5L5 tag=Q3FYP0N63MOA type=write size=139631 2024-09-14T11:22:26.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.926+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~4TG2KFEWWNQB.0 size=1048576 2024-09-14T11:22:26.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.926+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~4TG2KFEWWNQB.1 size=756508 2024-09-14T11:22:26.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.926+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=4TG2KFEWWNQB tag=MKGIAVXIXJ0B type=write size=2853660 2024-09-14T11:22:26.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.928+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~C9U11ISBEH1H.0 size=719621 2024-09-14T11:22:26.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.930+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=C9U11ISBEH1H tag=2ESJ1AQXSBZQ type=write size=1768197 2024-09-14T11:22:26.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.932+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~SNXK6A9V1VZW.0 size=173147 2024-09-14T11:22:26.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.932+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=SNXK6A9V1VZW tag=N8OAX204B5VB type=write size=1221723 2024-09-14T11:22:26.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.932+0000 7f43cc561780 1 < canceled part key=_multipart_AWBBRU4C8RDQ.2~HPBIS5OCRAGX.0 size=195357 2024-09-14T11:22:26.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.934+0000 7f43cc561780 1 < canceled multipart upload key=AWBBRU4C8RDQ upload=HPBIS5OCRAGX tag=9LLDCA0N34GQ type=write size=1243933 2024-09-14T11:22:26.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.936+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~OEAZB7ABMHM0.0 size=1048576 2024-09-14T11:22:26.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.937+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~OEAZB7ABMHM0.1 size=1048576 2024-09-14T11:22:26.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.938+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~OEAZB7ABMHM0.2 size=171943 2024-09-14T11:22:26.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.938+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=OEAZB7ABMHM0 tag=PY9PPQZFO0E6 type=write size=3317671 2024-09-14T11:22:26.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.940+0000 7f43cc561780 1 < suggested remove operation key=A1B2LIZIPET3 tag=FY63KRD08CSI type=del 2024-09-14T11:22:26.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.941+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=HHNOUJF1ME4I type=write size=486506 2024-09-14T11:22:26.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.943+0000 7f43cc561780 1 < completed write operation key=3YHEZHW0RS1W tag=YGK56BFFXS2T type=write size=848898 2024-09-14T11:22:26.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.944+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=O1YTB9D6IA13 type=del size=4137799 2024-09-14T11:22:26.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.946+0000 7f43cc561780 1 < suggested update operation key=S3NOACTF4K2W tag=11OABY34K83F type=write size=76098 2024-09-14T11:22:26.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.948+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~0N9MK7HIA4ZO.0 size=1048576 2024-09-14T11:22:26.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.949+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~0N9MK7HIA4ZO.1 size=962280 2024-09-14T11:22:26.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.949+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=0N9MK7HIA4ZO tag=YP2NIEBTRK66 type=write size=3059432 2024-09-14T11:22:26.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.950+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=JRHT6KNMBTNF type=del 2024-09-14T11:22:26.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.951+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=UXZS30XTLM53 type=write size=852598 2024-09-14T11:22:26.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.952+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=7XDQ55VQHCC0 type=del 2024-09-14T11:22:26.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.954+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~6R8WQNMB2XDR.0 size=1048576 2024-09-14T11:22:26.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.955+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~6R8WQNMB2XDR.1 size=51483 2024-09-14T11:22:26.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.955+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=6R8WQNMB2XDR tag=LR8RFBYN1AAS type=write size=2148635 2024-09-14T11:22:26.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.957+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~SJZDP37KRYMH.0 size=790605 2024-09-14T11:22:26.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.959+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=SJZDP37KRYMH tag=U3B01VNJXB3L type=write size=1839181 2024-09-14T11:22:26.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.961+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~EPOMWS7JPXDF.0 size=1048576 2024-09-14T11:22:26.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.962+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~EPOMWS7JPXDF.1 size=1048576 2024-09-14T11:22:26.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.963+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~EPOMWS7JPXDF.2 size=865736 2024-09-14T11:22:26.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.963+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=EPOMWS7JPXDF tag=7WAPU3B91DUS type=write size=4011464 2024-09-14T11:22:26.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.964+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=0PQ1NHYW4RRP type=del 2024-09-14T11:22:26.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.967+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~Y4ORU81QP34B.0 size=1048576 2024-09-14T11:22:26.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.968+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~Y4ORU81QP34B.1 size=1048576 2024-09-14T11:22:26.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.968+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~Y4ORU81QP34B.2 size=568629 2024-09-14T11:22:26.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.968+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=Y4ORU81QP34B tag=W60UCPOS2HGF type=write size=3714357 2024-09-14T11:22:26.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.970+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~LM5JH6QIK8QT.0 size=1048576 2024-09-14T11:22:26.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.971+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~LM5JH6QIK8QT.1 size=564330 2024-09-14T11:22:26.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.973+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=LM5JH6QIK8QT tag=33PZ2QDM4L13 type=write size=2661482 2024-09-14T11:22:26.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.975+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~C3W13IEEM38U.0 size=20200 2024-09-14T11:22:26.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.975+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=C3W13IEEM38U tag=SEWUNYB9F9MQ type=write size=1068776 2024-09-14T11:22:26.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.976+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=0PNGWBF2Q6GR type=del 2024-09-14T11:22:26.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.978+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~CNSV14GC0WEH.0 size=549059 2024-09-14T11:22:26.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.978+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=CNSV14GC0WEH tag=30GU1VUCQTXQ type=write size=1597635 2024-09-14T11:22:26.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.979+0000 7f43cc561780 1 < completed write operation key=BZDW69C3Z97G tag=LH0SUUCQYE8Z type=write size=45337 2024-09-14T11:22:26.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.980+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=RUIFCGKUY9KJ type=del size=1177919 2024-09-14T11:22:26.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.982+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=OJ6BMZSHXO2L type=del 2024-09-14T11:22:26.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.983+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=02UP476B5K3B type=write size=650173 2024-09-14T11:22:26.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.984+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~ZUIIJRRU5X9H.0 size=1048576 2024-09-14T11:22:26.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.985+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~ZUIIJRRU5X9H.1 size=1048576 2024-09-14T11:22:26.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.986+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~ZUIIJRRU5X9H.2 size=1026495 2024-09-14T11:22:26.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.988+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=ZUIIJRRU5X9H tag=I79G8QH1CJDH type=write size=4172223 2024-09-14T11:22:26.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.989+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=M8X45U8CXQNG type=del size=3351318 2024-09-14T11:22:26.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.990+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=4WNIIIJUXP3R type=del 2024-09-14T11:22:26.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.991+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=XU7MP2Z3DZL1 type=del size=1073720 2024-09-14T11:22:26.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.992+0000 7f43cc561780 1 < canceled part key=_multipart_W679WIFVPVOH.2~4TG2KFEWWNQB.0 size=1048576 2024-09-14T11:22:26.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.992+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~4TG2KFEWWNQB.1 size=756508 2024-09-14T11:22:26.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.994+0000 7f43cc561780 1 < canceled multipart upload key=W679WIFVPVOH upload=4TG2KFEWWNQB tag=MKGIAVXIXJ0B type=write size=2853660 2024-09-14T11:22:26.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.996+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=GF05WMS6V6XX type=del size=645235 2024-09-14T11:22:26.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:26.998+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~SNXK6A9V1VZW.0 size=173147 2024-09-14T11:22:26.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.000+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=SNXK6A9V1VZW tag=N8OAX204B5VB type=write size=1221723 2024-09-14T11:22:27.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.001+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=A5OQWZP0TY3W type=del size=3599246 2024-09-14T11:22:27.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.002+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~OEAZB7ABMHM0.0 size=1048576 2024-09-14T11:22:27.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.002+0000 7f43cc561780 1 < canceled part key=_multipart_FISMBWPDPCTA.2~OEAZB7ABMHM0.1 size=1048576 2024-09-14T11:22:27.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.003+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~OEAZB7ABMHM0.2 size=171943 2024-09-14T11:22:27.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.005+0000 7f43cc561780 1 < canceled multipart upload key=FISMBWPDPCTA upload=OEAZB7ABMHM0 tag=PY9PPQZFO0E6 type=write size=3317671 2024-09-14T11:22:27.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.008+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~FLR6W2YB41G0.0 size=1048576 2024-09-14T11:22:27.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.009+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~FLR6W2YB41G0.1 size=1048576 2024-09-14T11:22:27.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.009+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~FLR6W2YB41G0.2 size=342137 2024-09-14T11:22:27.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.009+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=FLR6W2YB41G0 tag=V9LH0D3LRCJE type=write size=3487865 2024-09-14T11:22:27.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.011+0000 7f43cc561780 1 < completed write operation key=WSFZN6JCWUXG tag=HHNOUJF1ME4I type=write size=486506 2024-09-14T11:22:27.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.013+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~8MUFCFWIW901.0 size=33466 2024-09-14T11:22:27.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.013+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=8MUFCFWIW901 tag=3MXLLN5BXGO6 type=write size=1082042 2024-09-14T11:22:27.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.014+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=O1YTB9D6IA13 type=del 2024-09-14T11:22:27.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.015+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=KJNTGVIG4I9K type=write size=411257 2024-09-14T11:22:27.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.017+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~0N9MK7HIA4ZO.0 size=1048576 2024-09-14T11:22:27.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.018+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~0N9MK7HIA4ZO.1 size=962280 2024-09-14T11:22:27.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.020+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=0N9MK7HIA4ZO tag=YP2NIEBTRK66 type=write size=3059432 2024-09-14T11:22:27.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.021+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=AT8QW0OD07ZE type=write size=401862 2024-09-14T11:22:27.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.023+0000 7f43cc561780 1 < suggested update operation key=9XIAGZKIUBGH tag=UXZS30XTLM53 type=write size=852598 2024-09-14T11:22:27.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.026+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~Y67ECL81VTJW.0 size=1041122 2024-09-14T11:22:27.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.026+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=Y67ECL81VTJW tag=6VZIZJE2Q8EW type=write size=2089698 2024-09-14T11:22:27.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.027+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~6R8WQNMB2XDR.0 size=1048576 2024-09-14T11:22:27.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.027+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~6R8WQNMB2XDR.1 size=51483 2024-09-14T11:22:27.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.029+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=6R8WQNMB2XDR tag=LR8RFBYN1AAS type=write size=2148635 2024-09-14T11:22:27.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.030+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=PU6VR3AJVYCK type=write size=651950 2024-09-14T11:22:27.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.031+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~EPOMWS7JPXDF.0 size=1048576 2024-09-14T11:22:27.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.031+0000 7f43cc561780 1 < canceled part key=_multipart_1M46U4U9MG1E.2~EPOMWS7JPXDF.1 size=1048576 2024-09-14T11:22:27.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.032+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~EPOMWS7JPXDF.2 size=865736 2024-09-14T11:22:27.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.034+0000 7f43cc561780 1 < canceled multipart upload key=1M46U4U9MG1E upload=EPOMWS7JPXDF tag=7WAPU3B91DUS type=write size=4011464 2024-09-14T11:22:27.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.037+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~SM3XMIMLI4HS.0 size=637189 2024-09-14T11:22:27.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.037+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=SM3XMIMLI4HS tag=FPHX30DGAB35 type=write size=1685765 2024-09-14T11:22:27.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.038+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~Y4ORU81QP34B.0 size=1048576 2024-09-14T11:22:27.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.039+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~Y4ORU81QP34B.1 size=1048576 2024-09-14T11:22:27.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.040+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~Y4ORU81QP34B.2 size=568629 2024-09-14T11:22:27.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.042+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=Y4ORU81QP34B tag=W60UCPOS2HGF type=write size=3714357 2024-09-14T11:22:27.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.044+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~0S61KG4SUFFE.0 size=1048576 2024-09-14T11:22:27.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.045+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~0S61KG4SUFFE.1 size=1048576 2024-09-14T11:22:27.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.046+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~0S61KG4SUFFE.2 size=665538 2024-09-14T11:22:27.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.046+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=0S61KG4SUFFE tag=XSGPV1DX950G type=write size=3811266 2024-09-14T11:22:27.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.047+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~C3W13IEEM38U.0 size=20200 2024-09-14T11:22:27.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.049+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=C3W13IEEM38U tag=SEWUNYB9F9MQ type=write size=1068776 2024-09-14T11:22:27.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.050+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=SGIC6DFRRKW5 type=del size=1866852 2024-09-14T11:22:27.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.051+0000 7f43cc561780 1 < canceled part key=_multipart_E6FDCACWGA2Y.2~CNSV14GC0WEH.0 size=549059 2024-09-14T11:22:27.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.053+0000 7f43cc561780 1 < canceled multipart upload key=E6FDCACWGA2Y upload=CNSV14GC0WEH tag=30GU1VUCQTXQ type=write size=1597635 2024-09-14T11:22:27.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.054+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=BA6FJSDPH4LC type=del size=304780 2024-09-14T11:22:27.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.055+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=RUIFCGKUY9KJ type=del 2024-09-14T11:22:27.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.056+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=PD0MIXU3B4MX type=write size=1002641 2024-09-14T11:22:27.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.058+0000 7f43cc561780 1 < completed write operation key=D84127SVSIPL tag=02UP476B5K3B type=write size=650173 2024-09-14T11:22:27.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.059+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=Q5SCH0F6U7UP type=del size=939801 2024-09-14T11:22:27.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.060+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=M8X45U8CXQNG type=del 2024-09-14T11:22:27.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.062+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~4V0RC8FDW6I3.0 size=447413 2024-09-14T11:22:27.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.062+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=4V0RC8FDW6I3 tag=9OE3OZSQDVSN type=write size=1495989 2024-09-14T11:22:27.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.064+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=XU7MP2Z3DZL1 type=del 2024-09-14T11:22:27.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.066+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~0MY6M7FRBW1R.0 size=1048576 2024-09-14T11:22:27.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.067+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~0MY6M7FRBW1R.1 size=1048576 2024-09-14T11:22:27.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.068+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~0MY6M7FRBW1R.2 size=533538 2024-09-14T11:22:27.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.068+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=0MY6M7FRBW1R tag=IZ112OQAWKUO type=write size=3679266 2024-09-14T11:22:27.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.069+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=GF05WMS6V6XX type=del 2024-09-14T11:22:27.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.070+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=FD1BBJHK4LI6 type=del size=3507512 2024-09-14T11:22:27.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.071+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=A5OQWZP0TY3W type=del 2024-09-14T11:22:27.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.074+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~QNTYW7Q2O6TK.0 size=37031 2024-09-14T11:22:27.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.074+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=QNTYW7Q2O6TK tag=PU56Z0NXBG0C type=write size=1085607 2024-09-14T11:22:27.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.075+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~FLR6W2YB41G0.0 size=1048576 2024-09-14T11:22:27.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.076+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~FLR6W2YB41G0.1 size=1048576 2024-09-14T11:22:27.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.077+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~FLR6W2YB41G0.2 size=342137 2024-09-14T11:22:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.079+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=FLR6W2YB41G0 tag=V9LH0D3LRCJE type=write size=3487865 2024-09-14T11:22:27.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.081+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=38MC9FJBHZXF type=write size=402430 2024-09-14T11:22:27.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.082+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~8MUFCFWIW901.0 size=33466 2024-09-14T11:22:27.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.084+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=8MUFCFWIW901 tag=3MXLLN5BXGO6 type=write size=1082042 2024-09-14T11:22:27.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.086+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~8NDVRM9OCZ4K.0 size=1048576 2024-09-14T11:22:27.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.087+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~8NDVRM9OCZ4K.1 size=646623 2024-09-14T11:22:27.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.087+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=8NDVRM9OCZ4K tag=RRYH1XY89QPN type=write size=2743775 2024-09-14T11:22:27.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.089+0000 7f43cc561780 1 < suggested update operation key=AWBBRU4C8RDQ tag=KJNTGVIG4I9K type=write size=411257 2024-09-14T11:22:27.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.091+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=KF6TZVQIPUC4 type=del size=1209336 2024-09-14T11:22:27.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.092+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=AT8QW0OD07ZE type=write size=401862 2024-09-14T11:22:27.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.094+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~07S6H76WNYRT.0 size=1048576 2024-09-14T11:22:27.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.095+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~07S6H76WNYRT.1 size=1048576 2024-09-14T11:22:27.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.096+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~07S6H76WNYRT.2 size=313733 2024-09-14T11:22:27.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.096+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=07S6H76WNYRT tag=WMNAD0QDVTGS type=write size=3459461 2024-09-14T11:22:27.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.098+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~Y67ECL81VTJW.0 size=1041122 2024-09-14T11:22:27.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.100+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=Y67ECL81VTJW tag=6VZIZJE2Q8EW type=write size=2089698 2024-09-14T11:22:27.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.103+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~W4CC61XOYWXK.0 size=1014174 2024-09-14T11:22:27.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.103+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=W4CC61XOYWXK tag=IOHNC4K2P4BP type=write size=2062750 2024-09-14T11:22:27.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.104+0000 7f43cc561780 1 < completed write operation key=LKY30XYUG2QW tag=PU6VR3AJVYCK type=write size=651950 2024-09-14T11:22:27.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.106+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~HK06XUU8KYGE.0 size=1048576 2024-09-14T11:22:27.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.107+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~HK06XUU8KYGE.1 size=105152 2024-09-14T11:22:27.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.107+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=HK06XUU8KYGE tag=RTHR1DAOC140 type=write size=2202304 2024-09-14T11:22:27.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.109+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~SM3XMIMLI4HS.0 size=637189 2024-09-14T11:22:27.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.112+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=SM3XMIMLI4HS tag=FPHX30DGAB35 type=write size=1685765 2024-09-14T11:22:27.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.113+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=JF0HMV5WPNP8 type=del size=3490653 2024-09-14T11:22:27.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.114+0000 7f43cc561780 1 < canceled part key=_multipart_MD14RGOQY0LK.2~0S61KG4SUFFE.0 size=1048576 2024-09-14T11:22:27.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.115+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~0S61KG4SUFFE.1 size=1048576 2024-09-14T11:22:27.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.116+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~0S61KG4SUFFE.2 size=665538 2024-09-14T11:22:27.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.118+0000 7f43cc561780 1 < canceled multipart upload key=MD14RGOQY0LK upload=0S61KG4SUFFE tag=XSGPV1DX950G type=write size=3811266 2024-09-14T11:22:27.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.120+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WLU91CSDB0Y8.0 size=1048576 2024-09-14T11:22:27.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.121+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WLU91CSDB0Y8.1 size=1048576 2024-09-14T11:22:27.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.122+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~WLU91CSDB0Y8.2 size=26598 2024-09-14T11:22:27.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.122+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=WLU91CSDB0Y8 tag=FG0DRDJYL8J3 type=write size=3172326 2024-09-14T11:22:27.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.123+0000 7f43cc561780 1 < canceled operation key=END3SHHS0FSA tag=SGIC6DFRRKW5 type=del size=1866852 2024-09-14T11:22:27.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.125+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~YYO8IK53SX0P.0 size=1048576 2024-09-14T11:22:27.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.126+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~YYO8IK53SX0P.1 size=1048576 2024-09-14T11:22:27.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.127+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~YYO8IK53SX0P.2 size=583148 2024-09-14T11:22:27.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.127+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=YYO8IK53SX0P tag=GRZW56TRLLC0 type=write size=3728876 2024-09-14T11:22:27.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.129+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=BA6FJSDPH4LC type=del 2024-09-14T11:22:27.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.130+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=NTGCW1DBJ0AM type=del size=1446591 2024-09-14T11:22:27.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.131+0000 7f43cc561780 1 < completed write operation key=UWES4CQZ8XW6 tag=PD0MIXU3B4MX type=write size=1002641 2024-09-14T11:22:27.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.132+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=ERGD29SMDD8N type=del size=1181572 2024-09-14T11:22:27.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.133+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=Q5SCH0F6U7UP type=del 2024-09-14T11:22:27.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.135+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=J5DRSBSW5PU5 type=del size=2816364 2024-09-14T11:22:27.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.136+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~4V0RC8FDW6I3.0 size=447413 2024-09-14T11:22:27.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.138+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=4V0RC8FDW6I3 tag=9OE3OZSQDVSN type=write size=1495989 2024-09-14T11:22:27.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.140+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=KC4L143L20X2 type=del size=473460 2024-09-14T11:22:27.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.141+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~0MY6M7FRBW1R.0 size=1048576 2024-09-14T11:22:27.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.142+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~0MY6M7FRBW1R.1 size=1048576 2024-09-14T11:22:27.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.143+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~0MY6M7FRBW1R.2 size=533538 2024-09-14T11:22:27.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.145+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=0MY6M7FRBW1R tag=IZ112OQAWKUO type=write size=3679266 2024-09-14T11:22:27.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.146+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=703Q4H6WI3IA type=del size=1193119 2024-09-14T11:22:27.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.148+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=FD1BBJHK4LI6 type=del 2024-09-14T11:22:27.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.149+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=PAPZ2WV6MII3 type=del size=2338098 2024-09-14T11:22:27.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.150+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~QNTYW7Q2O6TK.0 size=37031 2024-09-14T11:22:27.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.152+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=QNTYW7Q2O6TK tag=PU56Z0NXBG0C type=write size=1085607 2024-09-14T11:22:27.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.153+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=D1IBXTP9YTGO type=del size=3814835 2024-09-14T11:22:27.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.155+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=38MC9FJBHZXF type=write size=402430 2024-09-14T11:22:27.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.156+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=QWR9KY7N3HZZ type=del size=2896977 2024-09-14T11:22:27.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.157+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~8NDVRM9OCZ4K.0 size=1048576 2024-09-14T11:22:27.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.158+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~8NDVRM9OCZ4K.1 size=646623 2024-09-14T11:22:27.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.160+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=8NDVRM9OCZ4K tag=RRYH1XY89QPN type=write size=2743775 2024-09-14T11:22:27.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.162+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~JX3QN5E7V1XD.0 size=661113 2024-09-14T11:22:27.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.162+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=JX3QN5E7V1XD tag=JHBGV1BM1N81 type=write size=1709689 2024-09-14T11:22:27.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.164+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=KF6TZVQIPUC4 type=del 2024-09-14T11:22:27.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.165+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=FGH2XEAJRY3U type=del size=3436046 2024-09-14T11:22:27.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.166+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~07S6H76WNYRT.0 size=1048576 2024-09-14T11:22:27.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.167+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~07S6H76WNYRT.1 size=1048576 2024-09-14T11:22:27.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.167+0000 7f43cc561780 1 < canceled part key=_multipart_AWBBRU4C8RDQ.2~07S6H76WNYRT.2 size=313733 2024-09-14T11:22:27.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.169+0000 7f43cc561780 1 < canceled multipart upload key=AWBBRU4C8RDQ upload=07S6H76WNYRT tag=WMNAD0QDVTGS type=write size=3459461 2024-09-14T11:22:27.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.171+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=IB9GIWKLZ5QP type=del size=1077359 2024-09-14T11:22:27.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.172+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~W4CC61XOYWXK.0 size=1014174 2024-09-14T11:22:27.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.174+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=W4CC61XOYWXK tag=IOHNC4K2P4BP type=write size=2062750 2024-09-14T11:22:27.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.176+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~RNM8U83AEV5R.0 size=601014 2024-09-14T11:22:27.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.176+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=RNM8U83AEV5R tag=DKT4LDLPGCTR type=write size=1649590 2024-09-14T11:22:27.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.177+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~HK06XUU8KYGE.0 size=1048576 2024-09-14T11:22:27.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.178+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~HK06XUU8KYGE.1 size=105152 2024-09-14T11:22:27.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.181+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=HK06XUU8KYGE tag=RTHR1DAOC140 type=write size=2202304 2024-09-14T11:22:27.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.182+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=B6Y12MJ1BYPX type=del size=3676968 2024-09-14T11:22:27.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.184+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=JF0HMV5WPNP8 type=del 2024-09-14T11:22:27.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.186+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~GQGZX9VJV32K.0 size=846582 2024-09-14T11:22:27.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.186+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=GQGZX9VJV32K tag=XDIUN08O0EE7 type=write size=1895158 2024-09-14T11:22:27.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.188+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~WLU91CSDB0Y8.0 size=1048576 2024-09-14T11:22:27.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.189+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~WLU91CSDB0Y8.1 size=1048576 2024-09-14T11:22:27.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.189+0000 7f43cc561780 1 < canceled part key=_multipart_0TDWJO4AWOOF.2~WLU91CSDB0Y8.2 size=26598 2024-09-14T11:22:27.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.191+0000 7f43cc561780 1 < canceled multipart upload key=0TDWJO4AWOOF upload=WLU91CSDB0Y8 tag=FG0DRDJYL8J3 type=write size=3172326 2024-09-14T11:22:27.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.192+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=Y1QIBPE0XQZZ type=del size=1245601 2024-09-14T11:22:27.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.193+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~YYO8IK53SX0P.0 size=1048576 2024-09-14T11:22:27.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.194+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~YYO8IK53SX0P.1 size=1048576 2024-09-14T11:22:27.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.195+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~YYO8IK53SX0P.2 size=583148 2024-09-14T11:22:27.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.197+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=YYO8IK53SX0P tag=GRZW56TRLLC0 type=write size=3728876 2024-09-14T11:22:27.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.198+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=WB0FHD94WZLG type=del size=1644374 2024-09-14T11:22:27.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.199+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=NTGCW1DBJ0AM type=del 2024-09-14T11:22:27.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.201+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=YL6NF9ZGSU1J type=del size=1609088 2024-09-14T11:22:27.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.203+0000 7f43cc561780 1 < suggested update operation key=AWBBRU4C8RDQ tag=ERGD29SMDD8N type=del size=1181572 2024-09-14T11:22:27.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.204+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=E05W2NP3MVDW type=del size=1444428 2024-09-14T11:22:27.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.205+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=J5DRSBSW5PU5 type=del 2024-09-14T11:22:27.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.207+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~X00T7ZZE3Y0T.0 size=1048576 2024-09-14T11:22:27.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.208+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~X00T7ZZE3Y0T.1 size=1048576 2024-09-14T11:22:27.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.209+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~X00T7ZZE3Y0T.2 size=101713 2024-09-14T11:22:27.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.209+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=X00T7ZZE3Y0T tag=1S3GKTFX4XRS type=write size=3247441 2024-09-14T11:22:27.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.210+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=KC4L143L20X2 type=del 2024-09-14T11:22:27.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.211+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=5GFF4PYRXL1S type=del size=2663327 2024-09-14T11:22:27.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.213+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=703Q4H6WI3IA type=del 2024-09-14T11:22:27.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.215+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~D40D7F2TOHN4.0 size=122935 2024-09-14T11:22:27.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.215+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=D40D7F2TOHN4 tag=I03FS0HGCODJ type=write size=1171511 2024-09-14T11:22:27.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.217+0000 7f43cc561780 1 < suggested update operation key=3YHEZHW0RS1W tag=PAPZ2WV6MII3 type=del size=2338098 2024-09-14T11:22:27.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.218+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=WX5OJF7V5T1D type=del size=1125357 2024-09-14T11:22:27.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.219+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=D1IBXTP9YTGO type=del 2024-09-14T11:22:27.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.222+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~G9LU6U67637G.0 size=1048576 2024-09-14T11:22:27.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.223+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~G9LU6U67637G.1 size=1048576 2024-09-14T11:22:27.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.225+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~G9LU6U67637G.2 size=349663 2024-09-14T11:22:27.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.225+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=G9LU6U67637G tag=OUHHUUOFZIDM type=write size=3495391 2024-09-14T11:22:27.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.227+0000 7f43cc561780 1 < canceled operation key=80ZYEEE1EE78 tag=QWR9KY7N3HZZ type=del size=2896977 2024-09-14T11:22:27.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.229+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~GZ7S1HNTAXU3.0 size=732823 2024-09-14T11:22:27.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.229+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=GZ7S1HNTAXU3 tag=PF72S6NR3WFM type=write size=1781399 2024-09-14T11:22:27.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.230+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~JX3QN5E7V1XD.0 size=661113 2024-09-14T11:22:27.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.232+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=JX3QN5E7V1XD tag=JHBGV1BM1N81 type=write size=1709689 2024-09-14T11:22:27.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.233+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=P9R5624V5Q1P type=del size=3680852 2024-09-14T11:22:27.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.234+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=FGH2XEAJRY3U type=del 2024-09-14T11:22:27.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.235+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=RWLPI25RGQQT type=del size=161337 2024-09-14T11:22:27.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.237+0000 7f43cc561780 1 < suggested remove operation key=UWES4CQZ8XW6 tag=IB9GIWKLZ5QP type=del 2024-09-14T11:22:27.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.239+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=PT999UHSXQ5P type=del size=2077852 2024-09-14T11:22:27.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.240+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~RNM8U83AEV5R.0 size=601014 2024-09-14T11:22:27.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.242+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=RNM8U83AEV5R tag=DKT4LDLPGCTR type=write size=1649590 2024-09-14T11:22:27.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.244+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~T1LCG9O6YPIX.0 size=1048576 2024-09-14T11:22:27.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.245+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~T1LCG9O6YPIX.1 size=868468 2024-09-14T11:22:27.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.245+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=T1LCG9O6YPIX tag=LTSS2JUX12DY type=write size=2965620 2024-09-14T11:22:27.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.246+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=B6Y12MJ1BYPX type=del 2024-09-14T11:22:27.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.247+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=XQ4H4D3OBM44 type=del size=4004887 2024-09-14T11:22:27.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.248+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~GQGZX9VJV32K.0 size=846582 2024-09-14T11:22:27.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.250+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=GQGZX9VJV32K tag=XDIUN08O0EE7 type=write size=1895158 2024-09-14T11:22:27.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.252+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=P70VD6C8CFYY type=del size=1582166 2024-09-14T11:22:27.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.253+0000 7f43cc561780 -1 < failed to complete operation key=UWES4CQZ8XW6 tag=Y1QIBPE0XQZZ type=del size=1245601: (22) Invalid argument 2024-09-14T11:22:27.253 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.254+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=7RNJCZK0R7FA type=del size=1439132 2024-09-14T11:22:27.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.255+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=WB0FHD94WZLG type=del 2024-09-14T11:22:27.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.258+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~7N0LQS1MI6W1.0 size=1048576 2024-09-14T11:22:27.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.259+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~7N0LQS1MI6W1.1 size=1048576 2024-09-14T11:22:27.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.260+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~7N0LQS1MI6W1.2 size=561856 2024-09-14T11:22:27.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.260+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=7N0LQS1MI6W1 tag=65C14G862CSF type=write size=3707584 2024-09-14T11:22:27.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.261+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=YL6NF9ZGSU1J type=del 2024-09-14T11:22:27.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.262+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=CRC36MKXDEL4 type=del size=1251140 2024-09-14T11:22:27.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.263+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=E05W2NP3MVDW type=del 2024-09-14T11:22:27.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.265+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~Z6MJ375A5WPG.0 size=374794 2024-09-14T11:22:27.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.265+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=Z6MJ375A5WPG tag=BKEC11BKQHBM type=write size=1423370 2024-09-14T11:22:27.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.267+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~X00T7ZZE3Y0T.0 size=1048576 2024-09-14T11:22:27.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.268+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~X00T7ZZE3Y0T.1 size=1048576 2024-09-14T11:22:27.267 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.269+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~X00T7ZZE3Y0T.2 size=101713 2024-09-14T11:22:27.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.271+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=X00T7ZZE3Y0T tag=1S3GKTFX4XRS type=write size=3247441 2024-09-14T11:22:27.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.273+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~EOEO5Y8OJGPD.0 size=1048576 2024-09-14T11:22:27.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.274+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~EOEO5Y8OJGPD.1 size=169632 2024-09-14T11:22:27.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.274+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=EOEO5Y8OJGPD tag=DCC8QLG7DN7T type=write size=2266784 2024-09-14T11:22:27.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.275+0000 7f43cc561780 -1 < failed to complete operation key=3YHEZHW0RS1W tag=5GFF4PYRXL1S type=del size=2663327: (22) Invalid argument 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.277+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~DUJG769AOFCR.0 size=1048576 2024-09-14T11:22:27.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.278+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~DUJG769AOFCR.1 size=1047912 2024-09-14T11:22:27.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.278+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=DUJG769AOFCR tag=V8H5KIGNIUMW type=write size=3145064 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.279+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~D40D7F2TOHN4.0 size=122935 2024-09-14T11:22:27.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.282+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=D40D7F2TOHN4 tag=I03FS0HGCODJ type=write size=1171511 2024-09-14T11:22:27.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.283+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=SWFKU955I06Q type=del size=2080153 2024-09-14T11:22:27.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.285+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=WX5OJF7V5T1D type=del size=1125357 2024-09-14T11:22:27.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.287+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~25VLUEXXXOOG.0 size=1048576 2024-09-14T11:22:27.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.288+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~25VLUEXXXOOG.1 size=1048576 2024-09-14T11:22:27.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.290+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~25VLUEXXXOOG.2 size=728779 2024-09-14T11:22:27.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.290+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=25VLUEXXXOOG tag=7G0YZXEI48HQ type=write size=3874507 2024-09-14T11:22:27.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.291+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~G9LU6U67637G.0 size=1048576 2024-09-14T11:22:27.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.292+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~G9LU6U67637G.1 size=1048576 2024-09-14T11:22:27.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.293+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~G9LU6U67637G.2 size=349663 2024-09-14T11:22:27.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.295+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=G9LU6U67637G tag=OUHHUUOFZIDM type=write size=3495391 2024-09-14T11:22:27.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.296+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=A0YZERHM68GO type=del size=693398 2024-09-14T11:22:27.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.296+0000 7f43cc561780 1 < canceled part key=_multipart_D8EBH4NWN7SK.2~GZ7S1HNTAXU3.0 size=732823 2024-09-14T11:22:27.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.298+0000 7f43cc561780 1 < canceled multipart upload key=D8EBH4NWN7SK upload=GZ7S1HNTAXU3 tag=PF72S6NR3WFM type=write size=1781399 2024-09-14T11:22:27.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.299+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=12TZRS89D6CL type=del size=968299 2024-09-14T11:22:27.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.300+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=P9R5624V5Q1P type=del 2024-09-14T11:22:27.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.303+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~QHKAUZL0I0XE.0 size=875045 2024-09-14T11:22:27.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.303+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=QHKAUZL0I0XE tag=5XSXDD9WKFHB type=write size=1923621 2024-09-14T11:22:27.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.304+0000 7f43cc561780 1 < canceled operation key=BZDW69C3Z97G tag=RWLPI25RGQQT type=del size=161337 2024-09-14T11:22:27.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.306+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=A5K7Y0TZ7AM9 type=del size=2704375 2024-09-14T11:22:27.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.307+0000 7f43cc561780 -1 < failed to complete operation key=AY7JGVM96MO7 tag=PT999UHSXQ5P type=del size=2077852: (22) Invalid argument 2024-09-14T11:22:27.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.308+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=N8H11QQALCGP type=del size=2845 2024-09-14T11:22:27.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.310+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~T1LCG9O6YPIX.0 size=1048576 2024-09-14T11:22:27.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.311+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~T1LCG9O6YPIX.1 size=868468 2024-09-14T11:22:27.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.313+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=T1LCG9O6YPIX tag=LTSS2JUX12DY type=write size=2965620 2024-09-14T11:22:27.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.315+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~NSJL4E0D5TO0.0 size=1048576 2024-09-14T11:22:27.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.316+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~NSJL4E0D5TO0.1 size=258763 2024-09-14T11:22:27.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.316+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=NSJL4E0D5TO0 tag=YOIMJI2IJI2L type=write size=2355915 2024-09-14T11:22:27.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.317+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=XQ4H4D3OBM44 type=del 2024-09-14T11:22:27.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.318+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=YU4PG8LKBCRE type=del size=453912 2024-09-14T11:22:27.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.320+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=P70VD6C8CFYY type=del 2024-09-14T11:22:27.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.321+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=ZN4ZUMGXCT6K type=del size=1158105 2024-09-14T11:22:27.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.322+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=7RNJCZK0R7FA type=del 2024-09-14T11:22:27.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.323+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=7XMTPVJ2PTAS type=write size=241984 2024-09-14T11:22:27.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.324+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~7N0LQS1MI6W1.0 size=1048576 2024-09-14T11:22:27.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.325+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~7N0LQS1MI6W1.1 size=1048576 2024-09-14T11:22:27.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.326+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~7N0LQS1MI6W1.2 size=561856 2024-09-14T11:22:27.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.328+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=7N0LQS1MI6W1 tag=65C14G862CSF type=write size=3707584 2024-09-14T11:22:27.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.330+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~S6AFRKQE510M.0 size=1048576 2024-09-14T11:22:27.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.331+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~S6AFRKQE510M.1 size=328163 2024-09-14T11:22:27.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.331+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=S6AFRKQE510M tag=0V1URVC5D6YK type=write size=2425315 2024-09-14T11:22:27.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.333+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=CRC36MKXDEL4 type=del 2024-09-14T11:22:27.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.334+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=DIT1PRPDJEGD type=del size=1646579 2024-09-14T11:22:27.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.335+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~Z6MJ375A5WPG.0 size=374794 2024-09-14T11:22:27.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.338+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=Z6MJ375A5WPG tag=BKEC11BKQHBM type=write size=1423370 2024-09-14T11:22:27.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.339+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=FRQ5P7XSRPQ3 type=del size=1858809 2024-09-14T11:22:27.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.341+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~EOEO5Y8OJGPD.0 size=1048576 2024-09-14T11:22:27.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.342+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~EOEO5Y8OJGPD.1 size=169632 2024-09-14T11:22:27.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.344+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=EOEO5Y8OJGPD tag=DCC8QLG7DN7T type=write size=2266784 2024-09-14T11:22:27.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.345+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=W5CJT1OOVH38 type=write size=606702 2024-09-14T11:22:27.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.346+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~DUJG769AOFCR.0 size=1048576 2024-09-14T11:22:27.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.347+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~DUJG769AOFCR.1 size=1047912 2024-09-14T11:22:27.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.349+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=DUJG769AOFCR tag=V8H5KIGNIUMW type=write size=3145064 2024-09-14T11:22:27.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.350+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=QAZCSI08PD3F type=del size=497432 2024-09-14T11:22:27.350 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.351+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=SWFKU955I06Q type=del 2024-09-14T11:22:27.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.353+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=952FOB73LL5D type=del size=2696552 2024-09-14T11:22:27.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.354+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~25VLUEXXXOOG.0 size=1048576 2024-09-14T11:22:27.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.355+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~25VLUEXXXOOG.1 size=1048576 2024-09-14T11:22:27.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.356+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~25VLUEXXXOOG.2 size=728779 2024-09-14T11:22:27.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.358+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=25VLUEXXXOOG tag=7G0YZXEI48HQ type=write size=3874507 2024-09-14T11:22:27.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.359+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=VPA0NZQW3LT8 type=del size=1377155 2024-09-14T11:22:27.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.360+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=A0YZERHM68GO type=del 2024-09-14T11:22:27.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.361+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=P7ZPW94BUE8E type=del size=318954 2024-09-14T11:22:27.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.362+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=12TZRS89D6CL type=del 2024-09-14T11:22:27.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.365+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~4CF818Q8TUM0.0 size=278169 2024-09-14T11:22:27.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.365+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=4CF818Q8TUM0 tag=46POFZAZ1ILV type=write size=1326745 2024-09-14T11:22:27.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.365+0000 7f43cc561780 1 < canceled part key=_multipart_END3SHHS0FSA.2~QHKAUZL0I0XE.0 size=875045 2024-09-14T11:22:27.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.367+0000 7f43cc561780 1 < canceled multipart upload key=END3SHHS0FSA upload=QHKAUZL0I0XE tag=5XSXDD9WKFHB type=write size=1923621 2024-09-14T11:22:27.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.368+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=1STY6BOXWN03 type=write size=328544 2024-09-14T11:22:27.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.369+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=A5K7Y0TZ7AM9 type=del 2024-09-14T11:22:27.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.371+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~BO0SIHF1QCI1.0 size=128372 2024-09-14T11:22:27.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.371+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=BO0SIHF1QCI1 tag=GXEO0DIYMCX1 type=write size=1176948 2024-09-14T11:22:27.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.373+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=N8H11QQALCGP type=del 2024-09-14T11:22:27.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.375+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~WCVK0EQ68C57.0 size=1048576 2024-09-14T11:22:27.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.376+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~WCVK0EQ68C57.1 size=506074 2024-09-14T11:22:27.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.376+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=WCVK0EQ68C57 tag=XEDLQP8RK9F4 type=write size=2603226 2024-09-14T11:22:27.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.376+0000 7f43cc561780 1 < canceled part key=_multipart_IFHWMI5YO5L5.2~NSJL4E0D5TO0.0 size=1048576 2024-09-14T11:22:27.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.377+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~NSJL4E0D5TO0.1 size=258763 2024-09-14T11:22:27.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.379+0000 7f43cc561780 1 < canceled multipart upload key=IFHWMI5YO5L5 upload=NSJL4E0D5TO0 tag=YOIMJI2IJI2L type=write size=2355915 2024-09-14T11:22:27.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.380+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=34KYZ0PMEARB type=del size=792215 2024-09-14T11:22:27.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.383+0000 7f43cc561780 1 < suggested remove operation key=END3SHHS0FSA tag=YU4PG8LKBCRE type=del 2024-09-14T11:22:27.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.385+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~C622AVV0K0KZ.0 size=1048576 2024-09-14T11:22:27.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.386+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~C622AVV0K0KZ.1 size=959709 2024-09-14T11:22:27.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.386+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=C622AVV0K0KZ tag=KXWDKSLTSI4O type=write size=3056861 2024-09-14T11:22:27.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.388+0000 7f43cc561780 1 < suggested remove operation key=G6B4CGUBFSOT tag=ZN4ZUMGXCT6K type=del 2024-09-14T11:22:27.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.390+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~DX9IN4SFT5M1.0 size=1048576 2024-09-14T11:22:27.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.391+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~DX9IN4SFT5M1.1 size=896346 2024-09-14T11:22:27.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.391+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=DX9IN4SFT5M1 tag=LK08UA9WU9JH type=write size=2993498 2024-09-14T11:22:27.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.393+0000 7f43cc561780 1 < completed write operation key=AWBBRU4C8RDQ tag=7XMTPVJ2PTAS type=write size=241984 2024-09-14T11:22:27.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.394+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=PT1QBGEH19Z5 type=del size=3389399 2024-09-14T11:22:27.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.395+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~S6AFRKQE510M.0 size=1048576 2024-09-14T11:22:27.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.396+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~S6AFRKQE510M.1 size=328163 2024-09-14T11:22:27.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.398+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=S6AFRKQE510M tag=0V1URVC5D6YK type=write size=2425315 2024-09-14T11:22:27.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.399+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=8B08Q59C3B24 type=del size=3185239 2024-09-14T11:22:27.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.400+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=DIT1PRPDJEGD type=del 2024-09-14T11:22:27.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.401+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=LL66VEXEUY9Z type=write size=671055 2024-09-14T11:22:27.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.403+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=FRQ5P7XSRPQ3 type=del 2024-09-14T11:22:27.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.405+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~H0J16V1BBUNH.0 size=1048576 2024-09-14T11:22:27.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.406+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~H0J16V1BBUNH.1 size=1048576 2024-09-14T11:22:27.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.407+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~H0J16V1BBUNH.2 size=187221 2024-09-14T11:22:27.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.407+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=H0J16V1BBUNH tag=29BTP47I2V1G type=write size=3332949 2024-09-14T11:22:27.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.408+0000 7f43cc561780 1 < completed write operation key=E6FDCACWGA2Y tag=W5CJT1OOVH38 type=write size=606702 2024-09-14T11:22:27.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.410+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~65S1SCHSGQK6.0 size=1048576 2024-09-14T11:22:27.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.411+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~65S1SCHSGQK6.1 size=1048576 2024-09-14T11:22:27.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.412+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~65S1SCHSGQK6.2 size=784684 2024-09-14T11:22:27.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.412+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=65S1SCHSGQK6 tag=QXA6CQSVTMUW type=write size=3930412 2024-09-14T11:22:27.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.413+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=QAZCSI08PD3F type=del 2024-09-14T11:22:27.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.414+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=MGQWNJXGMDAL type=del size=3720215 2024-09-14T11:22:27.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.417+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=952FOB73LL5D type=del size=2696552 2024-09-14T11:22:27.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.419+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~LTHO08X84DI8.0 size=1048576 2024-09-14T11:22:27.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.420+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~LTHO08X84DI8.1 size=413804 2024-09-14T11:22:27.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.420+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=LTHO08X84DI8 tag=1QYS1POC292W type=write size=2510956 2024-09-14T11:22:27.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.421+0000 7f43cc561780 -1 < failed to complete operation key=END3SHHS0FSA tag=VPA0NZQW3LT8 type=del size=1377155: (22) Invalid argument 2024-09-14T11:22:27.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.423+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~H8Q9FDT833L1.0 size=1048576 2024-09-14T11:22:27.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.424+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~H8Q9FDT833L1.1 size=1048576 2024-09-14T11:22:27.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.425+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~H8Q9FDT833L1.2 size=304486 2024-09-14T11:22:27.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.425+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=H8Q9FDT833L1 tag=Q5WZYR9FLL1R type=write size=3450214 2024-09-14T11:22:27.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.426+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=P7ZPW94BUE8E type=del 2024-09-14T11:22:27.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.428+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=WC3D2IK9HSUJ type=del size=312159 2024-09-14T11:22:27.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.429+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~4CF818Q8TUM0.0 size=278169 2024-09-14T11:22:27.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.431+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=4CF818Q8TUM0 tag=46POFZAZ1ILV type=write size=1326745 2024-09-14T11:22:27.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.432+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=YFR225DSG3VP type=del size=1091297 2024-09-14T11:22:27.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.434+0000 7f43cc561780 1 < completed write operation key=D84127SVSIPL tag=1STY6BOXWN03 type=write size=328544 2024-09-14T11:22:27.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.435+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=575Z3LHM8K7U type=del size=2784149 2024-09-14T11:22:27.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.436+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~BO0SIHF1QCI1.0 size=128372 2024-09-14T11:22:27.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.438+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=BO0SIHF1QCI1 tag=GXEO0DIYMCX1 type=write size=1176948 2024-09-14T11:22:27.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.440+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=DF547DUEC4H7 type=del size=2695512 2024-09-14T11:22:27.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.440+0000 7f43cc561780 1 < canceled part key=_multipart_3YHEZHW0RS1W.2~WCVK0EQ68C57.0 size=1048576 2024-09-14T11:22:27.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.441+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~WCVK0EQ68C57.1 size=506074 2024-09-14T11:22:27.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.443+0000 7f43cc561780 1 < canceled multipart upload key=3YHEZHW0RS1W upload=WCVK0EQ68C57 tag=XEDLQP8RK9F4 type=write size=2603226 2024-09-14T11:22:27.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.444+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=I72ZRE10BZQ4 type=del size=1759356 2024-09-14T11:22:27.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.447+0000 7f43cc561780 1 < suggested update operation key=1M46U4U9MG1E tag=34KYZ0PMEARB type=del size=792215 2024-09-14T11:22:27.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.448+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=XNNEXPOZWW1B type=del size=3095830 2024-09-14T11:22:27.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.448+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~C622AVV0K0KZ.0 size=1048576 2024-09-14T11:22:27.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.449+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~C622AVV0K0KZ.1 size=959709 2024-09-14T11:22:27.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.452+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=C622AVV0K0KZ tag=KXWDKSLTSI4O type=write size=3056861 2024-09-14T11:22:27.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.454+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=MQQYSAPQKA0H type=del size=1639829 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.455+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~DX9IN4SFT5M1.0 size=1048576 2024-09-14T11:22:27.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.456+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~DX9IN4SFT5M1.1 size=896346 2024-09-14T11:22:27.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.458+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=DX9IN4SFT5M1 tag=LK08UA9WU9JH type=write size=2993498 2024-09-14T11:22:27.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.459+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=UN4XXS2J5HVX type=del size=2714322 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.460+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=PT1QBGEH19Z5 type=del 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.461+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=FGR6YFHEK6H9 type=del size=2548844 2024-09-14T11:22:27.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.463+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=8B08Q59C3B24 type=del 2024-09-14T11:22:27.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.465+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~C3R0SBZ5MJ6Z.0 size=543196 2024-09-14T11:22:27.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.465+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=C3R0SBZ5MJ6Z tag=RWBHCW39FOI4 type=write size=1591772 2024-09-14T11:22:27.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.466+0000 7f43cc561780 1 < completed write operation key=A1B2LIZIPET3 tag=LL66VEXEUY9Z type=write size=671055 2024-09-14T11:22:27.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.468+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=6GOLF8CZGH80 type=del size=1281381 2024-09-14T11:22:27.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.469+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~H0J16V1BBUNH.0 size=1048576 2024-09-14T11:22:27.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.470+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~H0J16V1BBUNH.1 size=1048576 2024-09-14T11:22:27.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.472+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~H0J16V1BBUNH.2 size=187221 2024-09-14T11:22:27.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.474+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=H0J16V1BBUNH tag=29BTP47I2V1G type=write size=3332949 2024-09-14T11:22:27.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.476+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=416EAKHS7SL4 type=del size=478845 2024-09-14T11:22:27.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.476+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~65S1SCHSGQK6.0 size=1048576 2024-09-14T11:22:27.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.476+0000 7f43cc561780 1 < canceled part key=_multipart_A1B2LIZIPET3.2~65S1SCHSGQK6.1 size=1048576 2024-09-14T11:22:27.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.477+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~65S1SCHSGQK6.2 size=784684 2024-09-14T11:22:27.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.479+0000 7f43cc561780 1 < canceled multipart upload key=A1B2LIZIPET3 upload=65S1SCHSGQK6 tag=QXA6CQSVTMUW type=write size=3930412 2024-09-14T11:22:27.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.481+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=6ZRXJ748AKXH type=del size=2016806 2024-09-14T11:22:27.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.482+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=MGQWNJXGMDAL type=del 2024-09-14T11:22:27.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.484+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=1JB5Q1S5TCU6 type=del size=695062 2024-09-14T11:22:27.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.485+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~LTHO08X84DI8.0 size=1048576 2024-09-14T11:22:27.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.486+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~LTHO08X84DI8.1 size=413804 2024-09-14T11:22:27.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.488+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=LTHO08X84DI8 tag=1QYS1POC292W type=write size=2510956 2024-09-14T11:22:27.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.490+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=SUL7XAJSFUI1 type=del size=3818454 2024-09-14T11:22:27.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.490+0000 7f43cc561780 1 < canceled part key=_multipart_S3NOACTF4K2W.2~H8Q9FDT833L1.0 size=1048576 2024-09-14T11:22:27.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.491+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~H8Q9FDT833L1.1 size=1048576 2024-09-14T11:22:27.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.492+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~H8Q9FDT833L1.2 size=304486 2024-09-14T11:22:27.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.494+0000 7f43cc561780 1 < canceled multipart upload key=S3NOACTF4K2W upload=H8Q9FDT833L1 tag=Q5WZYR9FLL1R type=write size=3450214 2024-09-14T11:22:27.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.495+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=AZB3WTV8ZLIA type=del size=2519623 2024-09-14T11:22:27.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.497+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=WC3D2IK9HSUJ type=del 2024-09-14T11:22:27.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.499+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~1GAVKG7DRZE6.0 size=1048576 2024-09-14T11:22:27.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.500+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~1GAVKG7DRZE6.1 size=1048576 2024-09-14T11:22:27.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.502+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~1GAVKG7DRZE6.2 size=609629 2024-09-14T11:22:27.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.502+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=1GAVKG7DRZE6 tag=OBLSB975A381 type=write size=3755357 2024-09-14T11:22:27.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.503+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=YFR225DSG3VP type=del 2024-09-14T11:22:27.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.505+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=JBLKXH5NYTML type=del size=3682184 2024-09-14T11:22:27.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.506+0000 7f43cc561780 1 < canceled operation key=683ZFW0BWMT7 tag=575Z3LHM8K7U type=del size=2784149 2024-09-14T11:22:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.507+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=0YG4UGMZXOFU type=del size=2439760 2024-09-14T11:22:27.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.510+0000 7f43cc561780 1 < suggested remove operation key=15F3ZZAAKT9B tag=DF547DUEC4H7 type=del 2024-09-14T11:22:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.511+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=EKKTAGI3IRBR type=del size=3173044 2024-09-14T11:22:27.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.512+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=I72ZRE10BZQ4 type=del 2024-09-14T11:22:27.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.514+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=3T5E37HTEOCB type=del size=585158 2024-09-14T11:22:27.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.516+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=XNNEXPOZWW1B type=del 2024-09-14T11:22:27.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.518+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=GDZD6SDN3V3J type=del size=1057836 2024-09-14T11:22:27.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.519+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=MQQYSAPQKA0H type=del 2024-09-14T11:22:27.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.520+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=50PCSSJ8QMQG type=del size=969414 2024-09-14T11:22:27.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.522+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=UN4XXS2J5HVX type=del 2024-09-14T11:22:27.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.523+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=G76BBQF2T0BU type=write size=12534 2024-09-14T11:22:27.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.526+0000 7f43cc561780 1 < suggested update operation key=W679WIFVPVOH tag=FGR6YFHEK6H9 type=del size=2548844 2024-09-14T11:22:27.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.528+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~R9WTHMV68NSC.0 size=1048576 2024-09-14T11:22:27.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.529+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~R9WTHMV68NSC.1 size=634999 2024-09-14T11:22:27.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.529+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=R9WTHMV68NSC tag=807K74N5FIE1 type=write size=2732151 2024-09-14T11:22:27.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.530+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~C3R0SBZ5MJ6Z.0 size=543196 2024-09-14T11:22:27.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.532+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=C3R0SBZ5MJ6Z tag=RWBHCW39FOI4 type=write size=1591772 2024-09-14T11:22:27.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.534+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~VQS2YFXMBG1T.0 size=1048576 2024-09-14T11:22:27.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.535+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~VQS2YFXMBG1T.1 size=219110 2024-09-14T11:22:27.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.535+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=VQS2YFXMBG1T tag=52BBJDW74CW5 type=write size=2316262 2024-09-14T11:22:27.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.536+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=6GOLF8CZGH80 type=del 2024-09-14T11:22:27.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.538+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=YD0GNUGEDHFE type=del size=119908 2024-09-14T11:22:27.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.539+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=416EAKHS7SL4 type=del 2024-09-14T11:22:27.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.540+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=NVGQT0YRXYIQ type=del size=1192857 2024-09-14T11:22:27.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.541+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=6ZRXJ748AKXH type=del 2024-09-14T11:22:27.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.542+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=W6V3PTUL8U1X type=write size=11930 2024-09-14T11:22:27.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.544+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=1JB5Q1S5TCU6 type=del 2024-09-14T11:22:27.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.545+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=DZNR40QMTKD4 type=write size=987950 2024-09-14T11:22:27.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.546+0000 7f43cc561780 1 < canceled operation key=CXP2PUIXR2PA tag=SUL7XAJSFUI1 type=del size=3818454 2024-09-14T11:22:27.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.547+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=1BWH27OTBTYE type=del size=3252953 2024-09-14T11:22:27.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.549+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=AZB3WTV8ZLIA type=del 2024-09-14T11:22:27.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.550+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=CEGXCA0176ZC type=write size=632375 2024-09-14T11:22:27.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.550+0000 7f43cc561780 1 < canceled part key=_multipart_OV4ATW747PY4.2~1GAVKG7DRZE6.0 size=1048576 2024-09-14T11:22:27.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.551+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~1GAVKG7DRZE6.1 size=1048576 2024-09-14T11:22:27.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.552+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~1GAVKG7DRZE6.2 size=609629 2024-09-14T11:22:27.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.554+0000 7f43cc561780 1 < canceled multipart upload key=OV4ATW747PY4 upload=1GAVKG7DRZE6 tag=OBLSB975A381 type=write size=3755357 2024-09-14T11:22:27.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.556+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~0WNHN0DCAV31.0 size=1048576 2024-09-14T11:22:27.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.557+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~0WNHN0DCAV31.1 size=1048576 2024-09-14T11:22:27.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.558+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~0WNHN0DCAV31.2 size=661865 2024-09-14T11:22:27.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.558+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=0WNHN0DCAV31 tag=CWQ7CLD9XV5Q type=write size=3807593 2024-09-14T11:22:27.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.559+0000 7f43cc561780 -1 < failed to complete operation key=BZDW69C3Z97G tag=JBLKXH5NYTML type=del size=3682184: (22) Invalid argument 2024-09-14T11:22:27.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.561+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~D4JPFI8CW26Z.0 size=1048576 2024-09-14T11:22:27.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.562+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~D4JPFI8CW26Z.1 size=951774 2024-09-14T11:22:27.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.562+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=D4JPFI8CW26Z tag=SQ6QOVLR93TW type=write size=3048926 2024-09-14T11:22:27.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.563+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=0YG4UGMZXOFU type=del 2024-09-14T11:22:27.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.566+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~H6XTIRXTH543.0 size=1031060 2024-09-14T11:22:27.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.566+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=H6XTIRXTH543 tag=5VO3MYM08AJP type=write size=2079636 2024-09-14T11:22:27.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.567+0000 7f43cc561780 1 < canceled operation key=D84127SVSIPL tag=EKKTAGI3IRBR type=del size=3173044 2024-09-14T11:22:27.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.569+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~1YN91HQ2LXJL.0 size=785319 2024-09-14T11:22:27.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.569+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=1YN91HQ2LXJL tag=K4R3HZ02GJT0 type=write size=1833895 2024-09-14T11:22:27.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.573+0000 7f43cc561780 1 < suggested remove operation key=0TDWJO4AWOOF tag=3T5E37HTEOCB type=del 2024-09-14T11:22:27.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.574+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=NEMRJ3POROCF type=del size=2290099 2024-09-14T11:22:27.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.575+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=GDZD6SDN3V3J type=del 2024-09-14T11:22:27.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.576+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=F7E2LLY21HGN type=del size=2270875 2024-09-14T11:22:27.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.577+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=50PCSSJ8QMQG type=del 2024-09-14T11:22:27.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.579+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=4ZL5TZEPUQFK type=del size=2306242 2024-09-14T11:22:27.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.581+0000 7f43cc561780 1 < suggested remove operation key=683ZFW0BWMT7 tag=G76BBQF2T0BU type=write 2024-09-14T11:22:27.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.583+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~X1AIPK3QQPJ3.0 size=1048576 2024-09-14T11:22:27.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.584+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~X1AIPK3QQPJ3.1 size=1048576 2024-09-14T11:22:27.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.585+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~X1AIPK3QQPJ3.2 size=163844 2024-09-14T11:22:27.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.585+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=X1AIPK3QQPJ3 tag=YUFQOGISIMOV type=write size=3309572 2024-09-14T11:22:27.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.586+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~R9WTHMV68NSC.0 size=1048576 2024-09-14T11:22:27.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.587+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~R9WTHMV68NSC.1 size=634999 2024-09-14T11:22:27.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.589+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=R9WTHMV68NSC tag=807K74N5FIE1 type=write size=2732151 2024-09-14T11:22:27.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.590+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=H1E6DUM1RIDN type=del size=2913339 2024-09-14T11:22:27.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.592+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~VQS2YFXMBG1T.0 size=1048576 2024-09-14T11:22:27.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.593+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~VQS2YFXMBG1T.1 size=219110 2024-09-14T11:22:27.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.595+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=VQS2YFXMBG1T tag=52BBJDW74CW5 type=write size=2316262 2024-09-14T11:22:27.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.596+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=LAPD63F60HBW type=del size=100364 2024-09-14T11:22:27.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.597+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=YD0GNUGEDHFE type=del 2024-09-14T11:22:27.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.598+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=90WP4K3TW698 type=del size=41862 2024-09-14T11:22:27.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.599+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=NVGQT0YRXYIQ type=del 2024-09-14T11:22:27.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.602+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~FVO2I73RCFH4.0 size=1048576 2024-09-14T11:22:27.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.603+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~FVO2I73RCFH4.1 size=1048576 2024-09-14T11:22:27.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.604+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~FVO2I73RCFH4.2 size=501498 2024-09-14T11:22:27.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.604+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=FVO2I73RCFH4 tag=KVI22P4DE24G type=write size=3647226 2024-09-14T11:22:27.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.606+0000 7f43cc561780 1 < suggested remove operation key=A1B2LIZIPET3 tag=W6V3PTUL8U1X type=write 2024-09-14T11:22:27.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.607+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=2I51H38YDNHD type=del size=2122362 2024-09-14T11:22:27.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.608+0000 7f43cc561780 1 < completed write operation key=D8EBH4NWN7SK tag=DZNR40QMTKD4 type=write size=987950 2024-09-14T11:22:27.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.611+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~HZWL8W6YXLFH.0 size=1048576 2024-09-14T11:22:27.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.612+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~HZWL8W6YXLFH.1 size=16258 2024-09-14T11:22:27.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.612+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=HZWL8W6YXLFH tag=OHCPCF1LI72A type=write size=2113410 2024-09-14T11:22:27.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.612+0000 7f43cc561780 -1 < no bi entry to suggest for operation key=0TDWJO4AWOOF tag=1BWH27OTBTYE type=del size=3252953: (2) No such file or directory 2024-09-14T11:22:27.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.613+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=1DCIGQN2ZK29 type=write size=449653 2024-09-14T11:22:27.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.616+0000 7f43cc561780 1 < suggested remove operation key=WHIZ2GREK1FE tag=CEGXCA0176ZC type=write 2024-09-14T11:22:27.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.618+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~L3ZPTQQNL2SH.0 size=186357 2024-09-14T11:22:27.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.618+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=L3ZPTQQNL2SH tag=32XP2O3U4XC4 type=write size=1234933 2024-09-14T11:22:27.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.619+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~0WNHN0DCAV31.0 size=1048576 2024-09-14T11:22:27.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.619+0000 7f43cc561780 1 < canceled part key=_multipart_AWBBRU4C8RDQ.2~0WNHN0DCAV31.1 size=1048576 2024-09-14T11:22:27.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.620+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~0WNHN0DCAV31.2 size=661865 2024-09-14T11:22:27.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.622+0000 7f43cc561780 1 < canceled multipart upload key=AWBBRU4C8RDQ upload=0WNHN0DCAV31 tag=CWQ7CLD9XV5Q type=write size=3807593 2024-09-14T11:22:27.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.624+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~80ZGC6OGRNWD.0 size=1048576 2024-09-14T11:22:27.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.625+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~80ZGC6OGRNWD.1 size=1048576 2024-09-14T11:22:27.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.626+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~80ZGC6OGRNWD.2 size=388222 2024-09-14T11:22:27.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.626+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=80ZGC6OGRNWD tag=B1POES27KHCF type=write size=3533950 2024-09-14T11:22:27.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.627+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~D4JPFI8CW26Z.0 size=1048576 2024-09-14T11:22:27.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.628+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~D4JPFI8CW26Z.1 size=951774 2024-09-14T11:22:27.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.630+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=D4JPFI8CW26Z tag=SQ6QOVLR93TW type=write size=3048926 2024-09-14T11:22:27.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.632+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=RUYLE40M190J type=del size=1599298 2024-09-14T11:22:27.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.632+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~H6XTIRXTH543.0 size=1031060 2024-09-14T11:22:27.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.634+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=H6XTIRXTH543 tag=5VO3MYM08AJP type=write size=2079636 2024-09-14T11:22:27.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.636+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~W4LGV2LGHW6P.0 size=1048576 2024-09-14T11:22:27.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.637+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~W4LGV2LGHW6P.1 size=1048576 2024-09-14T11:22:27.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.638+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~W4LGV2LGHW6P.2 size=65435 2024-09-14T11:22:27.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.638+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=W4LGV2LGHW6P tag=0OXJN5662VX1 type=write size=3211163 2024-09-14T11:22:27.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.639+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~1YN91HQ2LXJL.0 size=785319 2024-09-14T11:22:27.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.641+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=1YN91HQ2LXJL tag=K4R3HZ02GJT0 type=write size=1833895 2024-09-14T11:22:27.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.642+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=NIHNCC9BULH6 type=del size=3216009 2024-09-14T11:22:27.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.644+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=NEMRJ3POROCF type=del 2024-09-14T11:22:27.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.646+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~RTWT7O0UF4NK.0 size=583100 2024-09-14T11:22:27.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.646+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=RTWT7O0UF4NK tag=MCK8JN3JK2S7 type=write size=1631676 2024-09-14T11:22:27.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.647+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=F7E2LLY21HGN type=del 2024-09-14T11:22:27.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.648+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=X0AK8MHJNZI1 type=del size=263612 2024-09-14T11:22:27.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.650+0000 7f43cc561780 1 < suggested remove operation key=MD14RGOQY0LK tag=4ZL5TZEPUQFK type=del 2024-09-14T11:22:27.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.652+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=H4EQMUQ0RDXX type=del size=4077830 2024-09-14T11:22:27.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.653+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~X1AIPK3QQPJ3.0 size=1048576 2024-09-14T11:22:27.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.654+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~X1AIPK3QQPJ3.1 size=1048576 2024-09-14T11:22:27.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.655+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~X1AIPK3QQPJ3.2 size=163844 2024-09-14T11:22:27.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.658+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=X1AIPK3QQPJ3 tag=YUFQOGISIMOV type=write size=3309572 2024-09-14T11:22:27.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.660+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~45GLWZP03HXE.0 size=650221 2024-09-14T11:22:27.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.660+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=45GLWZP03HXE tag=6VG8UWXK10Q1 type=write size=1698797 2024-09-14T11:22:27.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.661+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=H1E6DUM1RIDN type=del 2024-09-14T11:22:27.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.664+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~1NGPHGNUF2LX.0 size=1048576 2024-09-14T11:22:27.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.665+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~1NGPHGNUF2LX.1 size=1048576 2024-09-14T11:22:27.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.666+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~1NGPHGNUF2LX.2 size=758538 2024-09-14T11:22:27.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.666+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=1NGPHGNUF2LX tag=UQQ6DL7RKYFV type=write size=3904266 2024-09-14T11:22:27.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.668+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=LAPD63F60HBW type=del 2024-09-14T11:22:27.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.670+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=8GM24K6WQZXX type=del size=98465 2024-09-14T11:22:27.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.671+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=90WP4K3TW698 type=del 2024-09-14T11:22:27.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.674+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~XB0VP8NZ2IDK.0 size=1048576 2024-09-14T11:22:27.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.675+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~XB0VP8NZ2IDK.1 size=1048576 2024-09-14T11:22:27.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.676+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~XB0VP8NZ2IDK.2 size=574880 2024-09-14T11:22:27.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.676+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=XB0VP8NZ2IDK tag=KQNS1S9A7CYS type=write size=3720608 2024-09-14T11:22:27.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.677+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~FVO2I73RCFH4.0 size=1048576 2024-09-14T11:22:27.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.679+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~FVO2I73RCFH4.1 size=1048576 2024-09-14T11:22:27.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.679+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~FVO2I73RCFH4.2 size=501498 2024-09-14T11:22:27.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.681+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=FVO2I73RCFH4 tag=KVI22P4DE24G type=write size=3647226 2024-09-14T11:22:27.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.682+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=3PKKT189NF6C type=del size=3300710 2024-09-14T11:22:27.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.683+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=2I51H38YDNHD type=del 2024-09-14T11:22:27.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.684+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=NRVI6EILJTXI type=del size=506807 2024-09-14T11:22:27.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.686+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~HZWL8W6YXLFH.0 size=1048576 2024-09-14T11:22:27.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.688+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~HZWL8W6YXLFH.1 size=16258 2024-09-14T11:22:27.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.690+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=HZWL8W6YXLFH tag=OHCPCF1LI72A type=write size=2113410 2024-09-14T11:22:27.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.692+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~6VMP1RHUN9DQ.0 size=1048576 2024-09-14T11:22:27.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.693+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~6VMP1RHUN9DQ.1 size=1048576 2024-09-14T11:22:27.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.694+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~6VMP1RHUN9DQ.2 size=424682 2024-09-14T11:22:27.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.694+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=6VMP1RHUN9DQ tag=9YIFYUPWODZ7 type=write size=3570410 2024-09-14T11:22:27.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.695+0000 7f43cc561780 1 < canceled operation key=UWES4CQZ8XW6 tag=1DCIGQN2ZK29 type=write size=449653 2024-09-14T11:22:27.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.696+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=UKR6R337APD0 type=del size=3022876 2024-09-14T11:22:27.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.698+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~L3ZPTQQNL2SH.0 size=186357 2024-09-14T11:22:27.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.700+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=L3ZPTQQNL2SH tag=32XP2O3U4XC4 type=write size=1234933 2024-09-14T11:22:27.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.701+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=1704STOPMFS8 type=write size=289467 2024-09-14T11:22:27.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.702+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~80ZGC6OGRNWD.0 size=1048576 2024-09-14T11:22:27.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.703+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~80ZGC6OGRNWD.1 size=1048576 2024-09-14T11:22:27.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.704+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~80ZGC6OGRNWD.2 size=388222 2024-09-14T11:22:27.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.706+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=80ZGC6OGRNWD tag=B1POES27KHCF type=write size=3533950 2024-09-14T11:22:27.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.708+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~280XZK89SB28.0 size=1048576 2024-09-14T11:22:27.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.709+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~280XZK89SB28.1 size=1048576 2024-09-14T11:22:27.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.710+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~280XZK89SB28.2 size=827837 2024-09-14T11:22:27.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.710+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=280XZK89SB28 tag=8HY0P6YVYEAM type=write size=3973565 2024-09-14T11:22:27.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.711+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=RUYLE40M190J type=del 2024-09-14T11:22:27.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.713+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~P4PW5YOPNS59.0 size=524793 2024-09-14T11:22:27.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.713+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=P4PW5YOPNS59 tag=LL3RMIDC4PRP type=write size=1573369 2024-09-14T11:22:27.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.715+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~W4LGV2LGHW6P.0 size=1048576 2024-09-14T11:22:27.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.716+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~W4LGV2LGHW6P.1 size=1048576 2024-09-14T11:22:27.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.717+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~W4LGV2LGHW6P.2 size=65435 2024-09-14T11:22:27.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.718+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=W4LGV2LGHW6P tag=0OXJN5662VX1 type=write size=3211163 2024-09-14T11:22:27.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.720+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=XBS1J01J05X0 type=del size=3087157 2024-09-14T11:22:27.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.721+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=NIHNCC9BULH6 type=del 2024-09-14T11:22:27.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.723+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~YDX4N58987JR.0 size=144530 2024-09-14T11:22:27.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.723+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=YDX4N58987JR tag=9UUP9CRNJNMS type=write size=1193106 2024-09-14T11:22:27.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.724+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~RTWT7O0UF4NK.0 size=583100 2024-09-14T11:22:27.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.726+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=RTWT7O0UF4NK tag=MCK8JN3JK2S7 type=write size=1631676 2024-09-14T11:22:27.726 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.727+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=VOSHO6DZ8WA6 type=del size=1606701 2024-09-14T11:22:27.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.729+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=X0AK8MHJNZI1 type=del 2024-09-14T11:22:27.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.731+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~LT8Y01D0SESH.0 size=923839 2024-09-14T11:22:27.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.731+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=LT8Y01D0SESH tag=VADO2BWK93M3 type=write size=1972415 2024-09-14T11:22:27.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.733+0000 7f43cc561780 1 < suggested remove operation key=OJOJZBG1WEGI tag=H4EQMUQ0RDXX type=del 2024-09-14T11:22:27.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.735+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~BXVDOE86T3AB.0 size=1043199 2024-09-14T11:22:27.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.735+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=BXVDOE86T3AB tag=UJOOHHROPFL4 type=write size=2091775 2024-09-14T11:22:27.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.736+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~45GLWZP03HXE.0 size=650221 2024-09-14T11:22:27.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.738+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=45GLWZP03HXE tag=6VG8UWXK10Q1 type=write size=1698797 2024-09-14T11:22:27.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.739+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=VS4H81XAGJMX type=del size=4016204 2024-09-14T11:22:27.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.740+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~1NGPHGNUF2LX.0 size=1048576 2024-09-14T11:22:27.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.741+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~1NGPHGNUF2LX.1 size=1048576 2024-09-14T11:22:27.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.741+0000 7f43cc561780 1 < canceled part key=_multipart_2975CNBC43ST.2~1NGPHGNUF2LX.2 size=758538 2024-09-14T11:22:27.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.744+0000 7f43cc561780 1 < canceled multipart upload key=2975CNBC43ST upload=1NGPHGNUF2LX tag=UQQ6DL7RKYFV type=write size=3904266 2024-09-14T11:22:27.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.745+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=KWKPYR76AF52 type=del size=90332 2024-09-14T11:22:27.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.747+0000 7f43cc561780 1 < suggested remove operation key=683ZFW0BWMT7 tag=8GM24K6WQZXX type=del 2024-09-14T11:22:27.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.749+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=51X61FXL27UW type=del size=51070 2024-09-14T11:22:27.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.750+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~XB0VP8NZ2IDK.0 size=1048576 2024-09-14T11:22:27.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.751+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~XB0VP8NZ2IDK.1 size=1048576 2024-09-14T11:22:27.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.752+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~XB0VP8NZ2IDK.2 size=574880 2024-09-14T11:22:27.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.754+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=XB0VP8NZ2IDK tag=KQNS1S9A7CYS type=write size=3720608 2024-09-14T11:22:27.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.756+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~8CMDLX4A7A8T.0 size=1048576 2024-09-14T11:22:27.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.757+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~8CMDLX4A7A8T.1 size=1048576 2024-09-14T11:22:27.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.758+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~8CMDLX4A7A8T.2 size=249348 2024-09-14T11:22:27.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.758+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=8CMDLX4A7A8T tag=85Z7L6DR3UTO type=write size=3395076 2024-09-14T11:22:27.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.759+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=3PKKT189NF6C type=del 2024-09-14T11:22:27.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.761+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~7ESO18AOA7TH.0 size=1048576 2024-09-14T11:22:27.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.762+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~7ESO18AOA7TH.1 size=131731 2024-09-14T11:22:27.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.762+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=7ESO18AOA7TH tag=RMO8GI2081LD type=write size=2228883 2024-09-14T11:22:27.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.763+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=NRVI6EILJTXI type=del 2024-09-14T11:22:27.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.764+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=L9RRD62GIQPN type=del size=1497631 2024-09-14T11:22:27.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.766+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~6VMP1RHUN9DQ.0 size=1048576 2024-09-14T11:22:27.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.767+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~6VMP1RHUN9DQ.1 size=1048576 2024-09-14T11:22:27.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.768+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~6VMP1RHUN9DQ.2 size=424682 2024-09-14T11:22:27.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.770+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=6VMP1RHUN9DQ tag=9YIFYUPWODZ7 type=write size=3570410 2024-09-14T11:22:27.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.771+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=QR8IEA1G9D6F type=write size=200528 2024-09-14T11:22:27.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.772+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=UKR6R337APD0 type=del 2024-09-14T11:22:27.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.773+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=P69FT0RSXNOO type=del size=1872212 2024-09-14T11:22:27.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.775+0000 7f43cc561780 1 < completed write operation key=WSFZN6JCWUXG tag=1704STOPMFS8 type=write size=289467 2024-09-14T11:22:27.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.776+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=7Z85SY8DRASC type=del size=1963977 2024-09-14T11:22:27.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.777+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~280XZK89SB28.0 size=1048576 2024-09-14T11:22:27.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.778+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~280XZK89SB28.1 size=1048576 2024-09-14T11:22:27.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.779+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~280XZK89SB28.2 size=827837 2024-09-14T11:22:27.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.781+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=280XZK89SB28 tag=8HY0P6YVYEAM type=write size=3973565 2024-09-14T11:22:27.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.783+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~XWQF9Z0DGBIZ.0 size=1048576 2024-09-14T11:22:27.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.784+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~XWQF9Z0DGBIZ.1 size=782481 2024-09-14T11:22:27.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.784+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=XWQF9Z0DGBIZ tag=ZQ0TCVF7KEE9 type=write size=2879633 2024-09-14T11:22:27.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.785+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~P4PW5YOPNS59.0 size=524793 2024-09-14T11:22:27.786 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.787+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=P4PW5YOPNS59 tag=LL3RMIDC4PRP type=write size=1573369 2024-09-14T11:22:27.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.789+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~9ELJMNK6XKP0.0 size=472780 2024-09-14T11:22:27.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.789+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=9ELJMNK6XKP0 tag=D9Q5U0ZRUB14 type=write size=1521356 2024-09-14T11:22:27.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.791+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=XBS1J01J05X0 type=del 2024-09-14T11:22:27.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.793+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~I6N4WMXSBWLV.0 size=1048576 2024-09-14T11:22:27.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.794+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~I6N4WMXSBWLV.1 size=1048576 2024-09-14T11:22:27.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.795+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~I6N4WMXSBWLV.2 size=681210 2024-09-14T11:22:27.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.795+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=I6N4WMXSBWLV tag=R6L1F0VTYPZY type=write size=3826938 2024-09-14T11:22:27.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.798+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~YDX4N58987JR.0 size=144530 2024-09-14T11:22:27.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.800+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=YDX4N58987JR tag=9UUP9CRNJNMS type=write size=1193106 2024-09-14T11:22:27.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.801+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=1JS5WQUF0F1F type=del size=2597011 2024-09-14T11:22:27.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.804+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=VOSHO6DZ8WA6 type=del size=1606701 2024-09-14T11:22:27.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.805+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=ZCN9SJ1E3YCQ type=del size=348532 2024-09-14T11:22:27.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.806+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~LT8Y01D0SESH.0 size=923839 2024-09-14T11:22:27.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.808+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=LT8Y01D0SESH tag=VADO2BWK93M3 type=write size=1972415 2024-09-14T11:22:27.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.809+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=D12YK1NWTAES type=del size=2458193 2024-09-14T11:22:27.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.810+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~BXVDOE86T3AB.0 size=1043199 2024-09-14T11:22:27.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.812+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=BXVDOE86T3AB tag=UJOOHHROPFL4 type=write size=2091775 2024-09-14T11:22:27.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.814+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=21FPJKRG1IF9 type=del size=1812362 2024-09-14T11:22:27.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.816+0000 7f43cc561780 1 < suggested update operation key=BRHP3DQEO3HZ tag=VS4H81XAGJMX type=del size=4016204 2024-09-14T11:22:27.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.817+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=W0AK3I7APSP0 type=write size=536695 2024-09-14T11:22:27.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.819+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=KWKPYR76AF52 type=del 2024-09-14T11:22:27.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.820+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=SIVK3AZFZYA2 type=write size=782278 2024-09-14T11:22:27.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.821+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=51X61FXL27UW type=del 2024-09-14T11:22:27.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.822+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=7YC70A3M7K6U type=del size=809193 2024-09-14T11:22:27.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.823+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~8CMDLX4A7A8T.0 size=1048576 2024-09-14T11:22:27.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.824+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~8CMDLX4A7A8T.1 size=1048576 2024-09-14T11:22:27.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.825+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~8CMDLX4A7A8T.2 size=249348 2024-09-14T11:22:27.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.827+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=8CMDLX4A7A8T tag=85Z7L6DR3UTO type=write size=3395076 2024-09-14T11:22:27.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.829+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=0ZUN8IK1B0B9 type=del size=3015198 2024-09-14T11:22:27.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.830+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~7ESO18AOA7TH.0 size=1048576 2024-09-14T11:22:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.831+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~7ESO18AOA7TH.1 size=131731 2024-09-14T11:22:27.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.833+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=7ESO18AOA7TH tag=RMO8GI2081LD type=write size=2228883 2024-09-14T11:22:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.834+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=L3JUHRVEIC2Z type=del size=3328077 2024-09-14T11:22:27.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.835+0000 7f43cc561780 -1 < failed to complete operation key=BRHP3DQEO3HZ tag=L9RRD62GIQPN type=del size=1497631: (22) Invalid argument 2024-09-14T11:22:27.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.836+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=VHDNCSHBGC1F type=write size=170928 2024-09-14T11:22:27.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.838+0000 7f43cc561780 1 < completed write operation key=CXP2PUIXR2PA tag=QR8IEA1G9D6F type=write size=200528 2024-09-14T11:22:27.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.839+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=P8C6W1HOZ14O type=del size=2313448 2024-09-14T11:22:27.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.841+0000 7f43cc561780 1 < suggested update operation key=AWBBRU4C8RDQ tag=P69FT0RSXNOO type=del size=1872212 2024-09-14T11:22:27.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.842+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=LAAL0MF5ZP9T type=write size=205886 2024-09-14T11:22:27.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.844+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=7Z85SY8DRASC type=del 2024-09-14T11:22:27.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.845+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=VNPWAZNXI425 type=write size=735317 2024-09-14T11:22:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.846+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~XWQF9Z0DGBIZ.0 size=1048576 2024-09-14T11:22:27.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.847+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~XWQF9Z0DGBIZ.1 size=782481 2024-09-14T11:22:27.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.849+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=XWQF9Z0DGBIZ tag=ZQ0TCVF7KEE9 type=write size=2879633 2024-09-14T11:22:27.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.851+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=R94UIJZA3H60 type=del size=3281251 2024-09-14T11:22:27.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.852+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~9ELJMNK6XKP0.0 size=472780 2024-09-14T11:22:27.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.854+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=9ELJMNK6XKP0 tag=D9Q5U0ZRUB14 type=write size=1521356 2024-09-14T11:22:27.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.856+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~F73DHKUFX70J.0 size=1048576 2024-09-14T11:22:27.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.857+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~F73DHKUFX70J.1 size=1048576 2024-09-14T11:22:27.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.858+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~F73DHKUFX70J.2 size=74407 2024-09-14T11:22:27.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.858+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=F73DHKUFX70J tag=EAZM0UY0G7BW type=write size=3220135 2024-09-14T11:22:27.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.859+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~I6N4WMXSBWLV.0 size=1048576 2024-09-14T11:22:27.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.860+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~I6N4WMXSBWLV.1 size=1048576 2024-09-14T11:22:27.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.860+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~I6N4WMXSBWLV.2 size=681210 2024-09-14T11:22:27.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.862+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=I6N4WMXSBWLV tag=R6L1F0VTYPZY type=write size=3826938 2024-09-14T11:22:27.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.864+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~7995QZFB0QNZ.0 size=843955 2024-09-14T11:22:27.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.864+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=7995QZFB0QNZ tag=IHIF93XMDFMH type=write size=1892531 2024-09-14T11:22:27.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.865+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=1JS5WQUF0F1F type=del 2024-09-14T11:22:27.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.866+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=90SOSEAA8KMN type=write size=273749 2024-09-14T11:22:27.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.867+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=ZCN9SJ1E3YCQ type=del 2024-09-14T11:22:27.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.869+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=I2JS3GQN71R0 type=del size=1263082 2024-09-14T11:22:27.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.871+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=D12YK1NWTAES type=del 2024-09-14T11:22:27.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.873+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~CE9W97MFOAKD.0 size=823904 2024-09-14T11:22:27.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.873+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=CE9W97MFOAKD tag=TNE7ORM2JQFW type=write size=1872480 2024-09-14T11:22:27.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.874+0000 7f43cc561780 -1 < failed to complete operation key=AWBBRU4C8RDQ tag=21FPJKRG1IF9 type=del size=1812362: (22) Invalid argument 2024-09-14T11:22:27.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.876+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~BOFBDMZPWZXO.0 size=122958 2024-09-14T11:22:27.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.876+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=BOFBDMZPWZXO tag=TZLSS9VV37SI type=write size=1171534 2024-09-14T11:22:27.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.878+0000 7f43cc561780 1 < suggested remove operation key=IFHWMI5YO5L5 tag=W0AK3I7APSP0 type=write 2024-09-14T11:22:27.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.880+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~0FIMSC70C0N3.0 size=1048576 2024-09-14T11:22:27.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.881+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~0FIMSC70C0N3.1 size=1048576 2024-09-14T11:22:27.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.882+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~0FIMSC70C0N3.2 size=237817 2024-09-14T11:22:27.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.882+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=0FIMSC70C0N3 tag=MBV7M6JRZ5NL type=write size=3383545 2024-09-14T11:22:27.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.883+0000 7f43cc561780 1 < completed write operation key=BRHP3DQEO3HZ tag=SIVK3AZFZYA2 type=write size=782278 2024-09-14T11:22:27.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.885+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=AJ6Q1VV5ZL0X type=write size=495930 2024-09-14T11:22:27.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.886+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=7YC70A3M7K6U type=del 2024-09-14T11:22:27.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.888+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~7O1S1XVSH1GN.0 size=800997 2024-09-14T11:22:27.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.888+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=7O1S1XVSH1GN tag=Q6EHGY3L0456 type=write size=1849573 2024-09-14T11:22:27.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.889+0000 7f43cc561780 -1 < failed to complete operation key=AWBBRU4C8RDQ tag=0ZUN8IK1B0B9 type=del size=3015198: (22) Invalid argument 2024-09-14T11:22:27.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.891+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=F7AVGX60PWRQ type=write size=548554 2024-09-14T11:22:27.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.892+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=L3JUHRVEIC2Z type=del 2024-09-14T11:22:27.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.894+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=AWKECW609LY4 type=del size=2344294 2024-09-14T11:22:27.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.895+0000 7f43cc561780 1 < completed write operation key=FISMBWPDPCTA tag=VHDNCSHBGC1F type=write size=170928 2024-09-14T11:22:27.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.896+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=3IX8COA8UEC6 type=del size=663692 2024-09-14T11:22:27.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.899+0000 7f43cc561780 1 < suggested remove operation key=WSFZN6JCWUXG tag=P8C6W1HOZ14O type=del 2024-09-14T11:22:27.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.901+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~1PN91ZVYNI7X.0 size=322221 2024-09-14T11:22:27.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.901+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=1PN91ZVYNI7X tag=ICY5EHW2E9C1 type=write size=1370797 2024-09-14T11:22:27.903 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.904+0000 7f43cc561780 1 < suggested update operation key=S3NOACTF4K2W tag=LAAL0MF5ZP9T type=write size=205886 2024-09-14T11:22:27.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.906+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~8OD394DA2V0N.0 size=1048576 2024-09-14T11:22:27.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.907+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~8OD394DA2V0N.1 size=308595 2024-09-14T11:22:27.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.907+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=8OD394DA2V0N tag=H764729WI781 type=write size=2405747 2024-09-14T11:22:27.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.909+0000 7f43cc561780 1 < suggested remove operation key=MD14RGOQY0LK tag=VNPWAZNXI425 type=write 2024-09-14T11:22:27.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.910+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=DO4WEF1FTERH type=write size=382651 2024-09-14T11:22:27.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.912+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=R94UIJZA3H60 type=del 2024-09-14T11:22:27.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.914+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=FF6NTFC63YVD type=del size=3707388 2024-09-14T11:22:27.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.915+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~F73DHKUFX70J.0 size=1048576 2024-09-14T11:22:27.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.916+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~F73DHKUFX70J.1 size=1048576 2024-09-14T11:22:27.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.917+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~F73DHKUFX70J.2 size=74407 2024-09-14T11:22:27.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.919+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=F73DHKUFX70J tag=EAZM0UY0G7BW type=write size=3220135 2024-09-14T11:22:27.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.921+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=4JSC5UK7AT4R type=write size=446540 2024-09-14T11:22:27.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.922+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~7995QZFB0QNZ.0 size=843955 2024-09-14T11:22:27.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.924+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=7995QZFB0QNZ tag=IHIF93XMDFMH type=write size=1892531 2024-09-14T11:22:27.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.926+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~58U2EPYZ4QPL.0 size=1048576 2024-09-14T11:22:27.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.927+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~58U2EPYZ4QPL.1 size=1048576 2024-09-14T11:22:27.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.928+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~58U2EPYZ4QPL.2 size=185932 2024-09-14T11:22:27.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.928+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=58U2EPYZ4QPL tag=8KXZUI0MCQ79 type=write size=3331660 2024-09-14T11:22:27.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.931+0000 7f43cc561780 1 < suggested remove operation key=9XIAGZKIUBGH tag=90SOSEAA8KMN type=write 2024-09-14T11:22:27.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.932+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=0HGTREYAI6WN type=del size=3650019 2024-09-14T11:22:27.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.933+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=I2JS3GQN71R0 type=del 2024-09-14T11:22:27.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.934+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=0HM61OU4YSLB type=del size=3936452 2024-09-14T11:22:27.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.936+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~CE9W97MFOAKD.0 size=823904 2024-09-14T11:22:27.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.938+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=CE9W97MFOAKD tag=TNE7ORM2JQFW type=write size=1872480 2024-09-14T11:22:27.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.940+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~98CVSKEAE2VX.0 size=1048576 2024-09-14T11:22:27.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.941+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~98CVSKEAE2VX.1 size=550694 2024-09-14T11:22:27.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.941+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=98CVSKEAE2VX tag=88I33P8RQ28U type=write size=2647846 2024-09-14T11:22:27.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.942+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~BOFBDMZPWZXO.0 size=122958 2024-09-14T11:22:27.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.944+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=BOFBDMZPWZXO tag=TZLSS9VV37SI type=write size=1171534 2024-09-14T11:22:27.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.945+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=DMBNVQA4Y2F4 type=del size=295770 2024-09-14T11:22:27.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.946+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~0FIMSC70C0N3.0 size=1048576 2024-09-14T11:22:27.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.947+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~0FIMSC70C0N3.1 size=1048576 2024-09-14T11:22:27.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.948+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~0FIMSC70C0N3.2 size=237817 2024-09-14T11:22:27.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.951+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=0FIMSC70C0N3 tag=MBV7M6JRZ5NL type=write size=3383545 2024-09-14T11:22:27.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.952+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=Q0ID192WH0XJ type=write size=157512 2024-09-14T11:22:27.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.953+0000 7f43cc561780 1 < completed write operation key=A1B2LIZIPET3 tag=AJ6Q1VV5ZL0X type=write size=495930 2024-09-14T11:22:27.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.954+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=44WGUSXV3M3T type=del size=1956611 2024-09-14T11:22:27.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.955+0000 7f43cc561780 1 < canceled part key=_multipart_AY7JGVM96MO7.2~7O1S1XVSH1GN.0 size=800997 2024-09-14T11:22:27.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.957+0000 7f43cc561780 1 < canceled multipart upload key=AY7JGVM96MO7 upload=7O1S1XVSH1GN tag=Q6EHGY3L0456 type=write size=1849573 2024-09-14T11:22:27.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.958+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=GTUVNX7S6Q87 type=del size=1941435 2024-09-14T11:22:27.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.959+0000 7f43cc561780 1 < completed write operation key=UWES4CQZ8XW6 tag=F7AVGX60PWRQ type=write size=548554 2024-09-14T11:22:27.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.960+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=30X00MPHHS0Y type=del size=3686077 2024-09-14T11:22:27.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.961+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=AWKECW609LY4 type=del 2024-09-14T11:22:27.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.963+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=XNNYZCMCF6EJ type=del size=674922 2024-09-14T11:22:27.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.965+0000 7f43cc561780 1 < suggested update operation key=AWBBRU4C8RDQ tag=3IX8COA8UEC6 type=del size=663692 2024-09-14T11:22:27.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.968+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~WEUHC1ODKTM2.0 size=1048576 2024-09-14T11:22:27.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.969+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~WEUHC1ODKTM2.1 size=69352 2024-09-14T11:22:27.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.969+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=WEUHC1ODKTM2 tag=USOG8IIW0K43 type=write size=2166504 2024-09-14T11:22:27.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.970+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~1PN91ZVYNI7X.0 size=322221 2024-09-14T11:22:27.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.972+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=1PN91ZVYNI7X tag=ICY5EHW2E9C1 type=write size=1370797 2024-09-14T11:22:27.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.974+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~J7Y3GAU7N287.0 size=1048576 2024-09-14T11:22:27.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.975+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~J7Y3GAU7N287.1 size=154659 2024-09-14T11:22:27.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.975+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=J7Y3GAU7N287 tag=JX13IDWXG8V8 type=write size=2251811 2024-09-14T11:22:27.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.976+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~8OD394DA2V0N.0 size=1048576 2024-09-14T11:22:27.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.977+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~8OD394DA2V0N.1 size=308595 2024-09-14T11:22:27.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.979+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=8OD394DA2V0N tag=H764729WI781 type=write size=2405747 2024-09-14T11:22:27.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.981+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=SM934V3LMQZ3 type=del size=1118255 2024-09-14T11:22:27.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.983+0000 7f43cc561780 1 < suggested remove operation key=CXP2PUIXR2PA tag=DO4WEF1FTERH type=write 2024-09-14T11:22:27.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.984+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=03PPU8J52GS2 type=del size=2393526 2024-09-14T11:22:27.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.985+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=FF6NTFC63YVD type=del 2024-09-14T11:22:27.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.987+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=GFCBZC5V2L4L type=del size=3551642 2024-09-14T11:22:27.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.988+0000 7f43cc561780 1 < completed write operation key=IG4QM506P41B tag=4JSC5UK7AT4R type=write size=446540 2024-09-14T11:22:27.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.989+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=MQL7KA2FRSPL type=del size=3051282 2024-09-14T11:22:27.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.990+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~58U2EPYZ4QPL.0 size=1048576 2024-09-14T11:22:27.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.991+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~58U2EPYZ4QPL.1 size=1048576 2024-09-14T11:22:27.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.992+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~58U2EPYZ4QPL.2 size=185932 2024-09-14T11:22:27.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.994+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=58U2EPYZ4QPL tag=8KXZUI0MCQ79 type=write size=3331660 2024-09-14T11:22:27.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.997+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~13JEBZS91PIV.0 size=1048576 2024-09-14T11:22:27.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.998+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~13JEBZS91PIV.1 size=1048576 2024-09-14T11:22:27.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.999+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~13JEBZS91PIV.2 size=135386 2024-09-14T11:22:27.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:27.999+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=13JEBZS91PIV tag=N41BW2FW5GMC type=write size=3281114 2024-09-14T11:22:27.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.000+0000 7f43cc561780 1 < canceled operation key=9XIAGZKIUBGH tag=0HGTREYAI6WN type=del size=3650019 2024-09-14T11:22:28.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.002+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~8XLLB36JPMZO.0 size=1048576 2024-09-14T11:22:28.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.003+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~8XLLB36JPMZO.1 size=61441 2024-09-14T11:22:28.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.003+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=8XLLB36JPMZO tag=0X9ZAKIHQKUA type=write size=2158593 2024-09-14T11:22:28.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.004+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=0HM61OU4YSLB type=del 2024-09-14T11:22:28.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.006+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=ZGFT3JANDYIF type=write size=949468 2024-09-14T11:22:28.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.007+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~98CVSKEAE2VX.0 size=1048576 2024-09-14T11:22:28.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.008+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~98CVSKEAE2VX.1 size=550694 2024-09-14T11:22:28.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.010+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=98CVSKEAE2VX tag=88I33P8RQ28U type=write size=2647846 2024-09-14T11:22:28.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.013+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~K2NND3R31OW2.0 size=1048576 2024-09-14T11:22:28.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.014+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~K2NND3R31OW2.1 size=1048576 2024-09-14T11:22:28.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.015+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~K2NND3R31OW2.2 size=340864 2024-09-14T11:22:28.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.015+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=K2NND3R31OW2 tag=3FIQ7OIQ44E6 type=write size=3486592 2024-09-14T11:22:28.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.016+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=DMBNVQA4Y2F4 type=del 2024-09-14T11:22:28.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.018+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=E4JPKNEE5B1W type=del size=3416273 2024-09-14T11:22:28.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.019+0000 7f43cc561780 1 < completed write operation key=MD14RGOQY0LK tag=Q0ID192WH0XJ type=write size=157512 2024-09-14T11:22:28.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.020+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=RVV4RUGJV91X type=del size=2400286 2024-09-14T11:22:28.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.021+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=44WGUSXV3M3T type=del 2024-09-14T11:22:28.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.023+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=UDM8I0COSCBY type=del size=3390093 2024-09-14T11:22:28.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.024+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=GTUVNX7S6Q87 type=del 2024-09-14T11:22:28.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.026+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~SO5SD3RQIH7N.0 size=534612 2024-09-14T11:22:28.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.026+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=SO5SD3RQIH7N tag=R1GTMFLPLEZT type=write size=1583188 2024-09-14T11:22:28.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.027+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=30X00MPHHS0Y type=del 2024-09-14T11:22:28.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.030+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=WTTRHBTWQ9ZX type=del size=590378 2024-09-14T11:22:28.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.031+0000 7f43cc561780 1 < canceled operation key=OV4ATW747PY4 tag=XNNYZCMCF6EJ type=del size=674922 2024-09-14T11:22:28.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.032+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=9UG1GF82MA3V type=del size=1472149 2024-09-14T11:22:28.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.034+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~WEUHC1ODKTM2.0 size=1048576 2024-09-14T11:22:28.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.035+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~WEUHC1ODKTM2.1 size=69352 2024-09-14T11:22:28.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.037+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=WEUHC1ODKTM2 tag=USOG8IIW0K43 type=write size=2166504 2024-09-14T11:22:28.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.039+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~29EUHPQ4JYMS.0 size=1048576 2024-09-14T11:22:28.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.040+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~29EUHPQ4JYMS.1 size=654553 2024-09-14T11:22:28.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.040+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=29EUHPQ4JYMS tag=6DVDUEX71BBW type=write size=2751705 2024-09-14T11:22:28.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.041+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~J7Y3GAU7N287.0 size=1048576 2024-09-14T11:22:28.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.042+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~J7Y3GAU7N287.1 size=154659 2024-09-14T11:22:28.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.044+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=J7Y3GAU7N287 tag=JX13IDWXG8V8 type=write size=2251811 2024-09-14T11:22:28.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.047+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~VFPA5INH5R3X.0 size=747359 2024-09-14T11:22:28.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.047+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=VFPA5INH5R3X tag=2YOBZ95VL1PD type=write size=1795935 2024-09-14T11:22:28.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.048+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=SM934V3LMQZ3 type=del 2024-09-14T11:22:28.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.050+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~AEDCVUT18J5P.0 size=352431 2024-09-14T11:22:28.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.050+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=AEDCVUT18J5P tag=N4SVMOAISHIV type=write size=1401007 2024-09-14T11:22:28.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.052+0000 7f43cc561780 1 < canceled operation key=3YHEZHW0RS1W tag=03PPU8J52GS2 type=del size=2393526 2024-09-14T11:22:28.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.053+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=ABBICFGLQS49 type=del size=2837108 2024-09-14T11:22:28.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.054+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=GFCBZC5V2L4L type=del 2024-09-14T11:22:28.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.055+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=MDW9QWTORZ1B type=del size=3735488 2024-09-14T11:22:28.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.058+0000 7f43cc561780 1 < suggested remove operation key=683ZFW0BWMT7 tag=MQL7KA2FRSPL type=del 2024-09-14T11:22:28.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.059+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=YMNAG8MDK7ZN type=del size=2162350 2024-09-14T11:22:28.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.060+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~13JEBZS91PIV.0 size=1048576 2024-09-14T11:22:28.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.060+0000 7f43cc561780 1 < canceled part key=_multipart_2975CNBC43ST.2~13JEBZS91PIV.1 size=1048576 2024-09-14T11:22:28.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.061+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~13JEBZS91PIV.2 size=135386 2024-09-14T11:22:28.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.063+0000 7f43cc561780 1 < canceled multipart upload key=2975CNBC43ST upload=13JEBZS91PIV tag=N41BW2FW5GMC type=write size=3281114 2024-09-14T11:22:28.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.064+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=8JA0X1SNBZCZ type=del size=1781981 2024-09-14T11:22:28.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.065+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~8XLLB36JPMZO.0 size=1048576 2024-09-14T11:22:28.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.066+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~8XLLB36JPMZO.1 size=61441 2024-09-14T11:22:28.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.068+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=8XLLB36JPMZO tag=0X9ZAKIHQKUA type=write size=2158593 2024-09-14T11:22:28.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.070+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=BXJC0AD19W89 type=del size=2507531 2024-09-14T11:22:28.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.071+0000 7f43cc561780 1 < completed write operation key=2975CNBC43ST tag=ZGFT3JANDYIF type=write size=949468 2024-09-14T11:22:28.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.072+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=B5OT7TQYO7RT type=del size=1359441 2024-09-14T11:22:28.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.073+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~K2NND3R31OW2.0 size=1048576 2024-09-14T11:22:28.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.074+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~K2NND3R31OW2.1 size=1048576 2024-09-14T11:22:28.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.075+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~K2NND3R31OW2.2 size=340864 2024-09-14T11:22:28.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.077+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=K2NND3R31OW2 tag=3FIQ7OIQ44E6 type=write size=3486592 2024-09-14T11:22:28.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.079+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~V83JPI504EX4.0 size=1048576 2024-09-14T11:22:28.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.080+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~V83JPI504EX4.1 size=369354 2024-09-14T11:22:28.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.080+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=V83JPI504EX4 tag=BDZYYCVN9GY3 type=write size=2466506 2024-09-14T11:22:28.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.082+0000 7f43cc561780 1 < suggested remove operation key=AWBBRU4C8RDQ tag=E4JPKNEE5B1W type=del 2024-09-14T11:22:28.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.084+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=BPSUAXOLJDUL type=del size=3392179 2024-09-14T11:22:28.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.086+0000 7f43cc561780 1 < suggested remove operation key=MD14RGOQY0LK tag=RVV4RUGJV91X type=del 2024-09-14T11:22:28.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.089+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~ROPD992LVKUC.0 size=1048576 2024-09-14T11:22:28.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.090+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~ROPD992LVKUC.1 size=162129 2024-09-14T11:22:28.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.090+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=ROPD992LVKUC tag=DHTB50IB8PJD type=write size=2259281 2024-09-14T11:22:28.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.091+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=UDM8I0COSCBY type=del 2024-09-14T11:22:28.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.092+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=A4GQ4DWUK7F4 type=del size=3133784 2024-09-14T11:22:28.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.093+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~SO5SD3RQIH7N.0 size=534612 2024-09-14T11:22:28.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.096+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=SO5SD3RQIH7N tag=R1GTMFLPLEZT type=write size=1583188 2024-09-14T11:22:28.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.099+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~M90V5LN645SC.0 size=681518 2024-09-14T11:22:28.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.099+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=M90V5LN645SC tag=4PYXFRD7VIU3 type=write size=1730094 2024-09-14T11:22:28.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.102+0000 7f43cc561780 1 < suggested update operation key=G6B4CGUBFSOT tag=WTTRHBTWQ9ZX type=del size=590378 2024-09-14T11:22:28.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.103+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=D9V0AYESK14K type=del size=3886163 2024-09-14T11:22:28.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.104+0000 7f43cc561780 -1 < failed to complete operation key=AWBBRU4C8RDQ tag=9UG1GF82MA3V type=del size=1472149: (22) Invalid argument 2024-09-14T11:22:28.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.105+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=0R6K45TW1CMR type=del size=1012428 2024-09-14T11:22:28.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.107+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~29EUHPQ4JYMS.0 size=1048576 2024-09-14T11:22:28.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.108+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~29EUHPQ4JYMS.1 size=654553 2024-09-14T11:22:28.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.110+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=29EUHPQ4JYMS tag=6DVDUEX71BBW type=write size=2751705 2024-09-14T11:22:28.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.112+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~9UB78Y5AFQGE.0 size=1048576 2024-09-14T11:22:28.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.113+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~9UB78Y5AFQGE.1 size=59366 2024-09-14T11:22:28.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.113+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=9UB78Y5AFQGE tag=AVKYDRSZVOL3 type=write size=2156518 2024-09-14T11:22:28.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.114+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~VFPA5INH5R3X.0 size=747359 2024-09-14T11:22:28.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.116+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=VFPA5INH5R3X tag=2YOBZ95VL1PD type=write size=1795935 2024-09-14T11:22:28.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.117+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=IVF9RNHHXG2Q type=del size=4182842 2024-09-14T11:22:28.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.119+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~AEDCVUT18J5P.0 size=352431 2024-09-14T11:22:28.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.121+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=AEDCVUT18J5P tag=N4SVMOAISHIV type=write size=1401007 2024-09-14T11:22:28.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.122+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=NWCXQF9BGHAT type=del size=2190485 2024-09-14T11:22:28.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.123+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=ABBICFGLQS49 type=del 2024-09-14T11:22:28.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.125+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~2WVYVM414S9B.0 size=1048576 2024-09-14T11:22:28.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.126+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~2WVYVM414S9B.1 size=1048576 2024-09-14T11:22:28.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.127+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~2WVYVM414S9B.2 size=1042969 2024-09-14T11:22:28.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.127+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=2WVYVM414S9B tag=ACAXZ6WYTAI8 type=write size=4188697 2024-09-14T11:22:28.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.128+0000 7f43cc561780 -1 < failed to complete operation key=683ZFW0BWMT7 tag=MDW9QWTORZ1B type=del size=3735488: (22) Invalid argument 2024-09-14T11:22:28.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.129+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=OYXX9MWT6E18 type=del size=2311719 2024-09-14T11:22:28.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.132+0000 7f43cc561780 1 < suggested update operation key=683ZFW0BWMT7 tag=YMNAG8MDK7ZN type=del size=2162350 2024-09-14T11:22:28.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.134+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~L2W7MZPY2A10.0 size=1048576 2024-09-14T11:22:28.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.135+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~L2W7MZPY2A10.1 size=659839 2024-09-14T11:22:28.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.135+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=L2W7MZPY2A10 tag=AE6UCWXHM69K type=write size=2756991 2024-09-14T11:22:28.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.136+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=8JA0X1SNBZCZ type=del 2024-09-14T11:22:28.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.138+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~FZBIL5RS5R00.0 size=340756 2024-09-14T11:22:28.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.138+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=FZBIL5RS5R00 tag=MOPFU9QHD5CT type=write size=1389332 2024-09-14T11:22:28.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.139+0000 7f43cc561780 -1 < failed to complete operation key=683ZFW0BWMT7 tag=BXJC0AD19W89 type=del size=2507531: (22) Invalid argument 2024-09-14T11:22:28.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.141+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=5J9ODRI7T3J4 type=del size=1274067 2024-09-14T11:22:28.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.142+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=B5OT7TQYO7RT type=del 2024-09-14T11:22:28.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.145+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~YED8AN29X2D1.0 size=1048576 2024-09-14T11:22:28.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.146+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~YED8AN29X2D1.1 size=771493 2024-09-14T11:22:28.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.146+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=YED8AN29X2D1 tag=A6U7QH8FX3M6 type=write size=2868645 2024-09-14T11:22:28.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.147+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~V83JPI504EX4.0 size=1048576 2024-09-14T11:22:28.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.148+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~V83JPI504EX4.1 size=369354 2024-09-14T11:22:28.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.150+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=V83JPI504EX4 tag=BDZYYCVN9GY3 type=write size=2466506 2024-09-14T11:22:28.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.152+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~3O2UUES2X73X.0 size=1048576 2024-09-14T11:22:28.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.153+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~3O2UUES2X73X.1 size=101571 2024-09-14T11:22:28.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.153+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=3O2UUES2X73X tag=8PQ49U5058ZP type=write size=2198723 2024-09-14T11:22:28.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.156+0000 7f43cc561780 1 < suggested remove operation key=2975CNBC43ST tag=BPSUAXOLJDUL type=del 2024-09-14T11:22:28.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.157+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=OH6H2VKB2AEK type=del size=3818340 2024-09-14T11:22:28.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.158+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~ROPD992LVKUC.0 size=1048576 2024-09-14T11:22:28.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.159+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~ROPD992LVKUC.1 size=162129 2024-09-14T11:22:28.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.161+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=ROPD992LVKUC tag=DHTB50IB8PJD type=write size=2259281 2024-09-14T11:22:28.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.163+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~JFK6M5MP0WE5.0 size=1048576 2024-09-14T11:22:28.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.164+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~JFK6M5MP0WE5.1 size=545409 2024-09-14T11:22:28.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.164+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=JFK6M5MP0WE5 tag=705NC8OTDXC2 type=write size=2642561 2024-09-14T11:22:28.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.165+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=A4GQ4DWUK7F4 type=del 2024-09-14T11:22:28.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.167+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~M8FCU3878TYJ.0 size=648646 2024-09-14T11:22:28.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.167+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=M8FCU3878TYJ tag=NZLE5YS7K2W7 type=write size=1697222 2024-09-14T11:22:28.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.168+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~M90V5LN645SC.0 size=681518 2024-09-14T11:22:28.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.170+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=M90V5LN645SC tag=4PYXFRD7VIU3 type=write size=1730094 2024-09-14T11:22:28.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.172+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=OL9WDAI324Y0 type=del size=1364698 2024-09-14T11:22:28.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.173+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=D9V0AYESK14K type=del 2024-09-14T11:22:28.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.174+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=R3HCDX25Z3Z8 type=del size=1075331 2024-09-14T11:22:28.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.175+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=0R6K45TW1CMR type=del 2024-09-14T11:22:28.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.177+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=OFFAOI0TX4KE type=del size=2578182 2024-09-14T11:22:28.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.178+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~9UB78Y5AFQGE.0 size=1048576 2024-09-14T11:22:28.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.179+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~9UB78Y5AFQGE.1 size=59366 2024-09-14T11:22:28.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.181+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=9UB78Y5AFQGE tag=AVKYDRSZVOL3 type=write size=2156518 2024-09-14T11:22:28.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.183+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~J65014XL96BO.0 size=1048576 2024-09-14T11:22:28.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.184+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~J65014XL96BO.1 size=1048576 2024-09-14T11:22:28.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.185+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~J65014XL96BO.2 size=181412 2024-09-14T11:22:28.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.185+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=J65014XL96BO tag=OPOH79580RDU type=write size=3327140 2024-09-14T11:22:28.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.187+0000 7f43cc561780 1 < suggested update operation key=MD14RGOQY0LK tag=IVF9RNHHXG2Q type=del size=4182842 2024-09-14T11:22:28.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.188+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=IPIMEE3B7M87 type=write size=873207 2024-09-14T11:22:28.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.191+0000 7f43cc561780 1 < suggested update operation key=W679WIFVPVOH tag=NWCXQF9BGHAT type=del size=2190485 2024-09-14T11:22:28.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.192+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=63DU8F83058A type=del size=3000711 2024-09-14T11:22:28.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.193+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~2WVYVM414S9B.0 size=1048576 2024-09-14T11:22:28.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.194+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~2WVYVM414S9B.1 size=1048576 2024-09-14T11:22:28.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.195+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~2WVYVM414S9B.2 size=1042969 2024-09-14T11:22:28.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.197+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=2WVYVM414S9B tag=ACAXZ6WYTAI8 type=write size=4188697 2024-09-14T11:22:28.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.198+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=67DCR4CZALWQ type=del size=1943222 2024-09-14T11:22:28.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.199+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=OYXX9MWT6E18 type=del 2024-09-14T11:22:28.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.200+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=6V064471I1OO type=del size=302901 2024-09-14T11:22:28.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.202+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~L2W7MZPY2A10.0 size=1048576 2024-09-14T11:22:28.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.203+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~L2W7MZPY2A10.1 size=659839 2024-09-14T11:22:28.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.205+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=L2W7MZPY2A10 tag=AE6UCWXHM69K type=write size=2756991 2024-09-14T11:22:28.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.206+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=O35E4J7H85JF type=del size=524668 2024-09-14T11:22:28.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.207+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~FZBIL5RS5R00.0 size=340756 2024-09-14T11:22:28.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.209+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=FZBIL5RS5R00 tag=MOPFU9QHD5CT type=write size=1389332 2024-09-14T11:22:28.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.211+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~WGMPJNOCSIFP.0 size=1048576 2024-09-14T11:22:28.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.212+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~WGMPJNOCSIFP.1 size=1048576 2024-09-14T11:22:28.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.213+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~WGMPJNOCSIFP.2 size=345814 2024-09-14T11:22:28.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.213+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=WGMPJNOCSIFP tag=FNR60JKYNJRU type=write size=3491542 2024-09-14T11:22:28.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.214+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=5J9ODRI7T3J4 type=del 2024-09-14T11:22:28.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.216+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=U6BGDUYNR3XW type=del size=1034022 2024-09-14T11:22:28.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.217+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~YED8AN29X2D1.0 size=1048576 2024-09-14T11:22:28.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.217+0000 7f43cc561780 1 < canceled part key=_multipart_LKY30XYUG2QW.2~YED8AN29X2D1.1 size=771493 2024-09-14T11:22:28.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.219+0000 7f43cc561780 1 < canceled multipart upload key=LKY30XYUG2QW upload=YED8AN29X2D1 tag=A6U7QH8FX3M6 type=write size=2868645 2024-09-14T11:22:28.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.221+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~8B5QP6H5ITBW.0 size=1048576 2024-09-14T11:22:28.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.222+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~8B5QP6H5ITBW.1 size=1048576 2024-09-14T11:22:28.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.223+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~8B5QP6H5ITBW.2 size=943297 2024-09-14T11:22:28.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.223+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=8B5QP6H5ITBW tag=O0DOOREFGKKN type=write size=4089025 2024-09-14T11:22:28.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.224+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~3O2UUES2X73X.0 size=1048576 2024-09-14T11:22:28.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.225+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~3O2UUES2X73X.1 size=101571 2024-09-14T11:22:28.226 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.227+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=3O2UUES2X73X tag=8PQ49U5058ZP type=write size=2198723 2024-09-14T11:22:28.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.229+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=9EXQD7ORO3EJ type=del size=1326921 2024-09-14T11:22:28.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.230+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=OH6H2VKB2AEK type=del 2024-09-14T11:22:28.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.232+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~CX4EJO26CT9E.0 size=1048576 2024-09-14T11:22:28.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.233+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~CX4EJO26CT9E.1 size=156913 2024-09-14T11:22:28.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.233+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=CX4EJO26CT9E tag=KR1HM0NY4HSX type=write size=2254065 2024-09-14T11:22:28.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.234+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~JFK6M5MP0WE5.0 size=1048576 2024-09-14T11:22:28.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.235+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~JFK6M5MP0WE5.1 size=545409 2024-09-14T11:22:28.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.237+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=JFK6M5MP0WE5 tag=705NC8OTDXC2 type=write size=2642561 2024-09-14T11:22:28.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.239+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=I79UPFZRZ795 type=del size=600836 2024-09-14T11:22:28.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.240+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~M8FCU3878TYJ.0 size=648646 2024-09-14T11:22:28.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.242+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=M8FCU3878TYJ tag=NZLE5YS7K2W7 type=write size=1697222 2024-09-14T11:22:28.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.243+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=NOBLFA1R5YOC type=del size=3261219 2024-09-14T11:22:28.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.244+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=OL9WDAI324Y0 type=del 2024-09-14T11:22:28.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.246+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~CX4H1D3RW2TJ.0 size=1048576 2024-09-14T11:22:28.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.247+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~CX4H1D3RW2TJ.1 size=496270 2024-09-14T11:22:28.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.247+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=CX4H1D3RW2TJ tag=QSR0ERD9V78X type=write size=2593422 2024-09-14T11:22:28.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.248+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=R3HCDX25Z3Z8 type=del 2024-09-14T11:22:28.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.249+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=S2CZ8K1HYPNE type=del size=3369625 2024-09-14T11:22:28.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.251+0000 7f43cc561780 1 < canceled operation key=0TDWJO4AWOOF tag=OFFAOI0TX4KE type=del size=2578182 2024-09-14T11:22:28.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.252+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=0JJMBKLLO0DN type=del size=152229 2024-09-14T11:22:28.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.253+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~J65014XL96BO.0 size=1048576 2024-09-14T11:22:28.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.255+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~J65014XL96BO.1 size=1048576 2024-09-14T11:22:28.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.256+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~J65014XL96BO.2 size=181412 2024-09-14T11:22:28.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.258+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=J65014XL96BO tag=OPOH79580RDU type=write size=3327140 2024-09-14T11:22:28.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.260+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=KHH4UUWJ7OMS type=write size=374582 2024-09-14T11:22:28.260 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.261+0000 7f43cc561780 1 < canceled operation key=A1B2LIZIPET3 tag=IPIMEE3B7M87 type=write size=873207 2024-09-14T11:22:28.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.263+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~UD32PR8YTGRW.0 size=858888 2024-09-14T11:22:28.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.263+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=UD32PR8YTGRW tag=WSZTXL7WNR6Z type=write size=1907464 2024-09-14T11:22:28.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.264+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=63DU8F83058A type=del 2024-09-14T11:22:28.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.267+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~TEL5NIBEY3IQ.0 size=1048576 2024-09-14T11:22:28.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.268+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~TEL5NIBEY3IQ.1 size=1048576 2024-09-14T11:22:28.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.269+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~TEL5NIBEY3IQ.2 size=181567 2024-09-14T11:22:28.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.269+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=TEL5NIBEY3IQ tag=7YJNFXEM0UDS type=write size=3327295 2024-09-14T11:22:28.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.270+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=67DCR4CZALWQ type=del 2024-09-14T11:22:28.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.271+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=FYQAQWDX497I type=del size=1223330 2024-09-14T11:22:28.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.273+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=6V064471I1OO type=del 2024-09-14T11:22:28.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.274+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=BLVWIEJU3PQ1 type=del size=3344603 2024-09-14T11:22:28.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.275+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=O35E4J7H85JF type=del 2024-09-14T11:22:28.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.276+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=WLP9ON3R9C23 type=del size=4097979 2024-09-14T11:22:28.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.277+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~WGMPJNOCSIFP.0 size=1048576 2024-09-14T11:22:28.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.278+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~WGMPJNOCSIFP.1 size=1048576 2024-09-14T11:22:28.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.279+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~WGMPJNOCSIFP.2 size=345814 2024-09-14T11:22:28.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.281+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=WGMPJNOCSIFP tag=FNR60JKYNJRU type=write size=3491542 2024-09-14T11:22:28.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.283+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=1ZJN1H7KBDXL type=del size=2553137 2024-09-14T11:22:28.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.284+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=U6BGDUYNR3XW type=del 2024-09-14T11:22:28.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.285+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=0V2L03B4TJZR type=write size=657938 2024-09-14T11:22:28.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.286+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~8B5QP6H5ITBW.0 size=1048576 2024-09-14T11:22:28.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.287+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~8B5QP6H5ITBW.1 size=1048576 2024-09-14T11:22:28.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.288+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~8B5QP6H5ITBW.2 size=943297 2024-09-14T11:22:28.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.290+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=8B5QP6H5ITBW tag=O0DOOREFGKKN type=write size=4089025 2024-09-14T11:22:28.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.292+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~7OB12EIV9849.0 size=173626 2024-09-14T11:22:28.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.292+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=7OB12EIV9849 tag=3WE281ZLE8KM type=write size=1222202 2024-09-14T11:22:28.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.294+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=9EXQD7ORO3EJ type=del 2024-09-14T11:22:28.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.295+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=UW5Q2WU00APY type=del size=2097361 2024-09-14T11:22:28.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.296+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~CX4EJO26CT9E.0 size=1048576 2024-09-14T11:22:28.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.298+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~CX4EJO26CT9E.1 size=156913 2024-09-14T11:22:28.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.299+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=CX4EJO26CT9E tag=KR1HM0NY4HSX type=write size=2254065 2024-09-14T11:22:28.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.301+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=OABLV9OH7JMQ type=del size=266153 2024-09-14T11:22:28.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.302+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=I79UPFZRZ795 type=del 2024-09-14T11:22:28.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.304+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~8Z5MNSS3L13J.0 size=1048576 2024-09-14T11:22:28.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.305+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~8Z5MNSS3L13J.1 size=940099 2024-09-14T11:22:28.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.305+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=8Z5MNSS3L13J tag=ACH41BRWINYK type=write size=3037251 2024-09-14T11:22:28.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.306+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=NOBLFA1R5YOC type=del 2024-09-14T11:22:28.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.308+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~HRJPWR4R4GRD.0 size=1048576 2024-09-14T11:22:28.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.309+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~HRJPWR4R4GRD.1 size=1048576 2024-09-14T11:22:28.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.310+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~HRJPWR4R4GRD.2 size=312967 2024-09-14T11:22:28.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.310+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=HRJPWR4R4GRD tag=IIKWQ44HLHGZ type=write size=3458695 2024-09-14T11:22:28.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.312+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~CX4H1D3RW2TJ.0 size=1048576 2024-09-14T11:22:28.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.313+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~CX4H1D3RW2TJ.1 size=496270 2024-09-14T11:22:28.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.315+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=CX4H1D3RW2TJ tag=QSR0ERD9V78X type=write size=2593422 2024-09-14T11:22:28.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.317+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~HTMWP8YCXLG0.0 size=1032262 2024-09-14T11:22:28.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.317+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=HTMWP8YCXLG0 tag=529YW580TI0M type=write size=2080838 2024-09-14T11:22:28.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.319+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=S2CZ8K1HYPNE type=del 2024-09-14T11:22:28.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.321+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~NP2VDSYBTZ6U.0 size=475315 2024-09-14T11:22:28.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.321+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=NP2VDSYBTZ6U tag=SNFW5ADYNLLV type=write size=1523891 2024-09-14T11:22:28.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.322+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=0JJMBKLLO0DN type=del 2024-09-14T11:22:28.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.324+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=BP6SNH1C0N6R type=del size=3528188 2024-09-14T11:22:28.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.326+0000 7f43cc561780 1 < suggested update operation key=CXP2PUIXR2PA tag=KHH4UUWJ7OMS type=write size=374582 2024-09-14T11:22:28.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.328+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=041LJARAOGVS type=del size=33920 2024-09-14T11:22:28.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.329+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~UD32PR8YTGRW.0 size=858888 2024-09-14T11:22:28.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.331+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=UD32PR8YTGRW tag=WSZTXL7WNR6Z type=write size=1907464 2024-09-14T11:22:28.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.333+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~HYPJCUYLFLP5.0 size=1048576 2024-09-14T11:22:28.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.334+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~HYPJCUYLFLP5.1 size=1048576 2024-09-14T11:22:28.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.335+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~HYPJCUYLFLP5.2 size=355522 2024-09-14T11:22:28.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.335+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=HYPJCUYLFLP5 tag=LXGP4KR5YP6Y type=write size=3501250 2024-09-14T11:22:28.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.336+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~TEL5NIBEY3IQ.0 size=1048576 2024-09-14T11:22:28.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.337+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~TEL5NIBEY3IQ.1 size=1048576 2024-09-14T11:22:28.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.338+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~TEL5NIBEY3IQ.2 size=181567 2024-09-14T11:22:28.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.340+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=TEL5NIBEY3IQ tag=7YJNFXEM0UDS type=write size=3327295 2024-09-14T11:22:28.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.342+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=2VU5ANZ4RAWW type=del size=78798 2024-09-14T11:22:28.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.344+0000 7f43cc561780 1 < suggested update operation key=BNNSFLYOU27F tag=FYQAQWDX497I type=del size=1223330 2024-09-14T11:22:28.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.346+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=GAQ09BAS27GO type=write size=789306 2024-09-14T11:22:28.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.347+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=BLVWIEJU3PQ1 type=del 2024-09-14T11:22:28.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.349+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~6H41AMYDDB70.0 size=1048576 2024-09-14T11:22:28.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.350+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~6H41AMYDDB70.1 size=1048576 2024-09-14T11:22:28.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.352+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~6H41AMYDDB70.2 size=822024 2024-09-14T11:22:28.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.352+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=6H41AMYDDB70 tag=8SGB4Q1E2ENR type=write size=3967752 2024-09-14T11:22:28.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.354+0000 7f43cc561780 1 < suggested update operation key=15F3ZZAAKT9B tag=WLP9ON3R9C23 type=del size=4097979 2024-09-14T11:22:28.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.357+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PDK9KQBEORXF.0 size=1048576 2024-09-14T11:22:28.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.358+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PDK9KQBEORXF.1 size=1048576 2024-09-14T11:22:28.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.359+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PDK9KQBEORXF.2 size=1025589 2024-09-14T11:22:28.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.359+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=PDK9KQBEORXF tag=YKP6RFEU79KA type=write size=4171317 2024-09-14T11:22:28.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.361+0000 7f43cc561780 1 < suggested remove operation key=IFHWMI5YO5L5 tag=1ZJN1H7KBDXL type=del 2024-09-14T11:22:28.362 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.363+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~MTO21V50B5A3.0 size=1036049 2024-09-14T11:22:28.362 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.363+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=MTO21V50B5A3 tag=G2HT40E6NBR2 type=write size=2084625 2024-09-14T11:22:28.363 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.365+0000 7f43cc561780 1 < completed write operation key=BZDW69C3Z97G tag=0V2L03B4TJZR type=write size=657938 2024-09-14T11:22:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.366+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=YMFNI3DAJIZ3 type=write size=223694 2024-09-14T11:22:28.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.367+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~7OB12EIV9849.0 size=173626 2024-09-14T11:22:28.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.369+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=7OB12EIV9849 tag=3WE281ZLE8KM type=write size=1222202 2024-09-14T11:22:28.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.372+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~1S7DXKUDGO1W.0 size=1048576 2024-09-14T11:22:28.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.373+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~1S7DXKUDGO1W.1 size=681219 2024-09-14T11:22:28.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.373+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=1S7DXKUDGO1W tag=RZVLOIZHGRZX type=write size=2778371 2024-09-14T11:22:28.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.374+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=UW5Q2WU00APY type=del 2024-09-14T11:22:28.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.376+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=74M22V4GSO24 type=del size=3950759 2024-09-14T11:22:28.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.378+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=OABLV9OH7JMQ type=del size=266153 2024-09-14T11:22:28.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.379+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=EPJRTNEIKXCF type=del size=1137614 2024-09-14T11:22:28.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.380+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~8Z5MNSS3L13J.0 size=1048576 2024-09-14T11:22:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.381+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~8Z5MNSS3L13J.1 size=940099 2024-09-14T11:22:28.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.383+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=8Z5MNSS3L13J tag=ACH41BRWINYK type=write size=3037251 2024-09-14T11:22:28.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.384+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=69VDUQLG13X8 type=del size=2529049 2024-09-14T11:22:28.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.386+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~HRJPWR4R4GRD.0 size=1048576 2024-09-14T11:22:28.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.387+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~HRJPWR4R4GRD.1 size=1048576 2024-09-14T11:22:28.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.387+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~HRJPWR4R4GRD.2 size=312967 2024-09-14T11:22:28.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.389+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=HRJPWR4R4GRD tag=IIKWQ44HLHGZ type=write size=3458695 2024-09-14T11:22:28.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.391+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~GBOPWY39N5CL.0 size=315477 2024-09-14T11:22:28.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.391+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=GBOPWY39N5CL tag=FVZYYYF4C44B type=write size=1364053 2024-09-14T11:22:28.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.393+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~HTMWP8YCXLG0.0 size=1032262 2024-09-14T11:22:28.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.395+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=HTMWP8YCXLG0 tag=529YW580TI0M type=write size=2080838 2024-09-14T11:22:28.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.396+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=ET4RYTVOMUOU type=del size=248431 2024-09-14T11:22:28.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.397+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~NP2VDSYBTZ6U.0 size=475315 2024-09-14T11:22:28.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.399+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=NP2VDSYBTZ6U tag=SNFW5ADYNLLV type=write size=1523891 2024-09-14T11:22:28.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.401+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~6CMDWSR33211.0 size=1048576 2024-09-14T11:22:28.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.402+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~6CMDWSR33211.1 size=873697 2024-09-14T11:22:28.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.402+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=6CMDWSR33211 tag=02U772AEDAP1 type=write size=2970849 2024-09-14T11:22:28.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.404+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=BP6SNH1C0N6R type=del 2024-09-14T11:22:28.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.406+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~NDI0TH1YRD3S.0 size=812889 2024-09-14T11:22:28.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.406+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=NDI0TH1YRD3S tag=GAE5X558GPDW type=write size=1861465 2024-09-14T11:22:28.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.407+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=041LJARAOGVS type=del 2024-09-14T11:22:28.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.408+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=IP9VXMPOCZO4 type=write size=772312 2024-09-14T11:22:28.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.410+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~HYPJCUYLFLP5.0 size=1048576 2024-09-14T11:22:28.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.411+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~HYPJCUYLFLP5.1 size=1048576 2024-09-14T11:22:28.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.411+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~HYPJCUYLFLP5.2 size=355522 2024-09-14T11:22:28.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.414+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=HYPJCUYLFLP5 tag=LXGP4KR5YP6Y type=write size=3501250 2024-09-14T11:22:28.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.417+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~3GUIRHF4WI5Z.0 size=1048576 2024-09-14T11:22:28.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.418+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~3GUIRHF4WI5Z.1 size=315420 2024-09-14T11:22:28.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.418+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=3GUIRHF4WI5Z tag=JE4BUE0PEWV9 type=write size=2412572 2024-09-14T11:22:28.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.419+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=2VU5ANZ4RAWW type=del 2024-09-14T11:22:28.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.421+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~9LCQO3ZQ6HW8.0 size=1048576 2024-09-14T11:22:28.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.422+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~9LCQO3ZQ6HW8.1 size=1048576 2024-09-14T11:22:28.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.423+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~9LCQO3ZQ6HW8.2 size=602584 2024-09-14T11:22:28.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.423+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=9LCQO3ZQ6HW8 tag=ZQB8YN6CV21S type=write size=3748312 2024-09-14T11:22:28.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.425+0000 7f43cc561780 1 < completed write operation key=OJOJZBG1WEGI tag=GAQ09BAS27GO type=write size=789306 2024-09-14T11:22:28.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.426+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=9AOF5OYANBKQ type=del size=1113130 2024-09-14T11:22:28.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.428+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~6H41AMYDDB70.0 size=1048576 2024-09-14T11:22:28.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.428+0000 7f43cc561780 1 < canceled part key=_multipart_BRHP3DQEO3HZ.2~6H41AMYDDB70.1 size=1048576 2024-09-14T11:22:28.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.429+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~6H41AMYDDB70.2 size=822024 2024-09-14T11:22:28.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.431+0000 7f43cc561780 1 < canceled multipart upload key=BRHP3DQEO3HZ upload=6H41AMYDDB70 tag=8SGB4Q1E2ENR type=write size=3967752 2024-09-14T11:22:28.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.433+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~72YU82Y1LP8X.0 size=1048576 2024-09-14T11:22:28.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.434+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~72YU82Y1LP8X.1 size=457690 2024-09-14T11:22:28.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.434+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=72YU82Y1LP8X tag=2A6ZGLX3INS3 type=write size=2554842 2024-09-14T11:22:28.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.436+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PDK9KQBEORXF.0 size=1048576 2024-09-14T11:22:28.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.437+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PDK9KQBEORXF.1 size=1048576 2024-09-14T11:22:28.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.438+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PDK9KQBEORXF.2 size=1025589 2024-09-14T11:22:28.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.440+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=PDK9KQBEORXF tag=YKP6RFEU79KA type=write size=4171317 2024-09-14T11:22:28.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.441+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=NMGJJ4A3FVYL type=del size=264236 2024-09-14T11:22:28.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.442+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~MTO21V50B5A3.0 size=1036049 2024-09-14T11:22:28.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.444+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=MTO21V50B5A3 tag=G2HT40E6NBR2 type=write size=2084625 2024-09-14T11:22:28.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.445+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=KMKCNZMIMSR2 type=del size=885971 2024-09-14T11:22:28.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.447+0000 7f43cc561780 1 < suggested remove operation key=CXP2PUIXR2PA tag=YMFNI3DAJIZ3 type=write 2024-09-14T11:22:28.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.449+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=43XH4WL7VEX9 type=del size=2728031 2024-09-14T11:22:28.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.450+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~1S7DXKUDGO1W.0 size=1048576 2024-09-14T11:22:28.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.450+0000 7f43cc561780 1 < canceled part key=_multipart_WSFZN6JCWUXG.2~1S7DXKUDGO1W.1 size=681219 2024-09-14T11:22:28.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.452+0000 7f43cc561780 1 < canceled multipart upload key=WSFZN6JCWUXG upload=1S7DXKUDGO1W tag=RZVLOIZHGRZX type=write size=2778371 2024-09-14T11:22:28.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.453+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=8HQHD71KM2W8 type=write size=238153 2024-09-14T11:22:28.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.455+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=74M22V4GSO24 type=del 2024-09-14T11:22:28.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.456+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=KVSVY8B2VGHO type=del size=1558802 2024-09-14T11:22:28.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.457+0000 7f43cc561780 1 < canceled operation key=MD14RGOQY0LK tag=EPJRTNEIKXCF type=del size=1137614 2024-09-14T11:22:28.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.459+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~OJOVD0XSLO9A.0 size=479969 2024-09-14T11:22:28.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.459+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=OJOVD0XSLO9A tag=O02J8OIOTAPA type=write size=1528545 2024-09-14T11:22:28.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.460+0000 7f43cc561780 1 < canceled operation key=D8EBH4NWN7SK tag=69VDUQLG13X8 type=del size=2529049 2024-09-14T11:22:28.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.462+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=UA2O8DQZQMFJ type=del size=2896622 2024-09-14T11:22:28.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.463+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~GBOPWY39N5CL.0 size=315477 2024-09-14T11:22:28.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.465+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=GBOPWY39N5CL tag=FVZYYYF4C44B type=write size=1364053 2024-09-14T11:22:28.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.467+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~LWNX3Y20S2KU.0 size=1048576 2024-09-14T11:22:28.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.468+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~LWNX3Y20S2KU.1 size=1048576 2024-09-14T11:22:28.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.469+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~LWNX3Y20S2KU.2 size=583014 2024-09-14T11:22:28.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.469+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=LWNX3Y20S2KU tag=6KL0SD40M12E type=write size=3728742 2024-09-14T11:22:28.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.471+0000 7f43cc561780 1 < suggested remove operation key=E6FDCACWGA2Y tag=ET4RYTVOMUOU type=del 2024-09-14T11:22:28.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.473+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=0SRQD4EDBQQL type=del size=1221705 2024-09-14T11:22:28.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.474+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~6CMDWSR33211.0 size=1048576 2024-09-14T11:22:28.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.475+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~6CMDWSR33211.1 size=873697 2024-09-14T11:22:28.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.477+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=6CMDWSR33211 tag=02U772AEDAP1 type=write size=2970849 2024-09-14T11:22:28.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.479+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~JZS7ZCVQVBS0.0 size=1048576 2024-09-14T11:22:28.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.480+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~JZS7ZCVQVBS0.1 size=85096 2024-09-14T11:22:28.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.480+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=JZS7ZCVQVBS0 tag=YVV7KVX44A30 type=write size=2182248 2024-09-14T11:22:28.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.482+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~NDI0TH1YRD3S.0 size=812889 2024-09-14T11:22:28.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.485+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=NDI0TH1YRD3S tag=GAE5X558GPDW type=write size=1861465 2024-09-14T11:22:28.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.487+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~AFSIFB2ZWYTO.0 size=1048576 2024-09-14T11:22:28.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.488+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~AFSIFB2ZWYTO.1 size=1048576 2024-09-14T11:22:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.489+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~AFSIFB2ZWYTO.2 size=668081 2024-09-14T11:22:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.489+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=AFSIFB2ZWYTO tag=CJO53P0MFTGA type=write size=3813809 2024-09-14T11:22:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.490+0000 7f43cc561780 1 < completed write operation key=G6B4CGUBFSOT tag=IP9VXMPOCZO4 type=write size=772312 2024-09-14T11:22:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.491+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=MZTSB3PUFOCD type=write size=963908 2024-09-14T11:22:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.493+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~3GUIRHF4WI5Z.0 size=1048576 2024-09-14T11:22:28.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.494+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~3GUIRHF4WI5Z.1 size=315420 2024-09-14T11:22:28.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.496+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=3GUIRHF4WI5Z tag=JE4BUE0PEWV9 type=write size=2412572 2024-09-14T11:22:28.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.498+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~JQ9V3S4DKCXM.0 size=1048576 2024-09-14T11:22:28.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.499+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~JQ9V3S4DKCXM.1 size=1048576 2024-09-14T11:22:28.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.500+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~JQ9V3S4DKCXM.2 size=241396 2024-09-14T11:22:28.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.500+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=JQ9V3S4DKCXM tag=9O59JB0V1CGU type=write size=3387124 2024-09-14T11:22:28.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.500+0000 7f43cc561780 1 < canceled part key=_multipart_LKY30XYUG2QW.2~9LCQO3ZQ6HW8.0 size=1048576 2024-09-14T11:22:28.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.501+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~9LCQO3ZQ6HW8.1 size=1048576 2024-09-14T11:22:28.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.501+0000 7f43cc561780 1 < canceled part key=_multipart_LKY30XYUG2QW.2~9LCQO3ZQ6HW8.2 size=602584 2024-09-14T11:22:28.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.503+0000 7f43cc561780 1 < canceled multipart upload key=LKY30XYUG2QW upload=9LCQO3ZQ6HW8 tag=ZQB8YN6CV21S type=write size=3748312 2024-09-14T11:22:28.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.505+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~BV0H2PECHOCO.0 size=1048576 2024-09-14T11:22:28.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.506+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~BV0H2PECHOCO.1 size=1048576 2024-09-14T11:22:28.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.507+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~BV0H2PECHOCO.2 size=251006 2024-09-14T11:22:28.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.507+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=BV0H2PECHOCO tag=5RV9JZ9Z3QM5 type=write size=3396734 2024-09-14T11:22:28.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.509+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=9AOF5OYANBKQ type=del 2024-09-14T11:22:28.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.510+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=KYG5MQNCG38O type=del size=657400 2024-09-14T11:22:28.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.511+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~72YU82Y1LP8X.0 size=1048576 2024-09-14T11:22:28.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.512+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~72YU82Y1LP8X.1 size=457690 2024-09-14T11:22:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.514+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=72YU82Y1LP8X tag=2A6ZGLX3INS3 type=write size=2554842 2024-09-14T11:22:28.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.516+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=GQ5PK6WRVND7 type=del size=2977606 2024-09-14T11:22:28.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.518+0000 7f43cc561780 1 < suggested remove operation key=UWES4CQZ8XW6 tag=NMGJJ4A3FVYL type=del 2024-09-14T11:22:28.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.520+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=DZHQHX0RTRLE type=write size=10369 2024-09-14T11:22:28.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.521+0000 7f43cc561780 -1 < failed to complete operation key=CXP2PUIXR2PA tag=KMKCNZMIMSR2 type=del size=885971: (22) Invalid argument 2024-09-14T11:22:28.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.523+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~SNAWDL4OZRR6.0 size=1048576 2024-09-14T11:22:28.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.524+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~SNAWDL4OZRR6.1 size=1048576 2024-09-14T11:22:28.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.525+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~SNAWDL4OZRR6.2 size=621957 2024-09-14T11:22:28.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.525+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=SNAWDL4OZRR6 tag=LDHCNJTLSQYV type=write size=3767685 2024-09-14T11:22:28.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.526+0000 7f43cc561780 1 < canceled operation key=FISMBWPDPCTA tag=43XH4WL7VEX9 type=del size=2728031 2024-09-14T11:22:28.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.527+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=97CRUKKWHWJP type=del size=4163067 2024-09-14T11:22:28.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.530+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=8HQHD71KM2W8 type=write 2024-09-14T11:22:28.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.532+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~JKGNNLISFXYX.0 size=1048576 2024-09-14T11:22:28.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.533+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~JKGNNLISFXYX.1 size=1048576 2024-09-14T11:22:28.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.534+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~JKGNNLISFXYX.2 size=860746 2024-09-14T11:22:28.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.534+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=JKGNNLISFXYX tag=R221TGBVGTFO type=write size=4006474 2024-09-14T11:22:28.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.535+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=KVSVY8B2VGHO type=del 2024-09-14T11:22:28.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.537+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~4WYQDHZE1475.0 size=1048576 2024-09-14T11:22:28.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.538+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~4WYQDHZE1475.1 size=501113 2024-09-14T11:22:28.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.538+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=4WYQDHZE1475 tag=T2F2U2K0JPRW type=write size=2598265 2024-09-14T11:22:28.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.540+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~OJOVD0XSLO9A.0 size=479969 2024-09-14T11:22:28.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.542+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=OJOVD0XSLO9A tag=O02J8OIOTAPA type=write size=1528545 2024-09-14T11:22:28.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.543+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=T3940XREKW7K type=write size=177848 2024-09-14T11:22:28.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.545+0000 7f43cc561780 1 < suggested remove operation key=3YHEZHW0RS1W tag=UA2O8DQZQMFJ type=del 2024-09-14T11:22:28.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.547+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~QLAWDA4MW74B.0 size=1048576 2024-09-14T11:22:28.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.548+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~QLAWDA4MW74B.1 size=541990 2024-09-14T11:22:28.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.548+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=QLAWDA4MW74B tag=XPMI1TDCTXLJ type=write size=2639142 2024-09-14T11:22:28.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.549+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~LWNX3Y20S2KU.0 size=1048576 2024-09-14T11:22:28.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.550+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~LWNX3Y20S2KU.1 size=1048576 2024-09-14T11:22:28.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.551+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~LWNX3Y20S2KU.2 size=583014 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.553+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=LWNX3Y20S2KU tag=6KL0SD40M12E type=write size=3728742 2024-09-14T11:22:28.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.554+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=VJM1U8RGDC3E type=del size=546863 2024-09-14T11:22:28.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.555+0000 7f43cc561780 1 < canceled operation key=BZDW69C3Z97G tag=0SRQD4EDBQQL type=del size=1221705 2024-09-14T11:22:28.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.556+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=DIAPYI0UL8CW type=del size=1522949 2024-09-14T11:22:28.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.558+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~JZS7ZCVQVBS0.0 size=1048576 2024-09-14T11:22:28.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.558+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~JZS7ZCVQVBS0.1 size=85096 2024-09-14T11:22:28.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.560+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=JZS7ZCVQVBS0 tag=YVV7KVX44A30 type=write size=2182248 2024-09-14T11:22:28.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.563+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~3X2Z1EE6S171.0 size=1048576 2024-09-14T11:22:28.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.564+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~3X2Z1EE6S171.1 size=424472 2024-09-14T11:22:28.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.564+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=3X2Z1EE6S171 tag=2UB1IVTHE6WA type=write size=2521624 2024-09-14T11:22:28.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.565+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~AFSIFB2ZWYTO.0 size=1048576 2024-09-14T11:22:28.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.566+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~AFSIFB2ZWYTO.1 size=1048576 2024-09-14T11:22:28.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.567+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~AFSIFB2ZWYTO.2 size=668081 2024-09-14T11:22:28.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.570+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=AFSIFB2ZWYTO tag=CJO53P0MFTGA type=write size=3813809 2024-09-14T11:22:28.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.571+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=34R0UD2AWW2X type=del size=2297651 2024-09-14T11:22:28.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.572+0000 7f43cc561780 1 < completed write operation key=BRHP3DQEO3HZ tag=MZTSB3PUFOCD type=write size=963908 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.574+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=DT47Z9NOGNLV type=del size=3961598 2024-09-14T11:22:28.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.575+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~JQ9V3S4DKCXM.0 size=1048576 2024-09-14T11:22:28.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.576+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~JQ9V3S4DKCXM.1 size=1048576 2024-09-14T11:22:28.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.577+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~JQ9V3S4DKCXM.2 size=241396 2024-09-14T11:22:28.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.580+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=JQ9V3S4DKCXM tag=9O59JB0V1CGU type=write size=3387124 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.581+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=8GOFP6DNM4KA type=del size=3765080 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.582+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~BV0H2PECHOCO.0 size=1048576 2024-09-14T11:22:28.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.584+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~BV0H2PECHOCO.1 size=1048576 2024-09-14T11:22:28.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.585+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~BV0H2PECHOCO.2 size=251006 2024-09-14T11:22:28.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.587+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=BV0H2PECHOCO tag=5RV9JZ9Z3QM5 type=write size=3396734 2024-09-14T11:22:28.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.588+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=S1PWMS18KMG5 type=write size=773027 2024-09-14T11:22:28.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.589+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=KYG5MQNCG38O type=del 2024-09-14T11:22:28.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.591+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=TS7A4ASMFZQW type=del size=3109726 2024-09-14T11:22:28.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.592+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=GQ5PK6WRVND7 type=del 2024-09-14T11:22:28.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.593+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=NT7SPJAU2NTK type=del size=3282381 2024-09-14T11:22:28.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.596+0000 7f43cc561780 1 < suggested update operation key=E6FDCACWGA2Y tag=DZHQHX0RTRLE type=write size=10369 2024-09-14T11:22:28.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.599+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=21NF3121LY6P type=del size=2557578 2024-09-14T11:22:28.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.600+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~SNAWDL4OZRR6.0 size=1048576 2024-09-14T11:22:28.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.601+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~SNAWDL4OZRR6.1 size=1048576 2024-09-14T11:22:28.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.602+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~SNAWDL4OZRR6.2 size=621957 2024-09-14T11:22:28.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.604+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=SNAWDL4OZRR6 tag=LDHCNJTLSQYV type=write size=3767685 2024-09-14T11:22:28.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.606+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~1TMR3KJNNXQJ.0 size=73817 2024-09-14T11:22:28.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.606+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=1TMR3KJNNXQJ tag=691SGTLVILQN type=write size=1122393 2024-09-14T11:22:28.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.608+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=97CRUKKWHWJP type=del 2024-09-14T11:22:28.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.609+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=9OU119I7J4UI type=write size=933574 2024-09-14T11:22:28.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.610+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~JKGNNLISFXYX.0 size=1048576 2024-09-14T11:22:28.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.611+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~JKGNNLISFXYX.1 size=1048576 2024-09-14T11:22:28.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.612+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~JKGNNLISFXYX.2 size=860746 2024-09-14T11:22:28.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.614+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=JKGNNLISFXYX tag=R221TGBVGTFO type=write size=4006474 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.616+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=13EC3B9KYSK9 type=del size=2660599 2024-09-14T11:22:28.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.617+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~4WYQDHZE1475.0 size=1048576 2024-09-14T11:22:28.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.618+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~4WYQDHZE1475.1 size=501113 2024-09-14T11:22:28.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.620+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=4WYQDHZE1475 tag=T2F2U2K0JPRW type=write size=2598265 2024-09-14T11:22:28.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.622+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=XBH0PV67U8JI type=del size=2989673 2024-09-14T11:22:28.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.623+0000 7f43cc561780 1 < completed write operation key=9XIAGZKIUBGH tag=T3940XREKW7K type=write size=177848 2024-09-14T11:22:28.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.624+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=IIVXCP884FZW type=write size=136309 2024-09-14T11:22:28.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.625+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~QLAWDA4MW74B.0 size=1048576 2024-09-14T11:22:28.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.626+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~QLAWDA4MW74B.1 size=541990 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.628+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=QLAWDA4MW74B tag=XPMI1TDCTXLJ type=write size=2639142 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.630+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~4092LP9BP6Z8.0 size=192697 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.630+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=4092LP9BP6Z8 tag=OG3245Q10G7U type=write size=1241273 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.632+0000 7f43cc561780 1 < suggested update operation key=W679WIFVPVOH tag=VJM1U8RGDC3E type=del size=546863 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.633+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=Z8ZJKO40D045 type=write size=305452 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.634+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=DIAPYI0UL8CW type=del 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.636+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=0O1IG5Q6J7ZZ type=del size=129787 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.636+0000 7f43cc561780 1 < canceled part key=_multipart_WHIZ2GREK1FE.2~3X2Z1EE6S171.0 size=1048576 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.637+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~3X2Z1EE6S171.1 size=424472 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.639+0000 7f43cc561780 1 < canceled multipart upload key=WHIZ2GREK1FE upload=3X2Z1EE6S171 tag=2UB1IVTHE6WA type=write size=2521624 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.641+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~WW32ZAGOTOUM.0 size=1048576 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.642+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~WW32ZAGOTOUM.1 size=997701 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.642+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=WW32ZAGOTOUM tag=5HQ8XX810KR3 type=write size=3094853 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.644+0000 7f43cc561780 1 < suggested update operation key=D8EBH4NWN7SK tag=34R0UD2AWW2X type=del size=2297651 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.646+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=SZUETG2GYYCL type=write size=457088 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.647+0000 7f43cc561780 1 < canceled operation key=A1B2LIZIPET3 tag=DT47Z9NOGNLV type=del size=3961598 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.648+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=0F0BDDUL2EV2 type=write size=170029 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.649+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=8GOFP6DNM4KA type=del 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.650+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=NC4DQG4B34D7 type=del size=1215354 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.652+0000 7f43cc561780 1 < completed write operation key=UWES4CQZ8XW6 tag=S1PWMS18KMG5 type=write size=773027 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.653+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=18GRC5EHL2YN type=del size=1113534 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.654+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=TS7A4ASMFZQW type=del 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.655+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=KVHBRUP8DUI5 type=del size=3722523 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.657+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=NT7SPJAU2NTK type=del 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.658+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=LAG96QTUPIE5 type=del size=343010 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.659+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=21NF3121LY6P type=del 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.661+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~QXXGNIHJLUNR.0 size=258147 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.661+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=QXXGNIHJLUNR tag=2981Z1D0323J type=write size=1306723 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.662+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~1TMR3KJNNXQJ.0 size=73817 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.664+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=1TMR3KJNNXQJ tag=691SGTLVILQN type=write size=1122393 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.667+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~W6PMSDNLEA4A.0 size=1048576 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.668+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~W6PMSDNLEA4A.1 size=1048576 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.669+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~W6PMSDNLEA4A.2 size=325971 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.669+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=W6PMSDNLEA4A tag=NMSZZMET01L8 type=write size=3471699 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.671+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=9OU119I7J4UI type=write 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.673+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~QKBZDP6QTPSA.0 size=1048576 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.674+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~QKBZDP6QTPSA.1 size=1048576 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.675+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~QKBZDP6QTPSA.2 size=991010 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.675+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=QKBZDP6QTPSA tag=NSXKQE7Q1C9Q type=write size=4136738 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.677+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=13EC3B9KYSK9 type=del 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.678+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=FT1LPJKVKUX3 type=del size=231882 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.679+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=XBH0PV67U8JI type=del 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.680+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=W8QD138QC2JI type=del size=2312438 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.682+0000 7f43cc561780 1 < canceled operation key=IFHWMI5YO5L5 tag=IIVXCP884FZW type=write size=136309 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.683+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=L257I698JVF7 type=del size=2908814 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.684+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~4092LP9BP6Z8.0 size=192697 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.686+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=4092LP9BP6Z8 tag=OG3245Q10G7U type=write size=1241273 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.688+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~CXEC7311CIV0.0 size=1048576 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.689+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~CXEC7311CIV0.1 size=585398 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.689+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=CXEC7311CIV0 tag=ENOOXQA7X5FO type=write size=2682550 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.692+0000 7f43cc561780 1 < suggested remove operation key=AY7JGVM96MO7 tag=Z8ZJKO40D045 type=write 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.693+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=NSLJY4CJTN1R type=del size=2364604 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.694+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=0O1IG5Q6J7ZZ type=del 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.695+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=ZY8L3WKXTRNA type=del size=3552575 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.697+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~WW32ZAGOTOUM.0 size=1048576 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.698+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~WW32ZAGOTOUM.1 size=997701 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.700+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=WW32ZAGOTOUM tag=5HQ8XX810KR3 type=write size=3094853 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.702+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~UGQ35HFLFW2H.0 size=367052 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.702+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=UGQ35HFLFW2H tag=67A3TL8BKCD3 type=write size=1415628 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.703+0000 7f43cc561780 1 < completed write operation key=END3SHHS0FSA tag=SZUETG2GYYCL type=write size=457088 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.704+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=RJWB4V130QNG type=del size=1010025 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.705+0000 7f43cc561780 1 < completed write operation key=683ZFW0BWMT7 tag=0F0BDDUL2EV2 type=write size=170029 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.708+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~VC0AFDOQY030.0 size=1048576 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.709+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~VC0AFDOQY030.1 size=270827 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.709+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=VC0AFDOQY030 tag=J6EEPB3W27Z0 type=write size=2367979 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.711+0000 7f43cc561780 1 < suggested update operation key=3YHEZHW0RS1W tag=NC4DQG4B34D7 type=del size=1215354 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.714+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=LB43Q9ZHM1BW type=write size=558238 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.715+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=18GRC5EHL2YN type=del 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.716+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=Y2OO5I7QKUOC type=del size=2110898 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.717+0000 7f43cc561780 -1 < failed to complete operation key=AY7JGVM96MO7 tag=KVHBRUP8DUI5 type=del size=3722523: (22) Invalid argument 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.719+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=NXW8U5MKQO88 type=del size=2433413 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.720+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=LAG96QTUPIE5 type=del 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.721+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=A8B48I3SIZE0 type=write size=880300 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.722+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~QXXGNIHJLUNR.0 size=258147 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.724+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=QXXGNIHJLUNR tag=2981Z1D0323J type=write size=1306723 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.725+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=4FLX8M7E2WLG type=del size=558339 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.727+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~W6PMSDNLEA4A.0 size=1048576 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.728+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~W6PMSDNLEA4A.1 size=1048576 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.729+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~W6PMSDNLEA4A.2 size=325971 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.730+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=W6PMSDNLEA4A tag=NMSZZMET01L8 type=write size=3471699 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.732+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=9MSZIOT84GB0 type=del size=181326 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.733+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~QKBZDP6QTPSA.0 size=1048576 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.734+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~QKBZDP6QTPSA.1 size=1048576 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.735+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~QKBZDP6QTPSA.2 size=991010 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.737+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=QKBZDP6QTPSA tag=NSXKQE7Q1C9Q type=write size=4136738 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.738+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=D43KQLEQJS3M type=del size=1865877 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.740+0000 7f43cc561780 1 < suggested update operation key=0TDWJO4AWOOF tag=FT1LPJKVKUX3 type=del size=231882 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.742+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=TCBRHGSI9VQR type=del size=332831 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.743+0000 7f43cc561780 1 < canceled operation key=2975CNBC43ST tag=W8QD138QC2JI type=del size=2312438 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.744+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=AVP5200XTS0R type=write size=487458 2024-09-14T11:22:28.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.745+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=L257I698JVF7 type=del 2024-09-14T11:22:28.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.746+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=ECUG4B596EZ3 type=del size=4088742 2024-09-14T11:22:28.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.747+0000 7f43cc561780 1 < canceled part key=_multipart_LKY30XYUG2QW.2~CXEC7311CIV0.0 size=1048576 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.748+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~CXEC7311CIV0.1 size=585398 2024-09-14T11:22:28.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.749+0000 7f43cc561780 1 < canceled multipart upload key=LKY30XYUG2QW upload=CXEC7311CIV0 tag=ENOOXQA7X5FO type=write size=2682550 2024-09-14T11:22:28.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.751+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=FHV4MO8U8LE5 type=del size=2146135 2024-09-14T11:22:28.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.752+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=NSLJY4CJTN1R type=del 2024-09-14T11:22:28.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.754+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~YW6BGG372DFI.0 size=265271 2024-09-14T11:22:28.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.754+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=YW6BGG372DFI tag=OV36KSDPI32O type=write size=1313847 2024-09-14T11:22:28.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.755+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=ZY8L3WKXTRNA type=del 2024-09-14T11:22:28.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.757+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~M4UGC87M04PX.0 size=1048576 2024-09-14T11:22:28.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.758+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~M4UGC87M04PX.1 size=807870 2024-09-14T11:22:28.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.758+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=M4UGC87M04PX tag=W8QYSQ1TCO2U type=write size=2905022 2024-09-14T11:22:28.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.759+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~UGQ35HFLFW2H.0 size=367052 2024-09-14T11:22:28.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.761+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=UGQ35HFLFW2H tag=67A3TL8BKCD3 type=write size=1415628 2024-09-14T11:22:28.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.763+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=2RNHYY9JO41H type=del size=3216404 2024-09-14T11:22:28.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.765+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=RJWB4V130QNG type=del 2024-09-14T11:22:28.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.767+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~XK2WN1QWK66K.0 size=563693 2024-09-14T11:22:28.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.767+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=XK2WN1QWK66K tag=G6QMAUVDUKPX type=write size=1612269 2024-09-14T11:22:28.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.768+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~VC0AFDOQY030.0 size=1048576 2024-09-14T11:22:28.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.769+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~VC0AFDOQY030.1 size=270827 2024-09-14T11:22:28.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.771+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=VC0AFDOQY030 tag=J6EEPB3W27Z0 type=write size=2367979 2024-09-14T11:22:28.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.772+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=M3VO9NKPSH9T type=del size=915854 2024-09-14T11:22:28.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.774+0000 7f43cc561780 1 < completed write operation key=1M46U4U9MG1E tag=LB43Q9ZHM1BW type=write size=558238 2024-09-14T11:22:28.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.776+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~Q5TLYFIJO5XP.0 size=1003142 2024-09-14T11:22:28.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.776+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=Q5TLYFIJO5XP tag=LFH2AQYHGDV8 type=write size=2051718 2024-09-14T11:22:28.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.778+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=Y2OO5I7QKUOC type=del 2024-09-14T11:22:28.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.779+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=QT1CBSLNZACQ type=del size=2466317 2024-09-14T11:22:28.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.780+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=NXW8U5MKQO88 type=del 2024-09-14T11:22:28.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.782+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~KS7M4B3645HS.0 size=789300 2024-09-14T11:22:28.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.782+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=KS7M4B3645HS tag=VC6G7KY1SXI0 type=write size=1837876 2024-09-14T11:22:28.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.783+0000 7f43cc561780 -1 < no bi entry to suggest for operation key=D84127SVSIPL tag=A8B48I3SIZE0 type=write size=880300: (2) No such file or directory 2024-09-14T11:22:28.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.785+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~4857C0V9VC5U.0 size=1048576 2024-09-14T11:22:28.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.786+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~4857C0V9VC5U.1 size=202708 2024-09-14T11:22:28.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.786+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=4857C0V9VC5U tag=VVBRU0ECOB02 type=write size=2299860 2024-09-14T11:22:28.786 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.787+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=4FLX8M7E2WLG type=del 2024-09-14T11:22:28.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.788+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=ZAAMWL845CZ8 type=del size=317992 2024-09-14T11:22:28.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.790+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=9MSZIOT84GB0 type=del 2024-09-14T11:22:28.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.791+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=OOPPQDABORYX type=del size=3232549 2024-09-14T11:22:28.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.792+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=D43KQLEQJS3M type=del 2024-09-14T11:22:28.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.794+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~W2D1ZM9KOWJA.0 size=443730 2024-09-14T11:22:28.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.794+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=W2D1ZM9KOWJA tag=6I072UOCPXGA type=write size=1492306 2024-09-14T11:22:28.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.796+0000 7f43cc561780 1 < suggested update operation key=LKY30XYUG2QW tag=TCBRHGSI9VQR type=del size=332831 2024-09-14T11:22:28.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.798+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=SMKKE2JA18MW type=del size=3496275 2024-09-14T11:22:28.798 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.799+0000 7f43cc561780 1 < completed write operation key=MD14RGOQY0LK tag=AVP5200XTS0R type=write size=487458 2024-09-14T11:22:28.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.800+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=SIPVQ6QKNF3N type=del size=680252 2024-09-14T11:22:28.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.801+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=ECUG4B596EZ3 type=del 2024-09-14T11:22:28.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.803+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=JNUWLWKUM8PA type=write size=184250 2024-09-14T11:22:28.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.804+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=FHV4MO8U8LE5 type=del 2024-09-14T11:22:28.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.806+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~G003GNN63Q69.0 size=1048576 2024-09-14T11:22:28.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.807+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~G003GNN63Q69.1 size=1048576 2024-09-14T11:22:28.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.808+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~G003GNN63Q69.2 size=143487 2024-09-14T11:22:28.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.808+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=G003GNN63Q69 tag=KOQKK0YPT28J type=write size=3289215 2024-09-14T11:22:28.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.809+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~YW6BGG372DFI.0 size=265271 2024-09-14T11:22:28.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.811+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=YW6BGG372DFI tag=OV36KSDPI32O type=write size=1313847 2024-09-14T11:22:28.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.813+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=CCHS50SK1OJ8 type=del size=2424615 2024-09-14T11:22:28.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.814+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~M4UGC87M04PX.0 size=1048576 2024-09-14T11:22:28.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.815+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~M4UGC87M04PX.1 size=807870 2024-09-14T11:22:28.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.817+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=M4UGC87M04PX tag=W8QYSQ1TCO2U type=write size=2905022 2024-09-14T11:22:28.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.818+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=L9PC190WA5F7 type=del size=2831468 2024-09-14T11:22:28.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.819+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=2RNHYY9JO41H type=del 2024-09-14T11:22:28.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.820+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=AS6OBFC1LT2Y type=del size=617376 2024-09-14T11:22:28.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.821+0000 7f43cc561780 1 < canceled part key=_multipart_683ZFW0BWMT7.2~XK2WN1QWK66K.0 size=563693 2024-09-14T11:22:28.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.823+0000 7f43cc561780 1 < canceled multipart upload key=683ZFW0BWMT7 upload=XK2WN1QWK66K tag=G6QMAUVDUKPX type=write size=1612269 2024-09-14T11:22:28.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.824+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=MW32OF6OUGQL type=del size=2019234 2024-09-14T11:22:28.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.825+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=M3VO9NKPSH9T type=del 2024-09-14T11:22:28.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.828+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~T7STFVS4ISIO.0 size=851087 2024-09-14T11:22:28.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.828+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=T7STFVS4ISIO tag=S4OYM8Y4SFVM type=write size=1899663 2024-09-14T11:22:28.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.829+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~Q5TLYFIJO5XP.0 size=1003142 2024-09-14T11:22:28.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.831+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=Q5TLYFIJO5XP tag=LFH2AQYHGDV8 type=write size=2051718 2024-09-14T11:22:28.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.832+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=UNUGATDWNIIT type=del size=1439847 2024-09-14T11:22:28.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.833+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=QT1CBSLNZACQ type=del 2024-09-14T11:22:28.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.836+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~5LTALI06YQH5.0 size=474376 2024-09-14T11:22:28.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.836+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=5LTALI06YQH5 tag=COWM6B0TRUPF type=write size=1522952 2024-09-14T11:22:28.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.837+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~KS7M4B3645HS.0 size=789300 2024-09-14T11:22:28.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.839+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=KS7M4B3645HS tag=VC6G7KY1SXI0 type=write size=1837876 2024-09-14T11:22:28.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.840+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=RTLE24M7KRQG type=del size=2758692 2024-09-14T11:22:28.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.841+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~4857C0V9VC5U.0 size=1048576 2024-09-14T11:22:28.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.842+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~4857C0V9VC5U.1 size=202708 2024-09-14T11:22:28.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.845+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=4857C0V9VC5U tag=VVBRU0ECOB02 type=write size=2299860 2024-09-14T11:22:28.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.847+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~NZE1TFGJXLRG.0 size=1048576 2024-09-14T11:22:28.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.848+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~NZE1TFGJXLRG.1 size=1048576 2024-09-14T11:22:28.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.849+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~NZE1TFGJXLRG.2 size=690166 2024-09-14T11:22:28.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.849+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=NZE1TFGJXLRG tag=MZOQ98VCZP88 type=write size=3835894 2024-09-14T11:22:28.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.850+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=ZAAMWL845CZ8 type=del 2024-09-14T11:22:28.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.851+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=D7EE128XRIHU type=del size=319255 2024-09-14T11:22:28.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.852+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=OOPPQDABORYX type=del 2024-09-14T11:22:28.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.854+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=P6ER0ZVY4AD4 type=del size=1834340 2024-09-14T11:22:28.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.854+0000 7f43cc561780 1 < canceled part key=_multipart_E6FDCACWGA2Y.2~W2D1ZM9KOWJA.0 size=443730 2024-09-14T11:22:28.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.856+0000 7f43cc561780 1 < canceled multipart upload key=E6FDCACWGA2Y upload=W2D1ZM9KOWJA tag=6I072UOCPXGA type=write size=1492306 2024-09-14T11:22:28.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.858+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~C9JWOWU38Q95.0 size=1048576 2024-09-14T11:22:28.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.859+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~C9JWOWU38Q95.1 size=145237 2024-09-14T11:22:28.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.859+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=C9JWOWU38Q95 tag=VYH7LUXXQL0H type=write size=2242389 2024-09-14T11:22:28.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.860+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=SMKKE2JA18MW type=del 2024-09-14T11:22:28.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.862+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=ZOPT10ABUL0P type=del size=2032898 2024-09-14T11:22:28.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.864+0000 7f43cc561780 1 < suggested update operation key=E6FDCACWGA2Y tag=SIPVQ6QKNF3N type=del size=680252 2024-09-14T11:22:28.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.865+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=GQ4BUAHHQ4T9 type=del size=3779507 2024-09-14T11:22:28.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.868+0000 7f43cc561780 1 < suggested remove operation key=2975CNBC43ST tag=JNUWLWKUM8PA type=write 2024-09-14T11:22:28.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.870+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~HUOTN20BYVEH.0 size=726385 2024-09-14T11:22:28.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.870+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=HUOTN20BYVEH tag=38VDO2G9MSSW type=write size=1774961 2024-09-14T11:22:28.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.872+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~G003GNN63Q69.0 size=1048576 2024-09-14T11:22:28.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.873+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~G003GNN63Q69.1 size=1048576 2024-09-14T11:22:28.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.874+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~G003GNN63Q69.2 size=143487 2024-09-14T11:22:28.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.876+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=G003GNN63Q69 tag=KOQKK0YPT28J type=write size=3289215 2024-09-14T11:22:28.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.877+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=CISSCMZURITK type=del size=1429278 2024-09-14T11:22:28.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.879+0000 7f43cc561780 1 < canceled operation key=S3NOACTF4K2W tag=CCHS50SK1OJ8 type=del size=2424615 2024-09-14T11:22:28.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.880+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=RORB5NPZCT8Z type=del size=1806996 2024-09-14T11:22:28.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.882+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=L9PC190WA5F7 type=del 2024-09-14T11:22:28.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.884+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~DU4D7SU8PMBG.0 size=1048576 2024-09-14T11:22:28.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.885+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~DU4D7SU8PMBG.1 size=1048576 2024-09-14T11:22:28.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.886+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~DU4D7SU8PMBG.2 size=991705 2024-09-14T11:22:28.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.886+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=DU4D7SU8PMBG tag=5P23EPQ7DIFF type=write size=4137433 2024-09-14T11:22:28.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.888+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=AS6OBFC1LT2Y type=del 2024-09-14T11:22:28.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.890+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~NMON4Z3L2NSA.0 size=1048576 2024-09-14T11:22:28.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.891+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~NMON4Z3L2NSA.1 size=320840 2024-09-14T11:22:28.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.891+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=NMON4Z3L2NSA tag=140FB59T1E46 type=write size=2417992 2024-09-14T11:22:28.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.894+0000 7f43cc561780 1 < suggested remove operation key=OJOJZBG1WEGI tag=MW32OF6OUGQL type=del 2024-09-14T11:22:28.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.897+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~336YGQ85JANJ.0 size=1048576 2024-09-14T11:22:28.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.898+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~336YGQ85JANJ.1 size=352679 2024-09-14T11:22:28.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.898+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=336YGQ85JANJ tag=BEX4MXH9N1P9 type=write size=2449831 2024-09-14T11:22:28.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.899+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~T7STFVS4ISIO.0 size=851087 2024-09-14T11:22:28.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.901+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=T7STFVS4ISIO tag=S4OYM8Y4SFVM type=write size=1899663 2024-09-14T11:22:28.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.903+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=S2F2468XCWOG type=del size=362599 2024-09-14T11:22:28.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.906+0000 7f43cc561780 1 < suggested update operation key=15F3ZZAAKT9B tag=UNUGATDWNIIT type=del size=1439847 2024-09-14T11:22:28.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.907+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=W5JW73834QAP type=del size=1405489 2024-09-14T11:22:28.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.908+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~5LTALI06YQH5.0 size=474376 2024-09-14T11:22:28.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.910+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=5LTALI06YQH5 tag=COWM6B0TRUPF type=write size=1522952 2024-09-14T11:22:28.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.911+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=0LWOLV00KCIC type=del size=425515 2024-09-14T11:22:28.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.913+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=RTLE24M7KRQG type=del 2024-09-14T11:22:28.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.914+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=CBVVLB7T9WYA type=del size=226535 2024-09-14T11:22:28.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.915+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~NZE1TFGJXLRG.0 size=1048576 2024-09-14T11:22:28.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.916+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~NZE1TFGJXLRG.1 size=1048576 2024-09-14T11:22:28.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.917+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~NZE1TFGJXLRG.2 size=690166 2024-09-14T11:22:28.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.919+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=NZE1TFGJXLRG tag=MZOQ98VCZP88 type=write size=3835894 2024-09-14T11:22:28.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.920+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=CRY9O3E308SD type=del size=298251 2024-09-14T11:22:28.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.922+0000 7f43cc561780 -1 < failed to complete operation key=E6FDCACWGA2Y tag=D7EE128XRIHU type=del size=319255: (22) Invalid argument 2024-09-14T11:22:28.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.923+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=G30WLLY00U3E type=write size=1039519 2024-09-14T11:22:28.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.924+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=P6ER0ZVY4AD4 type=del 2024-09-14T11:22:28.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.926+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=Z7AWZPEM4CD6 type=del size=1055277 2024-09-14T11:22:28.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.927+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~C9JWOWU38Q95.0 size=1048576 2024-09-14T11:22:28.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.927+0000 7f43cc561780 1 < canceled part key=_multipart_LKY30XYUG2QW.2~C9JWOWU38Q95.1 size=145237 2024-09-14T11:22:28.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.929+0000 7f43cc561780 1 < canceled multipart upload key=LKY30XYUG2QW upload=C9JWOWU38Q95 tag=VYH7LUXXQL0H type=write size=2242389 2024-09-14T11:22:28.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.931+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~X2XYEK8AD2KV.0 size=1048576 2024-09-14T11:22:28.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.932+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~X2XYEK8AD2KV.1 size=623651 2024-09-14T11:22:28.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.932+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=X2XYEK8AD2KV tag=VV67G1ZWGG14 type=write size=2720803 2024-09-14T11:22:28.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.934+0000 7f43cc561780 1 < suggested remove operation key=OV4ATW747PY4 tag=ZOPT10ABUL0P type=del 2024-09-14T11:22:28.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.936+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=8HSRPRSQ6XJ9 type=del size=1768967 2024-09-14T11:22:28.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.937+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=GQ4BUAHHQ4T9 type=del 2024-09-14T11:22:28.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.938+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=X0AN6F0BFABS type=del size=3991994 2024-09-14T11:22:28.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.939+0000 7f43cc561780 1 < canceled part key=_multipart_9XIAGZKIUBGH.2~HUOTN20BYVEH.0 size=726385 2024-09-14T11:22:28.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.941+0000 7f43cc561780 1 < canceled multipart upload key=9XIAGZKIUBGH upload=HUOTN20BYVEH tag=38VDO2G9MSSW type=write size=1774961 2024-09-14T11:22:28.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.942+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=YLQMPOZ6HSXI type=del size=3405026 2024-09-14T11:22:28.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.943+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=CISSCMZURITK type=del 2024-09-14T11:22:28.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.944+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=J1OD4NPVLG10 type=del size=655924 2024-09-14T11:22:28.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.948+0000 7f43cc561780 1 < suggested remove operation key=9XIAGZKIUBGH tag=RORB5NPZCT8Z type=del 2024-09-14T11:22:28.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.951+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~MC6EP0KIFYW7.0 size=1048576 2024-09-14T11:22:28.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.952+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~MC6EP0KIFYW7.1 size=1048576 2024-09-14T11:22:28.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.952+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~MC6EP0KIFYW7.2 size=599921 2024-09-14T11:22:28.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.952+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=MC6EP0KIFYW7 tag=IY437RNGFA2E type=write size=3745649 2024-09-14T11:22:28.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.954+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~DU4D7SU8PMBG.0 size=1048576 2024-09-14T11:22:28.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.955+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~DU4D7SU8PMBG.1 size=1048576 2024-09-14T11:22:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.956+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~DU4D7SU8PMBG.2 size=991705 2024-09-14T11:22:28.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.958+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=DU4D7SU8PMBG tag=5P23EPQ7DIFF type=write size=4137433 2024-09-14T11:22:28.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.960+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~EQQNY7Z5J0O0.0 size=1048576 2024-09-14T11:22:28.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.961+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~EQQNY7Z5J0O0.1 size=695523 2024-09-14T11:22:28.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.961+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=EQQNY7Z5J0O0 tag=OT1LBL3IVRB2 type=write size=2792675 2024-09-14T11:22:28.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.963+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~NMON4Z3L2NSA.0 size=1048576 2024-09-14T11:22:28.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.964+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~NMON4Z3L2NSA.1 size=320840 2024-09-14T11:22:28.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.966+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=NMON4Z3L2NSA tag=140FB59T1E46 type=write size=2417992 2024-09-14T11:22:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.967+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=ECXRCZBF94TW type=del size=750302 2024-09-14T11:22:28.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.969+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~336YGQ85JANJ.0 size=1048576 2024-09-14T11:22:28.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.970+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~336YGQ85JANJ.1 size=352679 2024-09-14T11:22:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.972+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=336YGQ85JANJ tag=BEX4MXH9N1P9 type=write size=2449831 2024-09-14T11:22:28.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.974+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~29B8YXG0LUBF.0 size=1048576 2024-09-14T11:22:28.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.975+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~29B8YXG0LUBF.1 size=231942 2024-09-14T11:22:28.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.975+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=29B8YXG0LUBF tag=HLZIM1HWYMWW type=write size=2329094 2024-09-14T11:22:28.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.976+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=S2F2468XCWOG type=del 2024-09-14T11:22:28.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.978+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~1PLKSOZF8MEN.0 size=859466 2024-09-14T11:22:28.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.978+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=1PLKSOZF8MEN tag=KF1XBA7KWSBO type=write size=1908042 2024-09-14T11:22:28.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.979+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=W5JW73834QAP type=del 2024-09-14T11:22:28.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.981+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=SGIRNT9MGPMJ type=del size=392786 2024-09-14T11:22:28.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.982+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=0LWOLV00KCIC type=del 2024-09-14T11:22:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.984+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~Y568VD0AGXCZ.0 size=1048576 2024-09-14T11:22:28.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.985+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~Y568VD0AGXCZ.1 size=797214 2024-09-14T11:22:28.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.985+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=Y568VD0AGXCZ tag=OWRUFNMBIIM5 type=write size=2894366 2024-09-14T11:22:28.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.986+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=CBVVLB7T9WYA type=del 2024-09-14T11:22:28.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.987+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=5BJWO9LN9214 type=del size=2402744 2024-09-14T11:22:28.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.990+0000 7f43cc561780 1 < suggested remove operation key=BRHP3DQEO3HZ tag=CRY9O3E308SD type=del 2024-09-14T11:22:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.991+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=0J2JK6ZYGKE7 type=del size=3999716 2024-09-14T11:22:28.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.992+0000 7f43cc561780 1 < completed write operation key=A1B2LIZIPET3 tag=G30WLLY00U3E type=write size=1039519 2024-09-14T11:22:28.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.993+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=SJZE9UKNK2A2 type=del size=1033869 2024-09-14T11:22:28.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.994+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=Z7AWZPEM4CD6 type=del 2024-09-14T11:22:28.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.997+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~IPNMRSQIVJO2.0 size=1048576 2024-09-14T11:22:28.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.998+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~IPNMRSQIVJO2.1 size=1048576 2024-09-14T11:22:28.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.998+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~IPNMRSQIVJO2.2 size=696830 2024-09-14T11:22:28.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:28.998+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=IPNMRSQIVJO2 tag=G7N7QJYMXXRG type=write size=3842558 2024-09-14T11:22:28.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.000+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~X2XYEK8AD2KV.0 size=1048576 2024-09-14T11:22:29.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.001+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~X2XYEK8AD2KV.1 size=623651 2024-09-14T11:22:29.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.003+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=X2XYEK8AD2KV tag=VV67G1ZWGG14 type=write size=2720803 2024-09-14T11:22:29.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.004+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=XSOV6ZXTRV4C type=del size=83422 2024-09-14T11:22:29.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.006+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=8HSRPRSQ6XJ9 type=del 2024-09-14T11:22:29.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.008+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~KOK7LH0VLMAF.0 size=1048576 2024-09-14T11:22:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.009+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~KOK7LH0VLMAF.1 size=926666 2024-09-14T11:22:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.009+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=KOK7LH0VLMAF tag=QD53CWFENWU0 type=write size=3023818 2024-09-14T11:22:29.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.010+0000 7f43cc561780 1 < canceled operation key=FISMBWPDPCTA tag=X0AN6F0BFABS type=del size=3991994 2024-09-14T11:22:29.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.012+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~KQNII5D1USLB.0 size=1040722 2024-09-14T11:22:29.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.012+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=KQNII5D1USLB tag=L8C12PCTY222 type=write size=2089298 2024-09-14T11:22:29.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.014+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=YLQMPOZ6HSXI type=del 2024-09-14T11:22:29.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.015+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=4Q8S8BSLCU54 type=del size=4187800 2024-09-14T11:22:29.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.017+0000 7f43cc561780 1 < suggested update operation key=END3SHHS0FSA tag=J1OD4NPVLG10 type=del size=655924 2024-09-14T11:22:29.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.018+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=HW24PBKR6B4J type=write size=474275 2024-09-14T11:22:29.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.019+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~MC6EP0KIFYW7.0 size=1048576 2024-09-14T11:22:29.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.020+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~MC6EP0KIFYW7.1 size=1048576 2024-09-14T11:22:29.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.021+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~MC6EP0KIFYW7.2 size=599921 2024-09-14T11:22:29.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.023+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=MC6EP0KIFYW7 tag=IY437RNGFA2E type=write size=3745649 2024-09-14T11:22:29.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.024+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=AC280C1E80SK type=write size=549376 2024-09-14T11:22:29.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.026+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~EQQNY7Z5J0O0.0 size=1048576 2024-09-14T11:22:29.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.026+0000 7f43cc561780 1 < canceled part key=_multipart_3YHEZHW0RS1W.2~EQQNY7Z5J0O0.1 size=695523 2024-09-14T11:22:29.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.027+0000 7f43cc561780 1 < canceled multipart upload key=3YHEZHW0RS1W upload=EQQNY7Z5J0O0 tag=OT1LBL3IVRB2 type=write size=2792675 2024-09-14T11:22:29.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.030+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~BH1BLFD1YPCP.0 size=1048576 2024-09-14T11:22:29.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.031+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~BH1BLFD1YPCP.1 size=506987 2024-09-14T11:22:29.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.031+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=BH1BLFD1YPCP tag=E9DCS7WX742T type=write size=2604139 2024-09-14T11:22:29.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.032+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=ECXRCZBF94TW type=del 2024-09-14T11:22:29.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.034+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~EY7J26G66FR6.0 size=1048576 2024-09-14T11:22:29.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.035+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~EY7J26G66FR6.1 size=1048576 2024-09-14T11:22:29.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.036+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~EY7J26G66FR6.2 size=458626 2024-09-14T11:22:29.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.036+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=EY7J26G66FR6 tag=PGWH994RF7XS type=write size=3604354 2024-09-14T11:22:29.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.037+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~29B8YXG0LUBF.0 size=1048576 2024-09-14T11:22:29.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.038+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~29B8YXG0LUBF.1 size=231942 2024-09-14T11:22:29.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.040+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=29B8YXG0LUBF tag=HLZIM1HWYMWW type=write size=2329094 2024-09-14T11:22:29.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.041+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=A2SDO50WLV1B type=del size=2439695 2024-09-14T11:22:29.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.041+0000 7f43cc561780 1 < canceled part key=_multipart_OV4ATW747PY4.2~1PLKSOZF8MEN.0 size=859466 2024-09-14T11:22:29.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.043+0000 7f43cc561780 1 < canceled multipart upload key=OV4ATW747PY4 upload=1PLKSOZF8MEN tag=KF1XBA7KWSBO type=write size=1908042 2024-09-14T11:22:29.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.045+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=PJM6LRMOPEJ0 type=del size=219013 2024-09-14T11:22:29.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.046+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=SGIRNT9MGPMJ type=del 2024-09-14T11:22:29.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.048+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~ZN31RS4DR6LJ.0 size=581009 2024-09-14T11:22:29.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.048+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=ZN31RS4DR6LJ tag=21GL9C6C0OMQ type=write size=1629585 2024-09-14T11:22:29.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.050+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~Y568VD0AGXCZ.0 size=1048576 2024-09-14T11:22:29.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.051+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~Y568VD0AGXCZ.1 size=797214 2024-09-14T11:22:29.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.053+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=Y568VD0AGXCZ tag=OWRUFNMBIIM5 type=write size=2894366 2024-09-14T11:22:29.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.054+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=FC3HIQNL1O3O type=del size=776636 2024-09-14T11:22:29.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.055+0000 7f43cc561780 -1 < failed to complete operation key=END3SHHS0FSA tag=5BJWO9LN9214 type=del size=2402744: (22) Invalid argument 2024-09-14T11:22:29.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.056+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=618SX45WXYTY type=del size=3305908 2024-09-14T11:22:29.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.059+0000 7f43cc561780 1 < suggested remove operation key=WSFZN6JCWUXG tag=0J2JK6ZYGKE7 type=del 2024-09-14T11:22:29.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.061+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=6GEGZ53RSNRN type=del size=282680 2024-09-14T11:22:29.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.063+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=SJZE9UKNK2A2 type=del 2024-09-14T11:22:29.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.065+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~4KGBV9AMJGRD.0 size=1048576 2024-09-14T11:22:29.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.066+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~4KGBV9AMJGRD.1 size=638581 2024-09-14T11:22:29.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.066+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=4KGBV9AMJGRD tag=QJE9R3KFSUN2 type=write size=2735733 2024-09-14T11:22:29.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.067+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~IPNMRSQIVJO2.0 size=1048576 2024-09-14T11:22:29.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.068+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~IPNMRSQIVJO2.1 size=1048576 2024-09-14T11:22:29.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.070+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~IPNMRSQIVJO2.2 size=696830 2024-09-14T11:22:29.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.072+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=IPNMRSQIVJO2 tag=G7N7QJYMXXRG type=write size=3842558 2024-09-14T11:22:29.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.073+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=U07TIHJQYFM2 type=del size=2586393 2024-09-14T11:22:29.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.074+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=XSOV6ZXTRV4C type=del 2024-09-14T11:22:29.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.076+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=GRUKRDLF1NWD type=del size=3233304 2024-09-14T11:22:29.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.077+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~KOK7LH0VLMAF.0 size=1048576 2024-09-14T11:22:29.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.078+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~KOK7LH0VLMAF.1 size=926666 2024-09-14T11:22:29.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.080+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=KOK7LH0VLMAF tag=QD53CWFENWU0 type=write size=3023818 2024-09-14T11:22:29.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.082+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~MAXTNNHSK5FQ.0 size=753015 2024-09-14T11:22:29.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.082+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=MAXTNNHSK5FQ tag=STW6TPTAJDWR type=write size=1801591 2024-09-14T11:22:29.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.082+0000 7f43cc561780 1 < canceled part key=_multipart_S3NOACTF4K2W.2~KQNII5D1USLB.0 size=1040722 2024-09-14T11:22:29.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.084+0000 7f43cc561780 1 < canceled multipart upload key=S3NOACTF4K2W upload=KQNII5D1USLB tag=L8C12PCTY222 type=write size=2089298 2024-09-14T11:22:29.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.085+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=HZXLC9TS28E5 type=del size=3430679 2024-09-14T11:22:29.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.088+0000 7f43cc561780 1 < suggested remove operation key=BNNSFLYOU27F tag=4Q8S8BSLCU54 type=del 2024-09-14T11:22:29.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.089+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=AGH89ID5B56E type=del size=340409 2024-09-14T11:22:29.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.090+0000 7f43cc561780 -1 < failed to complete operation key=BNNSFLYOU27F tag=HW24PBKR6B4J type=write size=474275: (22) Invalid argument 2024-09-14T11:22:29.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.091+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=2M4BKXGDS3KH type=del size=1388074 2024-09-14T11:22:29.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.094+0000 7f43cc561780 1 < suggested remove operation key=3YHEZHW0RS1W tag=AC280C1E80SK type=write 2024-09-14T11:22:29.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.095+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=SH85NIX5HKSP type=del size=3344726 2024-09-14T11:22:29.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.096+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~BH1BLFD1YPCP.0 size=1048576 2024-09-14T11:22:29.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.097+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~BH1BLFD1YPCP.1 size=506987 2024-09-14T11:22:29.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.100+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=BH1BLFD1YPCP tag=E9DCS7WX742T type=write size=2604139 2024-09-14T11:22:29.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.102+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~AV64E71DQ60A.0 size=1048576 2024-09-14T11:22:29.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.103+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~AV64E71DQ60A.1 size=683202 2024-09-14T11:22:29.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.103+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=AV64E71DQ60A tag=N4BAV4H8BEJ0 type=write size=2780354 2024-09-14T11:22:29.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.104+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~EY7J26G66FR6.0 size=1048576 2024-09-14T11:22:29.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.105+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~EY7J26G66FR6.1 size=1048576 2024-09-14T11:22:29.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.106+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~EY7J26G66FR6.2 size=458626 2024-09-14T11:22:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.108+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=EY7J26G66FR6 tag=PGWH994RF7XS type=write size=3604354 2024-09-14T11:22:29.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.109+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=5IQX2ROJSGF8 type=del size=1953863 2024-09-14T11:22:29.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.110+0000 7f43cc561780 -1 < failed to complete operation key=3YHEZHW0RS1W tag=A2SDO50WLV1B type=del size=2439695: (22) Invalid argument 2024-09-14T11:22:29.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.113+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~16UJVSZ2HWUW.0 size=305499 2024-09-14T11:22:29.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.113+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=16UJVSZ2HWUW tag=XH0R0SLXGJZM type=write size=1354075 2024-09-14T11:22:29.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.114+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=PJM6LRMOPEJ0 type=del 2024-09-14T11:22:29.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.115+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=NCA7YWU64ANB type=del size=3316930 2024-09-14T11:22:29.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.116+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~ZN31RS4DR6LJ.0 size=581009 2024-09-14T11:22:29.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.118+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=ZN31RS4DR6LJ tag=21GL9C6C0OMQ type=write size=1629585 2024-09-14T11:22:29.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.119+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=83REW5EQBAC1 type=write size=701036 2024-09-14T11:22:29.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.120+0000 7f43cc561780 -1 < failed to complete operation key=WSFZN6JCWUXG tag=FC3HIQNL1O3O type=del size=776636: (22) Invalid argument 2024-09-14T11:22:29.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.122+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=U09QYFUGKH6B type=del size=2702298 2024-09-14T11:22:29.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.122+0000 7f43cc561780 -1 < no bi entry to suggest for operation key=WSFZN6JCWUXG tag=618SX45WXYTY type=del size=3305908: (2) No such file or directory 2024-09-14T11:22:29.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.124+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=X1VLAPDTIQE1 type=del size=4103377 2024-09-14T11:22:29.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.125+0000 7f43cc561780 1 < completed delete operation key=W679WIFVPVOH tag=6GEGZ53RSNRN type=del 2024-09-14T11:22:29.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.127+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~MR6OA8FEVRB1.0 size=1048576 2024-09-14T11:22:29.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.128+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~MR6OA8FEVRB1.1 size=619770 2024-09-14T11:22:29.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.128+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=MR6OA8FEVRB1 tag=U9A4VDY0PR80 type=write size=2716922 2024-09-14T11:22:29.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.129+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~4KGBV9AMJGRD.0 size=1048576 2024-09-14T11:22:29.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.130+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~4KGBV9AMJGRD.1 size=638581 2024-09-14T11:22:29.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.133+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=4KGBV9AMJGRD tag=QJE9R3KFSUN2 type=write size=2735733 2024-09-14T11:22:29.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.134+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=R2JRRKHV1NKA type=del size=809992 2024-09-14T11:22:29.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.135+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=U07TIHJQYFM2 type=del 2024-09-14T11:22:29.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.136+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=TZDMEQ03NUFU type=write size=977215 2024-09-14T11:22:29.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.139+0000 7f43cc561780 1 < suggested update operation key=683ZFW0BWMT7 tag=GRUKRDLF1NWD type=del size=3233304 2024-09-14T11:22:29.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.140+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=GPXHOJG02F34 type=del size=1706303 2024-09-14T11:22:29.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.141+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~MAXTNNHSK5FQ.0 size=753015 2024-09-14T11:22:29.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.143+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=MAXTNNHSK5FQ tag=STW6TPTAJDWR type=write size=1801591 2024-09-14T11:22:29.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.144+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=R5KK2LMPEUKP type=del size=2241203 2024-09-14T11:22:29.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.147+0000 7f43cc561780 1 < suggested update operation key=CXP2PUIXR2PA tag=HZXLC9TS28E5 type=del size=3430679 2024-09-14T11:22:29.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.148+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=JQT4BK4UQ617 type=del size=3413471 2024-09-14T11:22:29.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.149+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=AGH89ID5B56E type=del 2024-09-14T11:22:29.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.151+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PQ7EQMSIQS0W.0 size=1048576 2024-09-14T11:22:29.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.152+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PQ7EQMSIQS0W.1 size=1048576 2024-09-14T11:22:29.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.153+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~PQ7EQMSIQS0W.2 size=471594 2024-09-14T11:22:29.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.153+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=PQ7EQMSIQS0W tag=T47RRUBNOGHM type=write size=3617322 2024-09-14T11:22:29.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.155+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=2M4BKXGDS3KH type=del 2024-09-14T11:22:29.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.157+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~U6PUSR8OLEPR.0 size=1048576 2024-09-14T11:22:29.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.158+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~U6PUSR8OLEPR.1 size=550227 2024-09-14T11:22:29.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.158+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=U6PUSR8OLEPR tag=6Y4WME5I30FY type=write size=2647379 2024-09-14T11:22:29.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.159+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=SH85NIX5HKSP type=del 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.160+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=20HYMWT2TQX0 type=del size=3695674 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.161+0000 7f43cc561780 1 < canceled part key=_multipart_683ZFW0BWMT7.2~AV64E71DQ60A.0 size=1048576 2024-09-14T11:22:29.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.162+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~AV64E71DQ60A.1 size=683202 2024-09-14T11:22:29.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.164+0000 7f43cc561780 1 < canceled multipart upload key=683ZFW0BWMT7 upload=AV64E71DQ60A tag=N4BAV4H8BEJ0 type=write size=2780354 2024-09-14T11:22:29.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.166+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~JQDSCCOEWMC2.0 size=1048576 2024-09-14T11:22:29.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.167+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~JQDSCCOEWMC2.1 size=287422 2024-09-14T11:22:29.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.167+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=JQDSCCOEWMC2 tag=OMVYCVGQE91K type=write size=2384574 2024-09-14T11:22:29.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.168+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=5IQX2ROJSGF8 type=del 2024-09-14T11:22:29.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.170+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=1DRLK2Q6OWQ1 type=write size=777410 2024-09-14T11:22:29.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.170+0000 7f43cc561780 1 < canceled part key=_multipart_15F3ZZAAKT9B.2~16UJVSZ2HWUW.0 size=305499 2024-09-14T11:22:29.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.172+0000 7f43cc561780 1 < canceled multipart upload key=15F3ZZAAKT9B upload=16UJVSZ2HWUW tag=XH0R0SLXGJZM type=write size=1354075 2024-09-14T11:22:29.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.175+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~8O1MEJZRK7QH.0 size=1048576 2024-09-14T11:22:29.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.176+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~8O1MEJZRK7QH.1 size=1048576 2024-09-14T11:22:29.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.178+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~8O1MEJZRK7QH.2 size=311209 2024-09-14T11:22:29.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.178+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=8O1MEJZRK7QH tag=L1HTF668CP1R type=write size=3456937 2024-09-14T11:22:29.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.180+0000 7f43cc561780 1 < suggested remove operation key=AWBBRU4C8RDQ tag=NCA7YWU64ANB type=del 2024-09-14T11:22:29.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.183+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~4FU3IU8NJSC6.0 size=1048576 2024-09-14T11:22:29.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.183+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~4FU3IU8NJSC6.1 size=213168 2024-09-14T11:22:29.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.183+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=4FU3IU8NJSC6 tag=KC2947KNVTUA type=write size=2310320 2024-09-14T11:22:29.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.185+0000 7f43cc561780 1 < completed write operation key=W679WIFVPVOH tag=83REW5EQBAC1 type=write size=701036 2024-09-14T11:22:29.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.186+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=AF2K3F88KR6M type=del size=984284 2024-09-14T11:22:29.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.187+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=U09QYFUGKH6B type=del 2024-09-14T11:22:29.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.188+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=3J0D5B5FKV2C type=del size=1803562 2024-09-14T11:22:29.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.189+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=X1VLAPDTIQE1 type=del 2024-09-14T11:22:29.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.190+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=CY4LIWA3N51B type=write size=487916 2024-09-14T11:22:29.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.191+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~MR6OA8FEVRB1.0 size=1048576 2024-09-14T11:22:29.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.192+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~MR6OA8FEVRB1.1 size=619770 2024-09-14T11:22:29.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.194+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=MR6OA8FEVRB1 tag=U9A4VDY0PR80 type=write size=2716922 2024-09-14T11:22:29.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.195+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=U0COGTKLYAIE type=del size=3664105 2024-09-14T11:22:29.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.197+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=R2JRRKHV1NKA type=del 2024-09-14T11:22:29.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.198+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=YK1L84GWP1VP type=del size=1988472 2024-09-14T11:22:29.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.199+0000 7f43cc561780 1 < completed write operation key=WSFZN6JCWUXG tag=TZDMEQ03NUFU type=write size=977215 2024-09-14T11:22:29.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.200+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=4C2VOAD0IF8Z type=write size=205072 2024-09-14T11:22:29.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.202+0000 7f43cc561780 1 < suggested update operation key=UWES4CQZ8XW6 tag=GPXHOJG02F34 type=del size=1706303 2024-09-14T11:22:29.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.204+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~0027H3V4VYYP.0 size=175975 2024-09-14T11:22:29.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.204+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=0027H3V4VYYP tag=VMXP035LU5EW type=write size=1224551 2024-09-14T11:22:29.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.206+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=R5KK2LMPEUKP type=del 2024-09-14T11:22:29.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.207+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=PG64Y0FNJ7X8 type=del size=1663968 2024-09-14T11:22:29.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.208+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=JQT4BK4UQ617 type=del 2024-09-14T11:22:29.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.210+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=11EHT0DMFP2K type=del size=862308 2024-09-14T11:22:29.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.211+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PQ7EQMSIQS0W.0 size=1048576 2024-09-14T11:22:29.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.212+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PQ7EQMSIQS0W.1 size=1048576 2024-09-14T11:22:29.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.213+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~PQ7EQMSIQS0W.2 size=471594 2024-09-14T11:22:29.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.216+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=PQ7EQMSIQS0W tag=T47RRUBNOGHM type=write size=3617322 2024-09-14T11:22:29.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.219+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~0IY1SB033VJ5.0 size=93374 2024-09-14T11:22:29.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.219+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=0IY1SB033VJ5 tag=P04OB3BCHA4K type=write size=1141950 2024-09-14T11:22:29.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.220+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~U6PUSR8OLEPR.0 size=1048576 2024-09-14T11:22:29.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.221+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~U6PUSR8OLEPR.1 size=550227 2024-09-14T11:22:29.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.223+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=U6PUSR8OLEPR tag=6Y4WME5I30FY type=write size=2647379 2024-09-14T11:22:29.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.224+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=5FQA8DTV9KZ3 type=del size=1683520 2024-09-14T11:22:29.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.225+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=20HYMWT2TQX0 type=del 2024-09-14T11:22:29.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.228+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~4JZ9OKJRQO2G.0 size=680056 2024-09-14T11:22:29.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.228+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=4JZ9OKJRQO2G tag=3FGOWEKYZL3K type=write size=1728632 2024-09-14T11:22:29.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.229+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~JQDSCCOEWMC2.0 size=1048576 2024-09-14T11:22:29.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.230+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~JQDSCCOEWMC2.1 size=287422 2024-09-14T11:22:29.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.232+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=JQDSCCOEWMC2 tag=OMVYCVGQE91K type=write size=2384574 2024-09-14T11:22:29.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.234+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=WPVH8MTS0FJ2 type=write size=885081 2024-09-14T11:22:29.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.235+0000 7f43cc561780 1 < completed write operation key=1M46U4U9MG1E tag=1DRLK2Q6OWQ1 type=write size=777410 2024-09-14T11:22:29.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.237+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~OY8LA9KJSOQA.0 size=526251 2024-09-14T11:22:29.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.237+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=OY8LA9KJSOQA tag=JWMMG3BOODFA type=write size=1574827 2024-09-14T11:22:29.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.239+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~8O1MEJZRK7QH.0 size=1048576 2024-09-14T11:22:29.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.239+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~8O1MEJZRK7QH.1 size=1048576 2024-09-14T11:22:29.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.240+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~8O1MEJZRK7QH.2 size=311209 2024-09-14T11:22:29.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.242+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=8O1MEJZRK7QH tag=L1HTF668CP1R type=write size=3456937 2024-09-14T11:22:29.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.244+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=3ZTFJSJXFJ3F type=del size=241277 2024-09-14T11:22:29.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.245+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~4FU3IU8NJSC6.0 size=1048576 2024-09-14T11:22:29.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.246+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~4FU3IU8NJSC6.1 size=213168 2024-09-14T11:22:29.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.248+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=4FU3IU8NJSC6 tag=KC2947KNVTUA type=write size=2310320 2024-09-14T11:22:29.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.250+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~2TYAJ53N7I33.0 size=612517 2024-09-14T11:22:29.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.250+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=2TYAJ53N7I33 tag=WGPA7A9B1JJQ type=write size=1661093 2024-09-14T11:22:29.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.252+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=AF2K3F88KR6M type=del size=984284 2024-09-14T11:22:29.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.253+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=NXE2CTLMTT9K type=write size=740197 2024-09-14T11:22:29.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.256+0000 7f43cc561780 1 < suggested remove operation key=9XIAGZKIUBGH tag=3J0D5B5FKV2C type=del 2024-09-14T11:22:29.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.257+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=00IMZS9L1LLD type=del size=2834052 2024-09-14T11:22:29.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.259+0000 7f43cc561780 1 < suggested update operation key=OV4ATW747PY4 tag=CY4LIWA3N51B type=write size=487916 2024-09-14T11:22:29.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.260+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=7RGHAD1HP2N0 type=del size=158585 2024-09-14T11:22:29.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.262+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=U0COGTKLYAIE type=del 2024-09-14T11:22:29.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.264+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=MY12AM2IE5YR type=del size=1051533 2024-09-14T11:22:29.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.265+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=YK1L84GWP1VP type=del 2024-09-14T11:22:29.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.267+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~C1IM8PFUW7M9.0 size=396914 2024-09-14T11:22:29.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.267+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=C1IM8PFUW7M9 tag=7K42394NQUEJ type=write size=1445490 2024-09-14T11:22:29.267 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.268+0000 7f43cc561780 1 < completed write operation key=CXP2PUIXR2PA tag=4C2VOAD0IF8Z type=write size=205072 2024-09-14T11:22:29.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.269+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=M16BU2V8KQR1 type=del size=3835845 2024-09-14T11:22:29.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.271+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~0027H3V4VYYP.0 size=175975 2024-09-14T11:22:29.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.272+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=0027H3V4VYYP tag=VMXP035LU5EW type=write size=1224551 2024-09-14T11:22:29.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.275+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~G7L5IDE8WOQ6.0 size=1048576 2024-09-14T11:22:29.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.275+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~G7L5IDE8WOQ6.1 size=1048576 2024-09-14T11:22:29.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.276+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~G7L5IDE8WOQ6.2 size=367596 2024-09-14T11:22:29.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.276+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=G7L5IDE8WOQ6 tag=ZOBH1GUNIX9V type=write size=3513324 2024-09-14T11:22:29.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.278+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=PG64Y0FNJ7X8 type=del 2024-09-14T11:22:29.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.279+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=JB78VXWQ7S5B type=del size=1042399 2024-09-14T11:22:29.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.280+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=11EHT0DMFP2K type=del 2024-09-14T11:22:29.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.282+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~9YSWH7YD1HDW.0 size=1048576 2024-09-14T11:22:29.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.283+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~9YSWH7YD1HDW.1 size=957054 2024-09-14T11:22:29.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.283+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=9YSWH7YD1HDW tag=HHXCPBS49N0U type=write size=3054206 2024-09-14T11:22:29.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.285+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~0IY1SB033VJ5.0 size=93374 2024-09-14T11:22:29.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.287+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=0IY1SB033VJ5 tag=P04OB3BCHA4K type=write size=1141950 2024-09-14T11:22:29.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.289+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~K11S40443ZUM.0 size=1048576 2024-09-14T11:22:29.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.290+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~K11S40443ZUM.1 size=441195 2024-09-14T11:22:29.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.290+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=K11S40443ZUM tag=HDZK5IV2ABS3 type=write size=2538347 2024-09-14T11:22:29.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.293+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=5FQA8DTV9KZ3 type=del 2024-09-14T11:22:29.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.295+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=FI17UNFL22LO type=del size=2066643 2024-09-14T11:22:29.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.295+0000 7f43cc561780 1 < canceled part key=_multipart_END3SHHS0FSA.2~4JZ9OKJRQO2G.0 size=680056 2024-09-14T11:22:29.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.297+0000 7f43cc561780 1 < canceled multipart upload key=END3SHHS0FSA upload=4JZ9OKJRQO2G tag=3FGOWEKYZL3K type=write size=1728632 2024-09-14T11:22:29.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.298+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=BOKQ2ALGBO80 type=del size=751096 2024-09-14T11:22:29.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.299+0000 7f43cc561780 1 < completed write operation key=E6FDCACWGA2Y tag=WPVH8MTS0FJ2 type=write size=885081 2024-09-14T11:22:29.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.301+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~1E0V38MXIGPR.0 size=1048576 2024-09-14T11:22:29.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.302+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~1E0V38MXIGPR.1 size=641255 2024-09-14T11:22:29.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.302+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=1E0V38MXIGPR tag=5451WEQMZ233 type=write size=2738407 2024-09-14T11:22:29.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.303+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~OY8LA9KJSOQA.0 size=526251 2024-09-14T11:22:29.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.305+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=OY8LA9KJSOQA tag=JWMMG3BOODFA type=write size=1574827 2024-09-14T11:22:29.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.306+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=SV2WUS2N2E8E type=write size=567751 2024-09-14T11:22:29.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.308+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=3ZTFJSJXFJ3F type=del 2024-09-14T11:22:29.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.310+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~DZCPP9DP6H8L.0 size=1048576 2024-09-14T11:22:29.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.311+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~DZCPP9DP6H8L.1 size=1048576 2024-09-14T11:22:29.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.312+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~DZCPP9DP6H8L.2 size=63433 2024-09-14T11:22:29.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.312+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=DZCPP9DP6H8L tag=PNXC4OMQR8DX type=write size=3209161 2024-09-14T11:22:29.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.313+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~2TYAJ53N7I33.0 size=612517 2024-09-14T11:22:29.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.315+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=2TYAJ53N7I33 tag=WGPA7A9B1JJQ type=write size=1661093 2024-09-14T11:22:29.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.316+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=2MZ0OLGGD4UE type=write size=360277 2024-09-14T11:22:29.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.317+0000 7f43cc561780 1 < completed write operation key=AWBBRU4C8RDQ tag=NXE2CTLMTT9K type=write size=740197 2024-09-14T11:22:29.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.318+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=DK4H811RWUKB type=del size=1733528 2024-09-14T11:22:29.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.320+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=00IMZS9L1LLD type=del 2024-09-14T11:22:29.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.321+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=8GQT5M60IDK1 type=del size=1561518 2024-09-14T11:22:29.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.322+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=7RGHAD1HP2N0 type=del 2024-09-14T11:22:29.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.323+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=OAVW2GO401WJ type=del size=893527 2024-09-14T11:22:29.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.325+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=MY12AM2IE5YR type=del 2024-09-14T11:22:29.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.327+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~V2YQVRY7AJ7H.0 size=1048576 2024-09-14T11:22:29.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.328+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~V2YQVRY7AJ7H.1 size=419663 2024-09-14T11:22:29.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.328+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=V2YQVRY7AJ7H tag=GLM553O0KJRN type=write size=2516815 2024-09-14T11:22:29.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.329+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~C1IM8PFUW7M9.0 size=396914 2024-09-14T11:22:29.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.331+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=C1IM8PFUW7M9 tag=7K42394NQUEJ type=write size=1445490 2024-09-14T11:22:29.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.333+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~HC9WHUC3WVE9.0 size=1048576 2024-09-14T11:22:29.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.334+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~HC9WHUC3WVE9.1 size=906497 2024-09-14T11:22:29.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.334+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=HC9WHUC3WVE9 tag=BI1DY3GQ8E3A type=write size=3003649 2024-09-14T11:22:29.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.335+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=M16BU2V8KQR1 type=del 2024-09-14T11:22:29.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.337+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=1OD706NBYV85 type=del size=3998424 2024-09-14T11:22:29.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.338+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~G7L5IDE8WOQ6.0 size=1048576 2024-09-14T11:22:29.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.339+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~G7L5IDE8WOQ6.1 size=1048576 2024-09-14T11:22:29.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.340+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~G7L5IDE8WOQ6.2 size=367596 2024-09-14T11:22:29.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.342+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=G7L5IDE8WOQ6 tag=ZOBH1GUNIX9V type=write size=3513324 2024-09-14T11:22:29.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.343+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=93T05SFX2AB9 type=del size=3199090 2024-09-14T11:22:29.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.345+0000 7f43cc561780 1 < canceled operation key=IG4QM506P41B tag=JB78VXWQ7S5B type=del size=1042399 2024-09-14T11:22:29.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.347+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~IOF62WTLBGPI.0 size=1048576 2024-09-14T11:22:29.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.348+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~IOF62WTLBGPI.1 size=853833 2024-09-14T11:22:29.347 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.348+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=IOF62WTLBGPI tag=3O007DON0AOM type=write size=2950985 2024-09-14T11:22:29.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.349+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~9YSWH7YD1HDW.0 size=1048576 2024-09-14T11:22:29.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.350+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~9YSWH7YD1HDW.1 size=957054 2024-09-14T11:22:29.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.352+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=9YSWH7YD1HDW tag=HHXCPBS49N0U type=write size=3054206 2024-09-14T11:22:29.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.353+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=I64CDIR4NI4A type=del size=2937356 2024-09-14T11:22:29.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.354+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~K11S40443ZUM.0 size=1048576 2024-09-14T11:22:29.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.355+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~K11S40443ZUM.1 size=441195 2024-09-14T11:22:29.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.357+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=K11S40443ZUM tag=HDZK5IV2ABS3 type=write size=2538347 2024-09-14T11:22:29.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.359+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=O0NLO31NYY6D type=write size=335314 2024-09-14T11:22:29.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.360+0000 7f43cc561780 1 < canceled operation key=BZDW69C3Z97G tag=FI17UNFL22LO type=del size=2066643 2024-09-14T11:22:29.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.362+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~F7FA2BNB7OHX.0 size=744441 2024-09-14T11:22:29.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.362+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=F7FA2BNB7OHX tag=214Z936X1L1M type=write size=1793017 2024-09-14T11:22:29.362 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.363+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=BOKQ2ALGBO80 type=del 2024-09-14T11:22:29.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.365+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~8IOSTPACXIVO.0 size=1048576 2024-09-14T11:22:29.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.366+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~8IOSTPACXIVO.1 size=815011 2024-09-14T11:22:29.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.366+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=8IOSTPACXIVO tag=ZJVW50YCWFG1 type=write size=2912163 2024-09-14T11:22:29.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.367+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~1E0V38MXIGPR.0 size=1048576 2024-09-14T11:22:29.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.368+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~1E0V38MXIGPR.1 size=641255 2024-09-14T11:22:29.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.370+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=1E0V38MXIGPR tag=5451WEQMZ233 type=write size=2738407 2024-09-14T11:22:29.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.371+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=A1UXHI8EN75B type=del size=2898566 2024-09-14T11:22:29.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.374+0000 7f43cc561780 1 < suggested update operation key=MD14RGOQY0LK tag=SV2WUS2N2E8E type=write size=567751 2024-09-14T11:22:29.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.375+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=VJH7L104FY5W type=write size=995049 2024-09-14T11:22:29.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.376+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~DZCPP9DP6H8L.0 size=1048576 2024-09-14T11:22:29.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.376+0000 7f43cc561780 1 < canceled part key=_multipart_END3SHHS0FSA.2~DZCPP9DP6H8L.1 size=1048576 2024-09-14T11:22:29.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.377+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~DZCPP9DP6H8L.2 size=63433 2024-09-14T11:22:29.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.379+0000 7f43cc561780 1 < canceled multipart upload key=END3SHHS0FSA upload=DZCPP9DP6H8L tag=PNXC4OMQR8DX type=write size=3209161 2024-09-14T11:22:29.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.380+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=ZMBJM6VPWFK7 type=del size=659702 2024-09-14T11:22:29.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.381+0000 7f43cc561780 1 < completed write operation key=OJOJZBG1WEGI tag=2MZ0OLGGD4UE type=write size=360277 2024-09-14T11:22:29.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.383+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=7IJCCHU3KVM3 type=del size=734806 2024-09-14T11:22:29.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.384+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=DK4H811RWUKB type=del 2024-09-14T11:22:29.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.386+0000 7f43cc561780 1 > prepared part key=_multipart_2975CNBC43ST.2~E3J8MCHLD6EX.0 size=16340 2024-09-14T11:22:29.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.386+0000 7f43cc561780 1 > prepared multipart upload key=2975CNBC43ST upload=E3J8MCHLD6EX tag=QGYIT3K7MF68 type=write size=1064916 2024-09-14T11:22:29.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.387+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=8GQT5M60IDK1 type=del 2024-09-14T11:22:29.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.388+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=NPRNYLQ9WKUL type=del size=1432839 2024-09-14T11:22:29.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.390+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=OAVW2GO401WJ type=del 2024-09-14T11:22:29.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.392+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~BF2POGXWTDB2.0 size=1048576 2024-09-14T11:22:29.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.393+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~BF2POGXWTDB2.1 size=1048576 2024-09-14T11:22:29.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.394+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~BF2POGXWTDB2.2 size=135826 2024-09-14T11:22:29.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.394+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=BF2POGXWTDB2 tag=0UUJL0GAJQSZ type=write size=3281554 2024-09-14T11:22:29.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.396+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~V2YQVRY7AJ7H.0 size=1048576 2024-09-14T11:22:29.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.397+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~V2YQVRY7AJ7H.1 size=419663 2024-09-14T11:22:29.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.399+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=V2YQVRY7AJ7H tag=GLM553O0KJRN type=write size=2516815 2024-09-14T11:22:29.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.401+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~BFS2SIQCVRF3.0 size=256095 2024-09-14T11:22:29.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.401+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=BFS2SIQCVRF3 tag=2AJWSTI79TQL type=write size=1304671 2024-09-14T11:22:29.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.402+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~HC9WHUC3WVE9.0 size=1048576 2024-09-14T11:22:29.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.403+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~HC9WHUC3WVE9.1 size=906497 2024-09-14T11:22:29.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.406+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=HC9WHUC3WVE9 tag=BI1DY3GQ8E3A type=write size=3003649 2024-09-14T11:22:29.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.408+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=LWZ2P08PYP4T type=del size=1820031 2024-09-14T11:22:29.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.409+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=1OD706NBYV85 type=del 2024-09-14T11:22:29.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.412+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~JZUAX73CWUX9.0 size=1048576 2024-09-14T11:22:29.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.413+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~JZUAX73CWUX9.1 size=219576 2024-09-14T11:22:29.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.413+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=JZUAX73CWUX9 tag=EIR4T9FMECMU type=write size=2316728 2024-09-14T11:22:29.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.415+0000 7f43cc561780 1 < suggested remove operation key=80ZYEEE1EE78 tag=93T05SFX2AB9 type=del 2024-09-14T11:22:29.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.417+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~8JM1PAW6EKPW.0 size=1048576 2024-09-14T11:22:29.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.418+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~8JM1PAW6EKPW.1 size=1048576 2024-09-14T11:22:29.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.419+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~8JM1PAW6EKPW.2 size=712993 2024-09-14T11:22:29.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.419+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=8JM1PAW6EKPW tag=1QL4AN3CTL7O type=write size=3858721 2024-09-14T11:22:29.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.419+0000 7f43cc561780 1 < canceled part key=_multipart_15F3ZZAAKT9B.2~IOF62WTLBGPI.0 size=1048576 2024-09-14T11:22:29.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.420+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~IOF62WTLBGPI.1 size=853833 2024-09-14T11:22:29.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.422+0000 7f43cc561780 1 < canceled multipart upload key=15F3ZZAAKT9B upload=IOF62WTLBGPI tag=3O007DON0AOM type=write size=2950985 2024-09-14T11:22:29.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.425+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~2KFXQMTYKRM5.0 size=763309 2024-09-14T11:22:29.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.425+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=2KFXQMTYKRM5 tag=T5BDKTF0IJQQ type=write size=1811885 2024-09-14T11:22:29.426 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.427+0000 7f43cc561780 1 < suggested remove operation key=BZDW69C3Z97G tag=I64CDIR4NI4A type=del 2024-09-14T11:22:29.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.428+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=W0OABQAOFWLC type=del size=3005113 2024-09-14T11:22:29.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.428+0000 7f43cc561780 -1 < no bi entry to suggest for operation key=BZDW69C3Z97G tag=O0NLO31NYY6D type=write size=335314: (2) No such file or directory 2024-09-14T11:22:29.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.430+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=5MRNDUAREVOV type=write size=449912 2024-09-14T11:22:29.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.431+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~F7FA2BNB7OHX.0 size=744441 2024-09-14T11:22:29.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.433+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=F7FA2BNB7OHX tag=214Z936X1L1M type=write size=1793017 2024-09-14T11:22:29.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.435+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~M8IQ1DJ1L4XZ.0 size=1048576 2024-09-14T11:22:29.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.436+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~M8IQ1DJ1L4XZ.1 size=1048576 2024-09-14T11:22:29.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.437+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~M8IQ1DJ1L4XZ.2 size=833233 2024-09-14T11:22:29.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.437+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=M8IQ1DJ1L4XZ tag=CA02H1IVRJ1Z type=write size=3978961 2024-09-14T11:22:29.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.438+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~8IOSTPACXIVO.0 size=1048576 2024-09-14T11:22:29.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.439+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~8IOSTPACXIVO.1 size=815011 2024-09-14T11:22:29.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.441+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=8IOSTPACXIVO tag=ZJVW50YCWFG1 type=write size=2912163 2024-09-14T11:22:29.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.442+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=WNUTWYZJXM5K type=del size=3695588 2024-09-14T11:22:29.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.443+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=A1UXHI8EN75B type=del 2024-09-14T11:22:29.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.445+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=4STYJ3URSBZ3 type=del size=3750818 2024-09-14T11:22:29.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.446+0000 7f43cc561780 1 < completed write operation key=1M46U4U9MG1E tag=VJH7L104FY5W type=write size=995049 2024-09-14T11:22:29.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.448+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~LU1AKUMF5S84.0 size=58942 2024-09-14T11:22:29.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.448+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=LU1AKUMF5S84 tag=VOVIL2GZFEGM type=write size=1107518 2024-09-14T11:22:29.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.450+0000 7f43cc561780 1 < suggested remove operation key=D8EBH4NWN7SK tag=ZMBJM6VPWFK7 type=del 2024-09-14T11:22:29.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.452+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=ODWO0R4IUHA3 type=del size=2578716 2024-09-14T11:22:29.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.453+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=7IJCCHU3KVM3 type=del 2024-09-14T11:22:29.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.454+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=BBGVYYJRADN1 type=del size=2405012 2024-09-14T11:22:29.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.455+0000 7f43cc561780 1 < completed part key=_multipart_2975CNBC43ST.2~E3J8MCHLD6EX.0 size=16340 2024-09-14T11:22:29.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.457+0000 7f43cc561780 1 < completed multipart upload key=2975CNBC43ST upload=E3J8MCHLD6EX tag=QGYIT3K7MF68 type=write size=1064916 2024-09-14T11:22:29.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.459+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~8HX1DC3DJ1D5.0 size=704271 2024-09-14T11:22:29.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.459+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=8HX1DC3DJ1D5 tag=04PDQ5ROPLI4 type=write size=1752847 2024-09-14T11:22:29.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.462+0000 7f43cc561780 1 < suggested update operation key=1M46U4U9MG1E tag=NPRNYLQ9WKUL type=del size=1432839 2024-09-14T11:22:29.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.464+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~2QOTQD914XLE.0 size=120159 2024-09-14T11:22:29.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.464+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=2QOTQD914XLE tag=GOOFFSLV08C7 type=write size=1168735 2024-09-14T11:22:29.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.464+0000 7f43cc561780 1 < canceled part key=_multipart_AWBBRU4C8RDQ.2~BF2POGXWTDB2.0 size=1048576 2024-09-14T11:22:29.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.465+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~BF2POGXWTDB2.1 size=1048576 2024-09-14T11:22:29.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.466+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~BF2POGXWTDB2.2 size=135826 2024-09-14T11:22:29.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.468+0000 7f43cc561780 1 < canceled multipart upload key=AWBBRU4C8RDQ upload=BF2POGXWTDB2 tag=0UUJL0GAJQSZ type=write size=3281554 2024-09-14T11:22:29.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.470+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~FZBKQNEA5058.0 size=1048576 2024-09-14T11:22:29.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.471+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~FZBKQNEA5058.1 size=1048576 2024-09-14T11:22:29.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.472+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~FZBKQNEA5058.2 size=575610 2024-09-14T11:22:29.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.472+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=FZBKQNEA5058 tag=SLY4GA3E9O1B type=write size=3721338 2024-09-14T11:22:29.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.473+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~BFS2SIQCVRF3.0 size=256095 2024-09-14T11:22:29.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.475+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=BFS2SIQCVRF3 tag=2AJWSTI79TQL type=write size=1304671 2024-09-14T11:22:29.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.477+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=23HTY7DKBIG3 type=del size=3878662 2024-09-14T11:22:29.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.478+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=LWZ2P08PYP4T type=del 2024-09-14T11:22:29.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.480+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~ITN9COQDS1ZK.0 size=1048576 2024-09-14T11:22:29.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.481+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~ITN9COQDS1ZK.1 size=333994 2024-09-14T11:22:29.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.481+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=ITN9COQDS1ZK tag=WIU8V1R5KTW8 type=write size=2431146 2024-09-14T11:22:29.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.482+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~JZUAX73CWUX9.0 size=1048576 2024-09-14T11:22:29.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.483+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~JZUAX73CWUX9.1 size=219576 2024-09-14T11:22:29.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.485+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=JZUAX73CWUX9 tag=EIR4T9FMECMU type=write size=2316728 2024-09-14T11:22:29.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.487+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=FTLW0R0361OH type=del size=3303427 2024-09-14T11:22:29.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.488+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~8JM1PAW6EKPW.0 size=1048576 2024-09-14T11:22:29.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.489+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~8JM1PAW6EKPW.1 size=1048576 2024-09-14T11:22:29.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.490+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~8JM1PAW6EKPW.2 size=712993 2024-09-14T11:22:29.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.492+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=8JM1PAW6EKPW tag=1QL4AN3CTL7O type=write size=3858721 2024-09-14T11:22:29.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.493+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=QVGTTH05YNK7 type=del size=2287851 2024-09-14T11:22:29.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.494+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~2KFXQMTYKRM5.0 size=763309 2024-09-14T11:22:29.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.496+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=2KFXQMTYKRM5 tag=T5BDKTF0IJQQ type=write size=1811885 2024-09-14T11:22:29.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.497+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=PTL651TJPXAQ type=write size=909930 2024-09-14T11:22:29.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.499+0000 7f43cc561780 -1 < failed to complete operation key=1M46U4U9MG1E tag=W0OABQAOFWLC type=del size=3005113: (22) Invalid argument 2024-09-14T11:22:29.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.501+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~4DTRJRSR81JT.0 size=173434 2024-09-14T11:22:29.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.501+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=4DTRJRSR81JT tag=WMYGQIHGK6UH type=write size=1222010 2024-09-14T11:22:29.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.503+0000 7f43cc561780 1 < suggested update operation key=CXP2PUIXR2PA tag=5MRNDUAREVOV type=write size=449912 2024-09-14T11:22:29.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.504+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=5WKJHGXF2K35 type=del size=681207 2024-09-14T11:22:29.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.506+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~M8IQ1DJ1L4XZ.0 size=1048576 2024-09-14T11:22:29.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.507+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~M8IQ1DJ1L4XZ.1 size=1048576 2024-09-14T11:22:29.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.508+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~M8IQ1DJ1L4XZ.2 size=833233 2024-09-14T11:22:29.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.510+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=M8IQ1DJ1L4XZ tag=CA02H1IVRJ1Z type=write size=3978961 2024-09-14T11:22:29.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.512+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~NOHGBAR1WKQX.0 size=288435 2024-09-14T11:22:29.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.512+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=NOHGBAR1WKQX tag=0GDRJW56P8AH type=write size=1337011 2024-09-14T11:22:29.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.513+0000 7f43cc561780 1 < canceled operation key=W679WIFVPVOH tag=WNUTWYZJXM5K type=del size=3695588 2024-09-14T11:22:29.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.514+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=VI8256144ZYC type=del size=3511820 2024-09-14T11:22:29.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.515+0000 7f43cc561780 -1 < failed to complete operation key=1M46U4U9MG1E tag=4STYJ3URSBZ3 type=del size=3750818: (22) Invalid argument 2024-09-14T11:22:29.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.519+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~ECCCPQMZJEML.0 size=1048576 2024-09-14T11:22:29.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.520+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~ECCCPQMZJEML.1 size=1048576 2024-09-14T11:22:29.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.521+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~ECCCPQMZJEML.2 size=507476 2024-09-14T11:22:29.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.521+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=ECCCPQMZJEML tag=5D1GOOYCJZQG type=write size=3653204 2024-09-14T11:22:29.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.522+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~LU1AKUMF5S84.0 size=58942 2024-09-14T11:22:29.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.524+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=LU1AKUMF5S84 tag=VOVIL2GZFEGM type=write size=1107518 2024-09-14T11:22:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.526+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=KYJR5W0ABGM2 type=del size=3486607 2024-09-14T11:22:29.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.527+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=ODWO0R4IUHA3 type=del 2024-09-14T11:22:29.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.528+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=NQY5NLHY5R7C type=del size=3879747 2024-09-14T11:22:29.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.531+0000 7f43cc561780 1 < suggested update operation key=IFHWMI5YO5L5 tag=BBGVYYJRADN1 type=del size=2405012 2024-09-14T11:22:29.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.532+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=LRJ1R4KWEMW8 type=del size=1113072 2024-09-14T11:22:29.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.534+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~8HX1DC3DJ1D5.0 size=704271 2024-09-14T11:22:29.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.536+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=8HX1DC3DJ1D5 tag=04PDQ5ROPLI4 type=write size=1752847 2024-09-14T11:22:29.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.538+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~Y2P6WC3K7Y6P.0 size=1048576 2024-09-14T11:22:29.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.539+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~Y2P6WC3K7Y6P.1 size=542536 2024-09-14T11:22:29.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.539+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=Y2P6WC3K7Y6P tag=7V1GSX2NKF4K type=write size=2639688 2024-09-14T11:22:29.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.541+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~2QOTQD914XLE.0 size=120159 2024-09-14T11:22:29.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.543+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=2QOTQD914XLE tag=GOOFFSLV08C7 type=write size=1168735 2024-09-14T11:22:29.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.544+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=PMOFFFKDKKEX type=del size=3676109 2024-09-14T11:22:29.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.545+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~FZBKQNEA5058.0 size=1048576 2024-09-14T11:22:29.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.546+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~FZBKQNEA5058.1 size=1048576 2024-09-14T11:22:29.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.547+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~FZBKQNEA5058.2 size=575610 2024-09-14T11:22:29.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.549+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=FZBKQNEA5058 tag=SLY4GA3E9O1B type=write size=3721338 2024-09-14T11:22:29.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.552+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~6OFEV2DZY43A.0 size=661801 2024-09-14T11:22:29.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.552+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=6OFEV2DZY43A tag=V1IPNKQGIFDI type=write size=1710377 2024-09-14T11:22:29.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.554+0000 7f43cc561780 1 < suggested remove operation key=S3NOACTF4K2W tag=23HTY7DKBIG3 type=del 2024-09-14T11:22:29.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.555+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=ZEWOS74W1DHA type=del size=2283387 2024-09-14T11:22:29.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.556+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~ITN9COQDS1ZK.0 size=1048576 2024-09-14T11:22:29.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.557+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~ITN9COQDS1ZK.1 size=333994 2024-09-14T11:22:29.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.559+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=ITN9COQDS1ZK tag=WIU8V1R5KTW8 type=write size=2431146 2024-09-14T11:22:29.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.560+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=WFR7Y6L4764Z type=del size=3982438 2024-09-14T11:22:29.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.561+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=FTLW0R0361OH type=del 2024-09-14T11:22:29.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.563+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=VRQ86D1L0HUT type=del size=4193685 2024-09-14T11:22:29.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.564+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=QVGTTH05YNK7 type=del 2024-09-14T11:22:29.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.566+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~7BKX09U89P1F.0 size=1048576 2024-09-14T11:22:29.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.567+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~7BKX09U89P1F.1 size=839584 2024-09-14T11:22:29.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.567+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=7BKX09U89P1F tag=O38WCN7U4GPP type=write size=2936736 2024-09-14T11:22:29.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.568+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=PTL651TJPXAQ type=write size=909930 2024-09-14T11:22:29.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.569+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=16SUMF8Y4ONX type=del size=2708825 2024-09-14T11:22:29.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.570+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~4DTRJRSR81JT.0 size=173434 2024-09-14T11:22:29.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.572+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=4DTRJRSR81JT tag=WMYGQIHGK6UH type=write size=1222010 2024-09-14T11:22:29.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.574+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~ROYCFT8RNGPQ.0 size=697188 2024-09-14T11:22:29.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.574+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=ROYCFT8RNGPQ tag=EPTWVWTKSKQQ type=write size=1745764 2024-09-14T11:22:29.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.575+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=5WKJHGXF2K35 type=del 2024-09-14T11:22:29.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.577+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~UNO4N5VIVJ1N.0 size=1048576 2024-09-14T11:22:29.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.579+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~UNO4N5VIVJ1N.1 size=1048576 2024-09-14T11:22:29.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.580+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~UNO4N5VIVJ1N.2 size=981483 2024-09-14T11:22:29.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.580+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=UNO4N5VIVJ1N tag=DUTWOCIECZOV type=write size=4127211 2024-09-14T11:22:29.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.581+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~NOHGBAR1WKQX.0 size=288435 2024-09-14T11:22:29.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.583+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=NOHGBAR1WKQX tag=0GDRJW56P8AH type=write size=1337011 2024-09-14T11:22:29.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.584+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=V1MYWBR61DHE type=del size=1743985 2024-09-14T11:22:29.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.585+0000 7f43cc561780 -1 < failed to complete operation key=S3NOACTF4K2W tag=VI8256144ZYC type=del size=3511820: (22) Invalid argument 2024-09-14T11:22:29.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.587+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~WLM0J80ANEOB.0 size=1048576 2024-09-14T11:22:29.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.588+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~WLM0J80ANEOB.1 size=1048576 2024-09-14T11:22:29.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.589+0000 7f43cc561780 1 > prepared part key=_multipart_LKY30XYUG2QW.2~WLM0J80ANEOB.2 size=1014009 2024-09-14T11:22:29.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.589+0000 7f43cc561780 1 > prepared multipart upload key=LKY30XYUG2QW upload=WLM0J80ANEOB tag=PJ19R675468Q type=write size=4159737 2024-09-14T11:22:29.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.590+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~ECCCPQMZJEML.0 size=1048576 2024-09-14T11:22:29.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.591+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~ECCCPQMZJEML.1 size=1048576 2024-09-14T11:22:29.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.592+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~ECCCPQMZJEML.2 size=507476 2024-09-14T11:22:29.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.594+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=ECCCPQMZJEML tag=5D1GOOYCJZQG type=write size=3653204 2024-09-14T11:22:29.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.595+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=AS4DWOUFCR9K type=del size=2230910 2024-09-14T11:22:29.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.596+0000 7f43cc561780 1 < canceled operation key=E6FDCACWGA2Y tag=KYJR5W0ABGM2 type=del size=3486607 2024-09-14T11:22:29.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.598+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~QPBM8MJOC2PY.0 size=1048576 2024-09-14T11:22:29.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.599+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~QPBM8MJOC2PY.1 size=679082 2024-09-14T11:22:29.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.599+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=QPBM8MJOC2PY tag=US48E9QF0PY4 type=write size=2776234 2024-09-14T11:22:29.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.600+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=NQY5NLHY5R7C type=del 2024-09-14T11:22:29.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.602+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=11SZ7LJ0I8N0 type=del size=1467412 2024-09-14T11:22:29.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.603+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=LRJ1R4KWEMW8 type=del 2024-09-14T11:22:29.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.604+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=74B1HBSVI05O type=del size=664891 2024-09-14T11:22:29.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.604+0000 7f43cc561780 1 < canceled part key=_multipart_FISMBWPDPCTA.2~Y2P6WC3K7Y6P.0 size=1048576 2024-09-14T11:22:29.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.605+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~Y2P6WC3K7Y6P.1 size=542536 2024-09-14T11:22:29.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.607+0000 7f43cc561780 1 < canceled multipart upload key=FISMBWPDPCTA upload=Y2P6WC3K7Y6P tag=7V1GSX2NKF4K type=write size=2639688 2024-09-14T11:22:29.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.608+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=F3MV78QZXEIN type=write size=450639 2024-09-14T11:22:29.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.611+0000 7f43cc561780 1 < suggested remove operation key=E6FDCACWGA2Y tag=PMOFFFKDKKEX type=del 2024-09-14T11:22:29.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.612+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=W2RJ2ID84OP0 type=del size=4099767 2024-09-14T11:22:29.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.612+0000 7f43cc561780 1 < canceled part key=_multipart_D84127SVSIPL.2~6OFEV2DZY43A.0 size=661801 2024-09-14T11:22:29.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.614+0000 7f43cc561780 1 < canceled multipart upload key=D84127SVSIPL upload=6OFEV2DZY43A tag=V1IPNKQGIFDI type=write size=1710377 2024-09-14T11:22:29.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.615+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=GVQVQ4AUWM04 type=del size=2417023 2024-09-14T11:22:29.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.616+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=ZEWOS74W1DHA type=del 2024-09-14T11:22:29.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.617+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=L0JH1WKCUZMN type=del size=1871722 2024-09-14T11:22:29.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.619+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=WFR7Y6L4764Z type=del 2024-09-14T11:22:29.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.620+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=3HPOZLVARQGB type=del size=1483979 2024-09-14T11:22:29.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.621+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=VRQ86D1L0HUT type=del 2024-09-14T11:22:29.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.622+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=2DAMHOAQV7QO type=del size=68692 2024-09-14T11:22:29.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.623+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~7BKX09U89P1F.0 size=1048576 2024-09-14T11:22:29.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.624+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~7BKX09U89P1F.1 size=839584 2024-09-14T11:22:29.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.626+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=7BKX09U89P1F tag=O38WCN7U4GPP type=write size=2936736 2024-09-14T11:22:29.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.630+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~HXZX3VC22UVS.0 size=1048576 2024-09-14T11:22:29.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.631+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~HXZX3VC22UVS.1 size=1048576 2024-09-14T11:22:29.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.632+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~HXZX3VC22UVS.2 size=243594 2024-09-14T11:22:29.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.632+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=HXZX3VC22UVS tag=8NA9XCABMSMR type=write size=3389322 2024-09-14T11:22:29.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.633+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=16SUMF8Y4ONX type=del 2024-09-14T11:22:29.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.635+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~BJ9QSY3YJX5L.0 size=1048576 2024-09-14T11:22:29.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.636+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~BJ9QSY3YJX5L.1 size=1048576 2024-09-14T11:22:29.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.637+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~BJ9QSY3YJX5L.2 size=325490 2024-09-14T11:22:29.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.637+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=BJ9QSY3YJX5L tag=3VEXS4S7DQS6 type=write size=3471218 2024-09-14T11:22:29.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.638+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~ROYCFT8RNGPQ.0 size=697188 2024-09-14T11:22:29.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.640+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=ROYCFT8RNGPQ tag=EPTWVWTKSKQQ type=write size=1745764 2024-09-14T11:22:29.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.641+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=0N7EO6C8BVTZ type=del size=2215490 2024-09-14T11:22:29.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.642+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~UNO4N5VIVJ1N.0 size=1048576 2024-09-14T11:22:29.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.643+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~UNO4N5VIVJ1N.1 size=1048576 2024-09-14T11:22:29.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.644+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~UNO4N5VIVJ1N.2 size=981483 2024-09-14T11:22:29.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.647+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=UNO4N5VIVJ1N tag=DUTWOCIECZOV type=write size=4127211 2024-09-14T11:22:29.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.648+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=8F8PWMVSAPUN type=del size=3288980 2024-09-14T11:22:29.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.649+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=V1MYWBR61DHE type=del 2024-09-14T11:22:29.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.650+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=4LHVVVXN9F36 type=write size=678363 2024-09-14T11:22:29.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.652+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~WLM0J80ANEOB.0 size=1048576 2024-09-14T11:22:29.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.653+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~WLM0J80ANEOB.1 size=1048576 2024-09-14T11:22:29.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.654+0000 7f43cc561780 1 < completed part key=_multipart_LKY30XYUG2QW.2~WLM0J80ANEOB.2 size=1014009 2024-09-14T11:22:29.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.656+0000 7f43cc561780 1 < completed multipart upload key=LKY30XYUG2QW upload=WLM0J80ANEOB tag=PJ19R675468Q type=write size=4159737 2024-09-14T11:22:29.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.658+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~TY2IP6YOZ2P7.0 size=1048576 2024-09-14T11:22:29.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.659+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~TY2IP6YOZ2P7.1 size=1048576 2024-09-14T11:22:29.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.660+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~TY2IP6YOZ2P7.2 size=791007 2024-09-14T11:22:29.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.660+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=TY2IP6YOZ2P7 tag=TN5WW0BNZE0R type=write size=3936735 2024-09-14T11:22:29.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.661+0000 7f43cc561780 1 < canceled operation key=G6B4CGUBFSOT tag=AS4DWOUFCR9K type=del size=2230910 2024-09-14T11:22:29.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.662+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=QMSYVU20G3QP type=del size=2576461 2024-09-14T11:22:29.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.664+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~QPBM8MJOC2PY.0 size=1048576 2024-09-14T11:22:29.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.665+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~QPBM8MJOC2PY.1 size=679082 2024-09-14T11:22:29.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.667+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=QPBM8MJOC2PY tag=US48E9QF0PY4 type=write size=2776234 2024-09-14T11:22:29.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.669+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~5H40GCF28O0J.0 size=646309 2024-09-14T11:22:29.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.669+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=5H40GCF28O0J tag=WQKTOGUD6OFN type=write size=1694885 2024-09-14T11:22:29.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.670+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=11SZ7LJ0I8N0 type=del 2024-09-14T11:22:29.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.672+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~G1VCZVBLMPEF.0 size=1048576 2024-09-14T11:22:29.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.673+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~G1VCZVBLMPEF.1 size=967667 2024-09-14T11:22:29.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.673+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=G1VCZVBLMPEF tag=ELTHAV8JW1RL type=write size=3064819 2024-09-14T11:22:29.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.675+0000 7f43cc561780 1 < canceled operation key=AWBBRU4C8RDQ tag=74B1HBSVI05O type=del size=664891 2024-09-14T11:22:29.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.677+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~0PUKZO12LRSZ.0 size=1048576 2024-09-14T11:22:29.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.678+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~0PUKZO12LRSZ.1 size=1048576 2024-09-14T11:22:29.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.679+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~0PUKZO12LRSZ.2 size=866706 2024-09-14T11:22:29.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.679+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=0PUKZO12LRSZ tag=28YDJGM9V5FV type=write size=4012434 2024-09-14T11:22:29.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.680+0000 7f43cc561780 1 < completed write operation key=W679WIFVPVOH tag=F3MV78QZXEIN type=write size=450639 2024-09-14T11:22:29.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.681+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=OO6M5903SGRJ type=del size=1873393 2024-09-14T11:22:29.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.683+0000 7f43cc561780 1 < suggested remove operation key=G6B4CGUBFSOT tag=W2RJ2ID84OP0 type=del 2024-09-14T11:22:29.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.685+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=KAPE0R6UOR0A type=del size=1750438 2024-09-14T11:22:29.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.686+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=GVQVQ4AUWM04 type=del 2024-09-14T11:22:29.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.687+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=9XSJQ0SLP1VR type=del size=1527743 2024-09-14T11:22:29.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.688+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=L0JH1WKCUZMN type=del 2024-09-14T11:22:29.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.689+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=VKKF177OMPLC type=del size=472201 2024-09-14T11:22:29.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.691+0000 7f43cc561780 1 < completed delete operation key=IFHWMI5YO5L5 tag=3HPOZLVARQGB type=del 2024-09-14T11:22:29.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.693+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~K9LW5G2LT57D.0 size=947993 2024-09-14T11:22:29.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.693+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=K9LW5G2LT57D tag=8M65I6VLS6PV type=write size=1996569 2024-09-14T11:22:29.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.694+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=2DAMHOAQV7QO type=del 2024-09-14T11:22:29.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.695+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=COQM0M7KG391 type=write size=757215 2024-09-14T11:22:29.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.696+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~HXZX3VC22UVS.0 size=1048576 2024-09-14T11:22:29.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.698+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~HXZX3VC22UVS.1 size=1048576 2024-09-14T11:22:29.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.699+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~HXZX3VC22UVS.2 size=243594 2024-09-14T11:22:29.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.701+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=HXZX3VC22UVS tag=8NA9XCABMSMR type=write size=3389322 2024-09-14T11:22:29.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.702+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=3JT9JQNINW13 type=del size=2510217 2024-09-14T11:22:29.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.702+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~BJ9QSY3YJX5L.0 size=1048576 2024-09-14T11:22:29.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.703+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~BJ9QSY3YJX5L.1 size=1048576 2024-09-14T11:22:29.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.704+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~BJ9QSY3YJX5L.2 size=325490 2024-09-14T11:22:29.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.706+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=BJ9QSY3YJX5L tag=3VEXS4S7DQS6 type=write size=3471218 2024-09-14T11:22:29.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.707+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=RMIDFKQTM3IL type=del size=1945823 2024-09-14T11:22:29.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.708+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=0N7EO6C8BVTZ type=del 2024-09-14T11:22:29.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.710+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~3L0GHP5FTTD9.0 size=1048576 2024-09-14T11:22:29.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.711+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~3L0GHP5FTTD9.1 size=1048576 2024-09-14T11:22:29.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.712+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~3L0GHP5FTTD9.2 size=521301 2024-09-14T11:22:29.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.712+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=3L0GHP5FTTD9 tag=4UR77V8BDR23 type=write size=3667029 2024-09-14T11:22:29.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.714+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=8F8PWMVSAPUN type=del 2024-09-14T11:22:29.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.715+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=KA56JED8YY5Z type=del size=1465361 2024-09-14T11:22:29.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.716+0000 7f43cc561780 1 < completed write operation key=END3SHHS0FSA tag=4LHVVVXN9F36 type=write size=678363 2024-09-14T11:22:29.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.717+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=WKWM3JVW6N3U type=del size=599637 2024-09-14T11:22:29.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.719+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~TY2IP6YOZ2P7.0 size=1048576 2024-09-14T11:22:29.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.720+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~TY2IP6YOZ2P7.1 size=1048576 2024-09-14T11:22:29.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.720+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~TY2IP6YOZ2P7.2 size=791007 2024-09-14T11:22:29.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.723+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=TY2IP6YOZ2P7 tag=TN5WW0BNZE0R type=write size=3936735 2024-09-14T11:22:29.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.725+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~151EU7SAL23I.0 size=1048576 2024-09-14T11:22:29.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.726+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~151EU7SAL23I.1 size=1048576 2024-09-14T11:22:29.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.727+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~151EU7SAL23I.2 size=420254 2024-09-14T11:22:29.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.727+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=151EU7SAL23I tag=U5TGES0Q3PE0 type=write size=3565982 2024-09-14T11:22:29.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.728+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=QMSYVU20G3QP type=del 2024-09-14T11:22:29.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.730+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~0BR2OOQBRJ4T.0 size=1048576 2024-09-14T11:22:29.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.731+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~0BR2OOQBRJ4T.1 size=1048576 2024-09-14T11:22:29.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.732+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~0BR2OOQBRJ4T.2 size=286736 2024-09-14T11:22:29.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.732+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=0BR2OOQBRJ4T tag=GXYKMEB1ZT8T type=write size=3432464 2024-09-14T11:22:29.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.733+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~5H40GCF28O0J.0 size=646309 2024-09-14T11:22:29.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.736+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=5H40GCF28O0J tag=WQKTOGUD6OFN type=write size=1694885 2024-09-14T11:22:29.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.738+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~79UB6A9G18T1.0 size=502971 2024-09-14T11:22:29.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.738+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=79UB6A9G18T1 tag=DOZT3C7KBOKU type=write size=1551547 2024-09-14T11:22:29.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.738+0000 7f43cc561780 1 < canceled part key=_multipart_15F3ZZAAKT9B.2~G1VCZVBLMPEF.0 size=1048576 2024-09-14T11:22:29.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.739+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~G1VCZVBLMPEF.1 size=967667 2024-09-14T11:22:29.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.743+0000 7f43cc561780 1 < canceled multipart upload key=15F3ZZAAKT9B upload=G1VCZVBLMPEF tag=ELTHAV8JW1RL type=write size=3064819 2024-09-14T11:22:29.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.745+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~I5HVVTE2ZVR5.0 size=1048576 2024-09-14T11:22:29.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.746+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~I5HVVTE2ZVR5.1 size=1048576 2024-09-14T11:22:29.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.747+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~I5HVVTE2ZVR5.2 size=1047443 2024-09-14T11:22:29.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.747+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=I5HVVTE2ZVR5 tag=91ZOTTDRL9T0 type=write size=4193171 2024-09-14T11:22:29.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.748+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~0PUKZO12LRSZ.0 size=1048576 2024-09-14T11:22:29.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.749+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~0PUKZO12LRSZ.1 size=1048576 2024-09-14T11:22:29.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.750+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~0PUKZO12LRSZ.2 size=866706 2024-09-14T11:22:29.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.752+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=0PUKZO12LRSZ tag=28YDJGM9V5FV type=write size=4012434 2024-09-14T11:22:29.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.753+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=VQRL8AW0KI24 type=del size=212108 2024-09-14T11:22:29.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.756+0000 7f43cc561780 1 < suggested remove operation key=WSFZN6JCWUXG tag=OO6M5903SGRJ type=del 2024-09-14T11:22:29.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.757+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=NX4YZDUSYR2F type=del size=1320031 2024-09-14T11:22:29.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.759+0000 7f43cc561780 1 < suggested update operation key=G6B4CGUBFSOT tag=KAPE0R6UOR0A type=del size=1750438 2024-09-14T11:22:29.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.761+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~PWKZ6IKP3L25.0 size=887983 2024-09-14T11:22:29.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.761+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=PWKZ6IKP3L25 tag=54B1WC2JC1F8 type=write size=1936559 2024-09-14T11:22:29.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.763+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=9XSJQ0SLP1VR type=del 2024-09-14T11:22:29.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.764+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=K200R59DGMWV type=write size=588284 2024-09-14T11:22:29.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.765+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=VKKF177OMPLC type=del 2024-09-14T11:22:29.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.766+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=TWSE1Q7SXPEH type=write size=829037 2024-09-14T11:22:29.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.767+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~K9LW5G2LT57D.0 size=947993 2024-09-14T11:22:29.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.769+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=K9LW5G2LT57D tag=8M65I6VLS6PV type=write size=1996569 2024-09-14T11:22:29.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.771+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=Y08C5VEI2PLT type=del size=2054798 2024-09-14T11:22:29.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.772+0000 7f43cc561780 1 < completed write operation key=1M46U4U9MG1E tag=COQM0M7KG391 type=write size=757215 2024-09-14T11:22:29.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.773+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=3TP3M2H70JXK type=write size=499550 2024-09-14T11:22:29.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.775+0000 7f43cc561780 -1 < failed to complete operation key=G6B4CGUBFSOT tag=3JT9JQNINW13 type=del size=2510217: (22) Invalid argument 2024-09-14T11:22:29.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.777+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~92WOFZL36YT3.0 size=1048576 2024-09-14T11:22:29.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.778+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~92WOFZL36YT3.1 size=1048576 2024-09-14T11:22:29.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.779+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~92WOFZL36YT3.2 size=940022 2024-09-14T11:22:29.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.779+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=92WOFZL36YT3 tag=1UAB9MKPJUT5 type=write size=4085750 2024-09-14T11:22:29.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.781+0000 7f43cc561780 1 < canceled operation key=MD14RGOQY0LK tag=RMIDFKQTM3IL type=del size=1945823 2024-09-14T11:22:29.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.782+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=DL0349DMRMMG type=write size=998775 2024-09-14T11:22:29.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.783+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~3L0GHP5FTTD9.0 size=1048576 2024-09-14T11:22:29.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.784+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~3L0GHP5FTTD9.1 size=1048576 2024-09-14T11:22:29.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.786+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~3L0GHP5FTTD9.2 size=521301 2024-09-14T11:22:29.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.788+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=3L0GHP5FTTD9 tag=4UR77V8BDR23 type=write size=3667029 2024-09-14T11:22:29.788 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.789+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=NNR6VOJULMWX type=del size=192852 2024-09-14T11:22:29.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.792+0000 7f43cc561780 1 < suggested remove operation key=A1B2LIZIPET3 tag=KA56JED8YY5Z type=del 2024-09-14T11:22:29.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.793+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=OKGBJ0U40EXZ type=write size=324734 2024-09-14T11:22:29.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.795+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=WKWM3JVW6N3U type=del 2024-09-14T11:22:29.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.796+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=DX9AIINYGJW1 type=del size=1167704 2024-09-14T11:22:29.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.798+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~151EU7SAL23I.0 size=1048576 2024-09-14T11:22:29.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.799+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~151EU7SAL23I.1 size=1048576 2024-09-14T11:22:29.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.800+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~151EU7SAL23I.2 size=420254 2024-09-14T11:22:29.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.802+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=151EU7SAL23I tag=U5TGES0Q3PE0 type=write size=3565982 2024-09-14T11:22:29.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.803+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=RO02OAFFO3PE type=del size=2858579 2024-09-14T11:22:29.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.804+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~0BR2OOQBRJ4T.0 size=1048576 2024-09-14T11:22:29.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.805+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~0BR2OOQBRJ4T.1 size=1048576 2024-09-14T11:22:29.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.806+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~0BR2OOQBRJ4T.2 size=286736 2024-09-14T11:22:29.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.808+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=0BR2OOQBRJ4T tag=GXYKMEB1ZT8T type=write size=3432464 2024-09-14T11:22:29.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.810+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~3LZ1N3U3S193.0 size=1048576 2024-09-14T11:22:29.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.811+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~3LZ1N3U3S193.1 size=405401 2024-09-14T11:22:29.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.811+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=3LZ1N3U3S193 tag=W4YEAEXJDZL7 type=write size=2502553 2024-09-14T11:22:29.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.812+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~79UB6A9G18T1.0 size=502971 2024-09-14T11:22:29.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.814+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=79UB6A9G18T1 tag=DOZT3C7KBOKU type=write size=1551547 2024-09-14T11:22:29.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.815+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=O9K4ZYROT6Z8 type=del size=1691967 2024-09-14T11:22:29.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.816+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~I5HVVTE2ZVR5.0 size=1048576 2024-09-14T11:22:29.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.817+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~I5HVVTE2ZVR5.1 size=1048576 2024-09-14T11:22:29.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.818+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~I5HVVTE2ZVR5.2 size=1047443 2024-09-14T11:22:29.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.821+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=I5HVVTE2ZVR5 tag=91ZOTTDRL9T0 type=write size=4193171 2024-09-14T11:22:29.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.822+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=85434JUV4OR1 type=del size=1726151 2024-09-14T11:22:29.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.823+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=VQRL8AW0KI24 type=del 2024-09-14T11:22:29.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.825+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~J2SNTVG3SHC6.0 size=713822 2024-09-14T11:22:29.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.825+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=J2SNTVG3SHC6 tag=V3KN8TTIK3HM type=write size=1762398 2024-09-14T11:22:29.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.826+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=NX4YZDUSYR2F type=del 2024-09-14T11:22:29.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.829+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~ZTUNPWS6O7RH.0 size=1048576 2024-09-14T11:22:29.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.830+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~ZTUNPWS6O7RH.1 size=834250 2024-09-14T11:22:29.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.830+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=ZTUNPWS6O7RH tag=KJHH4YM9393C type=write size=2931402 2024-09-14T11:22:29.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.831+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~PWKZ6IKP3L25.0 size=887983 2024-09-14T11:22:29.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.833+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=PWKZ6IKP3L25 tag=54B1WC2JC1F8 type=write size=1936559 2024-09-14T11:22:29.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.834+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=TNHYFDJJM5W9 type=del size=2478505 2024-09-14T11:22:29.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.836+0000 7f43cc561780 1 < suggested remove operation key=2975CNBC43ST tag=K200R59DGMWV type=write 2024-09-14T11:22:29.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.837+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=IVT02ASQ23SN type=del size=3414775 2024-09-14T11:22:29.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.839+0000 7f43cc561780 1 < completed write operation key=OV4ATW747PY4 tag=TWSE1Q7SXPEH type=write size=829037 2024-09-14T11:22:29.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.841+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~CSSR0C0G1VDD.0 size=847834 2024-09-14T11:22:29.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.841+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=CSSR0C0G1VDD tag=G2OLMDTD9BZJ type=write size=1896410 2024-09-14T11:22:29.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.843+0000 7f43cc561780 1 < suggested remove operation key=BRHP3DQEO3HZ tag=Y08C5VEI2PLT type=del 2024-09-14T11:22:29.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.845+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~9WBTJTNEJXLW.0 size=983566 2024-09-14T11:22:29.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.845+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=9WBTJTNEJXLW tag=G4B0CJ7G8NI2 type=write size=2032142 2024-09-14T11:22:29.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.847+0000 7f43cc561780 -1 < failed to complete operation key=BRHP3DQEO3HZ tag=3TP3M2H70JXK type=write size=499550: (22) Invalid argument 2024-09-14T11:22:29.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.849+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~205AY8GPJY7K.0 size=943827 2024-09-14T11:22:29.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.849+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=205AY8GPJY7K tag=MEZ1KB376K1V type=write size=1992403 2024-09-14T11:22:29.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.850+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~92WOFZL36YT3.0 size=1048576 2024-09-14T11:22:29.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.851+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~92WOFZL36YT3.1 size=1048576 2024-09-14T11:22:29.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.852+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~92WOFZL36YT3.2 size=940022 2024-09-14T11:22:29.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.854+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=92WOFZL36YT3 tag=1UAB9MKPJUT5 type=write size=4085750 2024-09-14T11:22:29.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.857+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=OZYJBP04OUH7 type=del size=216312 2024-09-14T11:22:29.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.858+0000 7f43cc561780 1 < canceled operation key=9XIAGZKIUBGH tag=DL0349DMRMMG type=write size=998775 2024-09-14T11:22:29.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.860+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=DSD2MQJS9T8B type=write size=896451 2024-09-14T11:22:29.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.862+0000 7f43cc561780 1 < suggested update operation key=WHIZ2GREK1FE tag=NNR6VOJULMWX type=del size=192852 2024-09-14T11:22:29.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.864+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~5O9HWZMP1B3J.0 size=1048576 2024-09-14T11:22:29.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.865+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~5O9HWZMP1B3J.1 size=126114 2024-09-14T11:22:29.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.865+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=5O9HWZMP1B3J tag=AJ1KJEDGQPCG type=write size=2223266 2024-09-14T11:22:29.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.866+0000 7f43cc561780 -1 < failed to complete operation key=BRHP3DQEO3HZ tag=OKGBJ0U40EXZ type=write size=324734: (22) Invalid argument 2024-09-14T11:22:29.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.867+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=BIAC0EOLLG4B type=del size=3046441 2024-09-14T11:22:29.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.869+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=DX9AIINYGJW1 type=del 2024-09-14T11:22:29.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.870+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=CAIDZ3WOYOB9 type=del size=698383 2024-09-14T11:22:29.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.871+0000 7f43cc561780 1 < canceled operation key=END3SHHS0FSA tag=RO02OAFFO3PE type=del size=2858579 2024-09-14T11:22:29.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.872+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=ASURPG8W0U0N type=del size=1667559 2024-09-14T11:22:29.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.872+0000 7f43cc561780 1 < canceled part key=_multipart_G6B4CGUBFSOT.2~3LZ1N3U3S193.0 size=1048576 2024-09-14T11:22:29.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.872+0000 7f43cc561780 1 < canceled part key=_multipart_G6B4CGUBFSOT.2~3LZ1N3U3S193.1 size=405401 2024-09-14T11:22:29.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.874+0000 7f43cc561780 1 < canceled multipart upload key=G6B4CGUBFSOT upload=3LZ1N3U3S193 tag=W4YEAEXJDZL7 type=write size=2502553 2024-09-14T11:22:29.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.877+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~6G32EYC0PLP2.0 size=1048576 2024-09-14T11:22:29.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.878+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~6G32EYC0PLP2.1 size=237167 2024-09-14T11:22:29.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.878+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=6G32EYC0PLP2 tag=S5B33407NT6H type=write size=2334319 2024-09-14T11:22:29.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.879+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=O9K4ZYROT6Z8 type=del 2024-09-14T11:22:29.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.880+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=Z2KY9KBPCHT0 type=write size=560015 2024-09-14T11:22:29.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.881+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=85434JUV4OR1 type=del 2024-09-14T11:22:29.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.882+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=CF90M3RPYC81 type=del size=1303655 2024-09-14T11:22:29.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.884+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~J2SNTVG3SHC6.0 size=713822 2024-09-14T11:22:29.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.886+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=J2SNTVG3SHC6 tag=V3KN8TTIK3HM type=write size=1762398 2024-09-14T11:22:29.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.887+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=MZ5XQ2X3IEFH type=write size=58066 2024-09-14T11:22:29.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.888+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~ZTUNPWS6O7RH.0 size=1048576 2024-09-14T11:22:29.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.889+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~ZTUNPWS6O7RH.1 size=834250 2024-09-14T11:22:29.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.891+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=ZTUNPWS6O7RH tag=KJHH4YM9393C type=write size=2931402 2024-09-14T11:22:29.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.893+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~YY6YKV0JD2V5.0 size=1048576 2024-09-14T11:22:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.894+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~YY6YKV0JD2V5.1 size=686999 2024-09-14T11:22:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.894+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=YY6YKV0JD2V5 tag=DOK3XB1EY2CQ type=write size=2784151 2024-09-14T11:22:29.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.896+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=TNHYFDJJM5W9 type=del 2024-09-14T11:22:29.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.897+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=QOO3DPCW116F type=write size=687891 2024-09-14T11:22:29.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.898+0000 7f43cc561780 1 < canceled operation key=15F3ZZAAKT9B tag=IVT02ASQ23SN type=del size=3414775 2024-09-14T11:22:29.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.900+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~MBUZENRNTB1U.0 size=623878 2024-09-14T11:22:29.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.900+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=MBUZENRNTB1U tag=C4I19053ZVG7 type=write size=1672454 2024-09-14T11:22:29.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.901+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~CSSR0C0G1VDD.0 size=847834 2024-09-14T11:22:29.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.903+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=CSSR0C0G1VDD tag=G2OLMDTD9BZJ type=write size=1896410 2024-09-14T11:22:29.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.906+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~YW7CQLYSHQJE.0 size=650788 2024-09-14T11:22:29.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.906+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=YW7CQLYSHQJE tag=VQJ9FTMRLJ38 type=write size=1699364 2024-09-14T11:22:29.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.907+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~9WBTJTNEJXLW.0 size=983566 2024-09-14T11:22:29.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.909+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=9WBTJTNEJXLW tag=G4B0CJ7G8NI2 type=write size=2032142 2024-09-14T11:22:29.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.912+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~SBPTXE6GUZK0.0 size=60357 2024-09-14T11:22:29.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.912+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=SBPTXE6GUZK0 tag=4PTMOGK8VDOB type=write size=1108933 2024-09-14T11:22:29.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.913+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~205AY8GPJY7K.0 size=943827 2024-09-14T11:22:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.915+0000 7f43cc561780 1 < completed multipart upload key=E6FDCACWGA2Y upload=205AY8GPJY7K tag=MEZ1KB376K1V type=write size=1992403 2024-09-14T11:22:29.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.916+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=Q79KGB5PH1E9 type=write size=180770 2024-09-14T11:22:29.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.918+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=OZYJBP04OUH7 type=del 2024-09-14T11:22:29.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.920+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~2XFQZHC1CE3J.0 size=552287 2024-09-14T11:22:29.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.920+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=2XFQZHC1CE3J tag=U8JGUZ7KJG1V type=write size=1600863 2024-09-14T11:22:29.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.922+0000 7f43cc561780 1 < suggested remove operation key=END3SHHS0FSA tag=DSD2MQJS9T8B type=write 2024-09-14T11:22:29.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.924+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=A1BFOI3LNDJB type=del size=2356432 2024-09-14T11:22:29.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.924+0000 7f43cc561780 1 < canceled part key=_multipart_BNNSFLYOU27F.2~5O9HWZMP1B3J.0 size=1048576 2024-09-14T11:22:29.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.925+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~5O9HWZMP1B3J.1 size=126114 2024-09-14T11:22:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.927+0000 7f43cc561780 1 < canceled multipart upload key=BNNSFLYOU27F upload=5O9HWZMP1B3J tag=AJ1KJEDGQPCG type=write size=2223266 2024-09-14T11:22:29.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.929+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~ZY182AT866UZ.0 size=957924 2024-09-14T11:22:29.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.929+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=ZY182AT866UZ tag=RNEXJZKZPU0I type=write size=2006500 2024-09-14T11:22:29.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.931+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=BIAC0EOLLG4B type=del 2024-09-14T11:22:29.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.932+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=QLJP710985AS type=del size=998292 2024-09-14T11:22:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.933+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=CAIDZ3WOYOB9 type=del 2024-09-14T11:22:29.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.935+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=S43FJJJNGGP7 type=del size=3906143 2024-09-14T11:22:29.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.936+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=ASURPG8W0U0N type=del 2024-09-14T11:22:29.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.938+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~N2VQC7Y73T4L.0 size=994437 2024-09-14T11:22:29.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.938+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=N2VQC7Y73T4L tag=TV33CJ9F84M9 type=write size=2043013 2024-09-14T11:22:29.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.940+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~6G32EYC0PLP2.0 size=1048576 2024-09-14T11:22:29.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.941+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~6G32EYC0PLP2.1 size=237167 2024-09-14T11:22:29.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.943+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=6G32EYC0PLP2 tag=S5B33407NT6H type=write size=2334319 2024-09-14T11:22:29.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.945+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~87LA0OZW4UB9.0 size=706183 2024-09-14T11:22:29.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.945+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=87LA0OZW4UB9 tag=VS6F530QALQZ type=write size=1754759 2024-09-14T11:22:29.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.946+0000 7f43cc561780 1 < completed write operation key=683ZFW0BWMT7 tag=Z2KY9KBPCHT0 type=write size=560015 2024-09-14T11:22:29.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.947+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=59Q4W2DNG89E type=del size=4131643 2024-09-14T11:22:29.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.949+0000 7f43cc561780 -1 < failed to complete operation key=END3SHHS0FSA tag=CF90M3RPYC81 type=del size=1303655: (22) Invalid argument 2024-09-14T11:22:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.951+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HNROR9TS734L.0 size=1048576 2024-09-14T11:22:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.952+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HNROR9TS734L.1 size=1048576 2024-09-14T11:22:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.953+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~HNROR9TS734L.2 size=241483 2024-09-14T11:22:29.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.953+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=HNROR9TS734L tag=H08JKUWBP0YN type=write size=3387211 2024-09-14T11:22:29.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.954+0000 7f43cc561780 -1 < failed to complete operation key=END3SHHS0FSA tag=MZ5XQ2X3IEFH type=write size=58066: (22) Invalid argument 2024-09-14T11:22:29.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.956+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~6NDMDWI220LI.0 size=1048576 2024-09-14T11:22:29.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.957+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~6NDMDWI220LI.1 size=347618 2024-09-14T11:22:29.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.957+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=6NDMDWI220LI tag=EE1YR99XZ24A type=write size=2444770 2024-09-14T11:22:29.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.958+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~YY6YKV0JD2V5.0 size=1048576 2024-09-14T11:22:29.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.959+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~YY6YKV0JD2V5.1 size=686999 2024-09-14T11:22:29.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.961+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=YY6YKV0JD2V5 tag=DOK3XB1EY2CQ type=write size=2784151 2024-09-14T11:22:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.963+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~6O2MHW0NLTX1.0 size=855852 2024-09-14T11:22:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.963+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=6O2MHW0NLTX1 tag=0SFDS2GW2U98 type=write size=1904428 2024-09-14T11:22:29.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.964+0000 7f43cc561780 1 < completed write operation key=IG4QM506P41B tag=QOO3DPCW116F type=write size=687891 2024-09-14T11:22:29.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.966+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=OHVTH2JKMRQQ type=del size=1108018 2024-09-14T11:22:29.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.967+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~MBUZENRNTB1U.0 size=623878 2024-09-14T11:22:29.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.969+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=MBUZENRNTB1U tag=C4I19053ZVG7 type=write size=1672454 2024-09-14T11:22:29.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.970+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=55YE80TRNRNE type=write size=1046133 2024-09-14T11:22:29.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.972+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~YW7CQLYSHQJE.0 size=650788 2024-09-14T11:22:29.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.974+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=YW7CQLYSHQJE tag=VQJ9FTMRLJ38 type=write size=1699364 2024-09-14T11:22:29.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.976+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~RFESGEFYNG8G.0 size=1048576 2024-09-14T11:22:29.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.977+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~RFESGEFYNG8G.1 size=138902 2024-09-14T11:22:29.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.977+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=RFESGEFYNG8G tag=K0ABTSIH5CYD type=write size=2236054 2024-09-14T11:22:29.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.979+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~SBPTXE6GUZK0.0 size=60357 2024-09-14T11:22:29.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.981+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=SBPTXE6GUZK0 tag=4PTMOGK8VDOB type=write size=1108933 2024-09-14T11:22:29.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.983+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~QNNWFFPDS70I.0 size=1048576 2024-09-14T11:22:29.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.984+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~QNNWFFPDS70I.1 size=1048576 2024-09-14T11:22:29.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.985+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~QNNWFFPDS70I.2 size=767373 2024-09-14T11:22:29.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.985+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=QNNWFFPDS70I tag=FL6POI8N4H40 type=write size=3913101 2024-09-14T11:22:29.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.986+0000 7f43cc561780 1 < completed write operation key=OV4ATW747PY4 tag=Q79KGB5PH1E9 type=write size=180770 2024-09-14T11:22:29.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.987+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=OVFHRY8XUU26 type=write size=724165 2024-09-14T11:22:29.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.988+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~2XFQZHC1CE3J.0 size=552287 2024-09-14T11:22:29.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.991+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=2XFQZHC1CE3J tag=U8JGUZ7KJG1V type=write size=1600863 2024-09-14T11:22:29.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.992+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=B9AFXPX2IG2Y type=del size=203491 2024-09-14T11:22:29.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.993+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=A1BFOI3LNDJB type=del 2024-09-14T11:22:29.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.994+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=4ZYX9B46KZY2 type=del size=3860850 2024-09-14T11:22:29.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.996+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~ZY182AT866UZ.0 size=957924 2024-09-14T11:22:29.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.997+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=ZY182AT866UZ tag=RNEXJZKZPU0I type=write size=2006500 2024-09-14T11:22:29.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:29.999+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=3MFJOBTQI4UV type=del size=2164186 2024-09-14T11:22:30.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.001+0000 7f43cc561780 1 < suggested update operation key=15F3ZZAAKT9B tag=QLJP710985AS type=del size=998292 2024-09-14T11:22:30.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.003+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~0W783HSX1GNW.0 size=1048576 2024-09-14T11:22:30.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.004+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~0W783HSX1GNW.1 size=1048576 2024-09-14T11:22:30.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.005+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~0W783HSX1GNW.2 size=1033708 2024-09-14T11:22:30.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.005+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=0W783HSX1GNW tag=WIRDPTTAHNTU type=write size=4179436 2024-09-14T11:22:30.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.006+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=S43FJJJNGGP7 type=del 2024-09-14T11:22:30.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.008+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=3XB5BEIIYYM9 type=del size=3051543 2024-09-14T11:22:30.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.009+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~N2VQC7Y73T4L.0 size=994437 2024-09-14T11:22:30.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.011+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=N2VQC7Y73T4L tag=TV33CJ9F84M9 type=write size=2043013 2024-09-14T11:22:30.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.013+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~303HN217ZPDC.0 size=308603 2024-09-14T11:22:30.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.013+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=303HN217ZPDC tag=DAZVYWW057E5 type=write size=1357179 2024-09-14T11:22:30.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.014+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~87LA0OZW4UB9.0 size=706183 2024-09-14T11:22:30.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.016+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=87LA0OZW4UB9 tag=VS6F530QALQZ type=write size=1754759 2024-09-14T11:22:30.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.017+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=P4ECCT1QKVRR type=del size=3937699 2024-09-14T11:22:30.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.019+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=59Q4W2DNG89E type=del 2024-09-14T11:22:30.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.021+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~FAQ5ACX1X4TT.0 size=466598 2024-09-14T11:22:30.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.021+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=FAQ5ACX1X4TT tag=M1CILNPGBT67 type=write size=1515174 2024-09-14T11:22:30.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.022+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HNROR9TS734L.0 size=1048576 2024-09-14T11:22:30.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.023+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HNROR9TS734L.1 size=1048576 2024-09-14T11:22:30.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.024+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~HNROR9TS734L.2 size=241483 2024-09-14T11:22:30.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.026+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=HNROR9TS734L tag=H08JKUWBP0YN type=write size=3387211 2024-09-14T11:22:30.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.028+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=U5HMTM7BX39A type=del size=507488 2024-09-14T11:22:30.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.029+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~6NDMDWI220LI.0 size=1048576 2024-09-14T11:22:30.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.030+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~6NDMDWI220LI.1 size=347618 2024-09-14T11:22:30.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.032+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=6NDMDWI220LI tag=EE1YR99XZ24A type=write size=2444770 2024-09-14T11:22:30.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.033+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=ZYD64Z33BFEK type=del size=1519613 2024-09-14T11:22:30.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.034+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~6O2MHW0NLTX1.0 size=855852 2024-09-14T11:22:30.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.037+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=6O2MHW0NLTX1 tag=0SFDS2GW2U98 type=write size=1904428 2024-09-14T11:22:30.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.038+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=6ET3183P6U0P type=del size=3365723 2024-09-14T11:22:30.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.039+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=OHVTH2JKMRQQ type=del 2024-09-14T11:22:30.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.040+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=IVDAIV82NIZL type=del size=617872 2024-09-14T11:22:30.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.042+0000 7f43cc561780 1 < canceled operation key=IG4QM506P41B tag=55YE80TRNRNE type=write size=1046133 2024-09-14T11:22:30.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.043+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=PKD3WHEXJ9DV type=del size=2318792 2024-09-14T11:22:30.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.044+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~RFESGEFYNG8G.0 size=1048576 2024-09-14T11:22:30.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.045+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~RFESGEFYNG8G.1 size=138902 2024-09-14T11:22:30.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.047+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=RFESGEFYNG8G tag=K0ABTSIH5CYD type=write size=2236054 2024-09-14T11:22:30.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.048+0000 7f43cc561780 1 > prepared operation key=IFHWMI5YO5L5 tag=5HOWWXXC5VM0 type=del size=397162 2024-09-14T11:22:30.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.050+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~QNNWFFPDS70I.0 size=1048576 2024-09-14T11:22:30.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.050+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~QNNWFFPDS70I.1 size=1048576 2024-09-14T11:22:30.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.052+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~QNNWFFPDS70I.2 size=767373 2024-09-14T11:22:30.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.054+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=QNNWFFPDS70I tag=FL6POI8N4H40 type=write size=3913101 2024-09-14T11:22:30.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.055+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=YVOO3X7GZXM4 type=del size=3136359 2024-09-14T11:22:30.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.057+0000 7f43cc561780 1 < suggested update operation key=683ZFW0BWMT7 tag=OVFHRY8XUU26 type=write size=724165 2024-09-14T11:22:30.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.059+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~HIM9QIIBG639.0 size=1048576 2024-09-14T11:22:30.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.061+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~HIM9QIIBG639.1 size=1048576 2024-09-14T11:22:30.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.062+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~HIM9QIIBG639.2 size=485701 2024-09-14T11:22:30.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.062+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=HIM9QIIBG639 tag=8VTF60DV7HIL type=write size=3631429 2024-09-14T11:22:30.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.063+0000 7f43cc561780 1 < canceled operation key=1M46U4U9MG1E tag=B9AFXPX2IG2Y type=del size=203491 2024-09-14T11:22:30.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.064+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=2GCD241EM84N type=del size=2088979 2024-09-14T11:22:30.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.065+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=4ZYX9B46KZY2 type=del 2024-09-14T11:22:30.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.068+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~E1CHQY405BXU.0 size=1048576 2024-09-14T11:22:30.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.068+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~E1CHQY405BXU.1 size=1048576 2024-09-14T11:22:30.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.069+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~E1CHQY405BXU.2 size=271092 2024-09-14T11:22:30.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.069+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=E1CHQY405BXU tag=97353UKSEZ0U type=write size=3416820 2024-09-14T11:22:30.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.071+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=3MFJOBTQI4UV type=del 2024-09-14T11:22:30.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.072+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=FOFR0CK21CN2 type=del size=2290077 2024-09-14T11:22:30.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.073+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~0W783HSX1GNW.0 size=1048576 2024-09-14T11:22:30.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.074+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~0W783HSX1GNW.1 size=1048576 2024-09-14T11:22:30.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.075+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~0W783HSX1GNW.2 size=1033708 2024-09-14T11:22:30.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.077+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=0W783HSX1GNW tag=WIRDPTTAHNTU type=write size=4179436 2024-09-14T11:22:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.078+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=U32JXBWASWKZ type=del size=3531929 2024-09-14T11:22:30.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.081+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=3XB5BEIIYYM9 type=del size=3051543 2024-09-14T11:22:30.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.082+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=I4HP4O0RYFVK type=del size=1515826 2024-09-14T11:22:30.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.083+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~303HN217ZPDC.0 size=308603 2024-09-14T11:22:30.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.087+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=303HN217ZPDC tag=DAZVYWW057E5 type=write size=1357179 2024-09-14T11:22:30.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.088+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=N4BORYZF4E8N type=del size=2394820 2024-09-14T11:22:30.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.089+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=P4ECCT1QKVRR type=del 2024-09-14T11:22:30.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.090+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=GQ8DDKOHFNJJ type=del size=2447227 2024-09-14T11:22:30.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.092+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~FAQ5ACX1X4TT.0 size=466598 2024-09-14T11:22:30.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.094+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=FAQ5ACX1X4TT tag=M1CILNPGBT67 type=write size=1515174 2024-09-14T11:22:30.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.096+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~GDPPFZ077UWA.0 size=228615 2024-09-14T11:22:30.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.096+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=GDPPFZ077UWA tag=GXTPSRD7RLQQ type=write size=1277191 2024-09-14T11:22:30.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.097+0000 7f43cc561780 1 < completed delete operation key=BZDW69C3Z97G tag=U5HMTM7BX39A type=del 2024-09-14T11:22:30.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.100+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~0Y1JBEXG3VLE.0 size=1048576 2024-09-14T11:22:30.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.101+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~0Y1JBEXG3VLE.1 size=1048576 2024-09-14T11:22:30.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.102+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~0Y1JBEXG3VLE.2 size=524969 2024-09-14T11:22:30.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.102+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=0Y1JBEXG3VLE tag=8CBTWMR7SLB1 type=write size=3670697 2024-09-14T11:22:30.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.105+0000 7f43cc561780 1 < suggested update operation key=683ZFW0BWMT7 tag=ZYD64Z33BFEK type=del size=1519613 2024-09-14T11:22:30.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.107+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~CPQWJ00D56I8.0 size=1048576 2024-09-14T11:22:30.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.108+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~CPQWJ00D56I8.1 size=929176 2024-09-14T11:22:30.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.108+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=CPQWJ00D56I8 tag=3ELPWZU1L5J3 type=write size=3026328 2024-09-14T11:22:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.110+0000 7f43cc561780 1 < suggested update operation key=IG4QM506P41B tag=6ET3183P6U0P type=del size=3365723 2024-09-14T11:22:30.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.111+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=HP277PEHH00L type=del size=1543911 2024-09-14T11:22:30.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.113+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=IVDAIV82NIZL type=del 2024-09-14T11:22:30.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.114+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=SRQQKC8R2AG4 type=del size=3880662 2024-09-14T11:22:30.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.115+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=PKD3WHEXJ9DV type=del 2024-09-14T11:22:30.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.116+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=I1W4ACVHFCFZ type=del size=1134516 2024-09-14T11:22:30.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.119+0000 7f43cc561780 1 < suggested remove operation key=IFHWMI5YO5L5 tag=5HOWWXXC5VM0 type=del 2024-09-14T11:22:30.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.120+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=XDFL1XWRR869 type=del size=2177054 2024-09-14T11:22:30.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.121+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=YVOO3X7GZXM4 type=del 2024-09-14T11:22:30.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.122+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=PUA8O1KY5LXB type=del size=935559 2024-09-14T11:22:30.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.124+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~HIM9QIIBG639.0 size=1048576 2024-09-14T11:22:30.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.125+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~HIM9QIIBG639.1 size=1048576 2024-09-14T11:22:30.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.126+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~HIM9QIIBG639.2 size=485701 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.128+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=HIM9QIIBG639 tag=8VTF60DV7HIL type=write size=3631429 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.129+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=HOXRM18EJFT6 type=del size=4084216 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.130+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=2GCD241EM84N type=del 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.131+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=ASY5I3HZXB30 type=del size=543271 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.132+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~E1CHQY405BXU.0 size=1048576 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.133+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~E1CHQY405BXU.1 size=1048576 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.134+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~E1CHQY405BXU.2 size=271092 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.136+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=E1CHQY405BXU tag=97353UKSEZ0U type=write size=3416820 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.137+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=B0ABTAPML54E type=write size=938593 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.139+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=FOFR0CK21CN2 type=del 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.140+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=YT49LMY16ZMZ type=del size=3842151 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.141+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=U32JXBWASWKZ type=del size=3531929: (22) Invalid argument 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.142+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=HM5IFX8YWRN9 type=del size=879690 2024-09-14T11:22:30.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.144+0000 7f43cc561780 1 < suggested update operation key=80ZYEEE1EE78 tag=I4HP4O0RYFVK type=del size=1515826 2024-09-14T11:22:30.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.146+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=XG5QGTDL977Y type=del size=313000 2024-09-14T11:22:30.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.147+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=N4BORYZF4E8N type=del 2024-09-14T11:22:30.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.149+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~GLOL3YBSLBVO.0 size=482913 2024-09-14T11:22:30.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.149+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=GLOL3YBSLBVO tag=9YUQ84DQR7FI type=write size=1531489 2024-09-14T11:22:30.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.150+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=GQ8DDKOHFNJJ type=del 2024-09-14T11:22:30.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.151+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=Q0YYG748IYF0 type=del size=2213142 2024-09-14T11:22:30.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.153+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~GDPPFZ077UWA.0 size=228615 2024-09-14T11:22:30.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.154+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=GDPPFZ077UWA tag=GXTPSRD7RLQQ type=write size=1277191 2024-09-14T11:22:30.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.157+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~H0RKDX583ZMZ.0 size=898093 2024-09-14T11:22:30.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.157+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=H0RKDX583ZMZ tag=89MTQH9FL1UR type=write size=1946669 2024-09-14T11:22:30.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.158+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~0Y1JBEXG3VLE.0 size=1048576 2024-09-14T11:22:30.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.159+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~0Y1JBEXG3VLE.1 size=1048576 2024-09-14T11:22:30.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.160+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~0Y1JBEXG3VLE.2 size=524969 2024-09-14T11:22:30.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.162+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=0Y1JBEXG3VLE tag=8CBTWMR7SLB1 type=write size=3670697 2024-09-14T11:22:30.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.163+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=56IERK7QQACR type=del size=2078121 2024-09-14T11:22:30.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.164+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~CPQWJ00D56I8.0 size=1048576 2024-09-14T11:22:30.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.165+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~CPQWJ00D56I8.1 size=929176 2024-09-14T11:22:30.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.167+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=CPQWJ00D56I8 tag=3ELPWZU1L5J3 type=write size=3026328 2024-09-14T11:22:30.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.168+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=XIFD477B3EEQ type=write size=857638 2024-09-14T11:22:30.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.170+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=HP277PEHH00L type=del 2024-09-14T11:22:30.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.171+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=M9LI65KZ2KOW type=del size=2851031 2024-09-14T11:22:30.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.172+0000 7f43cc561780 1 < canceled operation key=9XIAGZKIUBGH tag=SRQQKC8R2AG4 type=del size=3880662 2024-09-14T11:22:30.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.174+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~C68J11D6HNW6.0 size=611541 2024-09-14T11:22:30.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.174+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=C68J11D6HNW6 tag=HX90KD2ENXWB type=write size=1660117 2024-09-14T11:22:30.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.176+0000 7f43cc561780 1 < suggested remove operation key=683ZFW0BWMT7 tag=I1W4ACVHFCFZ type=del 2024-09-14T11:22:30.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.178+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~816NK0WNSGE8.0 size=1048576 2024-09-14T11:22:30.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.179+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~816NK0WNSGE8.1 size=1048576 2024-09-14T11:22:30.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.180+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~816NK0WNSGE8.2 size=842366 2024-09-14T11:22:30.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.180+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=816NK0WNSGE8 tag=UUL8EB3UE91M type=write size=3988094 2024-09-14T11:22:30.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.181+0000 7f43cc561780 -1 < failed to complete operation key=80ZYEEE1EE78 tag=XDFL1XWRR869 type=del size=2177054: (22) Invalid argument 2024-09-14T11:22:30.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.183+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~L94GY5MQB3ZN.0 size=1048576 2024-09-14T11:22:30.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.184+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~L94GY5MQB3ZN.1 size=560776 2024-09-14T11:22:30.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.184+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=L94GY5MQB3ZN tag=YIOPBNKG1QES type=write size=2657928 2024-09-14T11:22:30.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.186+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=PUA8O1KY5LXB type=del 2024-09-14T11:22:30.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.188+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~B8QS0JYISVMX.0 size=1048576 2024-09-14T11:22:30.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.189+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~B8QS0JYISVMX.1 size=721744 2024-09-14T11:22:30.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.189+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=B8QS0JYISVMX tag=O24JXP3MAUSS type=write size=2818896 2024-09-14T11:22:30.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.190+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=HOXRM18EJFT6 type=del 2024-09-14T11:22:30.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.192+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~9PW5RFS2C2FB.0 size=310852 2024-09-14T11:22:30.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.192+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=9PW5RFS2C2FB tag=BR0OUEMQ43XH type=write size=1359428 2024-09-14T11:22:30.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.193+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=ASY5I3HZXB30 type=del 2024-09-14T11:22:30.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.194+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=SR0615SUVNE6 type=del size=2112714 2024-09-14T11:22:30.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.196+0000 7f43cc561780 1 < completed write operation key=AWBBRU4C8RDQ tag=B0ABTAPML54E type=write size=938593 2024-09-14T11:22:30.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.197+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=GD31U6ZPNMOH type=del size=502690 2024-09-14T11:22:30.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.199+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=YT49LMY16ZMZ type=del 2024-09-14T11:22:30.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.201+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~XAO1M2HLMHQ4.0 size=1048576 2024-09-14T11:22:30.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.202+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~XAO1M2HLMHQ4.1 size=893062 2024-09-14T11:22:30.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.202+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=XAO1M2HLMHQ4 tag=XOOWN8WF56BY type=write size=2990214 2024-09-14T11:22:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.203+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=HM5IFX8YWRN9 type=del 2024-09-14T11:22:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.204+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=EA13A5OGB4P9 type=del size=2639366 2024-09-14T11:22:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.205+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=XG5QGTDL977Y type=del 2024-09-14T11:22:30.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.207+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~UUSVVZBD02OP.0 size=1048576 2024-09-14T11:22:30.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.208+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~UUSVVZBD02OP.1 size=1048576 2024-09-14T11:22:30.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.209+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~UUSVVZBD02OP.2 size=312930 2024-09-14T11:22:30.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.209+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=UUSVVZBD02OP tag=W065NFI6B11K type=write size=3458658 2024-09-14T11:22:30.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.211+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~GLOL3YBSLBVO.0 size=482913 2024-09-14T11:22:30.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.213+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=GLOL3YBSLBVO tag=9YUQ84DQR7FI type=write size=1531489 2024-09-14T11:22:30.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.214+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=GTMRJ5VG5X0B type=del size=169730 2024-09-14T11:22:30.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.215+0000 7f43cc561780 1 < completed delete operation key=D84127SVSIPL tag=Q0YYG748IYF0 type=del 2024-09-14T11:22:30.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.217+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~GA1GERR85KHC.0 size=441759 2024-09-14T11:22:30.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.217+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=GA1GERR85KHC tag=F5EESUX3PWOX type=write size=1490335 2024-09-14T11:22:30.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.219+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~H0RKDX583ZMZ.0 size=898093 2024-09-14T11:22:30.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.221+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=H0RKDX583ZMZ tag=89MTQH9FL1UR type=write size=1946669 2024-09-14T11:22:30.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.222+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=7UN568IQ6GTK type=del size=620708 2024-09-14T11:22:30.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.223+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=56IERK7QQACR type=del 2024-09-14T11:22:30.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.226+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~9VYYN5JKMA3I.0 size=1048576 2024-09-14T11:22:30.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.226+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~9VYYN5JKMA3I.1 size=108996 2024-09-14T11:22:30.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.226+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=9VYYN5JKMA3I tag=Q7QYNMZJPUUA type=write size=2206148 2024-09-14T11:22:30.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.228+0000 7f43cc561780 -1 < failed to complete operation key=683ZFW0BWMT7 tag=XIFD477B3EEQ type=write size=857638: (22) Invalid argument 2024-09-14T11:22:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.230+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~AMHEE667HVP8.0 size=1048576 2024-09-14T11:22:30.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.231+0000 7f43cc561780 1 > prepared part key=_multipart_WHIZ2GREK1FE.2~AMHEE667HVP8.1 size=46288 2024-09-14T11:22:30.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.231+0000 7f43cc561780 1 > prepared multipart upload key=WHIZ2GREK1FE upload=AMHEE667HVP8 tag=N9W1UK95DKT2 type=write size=2143440 2024-09-14T11:22:30.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.233+0000 7f43cc561780 1 < suggested remove operation key=WHIZ2GREK1FE tag=M9LI65KZ2KOW type=del 2024-09-14T11:22:30.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.235+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~76YEIP22YICN.0 size=370245 2024-09-14T11:22:30.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.235+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=76YEIP22YICN tag=3Z3ERRJA399N type=write size=1418821 2024-09-14T11:22:30.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.236+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~C68J11D6HNW6.0 size=611541 2024-09-14T11:22:30.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.238+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=C68J11D6HNW6 tag=HX90KD2ENXWB type=write size=1660117 2024-09-14T11:22:30.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.241+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~D5FGWD494XZH.0 size=1048576 2024-09-14T11:22:30.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.242+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~D5FGWD494XZH.1 size=1048576 2024-09-14T11:22:30.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.243+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~D5FGWD494XZH.2 size=105799 2024-09-14T11:22:30.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.243+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=D5FGWD494XZH tag=GCQWY3CYEUZT type=write size=3251527 2024-09-14T11:22:30.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.244+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~816NK0WNSGE8.0 size=1048576 2024-09-14T11:22:30.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.245+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~816NK0WNSGE8.1 size=1048576 2024-09-14T11:22:30.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.246+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~816NK0WNSGE8.2 size=842366 2024-09-14T11:22:30.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.248+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=816NK0WNSGE8 tag=UUL8EB3UE91M type=write size=3988094 2024-09-14T11:22:30.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.249+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=IR28AH3SCR2Z type=del size=1222664 2024-09-14T11:22:30.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.250+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~L94GY5MQB3ZN.0 size=1048576 2024-09-14T11:22:30.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.251+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~L94GY5MQB3ZN.1 size=560776 2024-09-14T11:22:30.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.254+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=L94GY5MQB3ZN tag=YIOPBNKG1QES type=write size=2657928 2024-09-14T11:22:30.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.256+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~SJADY1WN8KET.0 size=240183 2024-09-14T11:22:30.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.256+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=SJADY1WN8KET tag=JF4R78FRP9PI type=write size=1288759 2024-09-14T11:22:30.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.256+0000 7f43cc561780 1 < canceled part key=_multipart_E6FDCACWGA2Y.2~B8QS0JYISVMX.0 size=1048576 2024-09-14T11:22:30.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.257+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~B8QS0JYISVMX.1 size=721744 2024-09-14T11:22:30.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.260+0000 7f43cc561780 1 < canceled multipart upload key=E6FDCACWGA2Y upload=B8QS0JYISVMX tag=O24JXP3MAUSS type=write size=2818896 2024-09-14T11:22:30.260 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.261+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=1EST4XDA14SW type=del size=1433758 2024-09-14T11:22:30.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.262+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~9PW5RFS2C2FB.0 size=310852 2024-09-14T11:22:30.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.265+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=9PW5RFS2C2FB tag=BR0OUEMQ43XH type=write size=1359428 2024-09-14T11:22:30.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.266+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=9FOT6NZQHLAH type=del size=3777840 2024-09-14T11:22:30.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.268+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=SR0615SUVNE6 type=del 2024-09-14T11:22:30.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.269+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=CH2LFYQTSRA7 type=del size=722932 2024-09-14T11:22:30.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.272+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=GD31U6ZPNMOH type=del 2024-09-14T11:22:30.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.274+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NNEPE7TZ0MT1.0 size=1048576 2024-09-14T11:22:30.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.275+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NNEPE7TZ0MT1.1 size=1048576 2024-09-14T11:22:30.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.276+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NNEPE7TZ0MT1.2 size=261868 2024-09-14T11:22:30.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.276+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=NNEPE7TZ0MT1 tag=HIIRIVDIC5MV type=write size=3407596 2024-09-14T11:22:30.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.277+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~XAO1M2HLMHQ4.0 size=1048576 2024-09-14T11:22:30.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.278+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~XAO1M2HLMHQ4.1 size=893062 2024-09-14T11:22:30.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.280+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=XAO1M2HLMHQ4 tag=XOOWN8WF56BY type=write size=2990214 2024-09-14T11:22:30.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.282+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~E0V8UW2772LB.0 size=1048576 2024-09-14T11:22:30.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.283+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~E0V8UW2772LB.1 size=799383 2024-09-14T11:22:30.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.283+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=E0V8UW2772LB tag=NSTLUHU8NTLX type=write size=2896535 2024-09-14T11:22:30.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.284+0000 7f43cc561780 1 < canceled operation key=AY7JGVM96MO7 tag=EA13A5OGB4P9 type=del size=2639366 2024-09-14T11:22:30.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.285+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=SHAUN0J2ECXZ type=del size=3038559 2024-09-14T11:22:30.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.285+0000 7f43cc561780 1 < canceled part key=_multipart_UWES4CQZ8XW6.2~UUSVVZBD02OP.0 size=1048576 2024-09-14T11:22:30.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.286+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~UUSVVZBD02OP.1 size=1048576 2024-09-14T11:22:30.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.287+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~UUSVVZBD02OP.2 size=312930 2024-09-14T11:22:30.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.289+0000 7f43cc561780 1 < canceled multipart upload key=UWES4CQZ8XW6 upload=UUSVVZBD02OP tag=W065NFI6B11K type=write size=3458658 2024-09-14T11:22:30.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.291+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=TLYBOCYGYBOK type=del size=87491 2024-09-14T11:22:30.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.292+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=GTMRJ5VG5X0B type=del 2024-09-14T11:22:30.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.293+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=GK4IYU6I3W7Q type=del size=915367 2024-09-14T11:22:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.294+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~GA1GERR85KHC.0 size=441759 2024-09-14T11:22:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.296+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=GA1GERR85KHC tag=F5EESUX3PWOX type=write size=1490335 2024-09-14T11:22:30.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.298+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=58W5UMG8KNDM type=del size=1217765 2024-09-14T11:22:30.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.300+0000 7f43cc561780 1 < suggested update operation key=OJOJZBG1WEGI tag=7UN568IQ6GTK type=del size=620708 2024-09-14T11:22:30.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.303+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~T36YRP98MN77.0 size=165072 2024-09-14T11:22:30.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.303+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=T36YRP98MN77 tag=AI6JL10VJUZQ type=write size=1213648 2024-09-14T11:22:30.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.304+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~9VYYN5JKMA3I.0 size=1048576 2024-09-14T11:22:30.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.305+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~9VYYN5JKMA3I.1 size=108996 2024-09-14T11:22:30.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.307+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=9VYYN5JKMA3I tag=Q7QYNMZJPUUA type=write size=2206148 2024-09-14T11:22:30.307 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.308+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=AR91920F4E03 type=del size=1400347 2024-09-14T11:22:30.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.310+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~AMHEE667HVP8.0 size=1048576 2024-09-14T11:22:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.311+0000 7f43cc561780 1 < completed part key=_multipart_WHIZ2GREK1FE.2~AMHEE667HVP8.1 size=46288 2024-09-14T11:22:30.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.313+0000 7f43cc561780 1 < completed multipart upload key=WHIZ2GREK1FE upload=AMHEE667HVP8 tag=N9W1UK95DKT2 type=write size=2143440 2024-09-14T11:22:30.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.316+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~SUV0JZ1KG1CR.0 size=1048576 2024-09-14T11:22:30.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.317+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~SUV0JZ1KG1CR.1 size=1048576 2024-09-14T11:22:30.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.318+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~SUV0JZ1KG1CR.2 size=140013 2024-09-14T11:22:30.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.318+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=SUV0JZ1KG1CR tag=KH7ROCTU642X type=write size=3285741 2024-09-14T11:22:30.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.319+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~76YEIP22YICN.0 size=370245 2024-09-14T11:22:30.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.321+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=76YEIP22YICN tag=3Z3ERRJA399N type=write size=1418821 2024-09-14T11:22:30.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.323+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~RHSUZ9IY5U6S.0 size=1048576 2024-09-14T11:22:30.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.324+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~RHSUZ9IY5U6S.1 size=1048576 2024-09-14T11:22:30.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.325+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~RHSUZ9IY5U6S.2 size=228316 2024-09-14T11:22:30.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.325+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=RHSUZ9IY5U6S tag=G15Z07FSAYDR type=write size=3374044 2024-09-14T11:22:30.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.327+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~D5FGWD494XZH.0 size=1048576 2024-09-14T11:22:30.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.328+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~D5FGWD494XZH.1 size=1048576 2024-09-14T11:22:30.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.329+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~D5FGWD494XZH.2 size=105799 2024-09-14T11:22:30.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.331+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=D5FGWD494XZH tag=GCQWY3CYEUZT type=write size=3251527 2024-09-14T11:22:30.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.332+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=Y5WBOVYDZF6K type=del size=642766 2024-09-14T11:22:30.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.334+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=IR28AH3SCR2Z type=del 2024-09-14T11:22:30.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.336+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=0KUXAFSK318V type=del size=853771 2024-09-14T11:22:30.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.337+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~SJADY1WN8KET.0 size=240183 2024-09-14T11:22:30.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.339+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=SJADY1WN8KET tag=JF4R78FRP9PI type=write size=1288759 2024-09-14T11:22:30.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.340+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=JG44D1QOQVDW type=del size=927403 2024-09-14T11:22:30.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.341+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=1EST4XDA14SW type=del 2024-09-14T11:22:30.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.342+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=RY5UUX82H0TY type=write size=730387 2024-09-14T11:22:30.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.344+0000 7f43cc561780 1 < canceled operation key=IG4QM506P41B tag=9FOT6NZQHLAH type=del size=3777840 2024-09-14T11:22:30.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.346+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~TF7FC45VHVSR.0 size=496663 2024-09-14T11:22:30.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.346+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=TF7FC45VHVSR tag=DJJO0LLB9WRW type=write size=1545239 2024-09-14T11:22:30.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.347+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=CH2LFYQTSRA7 type=del 2024-09-14T11:22:30.347 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.349+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=GBGC33GNB9Z5 type=write size=191333 2024-09-14T11:22:30.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.350+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NNEPE7TZ0MT1.0 size=1048576 2024-09-14T11:22:30.350 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.351+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NNEPE7TZ0MT1.1 size=1048576 2024-09-14T11:22:30.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.352+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NNEPE7TZ0MT1.2 size=261868 2024-09-14T11:22:30.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.354+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=NNEPE7TZ0MT1 tag=HIIRIVDIC5MV type=write size=3407596 2024-09-14T11:22:30.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.357+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~D9TNQZCJRZE3.0 size=658045 2024-09-14T11:22:30.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.357+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=D9TNQZCJRZE3 tag=S8NLYJ5B28WN type=write size=1706621 2024-09-14T11:22:30.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.358+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~E0V8UW2772LB.0 size=1048576 2024-09-14T11:22:30.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.359+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~E0V8UW2772LB.1 size=799383 2024-09-14T11:22:30.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.361+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=E0V8UW2772LB tag=NSTLUHU8NTLX type=write size=2896535 2024-09-14T11:22:30.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.362+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=L8SE8WXHXZRQ type=del size=2938913 2024-09-14T11:22:30.362 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.364+0000 7f43cc561780 -1 < failed to complete operation key=OJOJZBG1WEGI tag=SHAUN0J2ECXZ type=del size=3038559: (22) Invalid argument 2024-09-14T11:22:30.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.365+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=DS9ZYAP24KRF type=del size=1006642 2024-09-14T11:22:30.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.366+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=TLYBOCYGYBOK type=del 2024-09-14T11:22:30.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.368+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=1LM13URHIPDY type=del size=2896601 2024-09-14T11:22:30.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.369+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=GK4IYU6I3W7Q type=del 2024-09-14T11:22:30.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.370+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=N98RQXXD25IA type=del size=313858 2024-09-14T11:22:30.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.372+0000 7f43cc561780 1 < suggested remove operation key=3YHEZHW0RS1W tag=58W5UMG8KNDM type=del 2024-09-14T11:22:30.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.374+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~QBZDXNT112TF.0 size=1048576 2024-09-14T11:22:30.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.375+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~QBZDXNT112TF.1 size=1048576 2024-09-14T11:22:30.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.376+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~QBZDXNT112TF.2 size=761202 2024-09-14T11:22:30.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.376+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=QBZDXNT112TF tag=7M60EZGCHTR4 type=write size=3906930 2024-09-14T11:22:30.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.378+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~T36YRP98MN77.0 size=165072 2024-09-14T11:22:30.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.379+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=T36YRP98MN77 tag=AI6JL10VJUZQ type=write size=1213648 2024-09-14T11:22:30.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.381+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=DG1A3CE4NB18 type=del size=3530569 2024-09-14T11:22:30.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.382+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=AR91920F4E03 type=del 2024-09-14T11:22:30.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.383+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=UMZ1SAQU9WHO type=del size=2624543 2024-09-14T11:22:30.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.385+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~SUV0JZ1KG1CR.0 size=1048576 2024-09-14T11:22:30.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.386+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~SUV0JZ1KG1CR.1 size=1048576 2024-09-14T11:22:30.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.386+0000 7f43cc561780 1 < canceled part key=_multipart_END3SHHS0FSA.2~SUV0JZ1KG1CR.2 size=140013 2024-09-14T11:22:30.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.388+0000 7f43cc561780 1 < canceled multipart upload key=END3SHHS0FSA upload=SUV0JZ1KG1CR tag=KH7ROCTU642X type=write size=3285741 2024-09-14T11:22:30.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.391+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~4UCC0S0PDCZS.0 size=1048576 2024-09-14T11:22:30.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.392+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~4UCC0S0PDCZS.1 size=1048576 2024-09-14T11:22:30.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.393+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~4UCC0S0PDCZS.2 size=43280 2024-09-14T11:22:30.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.393+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=4UCC0S0PDCZS tag=M5UM43AV1481 type=write size=3189008 2024-09-14T11:22:30.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.394+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~RHSUZ9IY5U6S.0 size=1048576 2024-09-14T11:22:30.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.396+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~RHSUZ9IY5U6S.1 size=1048576 2024-09-14T11:22:30.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.397+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~RHSUZ9IY5U6S.2 size=228316 2024-09-14T11:22:30.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.399+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=RHSUZ9IY5U6S tag=G15Z07FSAYDR type=write size=3374044 2024-09-14T11:22:30.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.402+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~VLEI1LWTCPAB.0 size=1048576 2024-09-14T11:22:30.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.403+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~VLEI1LWTCPAB.1 size=1048576 2024-09-14T11:22:30.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.404+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~VLEI1LWTCPAB.2 size=92 2024-09-14T11:22:30.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.404+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=VLEI1LWTCPAB tag=WST20M8BFW42 type=write size=3145820 2024-09-14T11:22:30.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.406+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=Y5WBOVYDZF6K type=del 2024-09-14T11:22:30.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.407+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=NXQSP02NBVPU type=write size=829300 2024-09-14T11:22:30.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.409+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=0KUXAFSK318V type=del 2024-09-14T11:22:30.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.410+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=HJU54QGKR8PU type=del size=2045961 2024-09-14T11:22:30.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.412+0000 7f43cc561780 1 < completed delete operation key=1M46U4U9MG1E tag=JG44D1QOQVDW type=del 2024-09-14T11:22:30.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.414+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~3PZ1X5OLXD16.0 size=896800 2024-09-14T11:22:30.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.414+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=3PZ1X5OLXD16 tag=12QMMCI3K8GN type=write size=1945376 2024-09-14T11:22:30.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.416+0000 7f43cc561780 1 < canceled operation key=15F3ZZAAKT9B tag=RY5UUX82H0TY type=write size=730387 2024-09-14T11:22:30.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.418+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~BMH2RIUXHG46.0 size=1048576 2024-09-14T11:22:30.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.419+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~BMH2RIUXHG46.1 size=591180 2024-09-14T11:22:30.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.419+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=BMH2RIUXHG46 tag=M0CQH609FOGL type=write size=2688332 2024-09-14T11:22:30.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.421+0000 7f43cc561780 1 < completed part key=_multipart_IFHWMI5YO5L5.2~TF7FC45VHVSR.0 size=496663 2024-09-14T11:22:30.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.423+0000 7f43cc561780 1 < completed multipart upload key=IFHWMI5YO5L5 upload=TF7FC45VHVSR tag=DJJO0LLB9WRW type=write size=1545239 2024-09-14T11:22:30.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.425+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~MCY06T30JVQW.0 size=881205 2024-09-14T11:22:30.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.425+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=MCY06T30JVQW tag=I408X821H367 type=write size=1929781 2024-09-14T11:22:30.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.426+0000 7f43cc561780 1 < completed write operation key=CXP2PUIXR2PA tag=GBGC33GNB9Z5 type=write size=191333 2024-09-14T11:22:30.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.428+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~6I6OQMO4FS7E.0 size=1048576 2024-09-14T11:22:30.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.429+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~6I6OQMO4FS7E.1 size=910119 2024-09-14T11:22:30.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.429+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=6I6OQMO4FS7E tag=WPVW3KJCVMIF type=write size=3007271 2024-09-14T11:22:30.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.431+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~D9TNQZCJRZE3.0 size=658045 2024-09-14T11:22:30.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.434+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=D9TNQZCJRZE3 tag=S8NLYJ5B28WN type=write size=1706621 2024-09-14T11:22:30.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.436+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~0H3U01KQTF0D.0 size=1048576 2024-09-14T11:22:30.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.437+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~0H3U01KQTF0D.1 size=643784 2024-09-14T11:22:30.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.437+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=0H3U01KQTF0D tag=MME41JFNNXOM type=write size=2740936 2024-09-14T11:22:30.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.439+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=L8SE8WXHXZRQ type=del 2024-09-14T11:22:30.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.440+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=7NMBU59XY523 type=del size=1044747 2024-09-14T11:22:30.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.442+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=DS9ZYAP24KRF type=del 2024-09-14T11:22:30.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.443+0000 7f43cc561780 1 > prepared operation key=WSFZN6JCWUXG tag=C4YL9I0NO1PH type=del size=2828761 2024-09-14T11:22:30.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.445+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=1LM13URHIPDY type=del 2024-09-14T11:22:30.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.446+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=53V3TV90K6QZ type=del size=2711352 2024-09-14T11:22:30.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.447+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=N98RQXXD25IA type=del 2024-09-14T11:22:30.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.449+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~AB75W1R35MQZ.0 size=23898 2024-09-14T11:22:30.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.449+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=AB75W1R35MQZ tag=G9VM95NLT1CU type=write size=1072474 2024-09-14T11:22:30.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.451+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~QBZDXNT112TF.0 size=1048576 2024-09-14T11:22:30.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.451+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~QBZDXNT112TF.1 size=1048576 2024-09-14T11:22:30.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.452+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~QBZDXNT112TF.2 size=761202 2024-09-14T11:22:30.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.454+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=QBZDXNT112TF tag=7M60EZGCHTR4 type=write size=3906930 2024-09-14T11:22:30.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.455+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=ODJHBQACJXF4 type=del size=287595 2024-09-14T11:22:30.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.458+0000 7f43cc561780 1 < suggested update operation key=0TDWJO4AWOOF tag=DG1A3CE4NB18 type=del size=3530569 2024-09-14T11:22:30.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.460+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~2KRA6G70INFQ.0 size=1048576 2024-09-14T11:22:30.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.461+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~2KRA6G70INFQ.1 size=525650 2024-09-14T11:22:30.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.461+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=2KRA6G70INFQ tag=BCUUBNX5AE2V type=write size=2622802 2024-09-14T11:22:30.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.462+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=UMZ1SAQU9WHO type=del 2024-09-14T11:22:30.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.464+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~IKEXWL7F3SYU.0 size=818736 2024-09-14T11:22:30.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.464+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=IKEXWL7F3SYU tag=D3SP5KT6GP8J type=write size=1867312 2024-09-14T11:22:30.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.465+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~4UCC0S0PDCZS.0 size=1048576 2024-09-14T11:22:30.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.465+0000 7f43cc561780 1 < canceled part key=_multipart_IG4QM506P41B.2~4UCC0S0PDCZS.1 size=1048576 2024-09-14T11:22:30.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.466+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~4UCC0S0PDCZS.2 size=43280 2024-09-14T11:22:30.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.468+0000 7f43cc561780 1 < canceled multipart upload key=IG4QM506P41B upload=4UCC0S0PDCZS tag=M5UM43AV1481 type=write size=3189008 2024-09-14T11:22:30.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.469+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=USD7488JOMYV type=del size=1180685 2024-09-14T11:22:30.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.470+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~VLEI1LWTCPAB.0 size=1048576 2024-09-14T11:22:30.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.471+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~VLEI1LWTCPAB.1 size=1048576 2024-09-14T11:22:30.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.472+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~VLEI1LWTCPAB.2 size=92 2024-09-14T11:22:30.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.474+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=VLEI1LWTCPAB tag=WST20M8BFW42 type=write size=3145820 2024-09-14T11:22:30.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.476+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~DKC84TRO6N6Q.0 size=1048576 2024-09-14T11:22:30.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.477+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~DKC84TRO6N6Q.1 size=997526 2024-09-14T11:22:30.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.477+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=DKC84TRO6N6Q tag=SFSCPRWWZA05 type=write size=3094678 2024-09-14T11:22:30.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.478+0000 7f43cc561780 1 < completed write operation key=OJOJZBG1WEGI tag=NXQSP02NBVPU type=write size=829300 2024-09-14T11:22:30.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.479+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=42HBL54TYM3Z type=write size=25470 2024-09-14T11:22:30.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.480+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=HJU54QGKR8PU type=del 2024-09-14T11:22:30.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.482+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=NSC5GT3WBHKA type=write size=662281 2024-09-14T11:22:30.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.483+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~3PZ1X5OLXD16.0 size=896800 2024-09-14T11:22:30.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.485+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=3PZ1X5OLXD16 tag=12QMMCI3K8GN type=write size=1945376 2024-09-14T11:22:30.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.486+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=W04A2I2IC1OQ type=del size=3077065 2024-09-14T11:22:30.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.487+0000 7f43cc561780 1 < canceled part key=_multipart_OJOJZBG1WEGI.2~BMH2RIUXHG46.0 size=1048576 2024-09-14T11:22:30.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.488+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~BMH2RIUXHG46.1 size=591180 2024-09-14T11:22:30.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.490+0000 7f43cc561780 1 < canceled multipart upload key=OJOJZBG1WEGI upload=BMH2RIUXHG46 tag=M0CQH609FOGL type=write size=2688332 2024-09-14T11:22:30.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.492+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~H3OV0QSS7UD2.0 size=1048576 2024-09-14T11:22:30.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.493+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~H3OV0QSS7UD2.1 size=1048576 2024-09-14T11:22:30.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.494+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~H3OV0QSS7UD2.2 size=643707 2024-09-14T11:22:30.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.494+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=H3OV0QSS7UD2 tag=DFKIO4VBLWKE type=write size=3789435 2024-09-14T11:22:30.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.495+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~MCY06T30JVQW.0 size=881205 2024-09-14T11:22:30.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.498+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=MCY06T30JVQW tag=I408X821H367 type=write size=1929781 2024-09-14T11:22:30.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.499+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=RRPWKM4B8SHY type=write size=576214 2024-09-14T11:22:30.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.500+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~6I6OQMO4FS7E.0 size=1048576 2024-09-14T11:22:30.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.501+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~6I6OQMO4FS7E.1 size=910119 2024-09-14T11:22:30.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.503+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=6I6OQMO4FS7E tag=WPVW3KJCVMIF type=write size=3007271 2024-09-14T11:22:30.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.504+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=F7KSI8V5SZZT type=del size=3239619 2024-09-14T11:22:30.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.506+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~0H3U01KQTF0D.0 size=1048576 2024-09-14T11:22:30.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.507+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~0H3U01KQTF0D.1 size=643784 2024-09-14T11:22:30.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.509+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=0H3U01KQTF0D tag=MME41JFNNXOM type=write size=2740936 2024-09-14T11:22:30.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.510+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=JL2R1VXY9H4F type=del size=3010720 2024-09-14T11:22:30.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.511+0000 7f43cc561780 -1 < failed to complete operation key=D84127SVSIPL tag=7NMBU59XY523 type=del size=1044747: (22) Invalid argument 2024-09-14T11:22:30.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.513+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=NQJ7VT9H3RVN type=del size=909752 2024-09-14T11:22:30.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.514+0000 7f43cc561780 1 < completed delete operation key=WSFZN6JCWUXG tag=C4YL9I0NO1PH type=del 2024-09-14T11:22:30.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.515+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=TD09JCB8MU7P type=del size=3856886 2024-09-14T11:22:30.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.517+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=53V3TV90K6QZ type=del 2024-09-14T11:22:30.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.519+0000 7f43cc561780 1 > prepared part key=_multipart_FISMBWPDPCTA.2~1M0UMM2PW9HY.0 size=766068 2024-09-14T11:22:30.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.519+0000 7f43cc561780 1 > prepared multipart upload key=FISMBWPDPCTA upload=1M0UMM2PW9HY tag=98O3SJDDSZM8 type=write size=1814644 2024-09-14T11:22:30.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.520+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~AB75W1R35MQZ.0 size=23898 2024-09-14T11:22:30.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.522+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=AB75W1R35MQZ tag=G9VM95NLT1CU type=write size=1072474 2024-09-14T11:22:30.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.523+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=4RSU23V7KWPI type=del size=2468666 2024-09-14T11:22:30.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.525+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=ODJHBQACJXF4 type=del 2024-09-14T11:22:30.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.526+0000 7f43cc561780 1 > prepared operation key=BZDW69C3Z97G tag=YCE1T08KL3II type=del size=1532293 2024-09-14T11:22:30.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.526+0000 7f43cc561780 1 < canceled part key=_multipart_MD14RGOQY0LK.2~2KRA6G70INFQ.0 size=1048576 2024-09-14T11:22:30.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.527+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~2KRA6G70INFQ.1 size=525650 2024-09-14T11:22:30.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.529+0000 7f43cc561780 1 < canceled multipart upload key=MD14RGOQY0LK upload=2KRA6G70INFQ tag=BCUUBNX5AE2V type=write size=2622802 2024-09-14T11:22:30.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.531+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~KYHEHHRF9DSV.0 size=1048576 2024-09-14T11:22:30.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.533+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~KYHEHHRF9DSV.1 size=109600 2024-09-14T11:22:30.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.533+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=KYHEHHRF9DSV tag=27E76TROE3GI type=write size=2206752 2024-09-14T11:22:30.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.534+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~IKEXWL7F3SYU.0 size=818736 2024-09-14T11:22:30.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.536+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=IKEXWL7F3SYU tag=D3SP5KT6GP8J type=write size=1867312 2024-09-14T11:22:30.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.537+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=A1U9SOI3EWF0 type=write size=410210 2024-09-14T11:22:30.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.538+0000 7f43cc561780 1 < completed delete operation key=2975CNBC43ST tag=USD7488JOMYV type=del 2024-09-14T11:22:30.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.540+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~D8SYN04DH0YO.0 size=645085 2024-09-14T11:22:30.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.540+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=D8SYN04DH0YO tag=TOZOXA5GYZPG type=write size=1693661 2024-09-14T11:22:30.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.542+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~DKC84TRO6N6Q.0 size=1048576 2024-09-14T11:22:30.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.542+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~DKC84TRO6N6Q.1 size=997526 2024-09-14T11:22:30.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.545+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=DKC84TRO6N6Q tag=SFSCPRWWZA05 type=write size=3094678 2024-09-14T11:22:30.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.547+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=1EJL9NY4VRNJ type=del size=1467011 2024-09-14T11:22:30.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.548+0000 7f43cc561780 1 < completed write operation key=BRHP3DQEO3HZ tag=42HBL54TYM3Z type=write size=25470 2024-09-14T11:22:30.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.550+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=JQEKO1T32SL8 type=del size=1581959 2024-09-14T11:22:30.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.551+0000 7f43cc561780 1 < completed write operation key=LKY30XYUG2QW tag=NSC5GT3WBHKA type=write size=662281 2024-09-14T11:22:30.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.552+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=6NZSQ0JDCAR1 type=del size=1015560 2024-09-14T11:22:30.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.553+0000 7f43cc561780 1 < completed delete operation key=WHIZ2GREK1FE tag=W04A2I2IC1OQ type=del 2024-09-14T11:22:30.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.555+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~GGXBH1ATLLT1.0 size=1048576 2024-09-14T11:22:30.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.556+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~GGXBH1ATLLT1.1 size=1048576 2024-09-14T11:22:30.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.557+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~GGXBH1ATLLT1.2 size=747746 2024-09-14T11:22:30.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.557+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=GGXBH1ATLLT1 tag=ZYOE55SXATME type=write size=3893474 2024-09-14T11:22:30.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.558+0000 7f43cc561780 1 < canceled part key=_multipart_MD14RGOQY0LK.2~H3OV0QSS7UD2.0 size=1048576 2024-09-14T11:22:30.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.559+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~H3OV0QSS7UD2.1 size=1048576 2024-09-14T11:22:30.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.559+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~H3OV0QSS7UD2.2 size=643707 2024-09-14T11:22:30.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.561+0000 7f43cc561780 1 < canceled multipart upload key=MD14RGOQY0LK upload=H3OV0QSS7UD2 tag=DFKIO4VBLWKE type=write size=3789435 2024-09-14T11:22:30.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.563+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=XUHMR2VQX5P6 type=write size=295336 2024-09-14T11:22:30.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.565+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=RRPWKM4B8SHY type=write size=576214 2024-09-14T11:22:30.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.566+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=EJFBMKF9ZA92 type=del size=832590 2024-09-14T11:22:30.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.567+0000 7f43cc561780 1 < completed delete operation key=UWES4CQZ8XW6 tag=F7KSI8V5SZZT type=del 2024-09-14T11:22:30.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.569+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=F9WKI0XRNLLT type=del size=4007706 2024-09-14T11:22:30.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.570+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=JL2R1VXY9H4F type=del size=3010720: (22) Invalid argument 2024-09-14T11:22:30.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.571+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=9DPWV9YRQ2E6 type=del size=2989577 2024-09-14T11:22:30.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.574+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=NQJ7VT9H3RVN type=del size=909752 2024-09-14T11:22:30.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.575+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=0ZLREOQ5396U type=del size=1622397 2024-09-14T11:22:30.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.577+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=TD09JCB8MU7P type=del 2024-09-14T11:22:30.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.579+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~03G22H67FFUF.0 size=608270 2024-09-14T11:22:30.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.579+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=03G22H67FFUF tag=DU0KA38GXPGI type=write size=1656846 2024-09-14T11:22:30.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.580+0000 7f43cc561780 1 < completed part key=_multipart_FISMBWPDPCTA.2~1M0UMM2PW9HY.0 size=766068 2024-09-14T11:22:30.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.582+0000 7f43cc561780 1 < completed multipart upload key=FISMBWPDPCTA upload=1M0UMM2PW9HY tag=98O3SJDDSZM8 type=write size=1814644 2024-09-14T11:22:30.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.584+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~VM8GH5SXPXE3.0 size=1048576 2024-09-14T11:22:30.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.585+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~VM8GH5SXPXE3.1 size=296300 2024-09-14T11:22:30.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.585+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=VM8GH5SXPXE3 tag=KD2ES71N9XEV type=write size=2393452 2024-09-14T11:22:30.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.587+0000 7f43cc561780 1 < canceled operation key=BNNSFLYOU27F tag=4RSU23V7KWPI type=del size=2468666 2024-09-14T11:22:30.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.588+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=6GG1G5XPUPQD type=del size=2230692 2024-09-14T11:22:30.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.590+0000 7f43cc561780 1 < suggested update operation key=BZDW69C3Z97G tag=YCE1T08KL3II type=del size=1532293 2024-09-14T11:22:30.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.592+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=VAQ1MYCH43JS type=write size=840139 2024-09-14T11:22:30.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.593+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~KYHEHHRF9DSV.0 size=1048576 2024-09-14T11:22:30.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.594+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~KYHEHHRF9DSV.1 size=109600 2024-09-14T11:22:30.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.596+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=KYHEHHRF9DSV tag=27E76TROE3GI type=write size=2206752 2024-09-14T11:22:30.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.597+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=Y191FG5PSZR1 type=write size=869960 2024-09-14T11:22:30.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.600+0000 7f43cc561780 1 < suggested remove operation key=80ZYEEE1EE78 tag=A1U9SOI3EWF0 type=write 2024-09-14T11:22:30.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.601+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=I3PUXDDZTVMG type=del size=2783343 2024-09-14T11:22:30.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.602+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~D8SYN04DH0YO.0 size=645085 2024-09-14T11:22:30.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.604+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=D8SYN04DH0YO tag=TOZOXA5GYZPG type=write size=1693661 2024-09-14T11:22:30.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.607+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~BHBT5MAVSRBM.0 size=1048576 2024-09-14T11:22:30.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.608+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~BHBT5MAVSRBM.1 size=393437 2024-09-14T11:22:30.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.608+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=BHBT5MAVSRBM tag=85RCR4S13VMI type=write size=2490589 2024-09-14T11:22:30.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.609+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=1EJL9NY4VRNJ type=del 2024-09-14T11:22:30.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.610+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=C120P9667V2H type=del size=3324814 2024-09-14T11:22:30.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.611+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=JQEKO1T32SL8 type=del 2024-09-14T11:22:30.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.613+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~PO6Q9DHK60GE.0 size=1048576 2024-09-14T11:22:30.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.614+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~PO6Q9DHK60GE.1 size=333069 2024-09-14T11:22:30.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.614+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=PO6Q9DHK60GE tag=UOU6KL1KRJ80 type=write size=2430221 2024-09-14T11:22:30.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.617+0000 7f43cc561780 1 < suggested update operation key=IG4QM506P41B tag=6NZSQ0JDCAR1 type=del size=1015560 2024-09-14T11:22:30.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.618+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=K25HJRVRFO0H type=del size=1972187 2024-09-14T11:22:30.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.619+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~GGXBH1ATLLT1.0 size=1048576 2024-09-14T11:22:30.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.620+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~GGXBH1ATLLT1.1 size=1048576 2024-09-14T11:22:30.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.621+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~GGXBH1ATLLT1.2 size=747746 2024-09-14T11:22:30.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.623+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=GGXBH1ATLLT1 tag=ZYOE55SXATME type=write size=3893474 2024-09-14T11:22:30.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.625+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=6VYEM11DK0QV type=write size=508364 2024-09-14T11:22:30.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.626+0000 7f43cc561780 1 < canceled operation key=E6FDCACWGA2Y tag=XUHMR2VQX5P6 type=write size=295336 2024-09-14T11:22:30.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.627+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=HPAFMBL517QT type=del size=98094 2024-09-14T11:22:30.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.629+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=EJFBMKF9ZA92 type=del 2024-09-14T11:22:30.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.630+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=ZYVQKU70F243 type=del size=954590 2024-09-14T11:22:30.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.631+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=F9WKI0XRNLLT type=del 2024-09-14T11:22:30.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.634+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~K2WB40ONMSR1.0 size=1048576 2024-09-14T11:22:30.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.635+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~K2WB40ONMSR1.1 size=828515 2024-09-14T11:22:30.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.635+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=K2WB40ONMSR1 tag=BPB2WASZL2HT type=write size=2925667 2024-09-14T11:22:30.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.636+0000 7f43cc561780 1 < completed delete operation key=D8EBH4NWN7SK tag=9DPWV9YRQ2E6 type=del 2024-09-14T11:22:30.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.638+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~TZSJEHH9HZF3.0 size=1048576 2024-09-14T11:22:30.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.639+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~TZSJEHH9HZF3.1 size=1048576 2024-09-14T11:22:30.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.640+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~TZSJEHH9HZF3.2 size=784417 2024-09-14T11:22:30.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.640+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=TZSJEHH9HZF3 tag=I2RBM45BPB0W type=write size=3930145 2024-09-14T11:22:30.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.641+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=0ZLREOQ5396U type=del 2024-09-14T11:22:30.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.643+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=NOCQOKSTS4C9 type=del size=4015173 2024-09-14T11:22:30.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.644+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~03G22H67FFUF.0 size=608270 2024-09-14T11:22:30.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.646+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=03G22H67FFUF tag=DU0KA38GXPGI type=write size=1656846 2024-09-14T11:22:30.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.648+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~AOZMG0MHOURM.0 size=77101 2024-09-14T11:22:30.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.648+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=AOZMG0MHOURM tag=NWKRDYXG2YIL type=write size=1125677 2024-09-14T11:22:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.649+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~VM8GH5SXPXE3.0 size=1048576 2024-09-14T11:22:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.649+0000 7f43cc561780 1 < canceled part key=_multipart_BRHP3DQEO3HZ.2~VM8GH5SXPXE3.1 size=296300 2024-09-14T11:22:30.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.651+0000 7f43cc561780 1 < canceled multipart upload key=BRHP3DQEO3HZ upload=VM8GH5SXPXE3 tag=KD2ES71N9XEV type=write size=2393452 2024-09-14T11:22:30.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.653+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~Q323YKPR8156.0 size=1048576 2024-09-14T11:22:30.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.654+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~Q323YKPR8156.1 size=553808 2024-09-14T11:22:30.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.654+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=Q323YKPR8156 tag=EOH2XHMQTD6A type=write size=2650960 2024-09-14T11:22:30.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.655+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=6GG1G5XPUPQD type=del 2024-09-14T11:22:30.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.657+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~W0OADR32YINM.0 size=1048576 2024-09-14T11:22:30.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.658+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~W0OADR32YINM.1 size=699621 2024-09-14T11:22:30.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.658+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=W0OADR32YINM tag=TG4R1XNCYL3U type=write size=2796773 2024-09-14T11:22:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.659+0000 7f43cc561780 1 < canceled operation key=END3SHHS0FSA tag=VAQ1MYCH43JS type=write size=840139 2024-09-14T11:22:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.662+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~SO8SL9YBJXMI.0 size=1048576 2024-09-14T11:22:30.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.663+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~SO8SL9YBJXMI.1 size=1042197 2024-09-14T11:22:30.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.663+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=SO8SL9YBJXMI tag=0AO5KNGJ41QS type=write size=3139349 2024-09-14T11:22:30.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.666+0000 7f43cc561780 1 < suggested update operation key=IG4QM506P41B tag=Y191FG5PSZR1 type=write size=869960 2024-09-14T11:22:30.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.668+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~DYSFMUSUT7LE.0 size=1048576 2024-09-14T11:22:30.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.669+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~DYSFMUSUT7LE.1 size=1048576 2024-09-14T11:22:30.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.670+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~DYSFMUSUT7LE.2 size=527536 2024-09-14T11:22:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.670+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=DYSFMUSUT7LE tag=83AZAXJU931Y type=write size=3673264 2024-09-14T11:22:30.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.671+0000 7f43cc561780 1 < completed delete operation key=FISMBWPDPCTA tag=I3PUXDDZTVMG type=del 2024-09-14T11:22:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.673+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~3DGHP3MPOPKU.0 size=1048576 2024-09-14T11:22:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.674+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~3DGHP3MPOPKU.1 size=1048576 2024-09-14T11:22:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.674+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~3DGHP3MPOPKU.2 size=524517 2024-09-14T11:22:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.674+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=3DGHP3MPOPKU tag=RV23DR964SXZ type=write size=3670245 2024-09-14T11:22:30.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.676+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~BHBT5MAVSRBM.0 size=1048576 2024-09-14T11:22:30.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.676+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~BHBT5MAVSRBM.1 size=393437 2024-09-14T11:22:30.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.678+0000 7f43cc561780 1 < completed multipart upload key=WSFZN6JCWUXG upload=BHBT5MAVSRBM tag=85RCR4S13VMI type=write size=2490589 2024-09-14T11:22:30.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.680+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~OJVFCS8UE47D.0 size=1048576 2024-09-14T11:22:30.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.681+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~OJVFCS8UE47D.1 size=1048576 2024-09-14T11:22:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.682+0000 7f43cc561780 1 > prepared part key=_multipart_3YHEZHW0RS1W.2~OJVFCS8UE47D.2 size=845466 2024-09-14T11:22:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.682+0000 7f43cc561780 1 > prepared multipart upload key=3YHEZHW0RS1W upload=OJVFCS8UE47D tag=FAOG0GZOF0HA type=write size=3991194 2024-09-14T11:22:30.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.683+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=C120P9667V2H type=del 2024-09-14T11:22:30.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.685+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=FO473FEGJ3CV type=del size=1729264 2024-09-14T11:22:30.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.686+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~PO6Q9DHK60GE.0 size=1048576 2024-09-14T11:22:30.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.687+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~PO6Q9DHK60GE.1 size=333069 2024-09-14T11:22:30.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.689+0000 7f43cc561780 1 < completed multipart upload key=OJOJZBG1WEGI upload=PO6Q9DHK60GE tag=UOU6KL1KRJ80 type=write size=2430221 2024-09-14T11:22:30.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.690+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=V2ZEQSVYK63N type=del size=751160 2024-09-14T11:22:30.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.691+0000 7f43cc561780 1 < canceled operation key=9XIAGZKIUBGH tag=K25HJRVRFO0H type=del size=1972187 2024-09-14T11:22:30.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.694+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~OCK5MXR4YKUF.0 size=1048576 2024-09-14T11:22:30.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.695+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~OCK5MXR4YKUF.1 size=331697 2024-09-14T11:22:30.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.695+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=OCK5MXR4YKUF tag=BGJPX9LNH6WD type=write size=2428849 2024-09-14T11:22:30.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.696+0000 7f43cc561780 1 < completed write operation key=0TDWJO4AWOOF tag=6VYEM11DK0QV type=write size=508364 2024-09-14T11:22:30.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.698+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~H0QVJRUVLO9E.0 size=1048576 2024-09-14T11:22:30.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.699+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~H0QVJRUVLO9E.1 size=1048576 2024-09-14T11:22:30.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.700+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~H0QVJRUVLO9E.2 size=128434 2024-09-14T11:22:30.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.700+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=H0QVJRUVLO9E tag=KOKKV4IU1K6L type=write size=3274162 2024-09-14T11:22:30.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.702+0000 7f43cc561780 1 < suggested remove operation key=FISMBWPDPCTA tag=HPAFMBL517QT type=del 2024-09-14T11:22:30.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.704+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=F85MGW6F5AJP type=del size=2629931 2024-09-14T11:22:30.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.705+0000 7f43cc561780 1 < completed delete operation key=AWBBRU4C8RDQ tag=ZYVQKU70F243 type=del 2024-09-14T11:22:30.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.706+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=LXUY7GCQ0G20 type=del size=1457917 2024-09-14T11:22:30.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.707+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~K2WB40ONMSR1.0 size=1048576 2024-09-14T11:22:30.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.708+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~K2WB40ONMSR1.1 size=828515 2024-09-14T11:22:30.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.710+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=K2WB40ONMSR1 tag=BPB2WASZL2HT type=write size=2925667 2024-09-14T11:22:30.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.711+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=122IHEWKVC3L type=del size=1033699 2024-09-14T11:22:30.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.711+0000 7f43cc561780 1 < canceled part key=_multipart_END3SHHS0FSA.2~TZSJEHH9HZF3.0 size=1048576 2024-09-14T11:22:30.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.712+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~TZSJEHH9HZF3.1 size=1048576 2024-09-14T11:22:30.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.713+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~TZSJEHH9HZF3.2 size=784417 2024-09-14T11:22:30.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.715+0000 7f43cc561780 1 < canceled multipart upload key=END3SHHS0FSA upload=TZSJEHH9HZF3 tag=I2RBM45BPB0W type=write size=3930145 2024-09-14T11:22:30.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.717+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=S1NIPQSQLMGG type=del size=837326 2024-09-14T11:22:30.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.718+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=NOCQOKSTS4C9 type=del 2024-09-14T11:22:30.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.720+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~V5U0CIYJ40G4.0 size=323922 2024-09-14T11:22:30.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.720+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=V5U0CIYJ40G4 tag=A9WPVRTTB6NR type=write size=1372498 2024-09-14T11:22:30.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.722+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~AOZMG0MHOURM.0 size=77101 2024-09-14T11:22:30.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.723+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=AOZMG0MHOURM tag=NWKRDYXG2YIL type=write size=1125677 2024-09-14T11:22:30.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.725+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=PPTTWV498IGV type=del size=2792484 2024-09-14T11:22:30.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.726+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~Q323YKPR8156.0 size=1048576 2024-09-14T11:22:30.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.727+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~Q323YKPR8156.1 size=553808 2024-09-14T11:22:30.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.729+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=Q323YKPR8156 tag=EOH2XHMQTD6A type=write size=2650960 2024-09-14T11:22:30.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.731+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~8QYQ8EBPY48H.0 size=1048576 2024-09-14T11:22:30.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.732+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~8QYQ8EBPY48H.1 size=714297 2024-09-14T11:22:30.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.732+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=8QYQ8EBPY48H tag=TYCI67CV6G80 type=write size=2811449 2024-09-14T11:22:30.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.733+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~W0OADR32YINM.0 size=1048576 2024-09-14T11:22:30.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.734+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~W0OADR32YINM.1 size=699621 2024-09-14T11:22:30.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.736+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=W0OADR32YINM tag=TG4R1XNCYL3U type=write size=2796773 2024-09-14T11:22:30.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.737+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=H5ZESEE0L5AI type=del size=1650872 2024-09-14T11:22:30.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.738+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~SO8SL9YBJXMI.0 size=1048576 2024-09-14T11:22:30.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.740+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~SO8SL9YBJXMI.1 size=1042197 2024-09-14T11:22:30.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.742+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=SO8SL9YBJXMI tag=0AO5KNGJ41QS type=write size=3139349 2024-09-14T11:22:30.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.743+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=MLXUPSD6F9PG type=del size=2067103 2024-09-14T11:22:30.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.744+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~DYSFMUSUT7LE.0 size=1048576 2024-09-14T11:22:30.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.745+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~DYSFMUSUT7LE.1 size=1048576 2024-09-14T11:22:30.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.746+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~DYSFMUSUT7LE.2 size=527536 2024-09-14T11:22:30.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.748+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=DYSFMUSUT7LE tag=83AZAXJU931Y type=write size=3673264 2024-09-14T11:22:30.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.749+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=2KT4GJ1X8B34 type=del size=2545121 2024-09-14T11:22:30.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.751+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~3DGHP3MPOPKU.0 size=1048576 2024-09-14T11:22:30.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.752+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~3DGHP3MPOPKU.1 size=1048576 2024-09-14T11:22:30.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.753+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~3DGHP3MPOPKU.2 size=524517 2024-09-14T11:22:30.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.755+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=3DGHP3MPOPKU tag=RV23DR964SXZ type=write size=3670245 2024-09-14T11:22:30.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.756+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=6YDL5QAPGQ6R type=del size=3660283 2024-09-14T11:22:30.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.757+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~OJVFCS8UE47D.0 size=1048576 2024-09-14T11:22:30.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.759+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~OJVFCS8UE47D.1 size=1048576 2024-09-14T11:22:30.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.759+0000 7f43cc561780 1 < completed part key=_multipart_3YHEZHW0RS1W.2~OJVFCS8UE47D.2 size=845466 2024-09-14T11:22:30.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.762+0000 7f43cc561780 1 < completed multipart upload key=3YHEZHW0RS1W upload=OJVFCS8UE47D tag=FAOG0GZOF0HA type=write size=3991194 2024-09-14T11:22:30.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.763+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=2J4G9YYAX2JX type=del size=229039 2024-09-14T11:22:30.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.764+0000 7f43cc561780 1 < completed delete operation key=0TDWJO4AWOOF tag=FO473FEGJ3CV type=del 2024-09-14T11:22:30.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.767+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~R6VLK7AQZQ2A.0 size=1048576 2024-09-14T11:22:30.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.768+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~R6VLK7AQZQ2A.1 size=1048576 2024-09-14T11:22:30.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.769+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~R6VLK7AQZQ2A.2 size=422809 2024-09-14T11:22:30.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.769+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=R6VLK7AQZQ2A tag=4ENZ3A2EV1PT type=write size=3568537 2024-09-14T11:22:30.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.772+0000 7f43cc561780 1 < completed delete operation key=15F3ZZAAKT9B tag=V2ZEQSVYK63N type=del 2024-09-14T11:22:30.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.773+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=TRFXKUO7YVTD type=del size=3292868 2024-09-14T11:22:30.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.773+0000 7f43cc561780 1 < canceled part key=_multipart_WSFZN6JCWUXG.2~OCK5MXR4YKUF.0 size=1048576 2024-09-14T11:22:30.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.773+0000 7f43cc561780 1 < canceled part key=_multipart_WSFZN6JCWUXG.2~OCK5MXR4YKUF.1 size=331697 2024-09-14T11:22:30.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.775+0000 7f43cc561780 1 < canceled multipart upload key=WSFZN6JCWUXG upload=OCK5MXR4YKUF tag=BGJPX9LNH6WD type=write size=2428849 2024-09-14T11:22:30.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.777+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~E0GVC9CMA3DN.0 size=1048576 2024-09-14T11:22:30.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.778+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~E0GVC9CMA3DN.1 size=489190 2024-09-14T11:22:30.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.778+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=E0GVC9CMA3DN tag=XK8Y11JDRFKM type=write size=2586342 2024-09-14T11:22:30.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.780+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~H0QVJRUVLO9E.0 size=1048576 2024-09-14T11:22:30.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.781+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~H0QVJRUVLO9E.1 size=1048576 2024-09-14T11:22:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.782+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~H0QVJRUVLO9E.2 size=128434 2024-09-14T11:22:30.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.784+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=H0QVJRUVLO9E tag=KOKKV4IU1K6L type=write size=3274162 2024-09-14T11:22:30.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.786+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~LNLJQO1WH42C.0 size=1048576 2024-09-14T11:22:30.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.786+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~LNLJQO1WH42C.1 size=1048576 2024-09-14T11:22:30.786 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.787+0000 7f43cc561780 1 > prepared part key=_multipart_WSFZN6JCWUXG.2~LNLJQO1WH42C.2 size=1003753 2024-09-14T11:22:30.786 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.787+0000 7f43cc561780 1 > prepared multipart upload key=WSFZN6JCWUXG upload=LNLJQO1WH42C tag=T1Y0BKLV72Y5 type=write size=4149481 2024-09-14T11:22:30.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.789+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=F85MGW6F5AJP type=del 2024-09-14T11:22:30.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.790+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=UFVKXHPDOMP9 type=del size=215429 2024-09-14T11:22:30.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.791+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=LXUY7GCQ0G20 type=del 2024-09-14T11:22:30.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.793+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~ARH1AIT0J05F.0 size=1048576 2024-09-14T11:22:30.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.794+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~ARH1AIT0J05F.1 size=345815 2024-09-14T11:22:30.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.794+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=ARH1AIT0J05F tag=BCVSJWU2PVVC type=write size=2442967 2024-09-14T11:22:30.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.796+0000 7f43cc561780 1 < canceled operation key=BRHP3DQEO3HZ tag=122IHEWKVC3L type=del size=1033699 2024-09-14T11:22:30.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.797+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=UXO7IE6TI0AV type=del size=716935 2024-09-14T11:22:30.798 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.799+0000 7f43cc561780 1 < suggested remove operation key=W679WIFVPVOH tag=S1NIPQSQLMGG type=del 2024-09-14T11:22:30.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.801+0000 7f43cc561780 1 > prepared part key=_multipart_IFHWMI5YO5L5.2~9IR8UVMCFBR4.0 size=725494 2024-09-14T11:22:30.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.801+0000 7f43cc561780 1 > prepared multipart upload key=IFHWMI5YO5L5 upload=9IR8UVMCFBR4 tag=PG52QPVB3E18 type=write size=1774070 2024-09-14T11:22:30.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.803+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~V5U0CIYJ40G4.0 size=323922 2024-09-14T11:22:30.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.804+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=V5U0CIYJ40G4 tag=A9WPVRTTB6NR type=write size=1372498 2024-09-14T11:22:30.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.806+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=SI383INPBVJ2 type=del size=2575334 2024-09-14T11:22:30.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.807+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=PPTTWV498IGV type=del 2024-09-14T11:22:30.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.808+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=PQ5JL1BIK7LD type=del size=3958076 2024-09-14T11:22:30.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.809+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~8QYQ8EBPY48H.0 size=1048576 2024-09-14T11:22:30.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.810+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~8QYQ8EBPY48H.1 size=714297 2024-09-14T11:22:30.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.812+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=8QYQ8EBPY48H tag=TYCI67CV6G80 type=write size=2811449 2024-09-14T11:22:30.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.814+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~1TDNR0LJU08W.0 size=1048576 2024-09-14T11:22:30.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.815+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~1TDNR0LJU08W.1 size=1048576 2024-09-14T11:22:30.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.815+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~1TDNR0LJU08W.2 size=304168 2024-09-14T11:22:30.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.815+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=1TDNR0LJU08W tag=4YR0VHLRVA8R type=write size=3449896 2024-09-14T11:22:30.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.817+0000 7f43cc561780 1 < canceled operation key=BNNSFLYOU27F tag=H5ZESEE0L5AI type=del size=1650872 2024-09-14T11:22:30.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.818+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=B2SJPK59M3DU type=del size=2586995 2024-09-14T11:22:30.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.820+0000 7f43cc561780 1 < suggested update operation key=G6B4CGUBFSOT tag=MLXUPSD6F9PG type=del size=2067103 2024-09-14T11:22:30.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.821+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=2BOIVZQ9FGP8 type=del size=2592864 2024-09-14T11:22:30.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.822+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=2KT4GJ1X8B34 type=del 2024-09-14T11:22:30.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.823+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=F7ODB6SV3M0H type=del size=3109737 2024-09-14T11:22:30.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.825+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=6YDL5QAPGQ6R type=del 2024-09-14T11:22:30.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.826+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=5IRKK45WQCMS type=del size=3906131 2024-09-14T11:22:30.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.827+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=2J4G9YYAX2JX type=del 2024-09-14T11:22:30.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.829+0000 7f43cc561780 1 > prepared part key=_multipart_BNNSFLYOU27F.2~50RA8V8G6WUC.0 size=778209 2024-09-14T11:22:30.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.829+0000 7f43cc561780 1 > prepared multipart upload key=BNNSFLYOU27F upload=50RA8V8G6WUC tag=C7OCOVV3EXDP type=write size=1826785 2024-09-14T11:22:30.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.830+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~R6VLK7AQZQ2A.0 size=1048576 2024-09-14T11:22:30.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.831+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~R6VLK7AQZQ2A.1 size=1048576 2024-09-14T11:22:30.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.832+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~R6VLK7AQZQ2A.2 size=422809 2024-09-14T11:22:30.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.834+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=R6VLK7AQZQ2A tag=4ENZ3A2EV1PT type=write size=3568537 2024-09-14T11:22:30.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.835+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=0ARHY3NEAPZS type=del size=3757956 2024-09-14T11:22:30.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.836+0000 7f43cc561780 1 < canceled operation key=15F3ZZAAKT9B tag=TRFXKUO7YVTD type=del size=3292868 2024-09-14T11:22:30.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.837+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=MEDGB63U8KJ7 type=del size=1433965 2024-09-14T11:22:30.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.838+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~E0GVC9CMA3DN.0 size=1048576 2024-09-14T11:22:30.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.838+0000 7f43cc561780 1 < canceled part key=_multipart_683ZFW0BWMT7.2~E0GVC9CMA3DN.1 size=489190 2024-09-14T11:22:30.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.840+0000 7f43cc561780 1 < canceled multipart upload key=683ZFW0BWMT7 upload=E0GVC9CMA3DN tag=XK8Y11JDRFKM type=write size=2586342 2024-09-14T11:22:30.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.842+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=52OK1N3L95XB type=del size=2077358 2024-09-14T11:22:30.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.843+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~LNLJQO1WH42C.0 size=1048576 2024-09-14T11:22:30.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.844+0000 7f43cc561780 1 < completed part key=_multipart_WSFZN6JCWUXG.2~LNLJQO1WH42C.1 size=1048576 2024-09-14T11:22:30.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.844+0000 7f43cc561780 1 < canceled part key=_multipart_WSFZN6JCWUXG.2~LNLJQO1WH42C.2 size=1003753 2024-09-14T11:22:30.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.845+0000 7f43cc561780 1 < canceled multipart upload key=WSFZN6JCWUXG upload=LNLJQO1WH42C tag=T1Y0BKLV72Y5 type=write size=4149481 2024-09-14T11:22:30.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.848+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~BXU05HTOM1WB.0 size=1048576 2024-09-14T11:22:30.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.848+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~BXU05HTOM1WB.1 size=1048576 2024-09-14T11:22:30.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.849+0000 7f43cc561780 1 > prepared part key=_multipart_OJOJZBG1WEGI.2~BXU05HTOM1WB.2 size=567746 2024-09-14T11:22:30.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.849+0000 7f43cc561780 1 > prepared multipart upload key=OJOJZBG1WEGI upload=BXU05HTOM1WB tag=KUMGFCE4DIRH type=write size=3713474 2024-09-14T11:22:30.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.852+0000 7f43cc561780 1 < suggested update operation key=OV4ATW747PY4 tag=UFVKXHPDOMP9 type=del size=215429 2024-09-14T11:22:30.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.853+0000 7f43cc561780 1 > prepared operation key=E6FDCACWGA2Y tag=5UREJCU6TCTJ type=del size=1132287 2024-09-14T11:22:30.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.854+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~ARH1AIT0J05F.0 size=1048576 2024-09-14T11:22:30.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.855+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~ARH1AIT0J05F.1 size=345815 2024-09-14T11:22:30.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.857+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=ARH1AIT0J05F tag=BCVSJWU2PVVC type=write size=2442967 2024-09-14T11:22:30.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.859+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~1MJHR3F3WGB3.0 size=1048576 2024-09-14T11:22:30.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.860+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~1MJHR3F3WGB3.1 size=496733 2024-09-14T11:22:30.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.860+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=1MJHR3F3WGB3 tag=WK32LQQV042Z type=write size=2593885 2024-09-14T11:22:30.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.861+0000 7f43cc561780 1 < completed delete operation key=BNNSFLYOU27F tag=UXO7IE6TI0AV type=del 2024-09-14T11:22:30.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.863+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~JSR5VIL7QA5X.0 size=1048576 2024-09-14T11:22:30.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.864+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~JSR5VIL7QA5X.1 size=1048576 2024-09-14T11:22:30.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.865+0000 7f43cc561780 1 > prepared part key=_multipart_A1B2LIZIPET3.2~JSR5VIL7QA5X.2 size=215906 2024-09-14T11:22:30.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.865+0000 7f43cc561780 1 > prepared multipart upload key=A1B2LIZIPET3 upload=JSR5VIL7QA5X tag=JQAZ4MYDMDVY type=write size=3361634 2024-09-14T11:22:30.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.865+0000 7f43cc561780 1 < canceled part key=_multipart_IFHWMI5YO5L5.2~9IR8UVMCFBR4.0 size=725494 2024-09-14T11:22:30.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.867+0000 7f43cc561780 1 < canceled multipart upload key=IFHWMI5YO5L5 upload=9IR8UVMCFBR4 tag=PG52QPVB3E18 type=write size=1774070 2024-09-14T11:22:30.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.868+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=XBZ0B1R37UVS type=write size=180049 2024-09-14T11:22:30.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.869+0000 7f43cc561780 1 < canceled operation key=S3NOACTF4K2W tag=SI383INPBVJ2 type=del size=2575334 2024-09-14T11:22:30.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.870+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=PKADXYJYUSUM type=write size=712170 2024-09-14T11:22:30.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.872+0000 7f43cc561780 1 < suggested update operation key=FISMBWPDPCTA tag=PQ5JL1BIK7LD type=del size=3958076 2024-09-14T11:22:30.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.874+0000 7f43cc561780 1 > prepared operation key=FISMBWPDPCTA tag=6SVSI3X9HRZ8 type=write size=969366 2024-09-14T11:22:30.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.875+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~1TDNR0LJU08W.0 size=1048576 2024-09-14T11:22:30.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.876+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~1TDNR0LJU08W.1 size=1048576 2024-09-14T11:22:30.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.877+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~1TDNR0LJU08W.2 size=304168 2024-09-14T11:22:30.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.880+0000 7f43cc561780 1 < completed multipart upload key=0TDWJO4AWOOF upload=1TDNR0LJU08W tag=4YR0VHLRVA8R type=write size=3449896 2024-09-14T11:22:30.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.881+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=N2KNA0Q3IM9T type=del size=4023249 2024-09-14T11:22:30.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.882+0000 7f43cc561780 -1 < failed to complete operation key=FISMBWPDPCTA tag=B2SJPK59M3DU type=del size=2586995: (22) Invalid argument 2024-09-14T11:22:30.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.884+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~U4O7RL43AZ9R.0 size=563982 2024-09-14T11:22:30.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.884+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=U4O7RL43AZ9R tag=ZUCPNHYBN94P type=write size=1612558 2024-09-14T11:22:30.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.885+0000 7f43cc561780 1 < canceled operation key=MD14RGOQY0LK tag=2BOIVZQ9FGP8 type=del size=2592864 2024-09-14T11:22:30.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.886+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=U902XG2V8VHN type=write size=465527 2024-09-14T11:22:30.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.888+0000 7f43cc561780 1 < completed delete operation key=AY7JGVM96MO7 tag=F7ODB6SV3M0H type=del 2024-09-14T11:22:30.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.889+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=6BG8U3IGL5AV type=del size=3559627 2024-09-14T11:22:30.889 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.890+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=5IRKK45WQCMS type=del 2024-09-14T11:22:30.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.891+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=EJ1DLIO7TRED type=del size=3803137 2024-09-14T11:22:30.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.892+0000 7f43cc561780 1 < completed part key=_multipart_BNNSFLYOU27F.2~50RA8V8G6WUC.0 size=778209 2024-09-14T11:22:30.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.894+0000 7f43cc561780 1 < completed multipart upload key=BNNSFLYOU27F upload=50RA8V8G6WUC tag=C7OCOVV3EXDP type=write size=1826785 2024-09-14T11:22:30.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.895+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=V2HVIZD5DUPA type=del size=471829 2024-09-14T11:22:30.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.897+0000 7f43cc561780 1 < completed delete operation key=683ZFW0BWMT7 tag=0ARHY3NEAPZS type=del 2024-09-14T11:22:30.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.898+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=53CJ9R8EJ31G type=del size=1307971 2024-09-14T11:22:30.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.899+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=MEDGB63U8KJ7 type=del 2024-09-14T11:22:30.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.901+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~L47Z1R95MIUM.0 size=1048576 2024-09-14T11:22:30.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.902+0000 7f43cc561780 1 > prepared part key=_multipart_E6FDCACWGA2Y.2~L47Z1R95MIUM.1 size=525517 2024-09-14T11:22:30.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.902+0000 7f43cc561780 1 > prepared multipart upload key=E6FDCACWGA2Y upload=L47Z1R95MIUM tag=Z3MIWL2OQ203 type=write size=2622669 2024-09-14T11:22:30.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.903+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=52OK1N3L95XB type=del 2024-09-14T11:22:30.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.906+0000 7f43cc561780 1 > prepared part key=_multipart_S3NOACTF4K2W.2~XYG3BZ6W9M3Y.0 size=663650 2024-09-14T11:22:30.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.906+0000 7f43cc561780 1 > prepared multipart upload key=S3NOACTF4K2W upload=XYG3BZ6W9M3Y tag=Z7WSZXRAFVBA type=write size=1712226 2024-09-14T11:22:30.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.907+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~BXU05HTOM1WB.0 size=1048576 2024-09-14T11:22:30.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.908+0000 7f43cc561780 1 < completed part key=_multipart_OJOJZBG1WEGI.2~BXU05HTOM1WB.1 size=1048576 2024-09-14T11:22:30.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.908+0000 7f43cc561780 1 < canceled part key=_multipart_OJOJZBG1WEGI.2~BXU05HTOM1WB.2 size=567746 2024-09-14T11:22:30.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.910+0000 7f43cc561780 1 < canceled multipart upload key=OJOJZBG1WEGI upload=BXU05HTOM1WB tag=KUMGFCE4DIRH type=write size=3713474 2024-09-14T11:22:30.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.911+0000 7f43cc561780 1 > prepared operation key=END3SHHS0FSA tag=W0YRQK2Z3KH6 type=write size=964775 2024-09-14T11:22:30.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.912+0000 7f43cc561780 1 < completed delete operation key=E6FDCACWGA2Y tag=5UREJCU6TCTJ type=del 2024-09-14T11:22:30.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.914+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~S0JJT9IZ8Q3R.0 size=1048576 2024-09-14T11:22:30.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.915+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~S0JJT9IZ8Q3R.1 size=1048576 2024-09-14T11:22:30.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.916+0000 7f43cc561780 1 > prepared part key=_multipart_0TDWJO4AWOOF.2~S0JJT9IZ8Q3R.2 size=268827 2024-09-14T11:22:30.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.916+0000 7f43cc561780 1 > prepared multipart upload key=0TDWJO4AWOOF upload=S0JJT9IZ8Q3R tag=M93B14L5Y6NY type=write size=3414555 2024-09-14T11:22:30.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.917+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~1MJHR3F3WGB3.0 size=1048576 2024-09-14T11:22:30.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.918+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~1MJHR3F3WGB3.1 size=496733 2024-09-14T11:22:30.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.921+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=1MJHR3F3WGB3 tag=WK32LQQV042Z type=write size=2593885 2024-09-14T11:22:30.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.923+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~XF8YD8NLN2WE.0 size=1048576 2024-09-14T11:22:30.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.924+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~XF8YD8NLN2WE.1 size=912467 2024-09-14T11:22:30.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.924+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=XF8YD8NLN2WE tag=P66NX3E8GQEF type=write size=3009619 2024-09-14T11:22:30.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.925+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~JSR5VIL7QA5X.0 size=1048576 2024-09-14T11:22:30.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.926+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~JSR5VIL7QA5X.1 size=1048576 2024-09-14T11:22:30.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.927+0000 7f43cc561780 1 < completed part key=_multipart_A1B2LIZIPET3.2~JSR5VIL7QA5X.2 size=215906 2024-09-14T11:22:30.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.929+0000 7f43cc561780 1 < completed multipart upload key=A1B2LIZIPET3 upload=JSR5VIL7QA5X tag=JQAZ4MYDMDVY type=write size=3361634 2024-09-14T11:22:30.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.930+0000 7f43cc561780 1 > prepared operation key=AY7JGVM96MO7 tag=5PHFLL7BWPR3 type=del size=573900 2024-09-14T11:22:30.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.932+0000 7f43cc561780 1 < suggested update operation key=D84127SVSIPL tag=XBZ0B1R37UVS type=write size=180049 2024-09-14T11:22:30.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.934+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~UI3L7G0E2JSL.0 size=1048576 2024-09-14T11:22:30.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.935+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~UI3L7G0E2JSL.1 size=988763 2024-09-14T11:22:30.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.935+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=UI3L7G0E2JSL tag=VT36CCUYQ1PX type=write size=3085915 2024-09-14T11:22:30.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.937+0000 7f43cc561780 1 < completed write operation key=IG4QM506P41B tag=PKADXYJYUSUM type=write size=712170 2024-09-14T11:22:30.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.939+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~7JFYOCQJLG7B.0 size=1048576 2024-09-14T11:22:30.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.940+0000 7f43cc561780 1 > prepared part key=_multipart_BRHP3DQEO3HZ.2~7JFYOCQJLG7B.1 size=149938 2024-09-14T11:22:30.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.940+0000 7f43cc561780 1 > prepared multipart upload key=BRHP3DQEO3HZ upload=7JFYOCQJLG7B tag=QIWYAH9XI4SN type=write size=2247090 2024-09-14T11:22:30.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.941+0000 7f43cc561780 1 < completed write operation key=FISMBWPDPCTA tag=6SVSI3X9HRZ8 type=write size=969366 2024-09-14T11:22:30.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.942+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=HWJGRLR5LF9R type=write size=358928 2024-09-14T11:22:30.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.943+0000 7f43cc561780 1 < completed delete operation key=MD14RGOQY0LK tag=N2KNA0Q3IM9T type=del 2024-09-14T11:22:30.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.946+0000 7f43cc561780 1 > prepared part key=_multipart_1M46U4U9MG1E.2~KTNKFYWDANGX.0 size=480113 2024-09-14T11:22:30.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.946+0000 7f43cc561780 1 > prepared multipart upload key=1M46U4U9MG1E upload=KTNKFYWDANGX tag=DTVU5660FBNO type=write size=1528689 2024-09-14T11:22:30.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.947+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~U4O7RL43AZ9R.0 size=563982 2024-09-14T11:22:30.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.949+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=U4O7RL43AZ9R tag=ZUCPNHYBN94P type=write size=1612558 2024-09-14T11:22:30.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.950+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=8SH0SB3VPAQO type=del size=2589077 2024-09-14T11:22:30.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.952+0000 7f43cc561780 1 < completed write operation key=9XIAGZKIUBGH tag=U902XG2V8VHN type=write size=465527 2024-09-14T11:22:30.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.953+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=D3VPV5576TIJ type=del size=2358572 2024-09-14T11:22:30.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.954+0000 7f43cc561780 1 < completed delete operation key=END3SHHS0FSA tag=6BG8U3IGL5AV type=del 2024-09-14T11:22:30.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.956+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NFDGDMGBTRKY.0 size=1048576 2024-09-14T11:22:30.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.957+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NFDGDMGBTRKY.1 size=1048576 2024-09-14T11:22:30.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.958+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~NFDGDMGBTRKY.2 size=367713 2024-09-14T11:22:30.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.958+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=NFDGDMGBTRKY tag=G26RF7Y1IWVJ type=write size=3513441 2024-09-14T11:22:30.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.960+0000 7f43cc561780 1 < suggested remove operation key=END3SHHS0FSA tag=EJ1DLIO7TRED type=del 2024-09-14T11:22:30.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.963+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~G3H4PH4ZK8PL.0 size=145073 2024-09-14T11:22:30.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.963+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=G3H4PH4ZK8PL tag=XEGEEPM3EVCN type=write size=1193649 2024-09-14T11:22:30.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.964+0000 7f43cc561780 1 < completed delete operation key=OV4ATW747PY4 tag=V2HVIZD5DUPA type=del 2024-09-14T11:22:30.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.965+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=PWHROR5FWU59 type=del size=1410974 2024-09-14T11:22:30.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.966+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=53CJ9R8EJ31G type=del 2024-09-14T11:22:30.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.967+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=1TK98Q02M332 type=write size=161442 2024-09-14T11:22:30.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.969+0000 7f43cc561780 1 < completed part key=_multipart_E6FDCACWGA2Y.2~L47Z1R95MIUM.0 size=1048576 2024-09-14T11:22:30.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.969+0000 7f43cc561780 1 < canceled part key=_multipart_E6FDCACWGA2Y.2~L47Z1R95MIUM.1 size=525517 2024-09-14T11:22:30.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.971+0000 7f43cc561780 1 < canceled multipart upload key=E6FDCACWGA2Y upload=L47Z1R95MIUM tag=Z3MIWL2OQ203 type=write size=2622669 2024-09-14T11:22:30.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.972+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=ANYFCKYVVRAU type=write size=630056 2024-09-14T11:22:30.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.973+0000 7f43cc561780 1 < completed part key=_multipart_S3NOACTF4K2W.2~XYG3BZ6W9M3Y.0 size=663650 2024-09-14T11:22:30.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.975+0000 7f43cc561780 1 < completed multipart upload key=S3NOACTF4K2W upload=XYG3BZ6W9M3Y tag=Z7WSZXRAFVBA type=write size=1712226 2024-09-14T11:22:30.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.976+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=2AKE1MVBI5UB type=del size=1874830 2024-09-14T11:22:30.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.977+0000 7f43cc561780 -1 < failed to complete operation key=END3SHHS0FSA tag=W0YRQK2Z3KH6 type=write size=964775: (22) Invalid argument 2024-09-14T11:22:30.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.979+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=JVIBHJRE185L type=write size=779918 2024-09-14T11:22:30.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.980+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~S0JJT9IZ8Q3R.0 size=1048576 2024-09-14T11:22:30.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.980+0000 7f43cc561780 1 < canceled part key=_multipart_0TDWJO4AWOOF.2~S0JJT9IZ8Q3R.1 size=1048576 2024-09-14T11:22:30.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.981+0000 7f43cc561780 1 < completed part key=_multipart_0TDWJO4AWOOF.2~S0JJT9IZ8Q3R.2 size=268827 2024-09-14T11:22:30.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.983+0000 7f43cc561780 1 < canceled multipart upload key=0TDWJO4AWOOF upload=S0JJT9IZ8Q3R tag=M93B14L5Y6NY type=write size=3414555 2024-09-14T11:22:30.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.985+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~F1RW8ITY7FIP.0 size=1048576 2024-09-14T11:22:30.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.986+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~F1RW8ITY7FIP.1 size=580823 2024-09-14T11:22:30.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.986+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=F1RW8ITY7FIP tag=6LVVY6IFAAAE type=write size=2677975 2024-09-14T11:22:30.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.988+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~XF8YD8NLN2WE.0 size=1048576 2024-09-14T11:22:30.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.989+0000 7f43cc561780 1 < completed part key=_multipart_MD14RGOQY0LK.2~XF8YD8NLN2WE.1 size=912467 2024-09-14T11:22:30.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.992+0000 7f43cc561780 1 < completed multipart upload key=MD14RGOQY0LK upload=XF8YD8NLN2WE tag=P66NX3E8GQEF type=write size=3009619 2024-09-14T11:22:30.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.994+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~CKSUIQ1BPBU3.0 size=523257 2024-09-14T11:22:30.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.994+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=CKSUIQ1BPBU3 tag=0NFGPE1KS0RE type=write size=1571833 2024-09-14T11:22:30.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.997+0000 7f43cc561780 1 < suggested update operation key=AY7JGVM96MO7 tag=5PHFLL7BWPR3 type=del size=573900 2024-09-14T11:22:30.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:30.999+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~GW55TKAMQG6C.0 size=1048576 2024-09-14T11:22:30.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.000+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~GW55TKAMQG6C.1 size=1048576 2024-09-14T11:22:30.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.001+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~GW55TKAMQG6C.2 size=447580 2024-09-14T11:22:31.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.001+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=GW55TKAMQG6C tag=ECE2WIICF4AE type=write size=3593308 2024-09-14T11:22:31.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.002+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~UI3L7G0E2JSL.0 size=1048576 2024-09-14T11:22:31.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.003+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~UI3L7G0E2JSL.1 size=988763 2024-09-14T11:22:31.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.005+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=UI3L7G0E2JSL tag=VT36CCUYQ1PX type=write size=3085915 2024-09-14T11:22:31.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.007+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~1KWSZWFKPV16.0 size=364024 2024-09-14T11:22:31.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.007+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=1KWSZWFKPV16 tag=4LNSCQW13C3Q type=write size=1412600 2024-09-14T11:22:31.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.008+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~7JFYOCQJLG7B.0 size=1048576 2024-09-14T11:22:31.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.009+0000 7f43cc561780 1 < completed part key=_multipart_BRHP3DQEO3HZ.2~7JFYOCQJLG7B.1 size=149938 2024-09-14T11:22:31.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.011+0000 7f43cc561780 1 < completed multipart upload key=BRHP3DQEO3HZ upload=7JFYOCQJLG7B tag=QIWYAH9XI4SN type=write size=2247090 2024-09-14T11:22:31.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.012+0000 7f43cc561780 1 > prepared operation key=S3NOACTF4K2W tag=RX2H1RUH87YS type=del size=4096487 2024-09-14T11:22:31.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.013+0000 7f43cc561780 1 < completed write operation key=D8EBH4NWN7SK tag=HWJGRLR5LF9R type=write size=358928 2024-09-14T11:22:31.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.015+0000 7f43cc561780 1 > prepared operation key=AWBBRU4C8RDQ tag=9Q58KZYAOEWQ type=del size=911407 2024-09-14T11:22:31.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.016+0000 7f43cc561780 1 < completed part key=_multipart_1M46U4U9MG1E.2~KTNKFYWDANGX.0 size=480113 2024-09-14T11:22:31.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.018+0000 7f43cc561780 1 < completed multipart upload key=1M46U4U9MG1E upload=KTNKFYWDANGX tag=DTVU5660FBNO type=write size=1528689 2024-09-14T11:22:31.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.019+0000 7f43cc561780 1 > prepared operation key=UWES4CQZ8XW6 tag=GZDB4L53B3ER type=del size=1694541 2024-09-14T11:22:31.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.020+0000 7f43cc561780 1 < completed delete operation key=BRHP3DQEO3HZ tag=8SH0SB3VPAQO type=del 2024-09-14T11:22:31.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.021+0000 7f43cc561780 1 > prepared operation key=LKY30XYUG2QW tag=L4XSL9G9OXF8 type=write size=1036514 2024-09-14T11:22:31.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.022+0000 7f43cc561780 1 < completed delete operation key=A1B2LIZIPET3 tag=D3VPV5576TIJ type=del 2024-09-14T11:22:31.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.025+0000 7f43cc561780 1 > prepared part key=_multipart_683ZFW0BWMT7.2~SRP6IY224FZK.0 size=168463 2024-09-14T11:22:31.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.025+0000 7f43cc561780 1 > prepared multipart upload key=683ZFW0BWMT7 upload=SRP6IY224FZK tag=BPMAO0SXVIR3 type=write size=1217039 2024-09-14T11:22:31.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.026+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NFDGDMGBTRKY.0 size=1048576 2024-09-14T11:22:31.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.027+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NFDGDMGBTRKY.1 size=1048576 2024-09-14T11:22:31.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.028+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~NFDGDMGBTRKY.2 size=367713 2024-09-14T11:22:31.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.030+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=NFDGDMGBTRKY tag=G26RF7Y1IWVJ type=write size=3513441 2024-09-14T11:22:31.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.032+0000 7f43cc561780 1 > prepared part key=_multipart_AWBBRU4C8RDQ.2~53M9EOQ2G209.0 size=68041 2024-09-14T11:22:31.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.032+0000 7f43cc561780 1 > prepared multipart upload key=AWBBRU4C8RDQ upload=53M9EOQ2G209 tag=5TMRQ5RUNEBR type=write size=1116617 2024-09-14T11:22:31.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.033+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~G3H4PH4ZK8PL.0 size=145073 2024-09-14T11:22:31.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.035+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=G3H4PH4ZK8PL tag=XEGEEPM3EVCN type=write size=1193649 2024-09-14T11:22:31.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.038+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~WB3WKGX7D6AL.0 size=1048576 2024-09-14T11:22:31.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.039+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~WB3WKGX7D6AL.1 size=1048576 2024-09-14T11:22:31.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.040+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~WB3WKGX7D6AL.2 size=93593 2024-09-14T11:22:31.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.040+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=WB3WKGX7D6AL tag=NK6LSERGEYOM type=write size=3239321 2024-09-14T11:22:31.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.041+0000 7f43cc561780 1 < completed delete operation key=OJOJZBG1WEGI tag=PWHROR5FWU59 type=del 2024-09-14T11:22:31.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.042+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=BZXMRJQA0XMB type=del size=446337 2024-09-14T11:22:31.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.044+0000 7f43cc561780 1 < canceled operation key=W679WIFVPVOH tag=1TK98Q02M332 type=write size=161442 2024-09-14T11:22:31.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.045+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=VFFYQ5L90R2C type=write size=57401 2024-09-14T11:22:31.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.046+0000 7f43cc561780 1 < completed write operation key=3YHEZHW0RS1W tag=ANYFCKYVVRAU type=write size=630056 2024-09-14T11:22:31.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.049+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~SPJOIBF3KN2F.0 size=1048576 2024-09-14T11:22:31.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.049+0000 7f43cc561780 1 > prepared part key=_multipart_IG4QM506P41B.2~SPJOIBF3KN2F.1 size=648926 2024-09-14T11:22:31.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.049+0000 7f43cc561780 1 > prepared multipart upload key=IG4QM506P41B upload=SPJOIBF3KN2F tag=SYN7TS3QSMKJ type=write size=2746078 2024-09-14T11:22:31.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.051+0000 7f43cc561780 1 < completed delete operation key=LKY30XYUG2QW tag=2AKE1MVBI5UB type=del 2024-09-14T11:22:31.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.052+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=86E0HAEPK5MX type=del size=2990762 2024-09-14T11:22:31.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.053+0000 7f43cc561780 1 < completed write operation key=D84127SVSIPL tag=JVIBHJRE185L type=write size=779918 2024-09-14T11:22:31.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.054+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=XYTQVW9T9C3C type=del size=3903111 2024-09-14T11:22:31.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.056+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~F1RW8ITY7FIP.0 size=1048576 2024-09-14T11:22:31.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.057+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~F1RW8ITY7FIP.1 size=580823 2024-09-14T11:22:31.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.059+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=F1RW8ITY7FIP tag=6LVVY6IFAAAE type=write size=2677975 2024-09-14T11:22:31.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.060+0000 7f43cc561780 1 > prepared operation key=3YHEZHW0RS1W tag=1VY1NLPG3ORU type=del size=4172452 2024-09-14T11:22:31.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.061+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~CKSUIQ1BPBU3.0 size=523257 2024-09-14T11:22:31.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.063+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=CKSUIQ1BPBU3 tag=0NFGPE1KS0RE type=write size=1571833 2024-09-14T11:22:31.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.065+0000 7f43cc561780 1 > prepared operation key=D8EBH4NWN7SK tag=T66V97579F09 type=del size=2152529 2024-09-14T11:22:31.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.066+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~GW55TKAMQG6C.0 size=1048576 2024-09-14T11:22:31.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.067+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~GW55TKAMQG6C.1 size=1048576 2024-09-14T11:22:31.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.068+0000 7f43cc561780 1 < completed part key=_multipart_D8EBH4NWN7SK.2~GW55TKAMQG6C.2 size=447580 2024-09-14T11:22:31.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.070+0000 7f43cc561780 1 < completed multipart upload key=D8EBH4NWN7SK upload=GW55TKAMQG6C tag=ECE2WIICF4AE type=write size=3593308 2024-09-14T11:22:31.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.073+0000 7f43cc561780 1 > prepared part key=_multipart_CXP2PUIXR2PA.2~Y9ZCIIENG2VJ.0 size=206820 2024-09-14T11:22:31.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.073+0000 7f43cc561780 1 > prepared multipart upload key=CXP2PUIXR2PA upload=Y9ZCIIENG2VJ tag=JU2KJDMEBF5E type=write size=1255396 2024-09-14T11:22:31.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.074+0000 7f43cc561780 1 < completed part key=_multipart_UWES4CQZ8XW6.2~1KWSZWFKPV16.0 size=364024 2024-09-14T11:22:31.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.076+0000 7f43cc561780 1 < completed multipart upload key=UWES4CQZ8XW6 upload=1KWSZWFKPV16 tag=4LNSCQW13C3Q type=write size=1412600 2024-09-14T11:22:31.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.079+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~QTD3V84P2ZUI.0 size=1048576 2024-09-14T11:22:31.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.080+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~QTD3V84P2ZUI.1 size=1048576 2024-09-14T11:22:31.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.081+0000 7f43cc561780 1 > prepared part key=_multipart_D84127SVSIPL.2~QTD3V84P2ZUI.2 size=44743 2024-09-14T11:22:31.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.081+0000 7f43cc561780 1 > prepared multipart upload key=D84127SVSIPL upload=QTD3V84P2ZUI tag=HL4TAABUM20H type=write size=3190471 2024-09-14T11:22:31.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.082+0000 7f43cc561780 1 < completed delete operation key=S3NOACTF4K2W tag=RX2H1RUH87YS type=del 2024-09-14T11:22:31.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.084+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~IQTDYAGZYZ8A.0 size=1048576 2024-09-14T11:22:31.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.085+0000 7f43cc561780 1 > prepared part key=_multipart_G6B4CGUBFSOT.2~IQTDYAGZYZ8A.1 size=882203 2024-09-14T11:22:31.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.085+0000 7f43cc561780 1 > prepared multipart upload key=G6B4CGUBFSOT upload=IQTDYAGZYZ8A tag=P5V71WNENB8V type=write size=2979355 2024-09-14T11:22:31.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.088+0000 7f43cc561780 1 < suggested remove operation key=AWBBRU4C8RDQ tag=9Q58KZYAOEWQ type=del 2024-09-14T11:22:31.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.089+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=T1AGHO9UN1ZQ type=del size=1709354 2024-09-14T11:22:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.092+0000 7f43cc561780 1 < suggested update operation key=UWES4CQZ8XW6 tag=GZDB4L53B3ER type=del size=1694541 2024-09-14T11:22:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.094+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~JCU14SL3PNXM.0 size=1048576 2024-09-14T11:22:31.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.095+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~JCU14SL3PNXM.1 size=1048576 2024-09-14T11:22:31.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.096+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~JCU14SL3PNXM.2 size=889454 2024-09-14T11:22:31.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.096+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=JCU14SL3PNXM tag=SK2ASOUF4FJE type=write size=4035182 2024-09-14T11:22:31.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.097+0000 7f43cc561780 1 < completed write operation key=LKY30XYUG2QW tag=L4XSL9G9OXF8 type=write size=1036514 2024-09-14T11:22:31.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.099+0000 7f43cc561780 1 > prepared operation key=683ZFW0BWMT7 tag=M72GC5ZV1QJF type=write size=916341 2024-09-14T11:22:31.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.100+0000 7f43cc561780 1 < completed part key=_multipart_683ZFW0BWMT7.2~SRP6IY224FZK.0 size=168463 2024-09-14T11:22:31.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.102+0000 7f43cc561780 1 < completed multipart upload key=683ZFW0BWMT7 upload=SRP6IY224FZK tag=BPMAO0SXVIR3 type=write size=1217039 2024-09-14T11:22:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.104+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=V4YA3ZPVKFYV type=write size=610642 2024-09-14T11:22:31.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.106+0000 7f43cc561780 1 < completed part key=_multipart_AWBBRU4C8RDQ.2~53M9EOQ2G209.0 size=68041 2024-09-14T11:22:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.108+0000 7f43cc561780 1 < completed multipart upload key=AWBBRU4C8RDQ upload=53M9EOQ2G209 tag=5TMRQ5RUNEBR type=write size=1116617 2024-09-14T11:22:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.110+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~RRV8Z4YOXCFE.0 size=1048576 2024-09-14T11:22:31.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.111+0000 7f43cc561780 1 > prepared part key=_multipart_OV4ATW747PY4.2~RRV8Z4YOXCFE.1 size=272258 2024-09-14T11:22:31.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.111+0000 7f43cc561780 1 > prepared multipart upload key=OV4ATW747PY4 upload=RRV8Z4YOXCFE tag=WKBFTT2PF7AX type=write size=2369410 2024-09-14T11:22:31.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.112+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~WB3WKGX7D6AL.0 size=1048576 2024-09-14T11:22:31.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.114+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~WB3WKGX7D6AL.1 size=1048576 2024-09-14T11:22:31.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.115+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~WB3WKGX7D6AL.2 size=93593 2024-09-14T11:22:31.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.117+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=WB3WKGX7D6AL tag=NK6LSERGEYOM type=write size=3239321 2024-09-14T11:22:31.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.118+0000 7f43cc561780 1 > prepared operation key=CXP2PUIXR2PA tag=QGTT7XS2OEDW type=del size=1863120 2024-09-14T11:22:31.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.121+0000 7f43cc561780 1 < suggested update operation key=WHIZ2GREK1FE tag=BZXMRJQA0XMB type=del size=446337 2024-09-14T11:22:31.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.124+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~W6N4202FWX9C.0 size=1048576 2024-09-14T11:22:31.123 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.125+0000 7f43cc561780 1 > prepared part key=_multipart_15F3ZZAAKT9B.2~W6N4202FWX9C.1 size=525578 2024-09-14T11:22:31.123 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.125+0000 7f43cc561780 1 > prepared multipart upload key=15F3ZZAAKT9B upload=W6N4202FWX9C tag=WF8AHB03LMZZ type=write size=2622730 2024-09-14T11:22:31.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.126+0000 7f43cc561780 1 < canceled operation key=3YHEZHW0RS1W tag=VFFYQ5L90R2C type=write size=57401 2024-09-14T11:22:31.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.127+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=J9B0RAPYY8M1 type=del size=1604721 2024-09-14T11:22:31.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.128+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~SPJOIBF3KN2F.0 size=1048576 2024-09-14T11:22:31.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.129+0000 7f43cc561780 1 < completed part key=_multipart_IG4QM506P41B.2~SPJOIBF3KN2F.1 size=648926 2024-09-14T11:22:31.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.131+0000 7f43cc561780 1 < completed multipart upload key=IG4QM506P41B upload=SPJOIBF3KN2F tag=SYN7TS3QSMKJ type=write size=2746078 2024-09-14T11:22:31.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.133+0000 7f43cc561780 1 > prepared part key=_multipart_END3SHHS0FSA.2~DTEMG8JZ9J9N.0 size=84183 2024-09-14T11:22:31.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.133+0000 7f43cc561780 1 > prepared multipart upload key=END3SHHS0FSA upload=DTEMG8JZ9J9N tag=UUJMOTVQPV82 type=write size=1132759 2024-09-14T11:22:31.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.135+0000 7f43cc561780 1 < suggested remove operation key=IG4QM506P41B tag=86E0HAEPK5MX type=del 2024-09-14T11:22:31.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.137+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=LVUY13WF23S1 type=del size=2874077 2024-09-14T11:22:31.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.139+0000 7f43cc561780 1 < suggested remove operation key=D84127SVSIPL tag=XYTQVW9T9C3C type=del 2024-09-14T11:22:31.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.141+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~WEXZ6P1R9CHN.0 size=1048576 2024-09-14T11:22:31.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.142+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~WEXZ6P1R9CHN.1 size=1048576 2024-09-14T11:22:31.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.143+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~WEXZ6P1R9CHN.2 size=352265 2024-09-14T11:22:31.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.143+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=WEXZ6P1R9CHN tag=0HIJQ9TTR35S type=write size=3497993 2024-09-14T11:22:31.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.144+0000 7f43cc561780 1 < completed delete operation key=3YHEZHW0RS1W tag=1VY1NLPG3ORU type=del 2024-09-14T11:22:31.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.146+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~EW0VNAXXZAHC.0 size=1048576 2024-09-14T11:22:31.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.147+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~EW0VNAXXZAHC.1 size=1048576 2024-09-14T11:22:31.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.148+0000 7f43cc561780 1 > prepared part key=_multipart_W679WIFVPVOH.2~EW0VNAXXZAHC.2 size=455745 2024-09-14T11:22:31.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.148+0000 7f43cc561780 1 > prepared multipart upload key=W679WIFVPVOH upload=EW0VNAXXZAHC tag=TNY31NC8B0VO type=write size=3601473 2024-09-14T11:22:31.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.151+0000 7f43cc561780 1 < suggested remove operation key=D8EBH4NWN7SK tag=T66V97579F09 type=del 2024-09-14T11:22:31.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.152+0000 7f43cc561780 1 > prepared operation key=WHIZ2GREK1FE tag=9N4N3OKGNGU2 type=del size=669110 2024-09-14T11:22:31.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.153+0000 7f43cc561780 1 < completed part key=_multipart_CXP2PUIXR2PA.2~Y9ZCIIENG2VJ.0 size=206820 2024-09-14T11:22:31.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.155+0000 7f43cc561780 1 < completed multipart upload key=CXP2PUIXR2PA upload=Y9ZCIIENG2VJ tag=JU2KJDMEBF5E type=write size=1255396 2024-09-14T11:22:31.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.156+0000 7f43cc561780 1 > prepared operation key=15F3ZZAAKT9B tag=188VHT2SDZWR type=write size=278299 2024-09-14T11:22:31.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.157+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~QTD3V84P2ZUI.0 size=1048576 2024-09-14T11:22:31.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.158+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~QTD3V84P2ZUI.1 size=1048576 2024-09-14T11:22:31.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.159+0000 7f43cc561780 1 < completed part key=_multipart_D84127SVSIPL.2~QTD3V84P2ZUI.2 size=44743 2024-09-14T11:22:31.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.161+0000 7f43cc561780 1 < completed multipart upload key=D84127SVSIPL upload=QTD3V84P2ZUI tag=HL4TAABUM20H type=write size=3190471 2024-09-14T11:22:31.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.162+0000 7f43cc561780 1 > prepared operation key=80ZYEEE1EE78 tag=S576UJKR16NP type=del size=1807703 2024-09-14T11:22:31.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.163+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~IQTDYAGZYZ8A.0 size=1048576 2024-09-14T11:22:31.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.164+0000 7f43cc561780 1 < completed part key=_multipart_G6B4CGUBFSOT.2~IQTDYAGZYZ8A.1 size=882203 2024-09-14T11:22:31.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.166+0000 7f43cc561780 1 < completed multipart upload key=G6B4CGUBFSOT upload=IQTDYAGZYZ8A tag=P5V71WNENB8V type=write size=2979355 2024-09-14T11:22:31.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.167+0000 7f43cc561780 1 > prepared operation key=IG4QM506P41B tag=1TPNG7CI7RQ8 type=write size=418929 2024-09-14T11:22:31.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.169+0000 7f43cc561780 1 < completed delete operation key=80ZYEEE1EE78 tag=T1AGHO9UN1ZQ type=del 2024-09-14T11:22:31.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.171+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~GO8KDJZQQCBR.0 size=1048576 2024-09-14T11:22:31.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.172+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~GO8KDJZQQCBR.1 size=1048576 2024-09-14T11:22:31.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.173+0000 7f43cc561780 1 > prepared part key=_multipart_80ZYEEE1EE78.2~GO8KDJZQQCBR.2 size=734058 2024-09-14T11:22:31.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.173+0000 7f43cc561780 1 > prepared multipart upload key=80ZYEEE1EE78 upload=GO8KDJZQQCBR tag=2Y6YSX2UPG6H type=write size=3879786 2024-09-14T11:22:31.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.174+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~JCU14SL3PNXM.0 size=1048576 2024-09-14T11:22:31.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.175+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~JCU14SL3PNXM.1 size=1048576 2024-09-14T11:22:31.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.175+0000 7f43cc561780 1 < canceled part key=_multipart_OV4ATW747PY4.2~JCU14SL3PNXM.2 size=889454 2024-09-14T11:22:31.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.177+0000 7f43cc561780 1 < canceled multipart upload key=OV4ATW747PY4 upload=JCU14SL3PNXM tag=SK2ASOUF4FJE type=write size=4035182 2024-09-14T11:22:31.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.178+0000 7f43cc561780 1 > prepared operation key=BNNSFLYOU27F tag=QSZY2P9HQF2X type=write size=886790 2024-09-14T11:22:31.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.179+0000 7f43cc561780 1 < completed write operation key=683ZFW0BWMT7 tag=M72GC5ZV1QJF type=write size=916341 2024-09-14T11:22:31.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.180+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=8U3AXCBD2HUV type=del size=1487143 2024-09-14T11:22:31.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.182+0000 7f43cc561780 -1 < failed to complete operation key=IG4QM506P41B tag=V4YA3ZPVKFYV type=write size=610642: (22) Invalid argument 2024-09-14T11:22:31.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.184+0000 7f43cc561780 1 > prepared part key=_multipart_9XIAGZKIUBGH.2~APDRSTPJ8FZA.0 size=436422 2024-09-14T11:22:31.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.184+0000 7f43cc561780 1 > prepared multipart upload key=9XIAGZKIUBGH upload=APDRSTPJ8FZA tag=Z5DU470ZD1UQ type=write size=1484998 2024-09-14T11:22:31.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.185+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~RRV8Z4YOXCFE.0 size=1048576 2024-09-14T11:22:31.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.186+0000 7f43cc561780 1 < completed part key=_multipart_OV4ATW747PY4.2~RRV8Z4YOXCFE.1 size=272258 2024-09-14T11:22:31.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.188+0000 7f43cc561780 1 < completed multipart upload key=OV4ATW747PY4 upload=RRV8Z4YOXCFE tag=WKBFTT2PF7AX type=write size=2369410 2024-09-14T11:22:31.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.190+0000 7f43cc561780 1 > prepared part key=_multipart_BZDW69C3Z97G.2~SBXMMVB6QQ2K.0 size=606224 2024-09-14T11:22:31.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.190+0000 7f43cc561780 1 > prepared multipart upload key=BZDW69C3Z97G upload=SBXMMVB6QQ2K tag=FJIOWPDDXWN2 type=write size=1654800 2024-09-14T11:22:31.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.192+0000 7f43cc561780 1 < completed delete operation key=CXP2PUIXR2PA tag=QGTT7XS2OEDW type=del 2024-09-14T11:22:31.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.193+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=80U7IEEG1ISM type=del size=2649171 2024-09-14T11:22:31.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.194+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~W6N4202FWX9C.0 size=1048576 2024-09-14T11:22:31.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.195+0000 7f43cc561780 1 < completed part key=_multipart_15F3ZZAAKT9B.2~W6N4202FWX9C.1 size=525578 2024-09-14T11:22:31.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.197+0000 7f43cc561780 1 < completed multipart upload key=15F3ZZAAKT9B upload=W6N4202FWX9C tag=WF8AHB03LMZZ type=write size=2622730 2024-09-14T11:22:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.198+0000 7f43cc561780 1 > prepared operation key=W679WIFVPVOH tag=22NK3YGFCVHH type=del size=194218 2024-09-14T11:22:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.200+0000 7f43cc561780 -1 < failed to complete operation key=IG4QM506P41B tag=J9B0RAPYY8M1 type=del size=1604721: (22) Invalid argument 2024-09-14T11:22:31.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.201+0000 7f43cc561780 1 > prepared operation key=2975CNBC43ST tag=BXXXRY3196PO type=del size=1913772 2024-09-14T11:22:31.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.202+0000 7f43cc561780 1 < completed part key=_multipart_END3SHHS0FSA.2~DTEMG8JZ9J9N.0 size=84183 2024-09-14T11:22:31.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.204+0000 7f43cc561780 1 < completed multipart upload key=END3SHHS0FSA upload=DTEMG8JZ9J9N tag=UUJMOTVQPV82 type=write size=1132759 2024-09-14T11:22:31.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.206+0000 7f43cc561780 1 > prepared part key=_multipart_AY7JGVM96MO7.2~BK59JT4ZBSPC.0 size=421767 2024-09-14T11:22:31.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.206+0000 7f43cc561780 1 > prepared multipart upload key=AY7JGVM96MO7 upload=BK59JT4ZBSPC tag=SU7JH107YX97 type=write size=1470343 2024-09-14T11:22:31.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.207+0000 7f43cc561780 1 < completed delete operation key=IG4QM506P41B tag=LVUY13WF23S1 type=del 2024-09-14T11:22:31.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.208+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=WP7ZZFJW77DH type=del size=2473791 2024-09-14T11:22:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.210+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~WEXZ6P1R9CHN.0 size=1048576 2024-09-14T11:22:31.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.211+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~WEXZ6P1R9CHN.1 size=1048576 2024-09-14T11:22:31.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.211+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~WEXZ6P1R9CHN.2 size=352265 2024-09-14T11:22:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.214+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=WEXZ6P1R9CHN tag=0HIJQ9TTR35S type=write size=3497993 2024-09-14T11:22:31.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.215+0000 7f43cc561780 1 > prepared operation key=OV4ATW747PY4 tag=CF1CU9G1GJBQ type=write size=799722 2024-09-14T11:22:31.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.217+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~EW0VNAXXZAHC.0 size=1048576 2024-09-14T11:22:31.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.218+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~EW0VNAXXZAHC.1 size=1048576 2024-09-14T11:22:31.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.219+0000 7f43cc561780 1 < completed part key=_multipart_W679WIFVPVOH.2~EW0VNAXXZAHC.2 size=455745 2024-09-14T11:22:31.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.221+0000 7f43cc561780 1 < completed multipart upload key=W679WIFVPVOH upload=EW0VNAXXZAHC tag=TNY31NC8B0VO type=write size=3601473 2024-09-14T11:22:31.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.222+0000 7f43cc561780 1 > prepared operation key=1M46U4U9MG1E tag=ISORP8YBTW3K type=del size=2656994 2024-09-14T11:22:31.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.224+0000 7f43cc561780 1 < canceled operation key=WHIZ2GREK1FE tag=9N4N3OKGNGU2 type=del size=669110 2024-09-14T11:22:31.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.225+0000 7f43cc561780 1 > prepared operation key=9XIAGZKIUBGH tag=WVG3K30ZHAHM type=del size=3826431 2024-09-14T11:22:31.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.226+0000 7f43cc561780 1 < completed write operation key=15F3ZZAAKT9B tag=188VHT2SDZWR type=write size=278299 2024-09-14T11:22:31.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.228+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~G8Q39XO9GODW.0 size=1048576 2024-09-14T11:22:31.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.229+0000 7f43cc561780 1 > prepared part key=_multipart_MD14RGOQY0LK.2~G8Q39XO9GODW.1 size=940679 2024-09-14T11:22:31.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.229+0000 7f43cc561780 1 > prepared multipart upload key=MD14RGOQY0LK upload=G8Q39XO9GODW tag=4YG1R7UJ8H2U type=write size=3037831 2024-09-14T11:22:31.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.231+0000 7f43cc561780 1 < suggested update operation key=80ZYEEE1EE78 tag=S576UJKR16NP type=del size=1807703 2024-09-14T11:22:31.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.232+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=CS3U6J4OMTID type=del size=4081240 2024-09-14T11:22:31.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.234+0000 7f43cc561780 1 < completed write operation key=IG4QM506P41B tag=1TPNG7CI7RQ8 type=write size=418929 2024-09-14T11:22:31.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.235+0000 7f43cc561780 1 > prepared operation key=A1B2LIZIPET3 tag=O21F2IX9JQDA type=del size=537740 2024-09-14T11:22:31.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.237+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~GO8KDJZQQCBR.0 size=1048576 2024-09-14T11:22:31.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.237+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~GO8KDJZQQCBR.1 size=1048576 2024-09-14T11:22:31.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.238+0000 7f43cc561780 1 < completed part key=_multipart_80ZYEEE1EE78.2~GO8KDJZQQCBR.2 size=734058 2024-09-14T11:22:31.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.240+0000 7f43cc561780 1 < completed multipart upload key=80ZYEEE1EE78 upload=GO8KDJZQQCBR tag=2Y6YSX2UPG6H type=write size=3879786 2024-09-14T11:22:31.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.242+0000 7f43cc561780 1 > prepared operation key=BRHP3DQEO3HZ tag=C045LDBNU62F type=del size=2599213 2024-09-14T11:22:31.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.243+0000 7f43cc561780 1 < completed write operation key=BNNSFLYOU27F tag=QSZY2P9HQF2X type=write size=886790 2024-09-14T11:22:31.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.245+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~97C4TKXI4F8V.0 size=1048576 2024-09-14T11:22:31.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.246+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~97C4TKXI4F8V.1 size=1048576 2024-09-14T11:22:31.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.247+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~97C4TKXI4F8V.2 size=778568 2024-09-14T11:22:31.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.247+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=97C4TKXI4F8V tag=9MHOLVM82ZRZ type=write size=3924296 2024-09-14T11:22:31.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.248+0000 7f43cc561780 1 < completed delete operation key=G6B4CGUBFSOT tag=8U3AXCBD2HUV type=del 2024-09-14T11:22:31.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.250+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~PL1JZUPPQ8D3.0 size=1048576 2024-09-14T11:22:31.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.251+0000 7f43cc561780 1 > prepared part key=_multipart_UWES4CQZ8XW6.2~PL1JZUPPQ8D3.1 size=611555 2024-09-14T11:22:31.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.251+0000 7f43cc561780 1 > prepared multipart upload key=UWES4CQZ8XW6 upload=PL1JZUPPQ8D3 tag=4P2I80MROA6H type=write size=2708707 2024-09-14T11:22:31.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.253+0000 7f43cc561780 1 < completed part key=_multipart_9XIAGZKIUBGH.2~APDRSTPJ8FZA.0 size=436422 2024-09-14T11:22:31.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.255+0000 7f43cc561780 1 < completed multipart upload key=9XIAGZKIUBGH upload=APDRSTPJ8FZA tag=Z5DU470ZD1UQ type=write size=1484998 2024-09-14T11:22:31.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.256+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=9308DP55ABM1 type=del size=632012 2024-09-14T11:22:31.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.258+0000 7f43cc561780 1 < completed part key=_multipart_BZDW69C3Z97G.2~SBXMMVB6QQ2K.0 size=606224 2024-09-14T11:22:31.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.260+0000 7f43cc561780 1 < completed multipart upload key=BZDW69C3Z97G upload=SBXMMVB6QQ2K tag=FJIOWPDDXWN2 type=write size=1654800 2024-09-14T11:22:31.260 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.261+0000 7f43cc561780 1 > prepared operation key=0TDWJO4AWOOF tag=CRPBMWYMPIA2 type=del size=52459 2024-09-14T11:22:31.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.263+0000 7f43cc561780 1 < completed delete operation key=9XIAGZKIUBGH tag=80U7IEEG1ISM type=del 2024-09-14T11:22:31.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.264+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=0D57P772NNMX type=del size=3513448 2024-09-14T11:22:31.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.266+0000 7f43cc561780 1 < suggested remove operation key=W679WIFVPVOH tag=22NK3YGFCVHH type=del 2024-09-14T11:22:31.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.268+0000 7f43cc561780 1 > prepared operation key=OJOJZBG1WEGI tag=F4MMOX6AKEWW type=write size=391845 2024-09-14T11:22:31.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.269+0000 7f43cc561780 1 < canceled operation key=2975CNBC43ST tag=BXXXRY3196PO type=del size=1913772 2024-09-14T11:22:31.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.271+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~YHHMAFO2RG59.0 size=593079 2024-09-14T11:22:31.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.271+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=YHHMAFO2RG59 tag=GU5P9F7618Z0 type=write size=1641655 2024-09-14T11:22:31.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.272+0000 7f43cc561780 1 < completed part key=_multipart_AY7JGVM96MO7.2~BK59JT4ZBSPC.0 size=421767 2024-09-14T11:22:31.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.274+0000 7f43cc561780 1 < completed multipart upload key=AY7JGVM96MO7 upload=BK59JT4ZBSPC tag=SU7JH107YX97 type=write size=1470343 2024-09-14T11:22:31.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.276+0000 7f43cc561780 1 > prepared operation key=G6B4CGUBFSOT tag=ZOIIFQRB1R9J type=del size=43321 2024-09-14T11:22:31.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.278+0000 7f43cc561780 1 < suggested remove operation key=OV4ATW747PY4 tag=WP7ZZFJW77DH type=del 2024-09-14T11:22:31.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.280+0000 7f43cc561780 1 > prepared operation key=MD14RGOQY0LK tag=UE9FICO8LYVX type=del size=3412968 2024-09-14T11:22:31.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.281+0000 7f43cc561780 -1 < failed to complete operation key=OV4ATW747PY4 tag=CF1CU9G1GJBQ type=write size=799722: (22) Invalid argument 2024-09-14T11:22:31.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.282+0000 7f43cc561780 1 > prepared operation key=D84127SVSIPL tag=9TQO9Z38GXA7 type=del size=4019782 2024-09-14T11:22:31.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.285+0000 7f43cc561780 1 < suggested remove operation key=1M46U4U9MG1E tag=ISORP8YBTW3K type=del 2024-09-14T11:22:31.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.287+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~F5RASD4IGPB1.0 size=1048576 2024-09-14T11:22:31.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.288+0000 7f43cc561780 1 > prepared part key=_multipart_D8EBH4NWN7SK.2~F5RASD4IGPB1.1 size=801528 2024-09-14T11:22:31.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:22:31.288+0000 7f43cc561780 1 > prepared multipart upload key=D8EBH4NWN7SK upload=F5RASD4IGPB1 tag=R3JWY1VJ94Y6 type=write size=2898680 2024-09-14T11:22:31.287 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] cls_rgw_stats.simulate (9199 ms) 2024-09-14T11:22:31.287 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 1 test from cls_rgw_stats (9199 ms total) 2024-09-14T11:22:31.288 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:22:31.288 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:32.110 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 1 test from 1 test suite ran. (11886 ms total) 2024-09-14T11:22:32.110 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 1 test. 2024-09-14T11:22:32.115 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:32.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:32.198 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:22:32.199 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:22:32.199 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:22:32.287 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:22:32.287 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:22:32.287 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:34.123 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:22:34.124 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:22:34.139 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (16 ms) 2024-09-14T11:22:34.139 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:22:34.148 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2024-09-14T11:22:34.148 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:22:34.151 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-14T11:22:34.151 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:22:34.154 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-14T11:22:34.154 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:22:34.161 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-14T11:22:34.161 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:22:34.168 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-14T11:22:34.168 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:22:34.171 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-14T11:22:34.171 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:22:34.175 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-14T11:22:34.268 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-14T11:22:34.271 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-14T11:22:34.272 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T11:22:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:22:34.274 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-14T11:22:34.274 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:22:34.279 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-14T11:22:34.279 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 31 tests from CmpOmap (155 ms total) 2024-09-14T11:22:34.279 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:22:34.279 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:35.130 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 31 tests from 1 test suite ran. (2843 ms total) 2024-09-14T11:22:35.130 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 31 tests. 2024-09-14T11:22:35.132 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:35.132 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:35.177 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:22:35.178 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:22:35.179 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:22:35.226 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:22:35.226 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:22:35.227 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:35.227 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:22:35.227 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:22:38.152 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2924 ms) 2024-09-14T11:22:38.152 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:22:41.171 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-09-14T11:22:41.171 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:22:44.180 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.Reserve (3008 ms) 2024-09-14T11:22:44.180 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:22:47.212 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3033 ms) 2024-09-14T11:22:47.213 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:22:50.232 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.Commit (3020 ms) 2024-09-14T11:22:50.232 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:22:53.245 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.Stats (3013 ms) 2024-09-14T11:22:53.246 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:22:57.268 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4023 ms) 2024-09-14T11:22:57.268 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:23:00.294 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.Abort (3026 ms) 2024-09-14T11:23:00.295 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:23:03.313 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.ReserveError (3018 ms) 2024-09-14T11:23:03.313 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:23:06.333 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.CommitError (3021 ms) 2024-09-14T11:23:06.334 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:23:09.366 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.AbortError (3033 ms) 2024-09-14T11:23:09.366 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:23:12.383 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3016 ms) 2024-09-14T11:23:12.383 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:23:15.399 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3016 ms) 2024-09-14T11:23:15.399 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:23:18.427 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3028 ms) 2024-09-14T11:23:18.428 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:23:21.444 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3017 ms) 2024-09-14T11:23:21.444 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:23:24.466 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3022 ms) 2024-09-14T11:23:24.466 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:23:27.479 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3014 ms) 2024-09-14T11:23:27.480 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:23:30.496 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.Cleanup (3017 ms) 2024-09-14T11:23:30.497 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:23:41.533 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11036 ms) 2024-09-14T11:23:41.533 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:23:44.556 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3023 ms) 2024-09-14T11:23:44.556 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:23:57.593 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13037 ms) 2024-09-14T11:23:57.593 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:24:01.611 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4018 ms) 2024-09-14T11:24:01.611 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:24:07.646 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6036 ms) 2024-09-14T11:24:07.647 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:24:12.996 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5349 ms) 2024-09-14T11:24:12.997 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from TestCls2PCQueue (97770 ms total) 2024-09-14T11:24:12.997 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:24:12.997 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:12.997 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 24 tests from 1 test suite ran. (97770 ms total) 2024-09-14T11:24:12.997 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 24 tests. 2024-09-14T11:24:13.001 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:24:13.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:24:13.045 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:24:13.046 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:24:13.046 DEBUG:teuthology.orchestra.run.smithi007:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:24:13.141 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:13.141 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:13.141 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:24:13.141 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:15.013 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:24:15.013 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:24:15.036 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsAccount.add (23 ms) 2024-09-14T11:24:15.036 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:24:15.041 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-14T11:24:15.041 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:24:15.048 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-14T11:24:15.048 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:24:15.069 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] ClsAccount.list (20 ms) 2024-09-14T11:24:15.069 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 4 tests from ClsAccount (56 ms total) 2024-09-14T11:24:15.069 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:24:15.069 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:16.017 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 4 tests from 1 test suite ran. (2876 ms total) 2024-09-14T11:24:16.017 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 4 tests. 2024-09-14T11:24:16.020 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:24:16.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:24:16.066 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:24:16.067 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:24:16.067 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:24:16.123 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:16.123 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:16.124 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:24:16.124 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:18.031 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:24:18.032 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:24:18.047 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] rgw_gc_log.init_existing_queue (15 ms) 2024-09-14T11:24:18.047 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:24:18.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-14T11:24:18.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:24:18.053 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-14T11:24:18.053 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:24:18.055 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T11:24:18.055 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:24:18.058 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-14T11:24:18.059 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:24:18.060 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-14T11:24:18.061 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 6 tests from rgw_gc_log (29 ms total) 2024-09-14T11:24:18.061 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:24:18.061 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:19.034 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 6 tests from 1 test suite ran. (2911 ms total) 2024-09-14T11:24:19.035 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 6 tests. 2024-09-14T11:24:19.038 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:24:19.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:24:19.083 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:24:19.085 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:24:19.085 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:Running main() from gmock_main.cc 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns= i= 2024-09-14T11:24:19.146 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns= i= 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns= i= 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.147 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.148 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.149 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.150 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.151 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.152 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.153 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns=ns i= 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns=ns i= 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.154 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns=ns i= 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.155 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.156 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.157 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.158 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.159 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns= i=v1 2024-09-14T11:24:19.160 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns= i=v1 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns= i=v1 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.161 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.162 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.163 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.164 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.165 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.166 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: _obj[v1] 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.167 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.168 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.169 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.170 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.171 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_obj", 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns= i= 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.172 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns= i= 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns= i= 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.173 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.174 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.175 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.176 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.177 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.178 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns=ns i= 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns=ns i= 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns=ns i= 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.179 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.180 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.181 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.182 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.183 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.184 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.185 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns= i=v1 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns= i=v1 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns= i=v1 2024-09-14T11:24:19.186 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.187 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.188 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.189 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.190 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.191 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.192 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:24:19.193 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout:parsed: obj[v1] 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "obj1": { 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.194 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "obj2": { 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.195 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.196 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3": { 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.197 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "obj3-2": { 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.198 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "obj", 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "v1", 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.199 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.200 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.201 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker_myobj", 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.202 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.203 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.204 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.205 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker_myobj", 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.206 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.207 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.208 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.209 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.210 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.211 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.212 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.213 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.214 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:24:19.215 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.216 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.217 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.218 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.219 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.220 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.221 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.222 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.223 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.224 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.225 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.225 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.225 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.225 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.225 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.225 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.226 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.226 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.226 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.226 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.226 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.226 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:24:19.227 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.227 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.227 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.227 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.227 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.227 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.227 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.228 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.229 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.230 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:24:19.231 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.232 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.233 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.234 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.235 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.236 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.237 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.238 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.239 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.240 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.241 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.242 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.243 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj", 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.244 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.245 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.246 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.247 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.248 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.249 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.250 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.251 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.252 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.252 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.252 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.252 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.252 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.252 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.253 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.254 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.255 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.256 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.257 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.258 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.259 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.260 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.261 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.262 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.263 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.264 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.265 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.266 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.267 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.268 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.269 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.270 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.271 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.272 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.273 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj_", 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.274 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.275 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.276 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.277 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.278 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj_", 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.279 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.280 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.281 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.282 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.283 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.284 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.285 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.286 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.287 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.288 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.289 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.290 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.291 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.292 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.293 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.294 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.295 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.296 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.297 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.298 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.299 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": "default-placement.data", 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "test", 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.300 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": "", 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": "" 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.301 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "obj": { 2024-09-14T11:24:19.302 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.303 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.304 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.305 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker_myobj", 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.306 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.307 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker_myobj", 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.308 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.309 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.310 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:24:19.311 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.312 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.313 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.314 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.315 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.316 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:24:19.317 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.318 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.319 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.320 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "myobj", 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:24:19.321 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj", 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.322 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.323 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj", 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.324 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.325 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.326 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.327 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.328 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.329 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.330 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.331 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.332 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj" 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.333 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.334 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.335 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.336 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.337 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj", 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.338 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj_", 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.339 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.340 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker___myobj_", 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.341 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.342 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.343 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:24:19.344 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.345 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "", 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.346 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.347 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.348 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "marker__myobj_" 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.349 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "" 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj": { 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:24:19.350 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj": { 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.351 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "raw_obj2": { 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "pool": ".data-pool", 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: "loc": "" 2024-09-14T11:24:19.352 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "new_obj2": { 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket": { 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "ebtest", 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "marker": "marker", 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_id": "bucket-id", 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "tenant": "", 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "explicit_placement": { 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "data_pool": ".data-pool", 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "data_extra_pool": "", 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "index_pool": ".index-pool" 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.353 INFO:tasks.workunit.client.0.smithi007.stdout: "key": { 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout: "name": "_myobj_", 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout: "instance": "inst", 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout: "ns": "ns" 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 4 tests from TestRGWObj (0 ms total) 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 4 tests from 1 test suite ran. (0 ms total) 2024-09-14T11:24:19.354 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 4 tests. 2024-09-14T11:24:19.355 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:24:19.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:24:19.397 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:24:19.398 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:24:19.398 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:24:19.517 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:19.517 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:19.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.566+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.567+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.567+0000 7f059f11f800 20 realm 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.567+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.568+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.568+0000 7f059f11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.568+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.568+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.568+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.569+0000 7f059f11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:19.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.569+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.570+0000 7f059f11f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:19.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.570+0000 7f059f11f800 20 searching for the correct realm 2024-09-14T11:24:19.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.578+0000 7f059b6aa640 0 -- 172.21.15.7:0/1841808215 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0590035060 msgr2=0x7f0590067810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:19.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.584+0000 7f059a6a8640 0 -- 172.21.15.7:0/1841808215 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f058c057b60 msgr2=0x7f058c009aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:19.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.791+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:19.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 20 zone default found 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 4 Realm: () 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 20 zonegroup default 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.792+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.793+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.793+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.793+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.793+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.793+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.793+0000 7f059f11f800 20 started sync module instance, tier type = 2024-09-14T11:24:19.794 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.793+0000 7f059f11f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.804+0000 7f059f11f800 20 add_watcher() i=0 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.804+0000 7f059f11f800 20 add_watcher() i=1 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.804+0000 7f059f11f800 20 add_watcher() i=2 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.804+0000 7f059f11f800 20 add_watcher() i=3 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.804+0000 7f059f11f800 20 add_watcher() i=4 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.804+0000 7f059f11f800 20 add_watcher() i=5 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.804+0000 7f059f11f800 20 add_watcher() i=6 2024-09-14T11:24:19.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.805+0000 7f059f11f800 20 add_watcher() i=7 2024-09-14T11:24:19.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.805+0000 7f059f11f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:19.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.807+0000 7f04517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:19.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.807+0000 7f059f11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:19.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.807+0000 7f059f11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:19.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.807+0000 7f059f11f800 5 note: GC not initialized 2024-09-14T11:24:19.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f03cbfff640 20 reqs_thread_entry: start 2024-09-14T11:24:19.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:19.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 20 Filter name: none 2024-09-14T11:24:19.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f03c9ffb640 20 reqs_thread_entry: start 2024-09-14T11:24:19.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:24:19.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:24:19.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:24:19.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.808+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 10 cache get: name=default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= : miss 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 10 cache put: name=default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= info.flags=0x0 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 10 adding default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= to cache LRU end 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 10 cache get: name=default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= : hit (negative entry) 2024-09-14T11:24:19.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.809+0000 7f059f11f800 10 cache get: name=default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= : hit (negative entry) 2024-09-14T11:24:19.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.811+0000 7f059f11f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:24:19.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.811+0000 7f059f11f800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:24:19.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.811+0000 7f059f11f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:24:19.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.811+0000 7f047dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889410 cookie 94678900711504 notifier 5309 bl.length()=697 2024-09-14T11:24:19.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.811+0000 7f047dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:24:19.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.811+0000 7f047dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:24:19.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.813+0000 7f059f11f800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:24:19.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.813+0000 7f059f11f800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:24:19.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.813+0000 7f059f11f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:24:19.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.814+0000 7f047dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889408 cookie 94678900701632 notifier 5309 bl.length()=194 2024-09-14T11:24:19.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.814+0000 7f047dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:24:19.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.814+0000 7f047dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:24:19.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.815+0000 7f059f11f800 10 cache put: name=default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= info.flags=0x7 2024-09-14T11:24:19.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.815+0000 7f059f11f800 10 moving default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= to cache LRU end 2024-09-14T11:24:19.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.815+0000 7f059f11f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:52vwUl/IixxxE4ox54ed/S9T8Qo=, ofs0, ns] 2024-09-14T11:24:19.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.816+0000 7f047e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889409 cookie 94678900701632 notifier 5309 bl.length()=203 2024-09-14T11:24:19.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.816+0000 7f047e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= info.flags=0x7 2024-09-14T11:24:19.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.816+0000 7f047e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+52vwUl/IixxxE4ox54ed/S9T8Qo= to cache LRU end 2024-09-14T11:24:19.815 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:24:19.815 INFO:tasks.workunit.client.0.smithi007.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:24:19.815 INFO:tasks.workunit.client.0.smithi007.stdout: "display_name": "librgw test user", 2024-09-14T11:24:19.815 INFO:tasks.workunit.client.0.smithi007.stdout: "email": "librgw@example.com", 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "suspended": 0, 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "subusers": [], 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "keys": [ 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: { 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "access_key": "52vwUl/IixxxE4ox54ed/S9T8Qo=", 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "secret_key": "doBLWqqhB0BKluJx3Nh9Qq7Xj3vDgz/qvHdPhpjLQKfGrvzsw5QXKA==", 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "active": true, 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "create_date": "2024-09-14T11:24:19.810928Z" 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "swift_keys": [], 2024-09-14T11:24:19.816 INFO:tasks.workunit.client.0.smithi007.stdout: "caps": [], 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "default_placement": "", 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "placement_tags": [], 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_quota": { 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "enabled": false, 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size": -1, 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "max_objects": -1 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "user_quota": { 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "enabled": false, 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:24:19.817 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size": -1, 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "max_objects": -1 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "rgw", 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "account_id": "", 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "path": "/", 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "create_date": "2024-09-14T11:24:19.810916Z", 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: "group_ids": [] 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:24:19.818 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:24:19.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.817+0000 7f04517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:19.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.820+0000 7f059f11f800 20 remove_watcher() i=0 2024-09-14T11:24:19.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.820+0000 7f059f11f800 2 removed watcher, disabling cache 2024-09-14T11:24:19.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.821+0000 7f059f11f800 20 remove_watcher() i=1 2024-09-14T11:24:19.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.822+0000 7f059f11f800 20 remove_watcher() i=2 2024-09-14T11:24:19.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.823+0000 7f059f11f800 20 remove_watcher() i=3 2024-09-14T11:24:19.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.824+0000 7f059f11f800 20 remove_watcher() i=4 2024-09-14T11:24:19.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.825+0000 7f059f11f800 20 remove_watcher() i=5 2024-09-14T11:24:19.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.826+0000 7f059f11f800 20 remove_watcher() i=6 2024-09-14T11:24:19.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:19.827+0000 7f059f11f800 20 remove_watcher() i=7 2024-09-14T11:24:19.837 INFO:tasks.workunit.client.0.smithi007.stdout:phase 1.1 2024-09-14T11:24:19.859 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:24:19.859 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:19.859 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:24:19.859 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:19.870 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:19.870 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:20.455 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (596 ms) 2024-09-14T11:24:20.455 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:24:20.456 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:24:20.456 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:20.456 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:24:20.456 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:24:20.465 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:24:20.469 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/f1 2024-09-14T11:24:20.471 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/f2 2024-09-14T11:24:20.475 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:24:20.478 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:24:20.481 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:24:20.483 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:24:20.487 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:24:20.489 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:24:20.491 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:24:20.494 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:24:20.497 INFO:tasks.workunit.client.0.smithi007.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:24:20.500 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETUP_HIER1 (43 ms) 2024-09-14T11:24:20.500 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:24:20.597 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETUP_DIRS1 (98 ms) 2024-09-14T11:24:20.597 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:24:20.597 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:24:20.598 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:24:20.614 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (17 ms) 2024-09-14T11:24:20.615 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:24:20.661 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (47 ms) 2024-09-14T11:24:20.662 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:24:20.662 INFO:tasks.workunit.client.0.smithi007.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:24:20.668 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-14T11:24:20.668 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:24:20.668 INFO:tasks.workunit.client.0.smithi007.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:24:20.674 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-14T11:24:20.674 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:24:20.674 INFO:tasks.workunit.client.0.smithi007.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:24:20.674 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:24:20.675 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:24:20.676 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:24:20.676 INFO:tasks.workunit.client.0.smithi007.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:24:20.676 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:24:20.676 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:24:20.676 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:24:20.677 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:24:20.677 INFO:tasks.workunit.client.0.smithi007.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:24:20.677 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:24:20.677 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:24:20.678 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:24:20.679 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:24:20.679 INFO:tasks.workunit.client.0.smithi007.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:24:20.679 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:24:20.679 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:24:20.680 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:24:20.681 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:24:20.681 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-14T11:24:20.681 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:24:20.861 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:24:20.862 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:24:20.863 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:24:20.863 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:24:20.863 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (1 ms) 2024-09-14T11:24:20.863 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:24:20.869 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:24:20.869 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:24:20.873 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:24:20.875 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:24:20.878 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:24:20.878 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:24:20.879 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:24:20.880 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:24:20.880 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:24:20.880 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:24:20.881 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:24:20.883 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:24:20.883 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:24:20.883 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.HIER1 (22 ms) 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:20.884 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:20.885 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:20.885 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:20.885 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:20.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:20.884+0000 7fefff5278c0 -1 shutting down 2024-09-14T11:24:20.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:20.885+0000 7feed7427640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63917, si_uid : 1000, si_addr0x3e80000f9ad, si_status0 2024-09-14T11:24:50.871 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (29987 ms) 2024-09-14T11:24:50.871 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from LibRGW (31012 ms total) 2024-09-14T11:24:50.871 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:24:50.871 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:50.871 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 24 tests from 1 test suite ran. (31012 ms total) 2024-09-14T11:24:50.871 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 24 tests. 2024-09-14T11:24:50.878 INFO:tasks.workunit.client.0.smithi007.stdout:phase 1.2 2024-09-14T11:24:50.904 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:24:50.904 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:50.904 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:24:50.904 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:50.912 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:50.912 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:51.513 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (610 ms) 2024-09-14T11:24:51.513 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:24:51.515 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:24:51.516 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:24:51.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:24:51.518 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:51.518 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:51.518 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:51.518 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:51.518 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:51.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:51.516+0000 7f343cf1f8c0 -1 shutting down 2024-09-14T11:24:51.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:24:51.517+0000 7f3314dcf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64543, si_uid : 1000, si_addr0x3e80000fc1f, si_status0 2024-09-14T11:25:21.801 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (30286 ms) 2024-09-14T11:25:21.801 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from LibRGW (30897 ms total) 2024-09-14T11:25:21.801 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:25:21.801 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:21.801 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 24 tests from 1 test suite ran. (30897 ms total) 2024-09-14T11:25:21.801 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 24 tests. 2024-09-14T11:25:21.806 INFO:tasks.workunit.client.0.smithi007.stdout:phase 1.3 2024-09-14T11:25:21.832 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:25:21.832 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:21.832 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:25:21.832 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:21.843 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:21.843 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (811 ms) 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:25:22.649 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-14T11:25:22.649 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETUP_DIRS1 (59 ms) 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:22.710 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi007.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:25:22.713 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:25:22.713 INFO:tasks.workunit.client.0.smithi007.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:25:22.713 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:25:22.714 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:25:22.714 INFO:tasks.workunit.client.0.smithi007.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:25:22.716 INFO:tasks.workunit.client.0.smithi007.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:25:22.716 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-14T11:25:22.716 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:25:22.716 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:25:22.716 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:25:22.716 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:25:22.716 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:25:22.717 INFO:tasks.workunit.client.0.smithi007.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:25:22.718 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:25:22.718 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:25:22.723 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:25:22.724 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:25:22.727 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:25:22.729 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:25:22.732 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:25:22.732 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:25:22.733 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:25:22.733 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:25:22.734 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:25:22.734 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:25:22.735 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:25:22.737 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:25:22.737 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:25:22.737 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:25:22.737 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:25:22.737 INFO:tasks.workunit.client.0.smithi007.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:25:22.737 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:22.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:22.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:25:22.738+0000 7fbbeb1238c0 -1 shutting down 2024-09-14T11:25:22.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:25:22.739+0000 7fbac274c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65162, si_uid : 1000, si_addr0x3e80000fe8a, si_status0 2024-09-14T11:25:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (30242 ms) 2024-09-14T11:25:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 24 tests from LibRGW (31146 ms total) 2024-09-14T11:25:52.979 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:25:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 24 tests from 1 test suite ran. (31146 ms total) 2024-09-14T11:25:52.980 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 24 tests. 2024-09-14T11:25:52.985 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2.1 2024-09-14T11:25:53.011 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:25:53.012 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:53.012 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:25:53.012 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:53.021 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:53.021 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:53.618 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (607 ms) 2024-09-14T11:25:53.619 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:53.619 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:25:53.619 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:25:53.627 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T11:25:53.627 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:25:53.628 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:25:53.628 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:25:53.638 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave0 2024-09-14T11:25:53.646 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave1 2024-09-14T11:25:53.655 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave2 2024-09-14T11:25:53.666 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave3 2024-09-14T11:25:53.674 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave4 2024-09-14T11:25:53.682 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave5 2024-09-14T11:25:53.690 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave6 2024-09-14T11:25:53.698 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave7 2024-09-14T11:25:53.706 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave8 2024-09-14T11:25:53.715 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave9 2024-09-14T11:25:53.715 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (87 ms) 2024-09-14T11:25:53.715 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:25:53.983 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (269 ms) 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:25:53.984+0000 7f4261d0c8c0 -1 shutting down 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:25:53.986+0000 7f413ba4b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65788, si_uid : 1000, si_addr0x3e8000100fc, si_status0 2024-09-14T11:26:24.035 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (30052 ms) 2024-09-14T11:26:24.036 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 9 tests from LibRGW (31024 ms total) 2024-09-14T11:26:24.036 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:26:24.036 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:24.036 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 9 tests from 1 test suite ran. (31024 ms total) 2024-09-14T11:26:24.036 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 9 tests. 2024-09-14T11:26:24.042 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2.2 2024-09-14T11:26:24.068 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:26:24.068 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:24.068 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:26:24.069 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:24.078 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:24.078 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:24.685 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (617 ms) 2024-09-14T11:26:24.686 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:24.686 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:26:24.686 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:26:24.686 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:26:24.686 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:26:24.717 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET (31 ms) 2024-09-14T11:26:24.717 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:26:24.728 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave0 2024-09-14T11:26:24.736 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave1 2024-09-14T11:26:24.747 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave2 2024-09-14T11:26:24.757 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave3 2024-09-14T11:26:24.765 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave4 2024-09-14T11:26:24.773 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave5 2024-09-14T11:26:24.781 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave6 2024-09-14T11:26:24.788 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave7 2024-09-14T11:26:24.796 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave8 2024-09-14T11:26:24.804 INFO:tasks.workunit.client.0.smithi007.stdout:created: sorrydave9 2024-09-14T11:26:24.804 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (87 ms) 2024-09-14T11:26:24.804 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:26:25.073 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (269 ms) 2024-09-14T11:26:25.073 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:25.074 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:25.074 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:25.074 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:25.074 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:25.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:26:25.075+0000 7f5b563358c0 -1 shutting down 2024-09-14T11:26:25.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:26:25.076+0000 7f5a2e219640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66408, si_uid : 1000, si_addr0x3e800010368, si_status0 2024-09-14T11:26:55.066 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (29991 ms) 2024-09-14T11:26:55.066 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 9 tests from LibRGW (30996 ms total) 2024-09-14T11:26:55.066 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:26:55.066 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:55.066 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 9 tests from 1 test suite ran. (30996 ms total) 2024-09-14T11:26:55.066 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 9 tests. 2024-09-14T11:26:55.072 INFO:tasks.workunit.client.0.smithi007.stdout:phase 3.1 2024-09-14T11:26:55.407 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:26:55.408 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:55.408 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:26:55.408 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:55.417 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:55.417 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:55.801 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (394 ms) 2024-09-14T11:26:55.801 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:55.802 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:26:55.802 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:26:55.810 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T11:26:55.811 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:26:55.814 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:26:55.814 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:26:55.816 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:26:55.816 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:26:55.878 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LARGE1 (63 ms) 2024-09-14T11:26:55.879 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LARGE2 (41 ms) 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:26:55.919 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:55.920 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:55.920 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:55.920 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:55.920 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:55.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:26:55.920+0000 7f16d33628c0 -1 shutting down 2024-09-14T11:26:55.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:26:55.922+0000 7f15ab365640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67028, si_uid : 1000, si_addr0x3e8000105d4, si_status0 2024-09-14T11:27:25.996 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (30076 ms) 2024-09-14T11:27:25.997 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 13 tests from LibRGW (30588 ms total) 2024-09-14T11:27:25.997 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:27:25.997 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:25.997 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 13 tests from 1 test suite ran. (30588 ms total) 2024-09-14T11:27:25.997 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 13 tests. 2024-09-14T11:27:26.004 INFO:tasks.workunit.client.0.smithi007.stdout:phase 3.2 2024-09-14T11:27:26.334 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:27:26.334 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:26.334 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:27:26.334 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:26.344 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:26.344 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:26.932 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (597 ms) 2024-09-14T11:27:26.932 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:26.933 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:26.933 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:27:26.933 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:27:26.933 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:27:26.937 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T11:27:26.938 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:27:26.941 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:27:26.941 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:27:27.016 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LARGE1 (75 ms) 2024-09-14T11:27:27.016 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:27:27.016 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:27:27.016 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:27:27.017 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:27:27.017 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:27:27.022 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:27:27.022 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:27:27.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-14T11:27:27.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:27.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:27.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:27.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:27.050 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:27.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:27:27.052+0000 7fdaef6c18c0 -1 shutting down 2024-09-14T11:27:27.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:27:27.053+0000 7fd9c66d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67656, si_uid : 1000, si_addr0x3e800010848, si_status0 2024-09-14T11:27:57.016 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (29967 ms) 2024-09-14T11:27:57.016 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 13 tests from LibRGW (30682 ms total) 2024-09-14T11:27:57.017 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:27:57.017 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:57.017 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 13 tests from 1 test suite ran. (30682 ms total) 2024-09-14T11:27:57.017 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 13 tests. 2024-09-14T11:27:57.024 INFO:tasks.workunit.client.0.smithi007.stdout:phase 4.1 2024-09-14T11:27:57.053 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:27:57.053 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:57.053 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:27:57.053 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:27:57.053 INFO:tasks.workunit.client.0.smithi007.stdout:read i1: 64001 2024-09-14T11:27:57.053 INFO:tasks.workunit.client.0.smithi007.stdout:read s1: blunderbuss 2024-09-14T11:27:57.053 INFO:tasks.workunit.client.0.smithi007.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:27:57.054 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:57.064 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:57.065 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:57.667 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (614 ms) 2024-09-14T11:27:57.667 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:57.667 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:57.668 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:27:57.685 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-14T11:27:57.685 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:27:58.132 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_0 2024-09-14T11:27:58.132 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_1 2024-09-14T11:27:58.132 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_2 2024-09-14T11:27:58.132 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_3 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_4 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_5 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_6 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_7 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_8 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_9 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_10 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_11 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_12 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_13 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_14 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_15 2024-09-14T11:27:58.133 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_16 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_17 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_18 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_19 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_20 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_21 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_22 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_23 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_24 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_25 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_26 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_27 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_28 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_29 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_30 2024-09-14T11:27:58.134 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_31 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_32 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_33 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_34 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_35 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_36 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_37 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_38 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_39 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_40 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_41 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_42 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_43 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_44 2024-09-14T11:27:58.135 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_45 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_46 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_47 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_48 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_49 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_50 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_51 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_52 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_53 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_54 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_55 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_56 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_57 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_58 2024-09-14T11:27:58.136 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_59 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_60 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_61 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_62 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_63 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_64 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_65 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_66 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_67 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_68 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_69 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_70 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_71 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_72 2024-09-14T11:27:58.137 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_73 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_74 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_75 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_76 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_77 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_78 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_79 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_80 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_81 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_82 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_83 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_84 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_85 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_86 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_87 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_88 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_89 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_90 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_91 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_92 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_93 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_94 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_95 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_96 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_97 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_98 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:created: dmarker:f_99 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (446 ms) 2024-09-14T11:27:58.140 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:27:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:27:58.142 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:27:58.143 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:27:58.144 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:27:58.145 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:27:58.146 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:27:58.147 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:27:58.148 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:27:58.149 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:27:58.150 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:27:58.151 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:27:58.152 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:27:58.153 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:27:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:27:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:27:58.139+0000 7fe8fb1478c0 -1 shutting down 2024-09-14T11:27:58.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:27:58.140+0000 7fe7d4e84640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68275, si_uid : 1000, si_addr0x3e800010ab3, si_status0 2024-09-14T11:28:28.095 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (29957 ms) 2024-09-14T11:28:28.096 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 11 tests from LibRGW (31042 ms total) 2024-09-14T11:28:28.096 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:28:28.096 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:28:28.096 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 11 tests from 1 test suite ran. (31042 ms total) 2024-09-14T11:28:28.096 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 11 tests. 2024-09-14T11:28:28.102 INFO:tasks.workunit.client.0.smithi007.stdout:phase 4.2 2024-09-14T11:28:28.127 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:28:28.128 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:28:28.128 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:28:28.128 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:28:28.128 INFO:tasks.workunit.client.0.smithi007.stdout:read i1: 64001 2024-09-14T11:28:28.128 INFO:tasks.workunit.client.0.smithi007.stdout:read s1: blunderbuss 2024-09-14T11:28:28.128 INFO:tasks.workunit.client.0.smithi007.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:28:28.128 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:28:28.136 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:28.136 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:28.736 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (608 ms) 2024-09-14T11:28:28.736 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:28:28.736 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:28:28.736 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:28:28.745 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-14T11:28:28.745 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:28:28.746 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:28:28.746 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:28:28.746 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:28:28.746 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:28:28.748 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:28:28.748 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:28:28.748 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:28:28.748 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:28:28.748 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:28:28.749 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:28:28.750 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:28:28.751 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:28:28.752 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:28:28.753 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:28:28.754 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:28:28.755 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:28:28.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:28:28.750+0000 7effc3daf8c0 -1 shutting down 2024-09-14T11:28:28.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:28:28.752+0000 7efe9daee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68894, si_uid : 1000, si_addr0x3e800010d1e, si_status0 2024-09-14T11:28:59.088 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (30339 ms) 2024-09-14T11:28:59.088 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 11 tests from LibRGW (30960 ms total) 2024-09-14T11:28:59.088 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:28:59.088 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:28:59.088 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 11 tests from 1 test suite ran. (30960 ms total) 2024-09-14T11:28:59.088 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 11 tests. 2024-09-14T11:28:59.094 INFO:tasks.workunit.client.0.smithi007.stdout:phase 5.1 2024-09-14T11:28:59.130 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:28:59.130 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:28:59.130 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:28:59.130 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:28:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:59.738 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (608 ms) 2024-09-14T11:28:59.739 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:28:59.739 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:28:59.740 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:28:59.748 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-14T11:28:59.748 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:28:59.751 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:28:59.751 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:28:59.751 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:28:59.752 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:28:59.753 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:28:59.753 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:28:59.753 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:28:59.753 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:28:59.757 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-14T11:28:59.757 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:28:59.760 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-14T11:28:59.760 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:28:59.760 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:28:59.760 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:28:59.761 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:28:59.762 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:28:59.762 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:28:59.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:28:59.761+0000 7f1209f1f8c0 -1 shutting down 2024-09-14T11:28:59.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:28:59.762+0000 7f10e14c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69513, si_uid : 1000, si_addr0x3e800010f89, si_status0 2024-09-14T11:29:29.856 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (30096 ms) 2024-09-14T11:29:29.857 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 19 tests from LibRGW (30725 ms total) 2024-09-14T11:29:29.857 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:29:29.857 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:29:29.857 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 19 tests from 1 test suite ran. (30725 ms total) 2024-09-14T11:29:29.857 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 19 tests. 2024-09-14T11:29:29.862 INFO:tasks.workunit.client.0.smithi007.stdout:phase 5.2 2024-09-14T11:29:29.897 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:29:29.897 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:29:29.897 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:29:29.897 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:29:29.904 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:29.904 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:30.296 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-14T11:29:30.296 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:29:30.297 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:29:30.297 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:29:30.297 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:29:30.297 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:29:30.302 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:29:30.303 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:29:30.305 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-14T11:29:30.305 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:29:30.333 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-14T11:29:30.333 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:29:30.333 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:29:30.333 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:29:30.333 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:29:30.333 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:29:30.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:29:30.335+0000 7f15da71f8c0 -1 shutting down 2024-09-14T11:29:30.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:29:30.337+0000 7f14b1cb2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70134, si_uid : 1000, si_addr0x3e8000111f6, si_status0 2024-09-14T11:30:00.486 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (30152 ms) 2024-09-14T11:30:00.486 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 19 tests from LibRGW (30589 ms total) 2024-09-14T11:30:00.486 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:30:00.486 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:30:00.486 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 19 tests from 1 test suite ran. (30589 ms total) 2024-09-14T11:30:00.486 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 19 tests. 2024-09-14T11:30:00.492 INFO:tasks.workunit.client.0.smithi007.stdout:phase 6.1 2024-09-14T11:30:00.518 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:30:00.519 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2024-09-14T11:30:00.519 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:30:00.519 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:30:00.526 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:00.526 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:01.126 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.INIT (608 ms) 2024-09-14T11:30:01.126 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:30:01.127 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:30:01.127 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:30:01.147 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CREATE_BUCKETS (20 ms) 2024-09-14T11:30:01.147 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:30:01.154 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-14T11:30:01.154 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:30:01.170 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.TOPDIR_RENAME (16 ms) 2024-09-14T11:30:01.170 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:30:01.189 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SUBDIR_RENAME (19 ms) 2024-09-14T11:30:01.189 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:30:01.206 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (18 ms) 2024-09-14T11:30:01.206 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:30:01.207 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:30:01.207 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:30:01.207 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:30:01.207 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:30:01.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:01.208+0000 7fa1b9d248c0 -1 shutting down 2024-09-14T11:30:01.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:01.209+0000 7fa091d24640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70753, si_uid : 1000, si_addr0x3e800011461, si_status0 2024-09-14T11:30:31.206 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] LibRGW.SHUTDOWN (29999 ms) 2024-09-14T11:30:31.206 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 10 tests from LibRGW (30687 ms total) 2024-09-14T11:30:31.206 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:30:31.206 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment tear-down 2024-09-14T11:30:31.206 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] 10 tests from 1 test suite ran. (30687 ms total) 2024-09-14T11:30:31.206 INFO:tasks.workunit.client.0.smithi007.stdout:[ PASSED ] 10 tests. 2024-09-14T11:30:31.213 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:30:31.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:30:31.260 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:30:31.262 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:30:31.262 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:30:31.298 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -z ']' 2024-09-14T11:30:31.298 INFO:tasks.workunit.client.0.smithi007.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:30:31.298 INFO:tasks.workunit.client.0.smithi007.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:30:31.298 INFO:tasks.workunit.client.0.smithi007.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:30:31.298 INFO:tasks.workunit.client.0.smithi007.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:30:31.299 INFO:tasks.workunit.client.0.smithi007.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:30:31.336 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:31.336 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:31.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.380+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.382+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.382+0000 7f6322e0f800 20 realm 2024-09-14T11:30:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.382+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.382+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.382+0000 7f6322e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.382+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.383+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.383+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.384+0000 7f6322e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:31.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.384+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.384+0000 7f6322e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:31.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.384+0000 7f6322e0f800 20 searching for the correct realm 2024-09-14T11:30:31.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.387+0000 7f63210fa640 0 -- 172.21.15.7:0/2060903352 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f631400b040 msgr2=0x7f6314042410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:31.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.391+0000 7f63200f8640 0 -- 172.21.15.7:0/2060903352 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f631009b040 msgr2=0x7f631007d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:31.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:30:31.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:31.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:31.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:30:31.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:31.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:31.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.598+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:31.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 zone default found 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 4 Realm: () 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 zonegroup default 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.599+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.600+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.600+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.600+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.600+0000 7f6322e0f800 20 started sync module instance, tier type = 2024-09-14T11:30:31.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.600+0000 7f6322e0f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:30:31.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.610+0000 7f6322e0f800 20 add_watcher() i=0 2024-09-14T11:30:31.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.610+0000 7f6322e0f800 20 add_watcher() i=1 2024-09-14T11:30:31.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.610+0000 7f6322e0f800 20 add_watcher() i=2 2024-09-14T11:30:31.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.610+0000 7f6322e0f800 20 add_watcher() i=3 2024-09-14T11:30:31.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.610+0000 7f6322e0f800 20 add_watcher() i=4 2024-09-14T11:30:31.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.610+0000 7f6322e0f800 20 add_watcher() i=5 2024-09-14T11:30:31.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.610+0000 7f6322e0f800 20 add_watcher() i=6 2024-09-14T11:30:31.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.611+0000 7f6322e0f800 20 add_watcher() i=7 2024-09-14T11:30:31.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.611+0000 7f6322e0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:31.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.613+0000 7f61d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.613+0000 7f6322e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.613+0000 7f6322e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.613+0000 7f6322e0f800 5 note: GC not initialized 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.613+0000 7f61d67e4640 20 reqs_thread_entry: start 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.613+0000 7f6322e0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 20 Filter name: none 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f61cffff640 20 reqs_thread_entry: start 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:30:31.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.614+0000 7f6322e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.615+0000 7f6322e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.615+0000 7f6322e0f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.615+0000 7f6322e0f800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.615+0000 7f6322e0f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:30:31.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.615+0000 7f6322e0f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:30:31.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.616+0000 7f6322e0f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:30:31.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.616+0000 7f6322e0f800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:30:31.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.616+0000 7f6322e0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:30:31.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.616+0000 7f61f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889415 cookie 94802522157904 notifier 5748 bl.length()=677 2024-09-14T11:30:31.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.616+0000 7f61f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:30:31.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.616+0000 7f61f7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:30:31.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.618+0000 7f6322e0f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:30:31.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.618+0000 7f6322e0f800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:30:31.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.618+0000 7f6322e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:30:31.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.618+0000 7f61f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889416 cookie 94802522150160 notifier 5748 bl.length()=187 2024-09-14T11:30:31.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.618+0000 7f61f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:30:31.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.618+0000 7f61f77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:30:31.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.620+0000 7f6322e0f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:30:31.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.620+0000 7f6322e0f800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:30:31.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.620+0000 7f6322e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:30:31.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.620+0000 7f61f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889417 cookie 94802522150160 notifier 5748 bl.length()=197 2024-09-14T11:30:31.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.620+0000 7f61f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:30:31.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.620+0000 7f61f77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "display_name": "maven test user", 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "email": "sigv4@example.com", 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "suspended": 0, 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "subusers": [], 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "keys": [ 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: { 2024-09-14T11:30:31.619 INFO:tasks.workunit.client.0.smithi007.stdout: "user": "ceph-test-maven", 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "active": true, 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "create_date": "2024-09-14T11:30:31.615542Z" 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "swift_keys": [], 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "caps": [], 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "default_placement": "", 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "placement_tags": [], 2024-09-14T11:30:31.620 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_quota": { 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "enabled": false, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size": -1, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "max_objects": -1 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "user_quota": { 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "enabled": false, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size": -1, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:30:31.621 INFO:tasks.workunit.client.0.smithi007.stdout: "max_objects": -1 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "rgw", 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "account_id": "", 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "path": "/", 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "create_date": "2024-09-14T11:30:31.615526Z", 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: "group_ids": [] 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:30:31.622 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:30:31.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.621+0000 7f61d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:31.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.624+0000 7f6322e0f800 20 remove_watcher() i=0 2024-09-14T11:30:31.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.624+0000 7f6322e0f800 2 removed watcher, disabling cache 2024-09-14T11:30:31.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.625+0000 7f6322e0f800 20 remove_watcher() i=1 2024-09-14T11:30:31.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.626+0000 7f6322e0f800 20 remove_watcher() i=2 2024-09-14T11:30:31.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.627+0000 7f6322e0f800 20 remove_watcher() i=3 2024-09-14T11:30:31.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.628+0000 7f6322e0f800 20 remove_watcher() i=4 2024-09-14T11:30:31.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.629+0000 7f6322e0f800 20 remove_watcher() i=5 2024-09-14T11:30:31.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.630+0000 7f6322e0f800 20 remove_watcher() i=6 2024-09-14T11:30:31.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:30:31.631+0000 7f6322e0f800 20 remove_watcher() i=7 2024-09-14T11:30:31.640 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -z ']' 2024-09-14T11:30:31.640 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:30:31.640 INFO:tasks.workunit.client.0.smithi007.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:30:31.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi007.front.sepia.ceph.com:443 2024-09-14T11:30:31.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi007.front.sepia.ceph.com:443 2024-09-14T11:30:31.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:30:31.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:30:31.641 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./mvnw clean package 2024-09-14T11:30:31.651 INFO:tasks.workunit.client.0.smithi007.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:30:33.110 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Scanning for projects... 2024-09-14T11:30:33.281 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:30:33.365 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 65 kB/s) 2024-09-14T11:30:33.379 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:30:33.419 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-14T11:30:33.427 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:30:33.446 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.8 MB/s) 2024-09-14T11:30:33.469 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:33.469 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:30:33.469 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:30:33.469 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] from pom.xml 2024-09-14T11:30:33.469 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:30:33.472 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:30:33.487 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-14T11:30:33.494 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:30:33.508 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 707 kB/s) 2024-09-14T11:30:33.511 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:30:33.526 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 3.0 MB/s) 2024-09-14T11:30:33.533 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:30:33.549 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-14T11:30:33.560 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:30:33.576 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.4 MB/s) 2024-09-14T11:30:33.583 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:30:33.597 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:30:33.600 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:30:33.615 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:30:33.617 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:30:33.632 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-14T11:30:33.636 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:30:33.651 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-14T11:30:33.656 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:30:33.672 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-14T11:30:33.678 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:30:33.693 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 701 kB/s) 2024-09-14T11:30:33.699 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:30:33.715 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15/66 kB Progress (1): 31/66 kB Progress (1): 48/66 kB Progress (1): 64/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-14T11:30:33.722 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:30:33.736 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-14T11:30:33.738 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:30:33.753 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-14T11:30:33.757 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:30:33.772 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T11:30:33.776 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:30:33.791 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-14T11:30:33.797 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:30:33.811 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 402 kB/s) 2024-09-14T11:30:33.814 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:30:33.830 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-14T11:30:33.837 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:30:33.851 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-14T11:30:33.854 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:30:33.869 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 707 kB/s) 2024-09-14T11:30:33.871 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:30:33.886 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-14T11:30:33.889 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:30:33.904 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-14T11:30:33.909 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:30:33.923 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:30:33.937 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:30:33.951 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 435 kB/s) 2024-09-14T11:30:33.954 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:30:33.968 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-14T11:30:33.972 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:30:33.987 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T11:30:33.994 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:30:34.009 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 286 kB/s) 2024-09-14T11:30:34.011 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:30:34.025 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 111 kB/s) 2024-09-14T11:30:34.028 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:30:34.042 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 159 kB/s) 2024-09-14T11:30:34.046 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:30:34.060 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-14T11:30:34.065 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:30:34.079 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 230 kB/s) 2024-09-14T11:30:34.083 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:30:34.097 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 783 kB/s) 2024-09-14T11:30:34.102 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:30:34.116 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-14T11:30:34.120 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:30:34.134 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 273 kB/s) 2024-09-14T11:30:34.138 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:30:34.152 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-14T11:30:34.156 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:30:34.170 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-14T11:30:34.173 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:30:34.186 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-14T11:30:34.189 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:30:34.202 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-14T11:30:34.205 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:30:34.219 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:30:34.224 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:30:34.239 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-14T11:30:34.242 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:30:34.257 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-14T11:30:34.260 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:30:34.274 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 529 kB/s) 2024-09-14T11:30:34.278 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:30:34.293 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 390 kB/s) 2024-09-14T11:30:34.297 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:30:34.311 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-14T11:30:34.316 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:30:34.331 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 314 kB/s) 2024-09-14T11:30:34.333 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:30:34.348 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:30:34.351 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:30:34.368 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 460 kB/s) 2024-09-14T11:30:34.369 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:30:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-14T11:30:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:30:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 212 kB/s) 2024-09-14T11:30:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:30:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-14T11:30:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:30:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 314 kB/s) 2024-09-14T11:30:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:30:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T11:30:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:30:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-14T11:30:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:30:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-14T11:30:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:30:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.5 MB/s) 2024-09-14T11:30:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:30:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-14T11:30:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:30:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T11:30:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:30:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-14T11:30:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:30:34.572 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-14T11:30:34.572 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:30:34.588 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 62/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T11:30:34.593 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:30:34.607 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-14T11:30:34.612 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:30:34.625 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:30:34.627 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:30:34.643 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-14T11:30:34.647 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:30:34.661 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-14T11:30:34.664 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:30:34.678 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.4 MB/s) 2024-09-14T11:30:34.681 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:30:34.697 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-14T11:30:34.703 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:30:34.716 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-14T11:30:34.718 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:30:34.732 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-14T11:30:34.735 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:30:34.749 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:30:34.752 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:30:34.766 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-14T11:30:34.768 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:30:34.781 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T11:30:34.783 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:30:34.797 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T11:30:34.799 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:30:34.813 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-14T11:30:34.815 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:30:34.829 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-14T11:30:34.831 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:30:34.845 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:30:34.847 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:30:34.861 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:30:34.864 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:30:34.878 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T11:30:34.881 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:30:34.895 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T11:30:34.898 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:30:34.911 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:30:34.913 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:30:34.927 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 233 kB/s) 2024-09-14T11:30:34.929 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:30:34.942 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-14T11:30:34.944 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:30:34.958 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 264 kB/s) 2024-09-14T11:30:34.960 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:30:34.973 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-14T11:30:34.990 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:30:35.073 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 40 MB/s) 2024-09-14T11:30:35.074 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:30:35.074 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:30:35.075 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:30:35.075 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:30:35.075 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:30:35.092 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15/35 kB Progress (1): 31/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.0 MB/s) 2024-09-14T11:30:35.092 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:30:35.113 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 411 kB/s) 2024-09-14T11:30:35.113 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:30:35.124 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/49 kB Progress (3): 1.4/16 kB | 1.4/49 kB | 1.4/98 kB Progress (3): 1.4/16 kB | 2.8/49 kB | 1.4/98 kB Progress (3): 2.8/16 kB | 2.8/49 kB | 1.4/98 kB Progress (4): 2.8/16 kB | 2.8/49 kB | 1.4/98 kB | 1.4/71 kB Progress (4): 4.1/16 kB | 2.8/49 kB | 1.4/98 kB | 1.4/71 kB Progress (4): 4.1/16 kB | 2.8/49 kB | 1.4/98 kB | 2.8/71 kB Progress (4): 4.1/16 kB | 4.1/49 kB | 1.4/98 kB | 2.8/71 kB Progress (4): 4.1/16 kB | 4.1/49 kB | 2.8/98 kB | 2.8/71 kB Progress (4): 4.1/16 kB | 5.5/49 kB | 2.8/98 kB | 2.8/71 kB Progress (4): 4.1/16 kB | 5.5/49 kB | 2.8/98 kB | 4.1/71 kB Progress (4): 5.5/16 kB | 5.5/49 kB | 2.8/98 kB | 4.1/71 kB Progress (4): 5.5/16 kB | 5.5/49 kB | 2.8/98 kB | 5.5/71 kB Progress (4): 5.5/16 kB | 6.9/49 kB | 2.8/98 kB | 5.5/71 kB Progress (4): 5.5/16 kB | 6.9/49 kB | 4.1/98 kB | 5.5/71 kB Progress (4): 5.5/16 kB | 6.9/49 kB | 4.1/98 kB | 6.9/71 kB Progress (4): 6.9/16 kB | 6.9/49 kB | 4.1/98 kB | 6.9/71 kB Progress (4): 6.9/16 kB | 6.9/49 kB | 5.5/98 kB | 6.9/71 kB Progress (4): 6.9/16 kB | 8.3/49 kB | 5.5/98 kB | 6.9/71 kB Progress (4): 6.9/16 kB | 8.3/49 kB | 6.9/98 kB | 6.9/71 kB Progress (4): 8.3/16 kB | 8.3/49 kB | 6.9/98 kB | 6.9/71 kB Progress (4): 8.3/16 kB | 8.3/49 kB | 6.9/98 kB | 8.3/71 kB Progress (4): 9.7/16 kB | 8.3/49 kB | 6.9/98 kB | 8.3/71 kB Progress (4): 9.7/16 kB | 8.3/49 kB | 8.3/98 kB | 8.3/71 kB Progress (4): 9.7/16 kB | 9.7/49 kB | 8.3/98 kB | 8.3/71 kB Progress (4): 9.7/16 kB | 9.7/49 kB | 9.7/98 kB | 8.3/71 kB Progress (4): 9.7/16 kB | 9.7/49 kB | 9.7/98 kB | 9.7/71 kB Progress (4): 11/16 kB | 9.7/49 kB | 9.7/98 kB | 9.7/71 kB Progress (4): 11/16 kB | 9.7/49 kB | 11/98 kB | 9.7/71 kB Progress (4): 11/16 kB | 11/49 kB | 11/98 kB | 9.7/71 kB Progress (4): 11/16 kB | 11/49 kB | 12/98 kB | 9.7/71 kB Progress (4): 12/16 kB | 11/49 kB | 12/98 kB | 9.7/71 kB Progress (4): 12/16 kB | 11/49 kB | 14/98 kB | 9.7/71 kB Progress (4): 12/16 kB | 11/49 kB | 14/98 kB | 11/71 kB Progress (4): 12/16 kB | 11/49 kB | 15/98 kB | 11/71 kB Progress (4): 14/16 kB | 11/49 kB | 15/98 kB | 11/71 kB Progress (4): 14/16 kB | 12/49 kB | 15/98 kB | 11/71 kB Progress (4): 15/16 kB | 12/49 kB | 15/98 kB | 11/71 kB Progress (4): 15/16 kB | 12/49 kB | 16/98 kB | 11/71 kB Progress (4): 15/16 kB | 12/49 kB | 16/98 kB | 12/71 kB Progress (4): 16 kB | 12/49 kB | 16/98 kB | 12/71 kB Progress (4): 16 kB | 14/49 kB | 16/98 kB | 12/71 kB Progress (4): 16 kB | 15/49 kB | 16/98 kB | 12/71 kB Progress (4): 16 kB | 15/49 kB | 16/98 kB | 14/71 kB Progress (4): 16 kB | 16/49 kB | 16/98 kB | 14/71 kB Progress (4): 16 kB | 16/49 kB | 16/98 kB | 15/71 kB Progress (4): 16 kB | 18/49 kB | 16/98 kB | 15/71 kB Progress (4): 16 kB | 18/49 kB | 16/98 kB | 16/71 kB Progress (4): 16 kB | 19/49 kB | 16/98 kB | 16/71 kB Progress (4): 16 kB | 19/49 kB | 16/98 kB | 18/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 329 kB/s) 2024-09-14T11:30:35.124 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 21/49 kB | 16/98 kB | 18/71 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:30:35.134 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 21/49 kB | 16/98 kB | 19/71 kB Progress (3): 22/49 kB | 16/98 kB | 19/71 kB Progress (3): 23/49 kB | 16/98 kB | 19/71 kB Progress (3): 23/49 kB | 16/98 kB | 21/71 kB Progress (3): 25/49 kB | 16/98 kB | 21/71 kB Progress (3): 25/49 kB | 16/98 kB | 22/71 kB Progress (3): 26/49 kB | 16/98 kB | 22/71 kB Progress (3): 26/49 kB | 16/98 kB | 23/71 kB Progress (3): 27/49 kB | 16/98 kB | 23/71 kB Progress (3): 27/49 kB | 16/98 kB | 25/71 kB Progress (3): 29/49 kB | 16/98 kB | 25/71 kB Progress (3): 29/49 kB | 16/98 kB | 26/71 kB Progress (3): 30/49 kB | 16/98 kB | 26/71 kB Progress (3): 30/49 kB | 16/98 kB | 27/71 kB Progress (3): 30/49 kB | 16/98 kB | 29/71 kB Progress (3): 30/49 kB | 16/98 kB | 30/71 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 16/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 33/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 49/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 65/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 82/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 98/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 115/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 131/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 147/782 kB Progress (4): 30/49 kB | 16/98 kB | 30/71 kB | 164/782 kB Progress (4): 32/49 kB | 16/98 kB | 30/71 kB | 164/782 kB Progress (4): 33/49 kB | 16/98 kB | 30/71 kB | 164/782 kB Progress (4): 33/49 kB | 16/98 kB | 32/71 kB | 164/782 kB Progress (4): 34/49 kB | 16/98 kB | 32/71 kB | 164/782 kB Progress (4): 34/49 kB | 16/98 kB | 32/71 kB | 180/782 kB Progress (4): 34/49 kB | 16/98 kB | 33/71 kB | 180/782 kB Progress (4): 34/49 kB | 33/98 kB | 33/71 kB | 180/782 kB Progress (4): 34/49 kB | 33/98 kB | 34/71 kB | 180/782 kB Progress (4): 36/49 kB | 33/98 kB | 34/71 kB | 180/782 kB Progress (4): 36/49 kB | 33/98 kB | 34/71 kB | 197/782 kB Progress (4): 36/49 kB | 33/98 kB | 36/71 kB | 197/782 kB Progress (4): 37/49 kB | 33/98 kB | 36/71 kB | 197/782 kB Progress (4): 37/49 kB | 33/98 kB | 37/71 kB | 197/782 kB Progress (4): 38/49 kB | 33/98 kB | 37/71 kB | 197/782 kB Progress (4): 38/49 kB | 33/98 kB | 38/71 kB | 197/782 kB Progress (4): 38/49 kB | 33/98 kB | 38/71 kB | 213/782 kB Progress (4): 40/49 kB | 33/98 kB | 38/71 kB | 213/782 kB Progress (4): 40/49 kB | 33/98 kB | 40/71 kB | 213/782 kB Progress (4): 41/49 kB | 33/98 kB | 40/71 kB | 213/782 kB Progress (4): 41/49 kB | 33/98 kB | 41/71 kB | 213/782 kB Progress (4): 43/49 kB | 33/98 kB | 41/71 kB | 213/782 kB Progress (4): 43/49 kB | 33/98 kB | 41/71 kB | 229/782 kB Progress (4): 43/49 kB | 33/98 kB | 43/71 kB | 229/782 kB Progress (4): 44/49 kB | 33/98 kB | 43/71 kB | 229/782 kB Progress (4): 44/49 kB | 33/98 kB | 44/71 kB | 229/782 kB Progress (4): 45/49 kB | 33/98 kB | 44/71 kB | 229/782 kB Progress (4): 45/49 kB | 33/98 kB | 45/71 kB | 229/782 kB Progress (4): 45/49 kB | 33/98 kB | 45/71 kB | 246/782 kB Progress (4): 45/49 kB | 33/98 kB | 45/71 kB | 262/782 kB Progress (4): 45/49 kB | 33/98 kB | 45/71 kB | 278/782 kB Progress (4): 47/49 kB | 33/98 kB | 45/71 kB | 278/782 kB Progress (4): 47/49 kB | 33/98 kB | 47/71 kB | 278/782 kB Progress (4): 48/49 kB | 33/98 kB | 47/71 kB | 278/782 kB Progress (4): 48/49 kB | 33/98 kB | 47/71 kB | 295/782 kB Progress (4): 48/49 kB | 33/98 kB | 48/71 kB | 295/782 kB Progress (4): 48/49 kB | 49/98 kB | 48/71 kB | 295/782 kB Progress (4): 49 kB | 49/98 kB | 48/71 kB | 295/782 kB Progress (4): 49 kB | 49/98 kB | 49/71 kB | 295/782 kB Progress (4): 49 kB | 49/98 kB | 49/71 kB | 311/782 kB Progress (4): 49 kB | 49/98 kB | 49/71 kB | 328/782 kB Progress (4): 49 kB | 49/98 kB | 49/71 kB | 344/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 834 kB/s) 2024-09-14T11:30:35.134 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:30:35.139 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 49/98 kB | 49/71 kB | 360/782 kB Progress (3): 49/98 kB | 49/71 kB | 377/782 kB Progress (3): 49/98 kB | 49/71 kB | 393/782 kB Progress (3): 49/98 kB | 49/71 kB | 410/782 kB Progress (3): 49/98 kB | 49/71 kB | 426/782 kB Progress (3): 49/98 kB | 49/71 kB | 442/782 kB Progress (3): 49/98 kB | 49/71 kB | 459/782 kB Progress (3): 49/98 kB | 49/71 kB | 475/782 kB Progress (4): 49/98 kB | 49/71 kB | 475/782 kB | 1.4/11 kB Progress (4): 49/98 kB | 49/71 kB | 491/782 kB | 1.4/11 kB Progress (4): 49/98 kB | 49/71 kB | 491/782 kB | 2.8/11 kB Progress (4): 49/98 kB | 49/71 kB | 491/782 kB | 4.1/11 kB Progress (4): 49/98 kB | 49/71 kB | 508/782 kB | 4.1/11 kB Progress (4): 49/98 kB | 49/71 kB | 508/782 kB | 5.5/11 kB Progress (4): 49/98 kB | 49/71 kB | 508/782 kB | 6.9/11 kB Progress (4): 49/98 kB | 49/71 kB | 524/782 kB | 6.9/11 kB Progress (4): 49/98 kB | 49/71 kB | 524/782 kB | 8.3/11 kB Progress (4): 49/98 kB | 49/71 kB | 524/782 kB | 9.7/11 kB Progress (4): 49/98 kB | 49/71 kB | 541/782 kB | 9.7/11 kB Progress (4): 49/98 kB | 49/71 kB | 557/782 kB | 9.7/11 kB Progress (4): 49/98 kB | 49/71 kB | 557/782 kB | 11/11 kB Progress (4): 49/98 kB | 49/71 kB | 557/782 kB | 11 kB Progress (4): 49/98 kB | 49/71 kB | 573/782 kB | 11 kB Progress (4): 49/98 kB | 49/71 kB | 590/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 178 kB/s) 2024-09-14T11:30:35.139 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 49/98 kB | 49/71 kB | 606/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:30:35.143 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 49/98 kB | 49/71 kB | 623/782 kB Progress (3): 49/98 kB | 49/71 kB | 639/782 kB Progress (3): 49/98 kB | 49/71 kB | 655/782 kB Progress (3): 49/98 kB | 49/71 kB | 672/782 kB Progress (3): 49/98 kB | 49/71 kB | 688/782 kB Progress (3): 66/98 kB | 49/71 kB | 688/782 kB Progress (3): 66/98 kB | 66/71 kB | 688/782 kB Progress (3): 66/98 kB | 66/71 kB | 704/782 kB Progress (3): 66/98 kB | 71 kB | 704/782 kB Progress (3): 66/98 kB | 71 kB | 721/782 kB Progress (3): 79/98 kB | 71 kB | 721/782 kB Progress (3): 79/98 kB | 71 kB | 737/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-14T11:30:35.143 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 79/98 kB | 754/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:30:35.144 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 79/98 kB | 770/782 kB Progress (2): 79/98 kB | 782 kB Progress (2): 95/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-09-14T11:30:35.145 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:30:35.145 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-14T11:30:35.146 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:30:35.158 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 1.4/30 kB Progress (2): 49/205 kB | 2.8/30 kB Progress (2): 49/205 kB | 4.1/30 kB Progress (2): 49/205 kB | 5.5/30 kB Progress (2): 49/205 kB | 6.9/30 kB Progress (2): 49/205 kB | 8.3/30 kB Progress (2): 49/205 kB | 9.7/30 kB Progress (2): 49/205 kB | 11/30 kB Progress (2): 49/205 kB | 12/30 kB Progress (2): 49/205 kB | 14/30 kB Progress (2): 49/205 kB | 15/30 kB Progress (2): 49/205 kB | 16/30 kB Progress (2): 49/205 kB | 18/30 kB Progress (2): 49/205 kB | 19/30 kB Progress (2): 49/205 kB | 21/30 kB Progress (2): 49/205 kB | 22/30 kB Progress (2): 49/205 kB | 23/30 kB Progress (2): 49/205 kB | 25/30 kB Progress (2): 49/205 kB | 26/30 kB Progress (3): 49/205 kB | 26/30 kB | 16/81 kB Progress (3): 49/205 kB | 27/30 kB | 16/81 kB Progress (3): 49/205 kB | 29/30 kB | 16/81 kB Progress (3): 49/205 kB | 30/30 kB | 16/81 kB Progress (3): 49/205 kB | 30 kB | 16/81 kB Progress (3): 49/205 kB | 30 kB | 33/81 kB Progress (3): 49/205 kB | 30 kB | 49/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 364 kB/s) 2024-09-14T11:30:35.158 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:30:35.159 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 49/205 kB | 66/81 kB Progress (2): 49/205 kB | 81 kB Progress (2): 66/205 kB | 81 kB Progress (3): 66/205 kB | 81 kB | 16/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 967 kB/s) 2024-09-14T11:30:35.159 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:30:35.160 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 81/205 kB | 16/798 kB Progress (3): 81/205 kB | 16/798 kB | 13 kB Progress (3): 81/205 kB | 33/798 kB | 13 kB Progress (3): 98/205 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 158 kB/s) 2024-09-14T11:30:35.160 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:30:35.171 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 98/205 kB | 49/798 kB Progress (2): 114/205 kB | 49/798 kB Progress (2): 114/205 kB | 66/798 kB Progress (2): 131/205 kB | 66/798 kB Progress (2): 131/205 kB | 82/798 kB Progress (2): 147/205 kB | 82/798 kB Progress (2): 163/205 kB | 82/798 kB Progress (2): 180/205 kB | 82/798 kB Progress (2): 196/205 kB | 82/798 kB Progress (2): 196/205 kB | 98/798 kB Progress (2): 205 kB | 98/798 kB Progress (2): 205 kB | 115/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-14T11:30:35.171 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:30:35.176 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 131/798 kB Progress (1): 147/798 kB Progress (2): 147/798 kB | 15/182 kB Progress (2): 164/798 kB | 15/182 kB Progress (3): 164/798 kB | 15/182 kB | 16/151 kB Progress (3): 180/798 kB | 15/182 kB | 16/151 kB Progress (3): 180/798 kB | 15/182 kB | 31/151 kB Progress (3): 180/798 kB | 31/182 kB | 31/151 kB Progress (3): 180/798 kB | 31/182 kB | 48/151 kB Progress (3): 197/798 kB | 31/182 kB | 48/151 kB Progress (3): 197/798 kB | 31/182 kB | 64/151 kB Progress (3): 213/798 kB | 31/182 kB | 64/151 kB Progress (3): 213/798 kB | 48/182 kB | 64/151 kB Progress (3): 213/798 kB | 48/182 kB | 81/151 kB Progress (4): 213/798 kB | 48/182 kB | 81/151 kB | 16/27 kB Progress (4): 213/798 kB | 48/182 kB | 97/151 kB | 16/27 kB Progress (4): 229/798 kB | 48/182 kB | 97/151 kB | 16/27 kB Progress (4): 229/798 kB | 48/182 kB | 97/151 kB | 27 kB Progress (4): 246/798 kB | 48/182 kB | 97/151 kB | 27 kB Progress (4): 246/798 kB | 48/182 kB | 111/151 kB | 27 kB Progress (4): 246/798 kB | 48/182 kB | 128/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 273 kB/s) 2024-09-14T11:30:35.176 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:30:35.177 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 246/798 kB | 48/182 kB | 144/151 kB Progress (3): 262/798 kB | 48/182 kB | 144/151 kB Progress (3): 262/798 kB | 48/182 kB | 151 kB Progress (3): 262/798 kB | 64/182 kB | 151 kB Progress (3): 279/798 kB | 64/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.5 MB/s) 2024-09-14T11:30:35.177 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:30:35.187 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 295/798 kB | 64/182 kB Progress (2): 311/798 kB | 64/182 kB Progress (2): 311/798 kB | 78/182 kB Progress (2): 328/798 kB | 78/182 kB Progress (2): 344/798 kB | 78/182 kB Progress (2): 360/798 kB | 78/182 kB Progress (2): 377/798 kB | 78/182 kB Progress (2): 377/798 kB | 94/182 kB Progress (2): 393/798 kB | 94/182 kB Progress (2): 410/798 kB | 94/182 kB Progress (2): 426/798 kB | 94/182 kB Progress (3): 426/798 kB | 94/182 kB | 16/30 kB Progress (3): 426/798 kB | 111/182 kB | 16/30 kB Progress (3): 426/798 kB | 111/182 kB | 30 kB Progress (3): 442/798 kB | 111/182 kB | 30 kB Progress (3): 459/798 kB | 111/182 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 273 kB/s) 2024-09-14T11:30:35.187 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 459/798 kB | 127/182 kB Progress (2): 475/798 kB | 127/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:30:35.190 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 492/798 kB | 127/182 kB Progress (2): 492/798 kB | 143/182 kB Progress (2): 508/798 kB | 143/182 kB Progress (2): 524/798 kB | 143/182 kB Progress (2): 541/798 kB | 143/182 kB Progress (2): 557/798 kB | 143/182 kB Progress (2): 557/798 kB | 160/182 kB Progress (2): 573/798 kB | 160/182 kB Progress (2): 590/798 kB | 160/182 kB Progress (2): 606/798 kB | 160/182 kB Progress (2): 623/798 kB | 160/182 kB Progress (2): 623/798 kB | 176/182 kB Progress (2): 639/798 kB | 176/182 kB Progress (2): 639/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-14T11:30:35.190 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:30:35.192 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 639/798 kB | 16/385 kB Progress (3): 639/798 kB | 16/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 114 kB/s) 2024-09-14T11:30:35.192 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:30:35.198 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 639/798 kB | 33/385 kB Progress (2): 639/798 kB | 49/385 kB Progress (2): 655/798 kB | 49/385 kB Progress (2): 672/798 kB | 49/385 kB Progress (2): 688/798 kB | 49/385 kB Progress (2): 688/798 kB | 65/385 kB Progress (2): 705/798 kB | 65/385 kB Progress (2): 721/798 kB | 65/385 kB Progress (2): 737/798 kB | 65/385 kB Progress (2): 754/798 kB | 65/385 kB Progress (2): 770/798 kB | 65/385 kB Progress (2): 786/798 kB | 65/385 kB Progress (2): 798 kB | 65/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.6 MB/s) 2024-09-14T11:30:35.198 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:30:35.203 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 82/385 kB Progress (2): 82/385 kB | 16/75 kB Progress (2): 82/385 kB | 33/75 kB Progress (2): 82/385 kB | 49/75 kB Progress (2): 98/385 kB | 49/75 kB Progress (2): 98/385 kB | 66/75 kB Progress (2): 98/385 kB | 75 kB Progress (2): 114/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 587 kB/s) 2024-09-14T11:30:35.203 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:30:35.214 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 131/385 kB Progress (2): 131/385 kB | 16/780 kB Progress (2): 131/385 kB | 33/780 kB Progress (2): 131/385 kB | 49/780 kB Progress (2): 147/385 kB | 49/780 kB Progress (2): 147/385 kB | 62/780 kB Progress (2): 147/385 kB | 78/780 kB Progress (2): 147/385 kB | 94/780 kB Progress (3): 147/385 kB | 94/780 kB | 16/329 kB Progress (3): 164/385 kB | 94/780 kB | 16/329 kB Progress (3): 164/385 kB | 94/780 kB | 33/329 kB Progress (3): 164/385 kB | 111/780 kB | 33/329 kB Progress (3): 164/385 kB | 111/780 kB | 49/329 kB Progress (3): 164/385 kB | 127/780 kB | 49/329 kB Progress (3): 180/385 kB | 127/780 kB | 49/329 kB Progress (3): 180/385 kB | 127/780 kB | 64/329 kB Progress (3): 180/385 kB | 144/780 kB | 64/329 kB Progress (3): 196/385 kB | 144/780 kB | 64/329 kB Progress (3): 196/385 kB | 144/780 kB | 81/329 kB Progress (3): 196/385 kB | 160/780 kB | 81/329 kB Progress (3): 196/385 kB | 160/780 kB | 97/329 kB Progress (3): 196/385 kB | 176/780 kB | 97/329 kB Progress (3): 196/385 kB | 176/780 kB | 113/329 kB Progress (3): 196/385 kB | 193/780 kB | 113/329 kB Progress (3): 213/385 kB | 193/780 kB | 113/329 kB Progress (3): 213/385 kB | 209/780 kB | 113/329 kB Progress (3): 213/385 kB | 209/780 kB | 130/329 kB Progress (3): 213/385 kB | 209/780 kB | 146/329 kB Progress (3): 213/385 kB | 225/780 kB | 146/329 kB Progress (3): 213/385 kB | 242/780 kB | 146/329 kB Progress (3): 213/385 kB | 242/780 kB | 162/329 kB Progress (3): 213/385 kB | 242/780 kB | 179/329 kB Progress (3): 213/385 kB | 242/780 kB | 195/329 kB Progress (3): 213/385 kB | 242/780 kB | 212/329 kB Progress (3): 213/385 kB | 242/780 kB | 228/329 kB Progress (3): 213/385 kB | 242/780 kB | 244/329 kB Progress (4): 213/385 kB | 242/780 kB | 244/329 kB | 16/501 kB Progress (4): 213/385 kB | 242/780 kB | 261/329 kB | 16/501 kB Progress (4): 213/385 kB | 242/780 kB | 261/329 kB | 33/501 kB Progress (4): 213/385 kB | 242/780 kB | 277/329 kB | 33/501 kB Progress (4): 213/385 kB | 242/780 kB | 277/329 kB | 49/501 kB Progress (4): 213/385 kB | 242/780 kB | 294/329 kB | 49/501 kB Progress (4): 213/385 kB | 242/780 kB | 294/329 kB | 63/501 kB Progress (4): 229/385 kB | 242/780 kB | 294/329 kB | 63/501 kB Progress (4): 229/385 kB | 242/780 kB | 310/329 kB | 63/501 kB Progress (4): 229/385 kB | 242/780 kB | 310/329 kB | 79/501 kB Progress (4): 229/385 kB | 242/780 kB | 326/329 kB | 79/501 kB Progress (4): 229/385 kB | 242/780 kB | 329 kB | 79/501 kB Progress (4): 229/385 kB | 242/780 kB | 329 kB | 96/501 kB Progress (4): 229/385 kB | 242/780 kB | 329 kB | 112/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.4 MB/s) 2024-09-14T11:30:35.214 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 229/385 kB | 242/780 kB | 128/501 kB Progress (3): 245/385 kB | 242/780 kB | 128/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:30:35.220 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 245/385 kB | 242/780 kB | 145/501 kB Progress (3): 262/385 kB | 242/780 kB | 145/501 kB Progress (3): 262/385 kB | 242/780 kB | 161/501 kB Progress (3): 262/385 kB | 242/780 kB | 177/501 kB Progress (3): 262/385 kB | 242/780 kB | 194/501 kB Progress (3): 262/385 kB | 242/780 kB | 210/501 kB Progress (3): 278/385 kB | 242/780 kB | 210/501 kB Progress (3): 278/385 kB | 242/780 kB | 227/501 kB Progress (3): 278/385 kB | 258/780 kB | 227/501 kB Progress (3): 295/385 kB | 258/780 kB | 227/501 kB Progress (3): 295/385 kB | 258/780 kB | 243/501 kB Progress (3): 295/385 kB | 275/780 kB | 243/501 kB Progress (3): 295/385 kB | 275/780 kB | 259/501 kB Progress (3): 295/385 kB | 291/780 kB | 259/501 kB Progress (3): 295/385 kB | 291/780 kB | 276/501 kB Progress (3): 311/385 kB | 291/780 kB | 276/501 kB Progress (3): 311/385 kB | 307/780 kB | 276/501 kB Progress (3): 311/385 kB | 307/780 kB | 292/501 kB Progress (3): 327/385 kB | 307/780 kB | 292/501 kB Progress (3): 327/385 kB | 324/780 kB | 292/501 kB Progress (3): 327/385 kB | 324/780 kB | 309/501 kB Progress (3): 344/385 kB | 324/780 kB | 309/501 kB Progress (3): 344/385 kB | 340/780 kB | 309/501 kB Progress (3): 344/385 kB | 340/780 kB | 325/501 kB Progress (3): 360/385 kB | 340/780 kB | 325/501 kB Progress (4): 360/385 kB | 340/780 kB | 325/501 kB | 16/354 kB Progress (4): 360/385 kB | 340/780 kB | 341/501 kB | 16/354 kB Progress (4): 360/385 kB | 356/780 kB | 341/501 kB | 16/354 kB Progress (4): 360/385 kB | 356/780 kB | 358/501 kB | 16/354 kB Progress (4): 360/385 kB | 356/780 kB | 358/501 kB | 33/354 kB Progress (4): 360/385 kB | 373/780 kB | 358/501 kB | 33/354 kB Progress (4): 360/385 kB | 373/780 kB | 374/501 kB | 33/354 kB Progress (4): 376/385 kB | 373/780 kB | 374/501 kB | 33/354 kB Progress (4): 376/385 kB | 389/780 kB | 374/501 kB | 33/354 kB Progress (4): 376/385 kB | 389/780 kB | 374/501 kB | 49/354 kB Progress (4): 385 kB | 389/780 kB | 374/501 kB | 49/354 kB Progress (4): 385 kB | 389/780 kB | 390/501 kB | 49/354 kB Progress (4): 385 kB | 406/780 kB | 390/501 kB | 49/354 kB Progress (4): 385 kB | 406/780 kB | 407/501 kB | 49/354 kB Progress (4): 385 kB | 406/780 kB | 407/501 kB | 66/354 kB Progress (4): 385 kB | 422/780 kB | 407/501 kB | 66/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.7 MB/s) 2024-09-14T11:30:35.220 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 422/780 kB | 423/501 kB | 66/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:30:35.221 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 422/780 kB | 423/501 kB | 78/354 kB Progress (3): 438/780 kB | 423/501 kB | 78/354 kB Progress (3): 438/780 kB | 440/501 kB | 78/354 kB Progress (3): 455/780 kB | 440/501 kB | 78/354 kB Progress (3): 455/780 kB | 440/501 kB | 94/354 kB Progress (3): 455/780 kB | 456/501 kB | 94/354 kB Progress (3): 471/780 kB | 456/501 kB | 94/354 kB Progress (3): 471/780 kB | 472/501 kB | 94/354 kB Progress (3): 471/780 kB | 472/501 kB | 111/354 kB Progress (3): 488/780 kB | 472/501 kB | 111/354 kB Progress (3): 488/780 kB | 489/501 kB | 111/354 kB Progress (3): 488/780 kB | 489/501 kB | 127/354 kB Progress (3): 504/780 kB | 489/501 kB | 127/354 kB Progress (3): 504/780 kB | 501 kB | 127/354 kB Progress (3): 520/780 kB | 501 kB | 127/354 kB Progress (3): 520/780 kB | 501 kB | 143/354 kB Progress (3): 537/780 kB | 501 kB | 143/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.5 MB/s) 2024-09-14T11:30:35.221 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:30:35.228 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 537/780 kB | 160/354 kB Progress (2): 553/780 kB | 160/354 kB Progress (2): 553/780 kB | 176/354 kB Progress (2): 569/780 kB | 176/354 kB Progress (2): 586/780 kB | 176/354 kB Progress (2): 586/780 kB | 193/354 kB Progress (2): 602/780 kB | 193/354 kB Progress (2): 602/780 kB | 209/354 kB Progress (2): 619/780 kB | 209/354 kB Progress (2): 635/780 kB | 209/354 kB Progress (2): 635/780 kB | 225/354 kB Progress (2): 651/780 kB | 225/354 kB Progress (2): 651/780 kB | 242/354 kB Progress (2): 668/780 kB | 242/354 kB Progress (2): 684/780 kB | 242/354 kB Progress (2): 684/780 kB | 258/354 kB Progress (2): 701/780 kB | 258/354 kB Progress (2): 717/780 kB | 258/354 kB Progress (2): 733/780 kB | 258/354 kB Progress (2): 750/780 kB | 258/354 kB Progress (2): 766/780 kB | 258/354 kB Progress (2): 780 kB | 258/354 kB Progress (3): 780 kB | 258/354 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.1 MB/s) 2024-09-14T11:30:35.228 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:30:35.229 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 258/354 kB | 33/41 kB Progress (2): 274/354 kB | 33/41 kB Progress (2): 274/354 kB | 41 kB Progress (2): 291/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 269 kB/s) 2024-09-14T11:30:35.229 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:30:35.231 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 307/354 kB Progress (1): 324/354 kB Progress (1): 340/354 kB Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.3 MB/s) 2024-09-14T11:30:35.231 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:30:35.233 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 41 kB/s) 2024-09-14T11:30:35.233 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:30:35.255 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15/586 kB Progress (1): 31/586 kB Progress (1): 48/586 kB Progress (1): 64/586 kB Progress (1): 81/586 kB Progress (1): 97/586 kB Progress (1): 113/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (1): 160/586 kB Progress (1): 176/586 kB Progress (1): 193/586 kB Progress (1): 209/586 kB Progress (1): 226/586 kB Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (1): 357/586 kB Progress (1): 373/586 kB Progress (1): 389/586 kB Progress (2): 389/586 kB | 6.8 kB Progress (3): 389/586 kB | 6.8 kB | 16/211 kB Progress (4): 389/586 kB | 6.8 kB | 16/211 kB | 14 kB Progress (5): 389/586 kB | 6.8 kB | 16/211 kB | 14 kB | 16/106 kB Progress (5): 406/586 kB | 6.8 kB | 16/211 kB | 14 kB | 16/106 kB Progress (5): 406/586 kB | 6.8 kB | 33/211 kB | 14 kB | 16/106 kB Progress (5): 406/586 kB | 6.8 kB | 33/211 kB | 14 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 39 kB/s) 2024-09-14T11:30:35.255 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:30:35.255 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (4): 422/586 kB | 33/211 kB | 14 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 80 kB/s) 2024-09-14T11:30:35.255 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 422/586 kB | 33/211 kB | 49/106 kB Progress (3): 422/586 kB | 49/211 kB | 49/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:30:35.257 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 439/586 kB | 49/211 kB | 49/106 kB Progress (3): 439/586 kB | 49/211 kB | 66/106 kB Progress (3): 439/586 kB | 65/211 kB | 66/106 kB Progress (3): 455/586 kB | 65/211 kB | 66/106 kB Progress (3): 455/586 kB | 65/211 kB | 81/106 kB Progress (3): 471/586 kB | 65/211 kB | 81/106 kB Progress (3): 471/586 kB | 81/211 kB | 81/106 kB Progress (3): 488/586 kB | 81/211 kB | 81/106 kB Progress (3): 488/586 kB | 98/211 kB | 81/106 kB Progress (3): 488/586 kB | 98/211 kB | 98/106 kB Progress (3): 488/586 kB | 114/211 kB | 98/106 kB Progress (3): 488/586 kB | 114/211 kB | 106 kB Progress (3): 504/586 kB | 114/211 kB | 106 kB Progress (3): 504/586 kB | 131/211 kB | 106 kB Progress (3): 521/586 kB | 131/211 kB | 106 kB Progress (3): 521/586 kB | 147/211 kB | 106 kB Progress (3): 521/586 kB | 163/211 kB | 106 kB Progress (3): 537/586 kB | 163/211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 590 kB/s) 2024-09-14T11:30:35.257 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:30:35.258 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 537/586 kB | 180/211 kB Progress (2): 553/586 kB | 180/211 kB Progress (2): 553/586 kB | 196/211 kB Progress (2): 570/586 kB | 196/211 kB Progress (2): 570/586 kB | 211 kB Progress (2): 586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T11:30:35.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-14T11:30:35.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:30:35.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:30:35.270 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (2): 33/245 kB | 15/205 kB Progress (2): 49/245 kB | 15/205 kB Progress (2): 49/245 kB | 31/205 kB Progress (2): 63/245 kB | 31/205 kB Progress (2): 63/245 kB | 48/205 kB Progress (2): 79/245 kB | 48/205 kB Progress (2): 79/245 kB | 64/205 kB Progress (2): 95/245 kB | 64/205 kB Progress (2): 95/245 kB | 77/205 kB Progress (2): 95/245 kB | 94/205 kB Progress (2): 112/245 kB | 94/205 kB Progress (2): 112/245 kB | 110/205 kB Progress (2): 128/245 kB | 110/205 kB Progress (2): 128/245 kB | 126/205 kB Progress (2): 145/245 kB | 126/205 kB Progress (3): 145/245 kB | 126/205 kB | 15 kB Progress (3): 145/245 kB | 143/205 kB | 15 kB Progress (3): 161/245 kB | 143/205 kB | 15 kB Progress (3): 161/245 kB | 159/205 kB | 15 kB Progress (3): 177/245 kB | 159/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 79 kB/s) 2024-09-14T11:30:35.271 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:30:35.272 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 177/245 kB | 175/205 kB Progress (2): 194/245 kB | 175/205 kB Progress (2): 194/245 kB | 192/205 kB Progress (2): 210/245 kB | 192/205 kB Progress (2): 210/245 kB | 205 kB Progress (2): 226/245 kB | 205 kB Progress (3): 226/245 kB | 205 kB | 16/16 kB Progress (3): 243/245 kB | 205 kB | 16/16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T11:30:35.272 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 245 kB | 16/16 kB Progress (2): 245 kB | 16 kB Progress (3): 245 kB | 16 kB | 6.4 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:30:35.273 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 84 kB/s) 2024-09-14T11:30:35.273 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-14T11:30:35.273 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:30:35.273 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-14T11:30:35.273 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:30:35.285 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 109 kB/s) 2024-09-14T11:30:35.286 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 116 kB/s) 2024-09-14T11:30:35.288 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/184 kB Progress (2): 16/184 kB | 16/17 kB Progress (2): 33/184 kB | 16/17 kB Progress (2): 33/184 kB | 17 kB Progress (2): 49/184 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 82 kB/s) 2024-09-14T11:30:35.290 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 66/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 863 kB/s) 2024-09-14T11:30:35.314 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:35.314 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:30:35.321 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:30:35.336 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-14T11:30:35.338 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:30:35.353 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T11:30:35.355 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:30:35.370 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T11:30:35.374 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:30:35.389 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:30:35.394 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:30:35.411 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15/153 kB Progress (1): 31/153 kB Progress (1): 48/153 kB Progress (1): 64/153 kB Progress (1): 80/153 kB Progress (1): 96/153 kB Progress (1): 112/153 kB Progress (1): 129/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-14T11:30:35.411 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:30:35.429 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-14T11:30:35.472 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:35.472 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:30:35.489 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:30:35.491 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:30:35.505 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:30:35.508 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:30:35.523 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-14T11:30:35.526 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:30:35.541 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-14T11:30:35.545 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:30:35.560 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:30:35.563 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:30:35.577 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-14T11:30:35.582 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:30:35.596 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-14T11:30:35.599 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:30:35.613 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:30:35.614 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:30:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-14T11:30:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:30:35.645 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-14T11:30:35.646 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:30:35.660 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-14T11:30:35.661 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:30:35.675 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-14T11:30:35.677 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:30:35.691 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-14T11:30:35.695 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:30:35.728 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-14T11:30:35.730 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:30:35.744 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:30:35.749 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:30:35.764 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-14T11:30:35.769 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:30:35.785 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 63/85 kB Progress (1): 79/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-14T11:30:35.785 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:30:35.785 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:30:35.785 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:30:35.785 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:30:35.785 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:30:35.800 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (3): 2.5 kB | 16/41 kB | 16/269 kB Progress (4): 2.5 kB | 16/41 kB | 16/269 kB | 8.5 kB Progress (4): 2.5 kB | 32/41 kB | 16/269 kB | 8.5 kB Progress (4): 2.5 kB | 32/41 kB | 33/269 kB | 8.5 kB Progress (5): 2.5 kB | 32/41 kB | 33/269 kB | 8.5 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-14T11:30:35.800 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (4): 41 kB | 33/269 kB | 8.5 kB | 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:30:35.800 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-14T11:30:35.800 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:30:35.800 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 41 kB | 49/269 kB | 16/55 kB Progress (3): 41 kB | 49/269 kB | 33/55 kB Progress (3): 41 kB | 66/269 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.9 MB/s) 2024-09-14T11:30:35.801 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 82/269 kB | 33/55 kB Progress (2): 82/269 kB | 49/55 kB Progress (2): 82/269 kB | 55 kB Progress (2): 98/269 kB | 55 kB Progress (2): 115/269 kB | 55 kB Progress (2): 131/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-14T11:30:35.803 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 15 MB/s) 2024-09-14T11:30:35.821 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (2): 33/587 kB | 16/327 kB Progress (2): 49/587 kB | 16/327 kB Progress (2): 49/587 kB | 33/327 kB Progress (2): 62/587 kB | 33/327 kB Progress (2): 62/587 kB | 49/327 kB Progress (2): 78/587 kB | 49/327 kB Progress (2): 78/587 kB | 65/327 kB Progress (2): 94/587 kB | 65/327 kB Progress (2): 94/587 kB | 81/327 kB Progress (2): 111/587 kB | 81/327 kB Progress (2): 111/587 kB | 98/327 kB Progress (2): 127/587 kB | 98/327 kB Progress (2): 127/587 kB | 114/327 kB Progress (2): 144/587 kB | 114/327 kB Progress (2): 144/587 kB | 130/327 kB Progress (2): 160/587 kB | 130/327 kB Progress (2): 160/587 kB | 147/327 kB Progress (2): 176/587 kB | 147/327 kB Progress (2): 176/587 kB | 163/327 kB Progress (2): 193/587 kB | 163/327 kB Progress (2): 193/587 kB | 179/327 kB Progress (2): 209/587 kB | 179/327 kB Progress (2): 209/587 kB | 196/327 kB Progress (2): 225/587 kB | 196/327 kB Progress (2): 225/587 kB | 212/327 kB Progress (2): 242/587 kB | 212/327 kB Progress (2): 242/587 kB | 229/327 kB Progress (2): 258/587 kB | 229/327 kB Progress (2): 258/587 kB | 245/327 kB Progress (2): 275/587 kB | 245/327 kB Progress (2): 275/587 kB | 261/327 kB Progress (2): 291/587 kB | 261/327 kB Progress (2): 291/587 kB | 278/327 kB Progress (2): 307/587 kB | 278/327 kB Progress (2): 307/587 kB | 294/327 kB Progress (2): 324/587 kB | 294/327 kB Progress (2): 324/587 kB | 311/327 kB Progress (2): 340/587 kB | 311/327 kB Progress (2): 340/587 kB | 327/327 kB Progress (2): 357/587 kB | 327/327 kB Progress (2): 357/587 kB | 327 kB Progress (2): 373/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-14T11:30:35.826 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 389/587 kB Progress (1): 406/587 kB Progress (1): 422/587 kB Progress (1): 438/587 kB Progress (1): 455/587 kB Progress (1): 471/587 kB Progress (1): 488/587 kB Progress (1): 504/587 kB Progress (1): 520/587 kB Progress (1): 537/587 kB Progress (1): 553/587 kB Progress (1): 570/587 kB Progress (1): 586/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-14T11:30:35.857 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:30:35.858 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:35.858 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:30:35.862 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:30:35.876 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:30:35.878 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:30:35.892 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T11:30:35.894 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:30:35.908 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:30:35.910 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:30:35.923 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 1.1 MB/s) 2024-09-14T11:30:35.926 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:30:35.940 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-14T11:30:35.941 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:30:35.955 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-14T11:30:35.957 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:30:35.971 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:30:35.974 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:30:35.988 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-14T11:30:35.990 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:30:36.004 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-14T11:30:36.007 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:30:36.021 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T11:30:36.023 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:30:36.037 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-14T11:30:36.040 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:30:36.054 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:30:36.057 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:30:36.071 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:30:36.073 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:30:36.088 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-14T11:30:36.090 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:30:36.104 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-14T11:30:36.106 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:30:36.121 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-14T11:30:36.124 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:30:36.137 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-14T11:30:36.141 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:30:36.155 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:30:36.158 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:30:36.172 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-14T11:30:36.173 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:30:36.187 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:30:36.189 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:30:36.204 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-14T11:30:36.206 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:30:36.221 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-14T11:30:36.222 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:30:36.237 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-14T11:30:36.242 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:30:36.257 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-14T11:30:36.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:30:36.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:30:36.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:30:36.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:30:36.258 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:30:36.275 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/27 kB Progress (3): 4.2 kB | 16/27 kB | 16/334 kB Progress (3): 4.2 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-14T11:30:36.275 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 27 kB | 16/334 kB | 16/55 kB Progress (4): 27 kB | 16/334 kB | 16/55 kB | 16/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:30:36.275 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (4): 27 kB | 33/334 kB | 16/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:30:36.275 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:30:36.275 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 33/334 kB | 32/55 kB | 16/122 kB Progress (3): 33/334 kB | 32/55 kB | 33/122 kB Progress (3): 49/334 kB | 32/55 kB | 33/122 kB Progress (3): 49/334 kB | 49/55 kB | 33/122 kB Progress (3): 64/334 kB | 49/55 kB | 33/122 kB Progress (3): 64/334 kB | 49/55 kB | 49/122 kB Progress (3): 64/334 kB | 55 kB | 49/122 kB Progress (3): 81/334 kB | 55 kB | 49/122 kB Progress (3): 81/334 kB | 55 kB | 66/122 kB Progress (3): 97/334 kB | 55 kB | 66/122 kB Progress (3): 97/334 kB | 55 kB | 82/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-14T11:30:36.275 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 113/334 kB | 82/122 kB Progress (2): 113/334 kB | 98/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:30:36.275 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 113/334 kB | 115/122 kB Progress (2): 130/334 kB | 115/122 kB Progress (2): 130/334 kB | 122 kB Progress (2): 146/334 kB | 122 kB Progress (2): 163/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-14T11:30:36.277 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 179/334 kB Progress (1): 195/334 kB Progress (1): 212/334 kB Progress (1): 228/334 kB Progress (1): 245/334 kB Progress (1): 261/334 kB Progress (1): 277/334 kB Progress (1): 294/334 kB Progress (1): 310/334 kB Progress (1): 326/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-14T11:30:36.286 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-14T11:30:36.287 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (2): 65/267 kB | 16/23 kB Progress (2): 80/267 kB | 16/23 kB Progress (2): 80/267 kB | 23 kB Progress (2): 96/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-14T11:30:36.290 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-14T11:30:36.342 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:30:36.343 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:30:37.043 INFO:tasks.workunit.client.0.smithi007.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:30:37.043 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:37.044 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:30:37.048 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:30:37.048 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:37.048 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:30:37.055 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:30:37.055 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:30:37.248 INFO:tasks.workunit.client.0.smithi007.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:30:37.248 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:37.248 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:30:37.252 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:30:37.267 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-14T11:30:37.270 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:30:37.285 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-14T11:30:37.288 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:30:37.303 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-14T11:30:37.306 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:30:37.320 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-14T11:30:37.324 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:30:37.338 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:30:37.342 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:30:37.356 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:30:37.359 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:30:37.373 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 136 kB/s) 2024-09-14T11:30:37.376 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:30:37.389 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-14T11:30:37.391 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:30:37.405 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-14T11:30:37.407 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:30:37.421 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 146 kB/s) 2024-09-14T11:30:37.423 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:30:37.437 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 446 kB/s) 2024-09-14T11:30:37.440 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:30:37.453 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:30:37.455 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:30:37.469 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-14T11:30:37.471 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:30:37.484 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-14T11:30:37.486 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:30:37.500 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:30:37.503 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:30:37.517 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:30:37.519 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:30:37.533 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-14T11:30:37.535 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:30:37.549 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 620 kB/s) 2024-09-14T11:30:37.551 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:30:37.565 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:30:37.568 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:30:37.582 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-14T11:30:37.585 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:30:37.598 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T11:30:37.599 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:30:37.613 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 236 kB/s) 2024-09-14T11:30:37.614 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:30:37.628 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.6 MB/s) 2024-09-14T11:30:37.629 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:30:37.643 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-14T11:30:37.645 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:30:37.660 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 904 kB/s) 2024-09-14T11:30:37.662 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:30:37.676 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 228 kB/s) 2024-09-14T11:30:37.677 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-14T11:30:37.692 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:30:37.705 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-14T11:30:37.707 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:30:37.721 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:30:37.723 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:30:37.737 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:30:37.740 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:30:37.754 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-14T11:30:37.757 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:30:37.772 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-14T11:30:37.774 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:30:37.789 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 906 kB/s) 2024-09-14T11:30:37.792 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:30:37.806 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-14T11:30:37.808 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:30:37.821 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 368 kB/s) 2024-09-14T11:30:37.823 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:30:37.838 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:30:37.839 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:30:37.854 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-14T11:30:37.856 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:30:37.870 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:30:37.872 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:30:37.886 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:30:37.888 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:30:37.903 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:30:37.904 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:30:37.918 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-14T11:30:37.920 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:30:37.934 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T11:30:37.936 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:30:37.950 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:30:37.952 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:30:37.966 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:30:37.969 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:30:37.982 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T11:30:37.984 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:30:37.998 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 267 kB/s) 2024-09-14T11:30:38.000 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:30:38.014 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:30:38.016 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:30:38.030 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-14T11:30:38.031 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:30:38.045 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-14T11:30:38.047 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:30:38.061 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 28 kB/s) 2024-09-14T11:30:38.062 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:30:38.075 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-14T11:30:38.077 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:30:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-14T11:30:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:30:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-14T11:30:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:30:38.120 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 562 kB/s) 2024-09-14T11:30:38.123 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:30:38.137 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T11:30:38.139 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:30:38.157 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 9.6/78 kB Progress (1): 26/78 kB Progress (1): 30/78 kB Progress (1): 47/78 kB Progress (1): 51/78 kB Progress (1): 67/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-14T11:30:38.160 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:30:38.174 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-14T11:30:38.177 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:30:38.191 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-14T11:30:38.193 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:30:38.206 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 329 kB/s) 2024-09-14T11:30:38.208 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:30:38.222 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-14T11:30:38.223 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:30:38.237 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T11:30:38.239 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-14T11:30:38.257 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:30:38.276 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-14T11:30:38.277 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:30:38.277 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:30:38.277 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:30:38.277 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:30:38.277 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:30:38.292 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 14 kB Progress (2): 32/171 kB | 14 kB Progress (2): 49/171 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-14T11:30:38.292 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 56/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:30:38.292 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 56/171 kB | 8.2 kB Progress (3): 56/171 kB | 8.2 kB | 16/118 kB Progress (3): 72/171 kB | 8.2 kB | 16/118 kB Progress (4): 72/171 kB | 8.2 kB | 16/118 kB | 4.1/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 545 kB/s) 2024-09-14T11:30:38.293 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 89/171 kB | 16/118 kB | 4.1/26 kB Progress (3): 89/171 kB | 33/118 kB | 4.1/26 kB Progress (3): 89/171 kB | 33/118 kB | 20/26 kB Progress (3): 89/171 kB | 33/118 kB | 26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:30:38.294 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 89/171 kB | 49/118 kB | 26 kB Progress (3): 105/171 kB | 49/118 kB | 26 kB Progress (3): 105/171 kB | 64/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-14T11:30:38.294 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:30:38.295 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 122/171 kB | 64/118 kB Progress (2): 122/171 kB | 80/118 kB Progress (2): 138/171 kB | 80/118 kB Progress (2): 138/171 kB | 97/118 kB Progress (2): 154/171 kB | 97/118 kB Progress (2): 154/171 kB | 113/118 kB Progress (2): 154/171 kB | 118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-14T11:30:38.295 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-14T11:30:38.295 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:30:38.295 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:30:38.308 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 62/146 kB Progress (2): 62/146 kB | 16/136 kB Progress (2): 79/146 kB | 16/136 kB Progress (2): 79/146 kB | 33/136 kB Progress (2): 95/146 kB | 33/136 kB Progress (2): 95/146 kB | 49/136 kB Progress (2): 112/146 kB | 49/136 kB Progress (2): 112/146 kB | 65/136 kB Progress (2): 128/146 kB | 65/136 kB Progress (3): 128/146 kB | 65/136 kB | 16/61 kB Progress (3): 128/146 kB | 81/136 kB | 16/61 kB Progress (3): 144/146 kB | 81/136 kB | 16/61 kB Progress (3): 146 kB | 81/136 kB | 16/61 kB Progress (3): 146 kB | 81/136 kB | 33/61 kB Progress (3): 146 kB | 98/136 kB | 33/61 kB Progress (3): 146 kB | 98/136 kB | 49/61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-14T11:30:38.308 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 114/136 kB | 49/61 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:30:38.308 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 114/136 kB | 61 kB Progress (2): 130/136 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-14T11:30:38.308 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 136 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:30:38.308 INFO:tasks.workunit.client.0.smithi007.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.4 MB/s) 2024-09-14T11:30:38.312 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/501 kB Progress (1): 33/501 kB Progress (1): 49/501 kB Progress (1): 65/501 kB Progress (1): 81/501 kB Progress (1): 97/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 179/501 kB Progress (2): 179/501 kB | 2.7/58 kB Progress (2): 196/501 kB | 2.7/58 kB Progress (2): 196/501 kB | 8.2/58 kB Progress (2): 196/501 kB | 16/58 kB Progress (2): 212/501 kB | 16/58 kB Progress (2): 212/501 kB | 27/58 kB Progress (2): 229/501 kB | 27/58 kB Progress (2): 229/501 kB | 41/58 kB Progress (2): 229/501 kB | 49/58 kB Progress (2): 245/501 kB | 49/58 kB Progress (2): 245/501 kB | 58 kB Progress (2): 261/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-14T11:30:38.316 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-14T11:30:38.322 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (2): 66/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 115/124 kB | 0/2.4 MB Progress (2): 115/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-14T11:30:38.364 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 28 MB/s) 2024-09-14T11:30:38.452 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:38.452 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:30:38.456 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:30:38.471 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-14T11:30:38.473 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:30:38.487 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:30:38.489 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:30:38.503 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-14T11:30:38.505 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:30:38.519 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 0.3/21 kB Progress (1): 17/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-14T11:30:38.522 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:30:38.536 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-14T11:30:38.539 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:30:38.554 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-14T11:30:38.556 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:30:38.570 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:30:38.573 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:30:38.587 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:30:38.590 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:30:38.603 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T11:30:38.607 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:30:38.624 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 855 kB/s) 2024-09-14T11:30:38.627 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:30:38.642 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-14T11:30:38.644 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:30:38.659 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 548 kB/s) 2024-09-14T11:30:38.662 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:30:38.676 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-14T11:30:38.683 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:30:38.698 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-14T11:30:38.699 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:30:38.699 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:30:38.699 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:30:38.699 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:30:38.699 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:30:38.715 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/79 kB Progress (2): 26 kB | 16/79 kB Progress (2): 26 kB | 32/79 kB Progress (2): 26 kB | 49/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-14T11:30:38.715 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 49/79 kB | 0/1.0 MB Progress (3): 49/79 kB | 0/1.0 MB | 16/211 kB Progress (3): 65/79 kB | 0/1.0 MB | 16/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:30:38.715 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 65/79 kB | 0/1.0 MB | 33/211 kB Progress (3): 79 kB | 0/1.0 MB | 33/211 kB Progress (4): 79 kB | 0/1.0 MB | 33/211 kB | 16/58 kB Progress (4): 79 kB | 0/1.0 MB | 33/211 kB | 16/58 kB Progress (4): 79 kB | 0/1.0 MB | 49/211 kB | 16/58 kB Progress (4): 79 kB | 0/1.0 MB | 49/211 kB | 33/58 kB Progress (4): 79 kB | 0/1.0 MB | 49/211 kB | 33/58 kB Progress (4): 79 kB | 0/1.0 MB | 49/211 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-14T11:30:38.715 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 0/1.0 MB | 66/211 kB | 49/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:30:38.716 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 0/1.0 MB | 66/211 kB | 58 kB Progress (3): 0.1/1.0 MB | 66/211 kB | 58 kB Progress (3): 0.1/1.0 MB | 82/211 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-14T11:30:38.718 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 0.1/1.0 MB | 82/211 kB Progress (2): 0.1/1.0 MB | 98/211 kB Progress (2): 0.1/1.0 MB | 115/211 kB Progress (2): 0.1/1.0 MB | 115/211 kB Progress (2): 0.1/1.0 MB | 131/211 kB Progress (2): 0.1/1.0 MB | 131/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.1/1.0 MB | 164/211 kB Progress (2): 0.1/1.0 MB | 164/211 kB Progress (2): 0.1/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 197/211 kB Progress (2): 0.2/1.0 MB | 197/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-14T11:30:38.728 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (2): 0.7/1.0 MB | 66/116 kB Progress (2): 0.7/1.0 MB | 82/116 kB Progress (2): 0.7/1.0 MB | 82/116 kB Progress (2): 0.7/1.0 MB | 98/116 kB Progress (2): 0.7/1.0 MB | 98/116 kB Progress (2): 0.7/1.0 MB | 115/116 kB Progress (2): 0.7/1.0 MB | 116 kB Progress (2): 0.7/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-14T11:30:38.734 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/267 kB Progress (2): 0.7/1.0 MB | 16/267 kB Progress (2): 0.7/1.0 MB | 33/267 kB Progress (2): 0.8/1.0 MB | 33/267 kB Progress (2): 0.8/1.0 MB | 49/267 kB Progress (2): 0.8/1.0 MB | 49/267 kB Progress (2): 0.8/1.0 MB | 66/267 kB Progress (2): 0.8/1.0 MB | 66/267 kB Progress (2): 0.8/1.0 MB | 82/267 kB Progress (2): 0.8/1.0 MB | 82/267 kB Progress (2): 0.8/1.0 MB | 98/267 kB Progress (2): 0.8/1.0 MB | 98/267 kB Progress (2): 0.8/1.0 MB | 115/267 kB Progress (2): 0.8/1.0 MB | 115/267 kB Progress (2): 0.8/1.0 MB | 131/267 kB Progress (2): 0.8/1.0 MB | 131/267 kB Progress (2): 0.8/1.0 MB | 147/267 kB Progress (2): 0.9/1.0 MB | 147/267 kB Progress (2): 0.9/1.0 MB | 164/267 kB Progress (2): 0.9/1.0 MB | 164/267 kB Progress (2): 0.9/1.0 MB | 180/267 kB Progress (2): 0.9/1.0 MB | 180/267 kB Progress (2): 0.9/1.0 MB | 197/267 kB Progress (2): 0.9/1.0 MB | 197/267 kB Progress (2): 0.9/1.0 MB | 213/267 kB Progress (2): 0.9/1.0 MB | 213/267 kB Progress (2): 0.9/1.0 MB | 229/267 kB Progress (2): 0.9/1.0 MB | 229/267 kB Progress (2): 0.9/1.0 MB | 246/267 kB Progress (2): 0.9/1.0 MB | 256/267 kB Progress (2): 1.0/1.0 MB | 256/267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-14T11:30:38.735 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 28 MB/s) 2024-09-14T11:30:38.917 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:30:38.943 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:30:38.944 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:30:38.944 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:30:38.945 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Total time: 5.853 s 2024-09-14T11:30:38.945 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Finished at: 2024-09-14T11:30:38Z 2024-09-14T11:30:38.945 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:30:38.969 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:30:38.979 INFO:tasks.workunit.client.0.smithi007.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:30:40.079 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Scanning for projects... 2024-09-14T11:30:40.158 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:40.158 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:30:40.158 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:30:40.158 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] from pom.xml 2024-09-14T11:30:40.158 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:30:40.401 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:40.401 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:30:40.490 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:30:40.491 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:40.491 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:30:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:30:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:30:40.585 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:30:40.586 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:40.586 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:30:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:30:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:30:40.772 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:30:40.967 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:30:41.158 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-14T11:30:41.167 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:30:41.184 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-14T11:30:41.190 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:30:41.206 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:30:41.210 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:30:41.226 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T11:30:41.229 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:30:41.245 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T11:30:41.247 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:30:41.265 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-14T11:30:41.268 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:30:41.284 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-14T11:30:41.290 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:30:41.310 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-14T11:30:41.312 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:30:41.312 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:30:41.313 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:30:41.313 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:30:41.314 INFO:tasks.workunit.client.0.smithi007.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:30:41.334 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 731 kB/s) 2024-09-14T11:30:41.372 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 1.4/103 kB Progress (2): 1.4/103 kB | 1.4/7.7 kB Progress (3): 1.4/103 kB | 1.4/7.7 kB | 1.4/189 kB Progress (3): 2.8/103 kB | 1.4/7.7 kB | 1.4/189 kB Progress (4): 2.8/103 kB | 1.4/7.7 kB | 1.4/189 kB | 1.4/169 kB Progress (4): 4.1/103 kB | 1.4/7.7 kB | 1.4/189 kB | 1.4/169 kB Progress (4): 4.1/103 kB | 1.4/7.7 kB | 2.8/189 kB | 1.4/169 kB Progress (4): 4.1/103 kB | 2.8/7.7 kB | 2.8/189 kB | 1.4/169 kB Progress (4): 4.1/103 kB | 2.8/7.7 kB | 4.1/189 kB | 1.4/169 kB Progress (4): 5.5/103 kB | 2.8/7.7 kB | 4.1/189 kB | 1.4/169 kB Progress (4): 5.5/103 kB | 2.8/7.7 kB | 4.1/189 kB | 2.8/169 kB Progress (4): 6.9/103 kB | 2.8/7.7 kB | 4.1/189 kB | 2.8/169 kB Progress (4): 6.9/103 kB | 2.8/7.7 kB | 5.5/189 kB | 2.8/169 kB Progress (4): 6.9/103 kB | 4.1/7.7 kB | 5.5/189 kB | 2.8/169 kB Progress (4): 6.9/103 kB | 4.1/7.7 kB | 6.9/189 kB | 2.8/169 kB Progress (4): 8.3/103 kB | 4.1/7.7 kB | 6.9/189 kB | 2.8/169 kB Progress (4): 8.3/103 kB | 4.1/7.7 kB | 6.9/189 kB | 4.1/169 kB Progress (4): 9.7/103 kB | 4.1/7.7 kB | 6.9/189 kB | 4.1/169 kB Progress (4): 9.7/103 kB | 4.1/7.7 kB | 8.3/189 kB | 4.1/169 kB Progress (4): 9.7/103 kB | 5.5/7.7 kB | 8.3/189 kB | 4.1/169 kB Progress (4): 9.7/103 kB | 5.5/7.7 kB | 9.7/189 kB | 4.1/169 kB Progress (4): 9.7/103 kB | 6.9/7.7 kB | 9.7/189 kB | 4.1/169 kB Progress (4): 11/103 kB | 6.9/7.7 kB | 9.7/189 kB | 4.1/169 kB Progress (4): 11/103 kB | 6.9/7.7 kB | 9.7/189 kB | 5.5/169 kB Progress (4): 12/103 kB | 6.9/7.7 kB | 9.7/189 kB | 5.5/169 kB Progress (4): 12/103 kB | 7.7 kB | 9.7/189 kB | 5.5/169 kB Progress (4): 12/103 kB | 7.7 kB | 11/189 kB | 5.5/169 kB Progress (4): 14/103 kB | 7.7 kB | 11/189 kB | 5.5/169 kB Progress (4): 14/103 kB | 7.7 kB | 11/189 kB | 6.9/169 kB Progress (4): 15/103 kB | 7.7 kB | 11/189 kB | 6.9/169 kB Progress (4): 15/103 kB | 7.7 kB | 12/189 kB | 6.9/169 kB Progress (4): 17/103 kB | 7.7 kB | 12/189 kB | 6.9/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 128 kB/s) 2024-09-14T11:30:41.392 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (3): 17/103 kB | 12/189 kB | 8.3/169 kB Progress (3): 18/103 kB | 12/189 kB | 8.3/169 kB Progress (3): 18/103 kB | 14/189 kB | 8.3/169 kB Progress (3): 19/103 kB | 14/189 kB | 8.3/169 kB Progress (3): 19/103 kB | 14/189 kB | 9.7/169 kB Progress (3): 21/103 kB | 14/189 kB | 9.7/169 kB Progress (3): 21/103 kB | 15/189 kB | 9.7/169 kB Progress (3): 22/103 kB | 15/189 kB | 9.7/169 kB Progress (3): 22/103 kB | 15/189 kB | 11/169 kB Progress (3): 23/103 kB | 15/189 kB | 11/169 kB Progress (3): 23/103 kB | 16/189 kB | 11/169 kB Progress (3): 25/103 kB | 16/189 kB | 11/169 kB Progress (3): 25/103 kB | 16/189 kB | 12/169 kB Progress (3): 26/103 kB | 16/189 kB | 12/169 kB Progress (3): 26/103 kB | 18/189 kB | 12/169 kB Progress (3): 28/103 kB | 18/189 kB | 12/169 kB Progress (3): 28/103 kB | 18/189 kB | 14/169 kB Progress (3): 29/103 kB | 18/189 kB | 14/169 kB Progress (3): 29/103 kB | 19/189 kB | 14/169 kB Progress (3): 30/103 kB | 19/189 kB | 14/169 kB Progress (3): 30/103 kB | 19/189 kB | 15/169 kB Progress (3): 31/103 kB | 19/189 kB | 15/169 kB Progress (3): 31/103 kB | 21/189 kB | 15/169 kB Progress (3): 31/103 kB | 21/189 kB | 16/169 kB Progress (3): 31/103 kB | 22/189 kB | 16/169 kB Progress (3): 31/103 kB | 22/189 kB | 18/169 kB Progress (3): 31/103 kB | 23/189 kB | 18/169 kB Progress (3): 31/103 kB | 23/189 kB | 19/169 kB Progress (3): 48/103 kB | 23/189 kB | 19/169 kB Progress (3): 48/103 kB | 23/189 kB | 21/169 kB Progress (3): 48/103 kB | 25/189 kB | 21/169 kB Progress (3): 48/103 kB | 25/189 kB | 22/169 kB Progress (3): 48/103 kB | 26/189 kB | 22/169 kB Progress (3): 48/103 kB | 26/189 kB | 23/169 kB Progress (3): 48/103 kB | 27/189 kB | 23/169 kB Progress (3): 48/103 kB | 27/189 kB | 25/169 kB Progress (3): 48/103 kB | 29/189 kB | 25/169 kB Progress (3): 48/103 kB | 29/189 kB | 26/169 kB Progress (3): 48/103 kB | 30/189 kB | 26/169 kB Progress (3): 48/103 kB | 30/189 kB | 27/169 kB Progress (3): 48/103 kB | 32/189 kB | 27/169 kB Progress (3): 48/103 kB | 32/189 kB | 29/169 kB Progress (3): 48/103 kB | 33/189 kB | 29/169 kB Progress (3): 48/103 kB | 33/189 kB | 30/169 kB Progress (3): 48/103 kB | 34/189 kB | 30/169 kB Progress (3): 48/103 kB | 34/189 kB | 32/169 kB Progress (3): 48/103 kB | 36/189 kB | 32/169 kB Progress (3): 64/103 kB | 36/189 kB | 32/169 kB Progress (3): 64/103 kB | 36/189 kB | 33/169 kB Progress (3): 64/103 kB | 37/189 kB | 33/169 kB Progress (3): 64/103 kB | 37/189 kB | 34/169 kB Progress (3): 64/103 kB | 38/189 kB | 34/169 kB Progress (3): 64/103 kB | 38/189 kB | 36/169 kB Progress (3): 64/103 kB | 40/189 kB | 36/169 kB Progress (3): 81/103 kB | 40/189 kB | 36/169 kB Progress (3): 81/103 kB | 40/189 kB | 37/169 kB Progress (3): 81/103 kB | 41/189 kB | 37/169 kB Progress (3): 81/103 kB | 41/189 kB | 38/169 kB Progress (3): 81/103 kB | 43/189 kB | 38/169 kB Progress (3): 81/103 kB | 43/189 kB | 40/169 kB Progress (3): 97/103 kB | 43/189 kB | 40/169 kB Progress (3): 97/103 kB | 44/189 kB | 40/169 kB Progress (3): 97/103 kB | 44/189 kB | 41/169 kB Progress (3): 97/103 kB | 45/189 kB | 41/169 kB Progress (3): 103 kB | 45/189 kB | 41/169 kB Progress (3): 103 kB | 45/189 kB | 43/169 kB Progress (3): 103 kB | 47/189 kB | 43/169 kB Progress (3): 103 kB | 47/189 kB | 44/169 kB Progress (3): 103 kB | 48/189 kB | 44/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-14T11:30:41.414 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (2): 48/189 kB | 45/169 kB Progress (2): 49/189 kB | 45/169 kB Progress (2): 49/189 kB | 47/169 kB Progress (2): 51/189 kB | 47/169 kB Progress (2): 51/189 kB | 48/169 kB Progress (2): 52/189 kB | 48/169 kB Progress (2): 52/189 kB | 49/169 kB Progress (2): 54/189 kB | 49/169 kB Progress (2): 54/189 kB | 51/169 kB Progress (2): 55/189 kB | 51/169 kB Progress (2): 55/189 kB | 52/169 kB Progress (2): 56/189 kB | 52/169 kB Progress (2): 56/189 kB | 54/169 kB Progress (2): 58/189 kB | 54/169 kB Progress (2): 58/189 kB | 55/169 kB Progress (2): 59/189 kB | 55/169 kB Progress (2): 59/189 kB | 56/169 kB Progress (2): 61/189 kB | 56/169 kB Progress (2): 61/189 kB | 58/169 kB Progress (2): 62/189 kB | 58/169 kB Progress (2): 62/189 kB | 59/169 kB Progress (2): 63/189 kB | 59/169 kB Progress (2): 63/189 kB | 61/169 kB Progress (2): 63/189 kB | 61/169 kB Progress (2): 79/189 kB | 61/169 kB Progress (2): 79/189 kB | 78/169 kB Progress (2): 96/189 kB | 78/169 kB Progress (2): 96/189 kB | 94/169 kB Progress (2): 112/189 kB | 94/169 kB Progress (2): 112/189 kB | 111/169 kB Progress (2): 112/189 kB | 127/169 kB Progress (2): 112/189 kB | 143/169 kB Progress (2): 128/189 kB | 143/169 kB Progress (2): 145/189 kB | 143/169 kB Progress (2): 145/189 kB | 160/169 kB Progress (2): 145/189 kB | 169 kB Progress (2): 161/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-09-14T11:30:41.416 INFO:tasks.workunit.client.0.smithi007.stdout:Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-09-14T11:30:41.431 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:41.431 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:30:41.431 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] T E S T S 2024-09-14T11:30:41.431 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:30:41.896 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:30:42.019 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjects.java: starting test run: 2024-09-14T11:30:42.020 INFO:tasks.workunit.client.0.smithi007.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:30:42.020 INFO:tasks.workunit.client.0.smithi007.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:30:42.020 INFO:tasks.workunit.client.0.smithi007.stdout: EndpointUrl=https://smithi007.front.sepia.ceph.com:443 2024-09-14T11:30:42.020 INFO:tasks.workunit.client.0.smithi007.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:30:42.117 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Environment Variables Read 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Generating File 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: File Generated 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Generating File 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: File Generated 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Generating File 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: File Generated 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Generating File 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: File Generated 2024-09-14T11:30:42.419 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Generating File 2024-09-14T11:30:42.420 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: File Generated 2024-09-14T11:30:42.420 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Generating File 2024-09-14T11:30:42.420 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: File Generated 2024-09-14T11:30:42.420 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Generated Big Files 2024-09-14T11:30:42.711 INFO:tasks.workunit.client.0.smithi007.stdout:HeadBucketResponse() 2024-09-14T11:30:42.711 INFO:tasks.workunit.client.0.smithi007.stdout:sheik is ready 2024-09-14T11:30:42.711 INFO:tasks.workunit.client.0.smithi007.stdout:DEBUG: Test Bucket Created 2024-09-14T11:30:42.811 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:30:42.818 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:30:42.919 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:30:42.954 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:30:43.011 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:30:43.019 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:30:43.119 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:30:43.213 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:30:43.219 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:30:43.319 INFO:tasks.workunit.client.0.smithi007.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:30:45.624 INFO:tasks.workunit.client.0.smithi007.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:30:46.024 INFO:tasks.workunit.client.0.smithi007.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:30:49.778 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-0b 2024-09-14T11:30:49.778 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-8b 2024-09-14T11:30:49.780 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-200b 2024-09-14T11:30:49.781 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-21983b 2024-09-14T11:30:49.782 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-5519b 2024-09-14T11:30:49.784 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-204329b 2024-09-14T11:30:49.785 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-256k 2024-09-14T11:30:49.786 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-1m 2024-09-14T11:30:49.787 INFO:tasks.workunit.client.0.smithi007.stdout:arg: file-1038757b 2024-09-14T11:30:49.823 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:30:49.823 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:49.829 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:30:49.878 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:49.929 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:30:49.930 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:49.992 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:30:49.992 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:50.030 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:30:50.030 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:50.077 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:30:50.077 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:50.103 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:30:50.103 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:50.130 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:30:50.150 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:50.230 INFO:tasks.workunit.client.0.smithi007.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:30:50.230 INFO:tasks.workunit.client.0.smithi007.stdout:PutObjectResponse 2024-09-14T11:30:50.330 INFO:tasks.workunit.client.0.smithi007.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:30:50.531 INFO:tasks.workunit.client.0.smithi007.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:30:51.131 INFO:tasks.workunit.client.0.smithi007.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:30:53.513 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.60 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:30:53.525 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:53.525 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Results: 2024-09-14T11:30:53.526 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:53.526 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:30:53.526 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] 2024-09-14T11:30:53.528 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:30:53.528 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:30:53.528 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:30:53.529 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Total time: 13.469 s 2024-09-14T11:30:53.529 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] Finished at: 2024-09-14T11:30:53Z 2024-09-14T11:30:53.529 INFO:tasks.workunit.client.0.smithi007.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:30:53.551 INFO:tasks.workunit.client.0.smithi007.stderr:+ exit 2024-09-14T11:30:53.552 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:30:53.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:30:53.631 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:30:53.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:30:54.019 DEBUG:teuthology.parallel:result is None 2024-09-14T11:30:54.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:30:54.060 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:30:54.060 DEBUG:teuthology.orchestra.run.smithi007:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:54.130 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:30:54.130 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:30:54.139 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:30:54.139 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:30:54.139 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:54.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:30:54.201 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:30:54.202 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:54.271 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:54.271 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:30:54.341 INFO:tasks.workunit:timeout=3h 2024-09-14T11:30:54.341 INFO:tasks.workunit:cleanup=True 2024-09-14T11:30:54.341 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:30:54.411 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:31:51.532 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 96% (12456/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:31:52.015 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:31:52.015 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:31:52.015 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:31:52.015 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:31:52.015 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:31:52.015 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:31:52.016 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:31:52.018 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:31:52.087 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:31:52.089 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:31:52.089 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:31:52.139 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:31:52.189 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:31:52.229 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:31:52.231 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:31:52.231 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:31:52.270 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:31:52.274 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:31:52.274 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:31:52.345 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:31:52.346 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:31:52.346 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:31:52.420 INFO:tasks.workunit.client.0.smithi007.stdout:INFO: fully qualified domain name: smithi007.front.sepia.ceph.com 2024-09-14T11:31:52.420 INFO:tasks.workunit.client.0.smithi007.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:31:52.420 INFO:tasks.workunit.client.0.smithi007.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:31:55.048 INFO:tasks.workunit.client.0.smithi007.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:31:55.243 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting pip 2024-09-14T11:31:55.248 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:31:55.295 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: pip 2024-09-14T11:31:55.295 INFO:tasks.workunit.client.0.smithi007.stdout: Attempting uninstall: pip 2024-09-14T11:31:55.296 INFO:tasks.workunit.client.0.smithi007.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:31:55.463 INFO:tasks.workunit.client.0.smithi007.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:31:55.468 INFO:tasks.workunit.client.0.smithi007.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:31:56.230 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed pip-24.2 2024-09-14T11:31:57.099 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting boto3 2024-09-14T11:31:57.100 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:31:57.657 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:31:57.659 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:31:57.715 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:31:57.716 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:31:57.769 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:31:57.771 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:31:57.821 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:31:57.822 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:31:57.899 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:31:57.901 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:31:58.043 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:31:58.044 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:31:58.049 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:31:58.050 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:31:58.059 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:31:58.060 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:31:58.062 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:31:58.063 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:31:58.065 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:31:58.141 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:31:59.183 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:31:59.624 INFO:tasks.workunit.client.0.smithi007.stdout:INFO: creating user 2024-09-14T11:32:00.145 INFO:tasks.workunit.client.0.smithi007.stdout:{ 2024-09-14T11:32:00.145 INFO:tasks.workunit.client.0.smithi007.stdout: "user_id": "testid", 2024-09-14T11:32:00.145 INFO:tasks.workunit.client.0.smithi007.stdout: "display_name": "M. Tester", 2024-09-14T11:32:00.145 INFO:tasks.workunit.client.0.smithi007.stdout: "email": "tester@ceph.com", 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "suspended": 0, 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "subusers": [], 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "keys": [ 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: { 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "user": "testid", 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "active": true, 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: "create_date": "2024-09-14T11:32:00.141975Z" 2024-09-14T11:32:00.146 INFO:tasks.workunit.client.0.smithi007.stdout: } 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: ], 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "swift_keys": [], 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "caps": [], 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "default_placement": "", 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "placement_tags": [], 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "bucket_quota": { 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "enabled": false, 2024-09-14T11:32:00.147 INFO:tasks.workunit.client.0.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size": -1, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "max_objects": -1 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "user_quota": { 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "enabled": false, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size": -1, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "max_objects": -1 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: }, 2024-09-14T11:32:00.148 INFO:tasks.workunit.client.0.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: "type": "rgw", 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: "account_id": "", 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: "path": "/", 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: "create_date": "2024-09-14T11:32:00.141957Z", 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: "tags": [], 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: "group_ids": [] 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout:} 2024-09-14T11:32:00.149 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-14T11:32:06.709 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:06.709 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:06.725 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:06.725 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:06.745 INFO:tasks.workunit.client.0.smithi007.stderr:5+0 records in 2024-09-14T11:32:06.745 INFO:tasks.workunit.client.0.smithi007.stderr:5+0 records out 2024-09-14T11:32:06.746 INFO:tasks.workunit.client.0.smithi007.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0147877 s, 355 MB/s 2024-09-14T11:32:06.749 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:06.749 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:06.806 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:06.806 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:06.869 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:06.869 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:06.924 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:06.924 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:06.989 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:06.989 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.045 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.045 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.106 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.106 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.170 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.170 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.230 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.290 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.290 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.352 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.353 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.414 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.414 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.472 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.472 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.534 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.534 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.585 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:07.585 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:32:07.595 INFO:tasks.workunit.client.0.smithi007.stdout:bucket nams is reupload-bkt-101779 2024-09-14T11:32:07.595 INFO:tasks.workunit.client.0.smithi007.stdout:endpoint is https://smithi007.front.sepia.ceph.com:443 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:start UploadId=2~lGOaP4WNLeVRXASy-WoLirt8IJwuK-e 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 1 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 1 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 2} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.596 INFO:tasks.workunit.client.0.smithi007.stdout:phase 2 uploaded part {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1} 2024-09-14T11:32:07.597 INFO:tasks.workunit.client.0.smithi007.stdout:aborting multipart upload, parts=[{'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 1}, {'ETag': '"8d39ffae734b1c063a0c2674c3ee46ab"', 'PartNumber': 2}] 2024-09-14T11:32:09.198 INFO:tasks.workunit.client.0.smithi007.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:32:09.259 INFO:tasks.workunit.client.0.smithi007.stdout:rados ls: 2024-09-14T11:32:09.263 INFO:tasks.workunit.client.0.smithi007.stdout:== PASSED == 2024-09-14T11:32:09.263 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:32:09.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:32:09.344 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:32:09.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:32:09.740 DEBUG:teuthology.parallel:result is None 2024-09-14T11:32:09.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:32:09.780 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:32:09.780 DEBUG:teuthology.orchestra.run.smithi007:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:09.850 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:32:09.850 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:32:09.863 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:32:09.864 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:32:09.864 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:32:09.864 DEBUG:teuthology.orchestra.run.smithi007:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:32:09.920 INFO:teuthology.orchestra.run.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:32:09.949 INFO:teuthology.orchestra.run.smithi007.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:32:09.949 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:32:09.951 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:32:09.951 DEBUG:teuthology.orchestra.run.smithi007:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:32:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:32:10.204 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:32:10.205 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:32:10.205 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key LZFGQGLAOFNZLKFJDFCC --secret XoEHJCf53CNmAh+j2leY1PoA84g3xKbKUY+PKr90L4QfGzjbKkpZ+w== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:32:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:10.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.350+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.351+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.351+0000 7f8dfa3a7800 20 realm 2024-09-14T11:32:10.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.351+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.352+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.352+0000 7f8dfa3a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:10.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.352+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.352+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.352+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.353+0000 7f8dfa3a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.353+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.353+0000 7f8dfa3a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:10.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.353+0000 7f8dfa3a7800 20 searching for the correct realm 2024-09-14T11:32:10.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.355+0000 7f8df8692640 0 -- 172.21.15.7:0/2730983394 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8dec018070 msgr2=0x7f8dec056a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.561+0000 7f8df7690640 0 -- 172.21.15.7:0/2730983394 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8de804c040 msgr2=0x7f8de804d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.767+0000 7f8dfa3a7800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.767+0000 7f8dfa3a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.767+0000 7f8dfa3a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.767+0000 7f8dfa3a7800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.767+0000 7f8dfa3a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.767+0000 7f8dfa3a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.767+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 zone default found 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 4 Realm: () 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 zonegroup default 2024-09-14T11:32:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.768+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.769+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.769+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.769+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.769+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.769+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.769+0000 7f8dfa3a7800 20 started sync module instance, tier type = 2024-09-14T11:32:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.769+0000 7f8dfa3a7800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:32:10.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.780+0000 7f8dfa3a7800 20 add_watcher() i=0 2024-09-14T11:32:10.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.780+0000 7f8dfa3a7800 20 add_watcher() i=1 2024-09-14T11:32:10.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.780+0000 7f8dfa3a7800 20 add_watcher() i=2 2024-09-14T11:32:10.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.780+0000 7f8dfa3a7800 20 add_watcher() i=3 2024-09-14T11:32:10.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.780+0000 7f8dfa3a7800 20 add_watcher() i=4 2024-09-14T11:32:10.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.780+0000 7f8dfa3a7800 20 add_watcher() i=5 2024-09-14T11:32:10.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.780+0000 7f8dfa3a7800 20 add_watcher() i=6 2024-09-14T11:32:10.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.781+0000 7f8dfa3a7800 20 add_watcher() i=7 2024-09-14T11:32:10.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.781+0000 7f8dfa3a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:10.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.783+0000 7f8cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.783+0000 7f8dfa3a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.783+0000 7f8dfa3a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.783+0000 7f8dfa3a7800 5 note: GC not initialized 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.783+0000 7f8cacfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.783+0000 7f8dfa3a7800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.783+0000 7f8dfa3a7800 20 Filter name: none 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8c267fc640 20 reqs_thread_entry: start 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:32:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 10 cache get: name=default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC : miss 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.784+0000 7f8dfa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.785+0000 7f8dfa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.785+0000 7f8dfa3a7800 10 cache put: name=default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC info.flags=0x0 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.785+0000 7f8dfa3a7800 10 adding default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC to cache LRU end 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.785+0000 7f8dfa3a7800 10 cache get: name=default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC : hit (negative entry) 2024-09-14T11:32:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.785+0000 7f8dfa3a7800 10 cache get: name=default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC : hit (negative entry) 2024-09-14T11:32:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.786+0000 7f8dfa3a7800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:32:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.786+0000 7f8dfa3a7800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:32:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.786+0000 7f8dfa3a7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:32:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.787+0000 7f8cd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791319 cookie 94073746001040 notifier 5862 bl.length()=675 2024-09-14T11:32:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.787+0000 7f8cd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:32:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.787+0000 7f8cd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:32:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.789+0000 7f8dfa3a7800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:32:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.789+0000 7f8dfa3a7800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:32:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.789+0000 7f8dfa3a7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:32:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.789+0000 7f8cd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791306 cookie 94073745991520 notifier 5862 bl.length()=202 2024-09-14T11:32:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.789+0000 7f8cd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:32:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.789+0000 7f8cd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:32:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.791+0000 7f8dfa3a7800 10 cache put: name=default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC info.flags=0x7 2024-09-14T11:32:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.791+0000 7f8dfa3a7800 10 moving default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC to cache LRU end 2024-09-14T11:32:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.791+0000 7f8dfa3a7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:LZFGQGLAOFNZLKFJDFCC, ofs0, ns] 2024-09-14T11:32:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.791+0000 7f8cd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791320 cookie 94073746001040 notifier 5862 bl.length()=190 2024-09-14T11:32:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.791+0000 7f8cd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC info.flags=0x7 2024-09-14T11:32:10.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.791+0000 7f8cd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LZFGQGLAOFNZLKFJDFCC to cache LRU end 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "ragweed.client.0", 2024-09-14T11:32:10.791 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "LZFGQGLAOFNZLKFJDFCC", 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "XoEHJCf53CNmAh+j2leY1PoA84g3xKbKUY+PKr90L4QfGzjbKkpZ+w==", 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:32:10.786745Z" 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:32:10.792 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:32:10.793 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:32:10.786709Z", 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.793+0000 7f8cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.795+0000 7f8dfa3a7800 20 remove_watcher() i=0 2024-09-14T11:32:10.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.795+0000 7f8dfa3a7800 2 removed watcher, disabling cache 2024-09-14T11:32:10.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.796+0000 7f8dfa3a7800 20 remove_watcher() i=1 2024-09-14T11:32:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.797+0000 7f8dfa3a7800 20 remove_watcher() i=2 2024-09-14T11:32:10.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.798+0000 7f8dfa3a7800 20 remove_watcher() i=3 2024-09-14T11:32:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.799+0000 7f8dfa3a7800 20 remove_watcher() i=4 2024-09-14T11:32:10.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.800+0000 7f8dfa3a7800 20 remove_watcher() i=5 2024-09-14T11:32:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.801+0000 7f8dfa3a7800 20 remove_watcher() i=6 2024-09-14T11:32:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.802+0000 7f8dfa3a7800 20 remove_watcher() i=7 2024-09-14T11:32:10.812 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:32:10.813 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key MEXWHCFWEFHQSEEJIWQC --secret G0RRFhmLnhXh2nZQrMmN32KjNCj+kwHZ1SICYFW4muqHeztxZwJ/lg== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:32:10.881 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:10.881 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:10.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.919+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.920+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.920+0000 7f47bea1d800 20 realm 2024-09-14T11:32:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.920+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.921+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.921+0000 7f47bea1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.921+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.921+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.921+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.922+0000 7f47bea1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.922+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.922+0000 7f47bea1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.923+0000 7f47bea1d800 20 searching for the correct realm 2024-09-14T11:32:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:10.924+0000 7f47ba9ec640 0 -- 172.21.15.7:0/2209878050 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f47b0018070 msgr2=0x7f47b0043f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.130+0000 7f47b99ea640 0 -- 172.21.15.7:0/2209878050 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f47ac069e10 msgr2=0x7f47ac07fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:32:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:32:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:11.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.337+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 zone default found 2024-09-14T11:32:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 4 Realm: () 2024-09-14T11:32:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:32:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 zonegroup default 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.338+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.339+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.339+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.339+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.339+0000 7f47bea1d800 20 started sync module instance, tier type = 2024-09-14T11:32:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.339+0000 7f47bea1d800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:32:11.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.350+0000 7f47bea1d800 20 add_watcher() i=0 2024-09-14T11:32:11.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.350+0000 7f47bea1d800 20 add_watcher() i=1 2024-09-14T11:32:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.350+0000 7f47bea1d800 20 add_watcher() i=2 2024-09-14T11:32:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.350+0000 7f47bea1d800 20 add_watcher() i=3 2024-09-14T11:32:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.350+0000 7f47bea1d800 20 add_watcher() i=4 2024-09-14T11:32:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.350+0000 7f47bea1d800 20 add_watcher() i=5 2024-09-14T11:32:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.350+0000 7f47bea1d800 20 add_watcher() i=6 2024-09-14T11:32:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.351+0000 7f47bea1d800 20 add_watcher() i=7 2024-09-14T11:32:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.351+0000 7f47bea1d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f4670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f47bea1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f47bea1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:11.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f47bea1d800 5 note: GC not initialized 2024-09-14T11:32:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f45eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f47bea1d800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f47bea1d800 20 Filter name: none 2024-09-14T11:32:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f45e97fa640 20 reqs_thread_entry: start 2024-09-14T11:32:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f47bea1d800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:32:11.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.353+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:32:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:32:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:32:11.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 10 cache get: name=default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC : miss 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.354+0000 7f47bea1d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.355+0000 7f47bea1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.355+0000 7f47bea1d800 10 cache put: name=default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC info.flags=0x0 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.355+0000 7f47bea1d800 10 adding default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC to cache LRU end 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.355+0000 7f47bea1d800 10 cache get: name=default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC : hit (negative entry) 2024-09-14T11:32:11.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.355+0000 7f47bea1d800 10 cache get: name=default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC : hit (negative entry) 2024-09-14T11:32:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.357+0000 7f47bea1d800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:32:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.357+0000 7f47bea1d800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:32:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.357+0000 7f47bea1d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:32:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.357+0000 7f469dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791307 cookie 94650378240848 notifier 5660 bl.length()=675 2024-09-14T11:32:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.357+0000 7f469dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:32:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.357+0000 7f469dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:32:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.359+0000 7f47bea1d800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:32:11.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.359+0000 7f47bea1d800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:32:11.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.359+0000 7f47bea1d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:32:11.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.359+0000 7f469dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791321 cookie 94650378243056 notifier 5660 bl.length()=202 2024-09-14T11:32:11.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.359+0000 7f469dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:32:11.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.359+0000 7f469dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:32:11.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.361+0000 7f47bea1d800 10 cache put: name=default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC info.flags=0x7 2024-09-14T11:32:11.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.361+0000 7f47bea1d800 10 moving default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC to cache LRU end 2024-09-14T11:32:11.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.361+0000 7f47bea1d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:MEXWHCFWEFHQSEEJIWQC, ofs0, ns] 2024-09-14T11:32:11.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.361+0000 7f469dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791322 cookie 94650378243056 notifier 5660 bl.length()=190 2024-09-14T11:32:11.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.361+0000 7f469dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC info.flags=0x7 2024-09-14T11:32:11.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.361+0000 7f469dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MEXWHCFWEFHQSEEJIWQC to cache LRU end 2024-09-14T11:32:11.360 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:32:11.360 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "sysuser.client.0", 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "MEXWHCFWEFHQSEEJIWQC", 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "G0RRFhmLnhXh2nZQrMmN32KjNCj+kwHZ1SICYFW4muqHeztxZwJ/lg==", 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:32:11.356550Z" 2024-09-14T11:32:11.361 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "system": true, 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:32:11.362 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:32:11.356529Z", 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:32:11.363 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:32:11.364 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:32:11.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.363+0000 7f4670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.365+0000 7f47bea1d800 20 remove_watcher() i=0 2024-09-14T11:32:11.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.365+0000 7f47bea1d800 2 removed watcher, disabling cache 2024-09-14T11:32:11.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.366+0000 7f47bea1d800 20 remove_watcher() i=1 2024-09-14T11:32:11.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.368+0000 7f47bea1d800 20 remove_watcher() i=2 2024-09-14T11:32:11.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.369+0000 7f47bea1d800 20 remove_watcher() i=3 2024-09-14T11:32:11.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.370+0000 7f47bea1d800 20 remove_watcher() i=4 2024-09-14T11:32:11.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.371+0000 7f47bea1d800 20 remove_watcher() i=5 2024-09-14T11:32:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.372+0000 7f47bea1d800 20 remove_watcher() i=6 2024-09-14T11:32:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:11.373+0000 7f47bea1d800 20 remove_watcher() i=7 2024-09-14T11:32:11.384 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:32:11.384 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:32:11.384 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:32:11.415 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:32:11.415 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:32:11.415 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:32:11.484 DEBUG:teuthology.orchestra.run.smithi007:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:32:11.677 INFO:teuthology.orchestra.run.smithi007.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:32:11.845 INFO:teuthology.orchestra.run.smithi007.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:32:12.450 INFO:teuthology.orchestra.run.smithi007.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:32:18.886 INFO:teuthology.orchestra.run.smithi007.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:32:22.356 INFO:teuthology.orchestra.run.smithi007.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=4d236ea3844f968c3a8e7dfc9dfc7711aab374c730dcb725eb245234860e4425,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:32:22.356 INFO:teuthology.orchestra.run.smithi007.stdout:py run-test-pre: PYTHONHASHSEED='1173667408' 2024-09-14T11:32:22.356 INFO:teuthology.orchestra.run.smithi007.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:32:22.559 INFO:teuthology.orchestra.run.smithi007.stdout:============================= test session starts ============================== 2024-09-14T11:32:22.560 INFO:teuthology.orchestra.run.smithi007.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:32:22.560 INFO:teuthology.orchestra.run.smithi007.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:32:22.560 INFO:teuthology.orchestra.run.smithi007.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:32:22.560 INFO:teuthology.orchestra.run.smithi007.stdout:configfile: pytest.ini 2024-09-14T11:32:22.660 INFO:teuthology.orchestra.run.smithi007.stdout:collecting ... collected 9 items 2024-09-14T11:32:22.661 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:32:24.528 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:32:25.365 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:32:26.155 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:32:26.998 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:32:27.815 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:32:34.261 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:32:35.885 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:32:37.898 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:32:41.148 INFO:teuthology.orchestra.run.smithi007.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:32:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:32:41.148 INFO:teuthology.orchestra.run.smithi007.stdout:=============================== warnings summary =============================== 2024-09-14T11:32:41.148 INFO:teuthology.orchestra.run.smithi007.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:32:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:32:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: import imp 2024-09-14T11:32:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:32:41.149 INFO:teuthology.orchestra.run.smithi007.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:32:41.149 INFO:teuthology.orchestra.run.smithi007.stdout:======================== 9 passed, 1 warning in 18.59s ========================= 2024-09-14T11:32:41.178 INFO:teuthology.orchestra.run.smithi007.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:32:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: py: commands succeeded 2024-09-14T11:32:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: congratulations :) 2024-09-14T11:32:41.196 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:32:41.197 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:32:41.226 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:32:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:41.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.364+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 20 realm 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.366+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.367+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:41.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.367+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.368+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:41.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.368+0000 7f858c940800 20 searching for the correct realm 2024-09-14T11:32:41.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.370+0000 7f8588e87640 0 -- 172.21.15.7:0/786349657 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f857c07a040 msgr2=0x7f857c083230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:41.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.577+0000 7f8587e85640 0 -- 172.21.15.7:0/786349657 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8578069ef0 msgr2=0x7f857806f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:41.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:41.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.785+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 zone default found 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 4 Realm: () 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 zonegroup default 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.786+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.787+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.787+0000 7f858c940800 20 started sync module instance, tier type = 2024-09-14T11:32:41.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.787+0000 7f858c940800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:32:41.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.797+0000 7f858c940800 20 add_watcher() i=0 2024-09-14T11:32:41.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.797+0000 7f858c940800 20 add_watcher() i=1 2024-09-14T11:32:41.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.797+0000 7f858c940800 20 add_watcher() i=2 2024-09-14T11:32:41.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.797+0000 7f858c940800 20 add_watcher() i=3 2024-09-14T11:32:41.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.797+0000 7f858c940800 20 add_watcher() i=4 2024-09-14T11:32:41.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.797+0000 7f858c940800 20 add_watcher() i=5 2024-09-14T11:32:41.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.797+0000 7f858c940800 20 add_watcher() i=6 2024-09-14T11:32:41.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.798+0000 7f858c940800 20 add_watcher() i=7 2024-09-14T11:32:41.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.798+0000 7f858c940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:41.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.800+0000 7f843efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:41.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.800+0000 7f858c940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:41.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.800+0000 7f858c940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.840+0000 7f843dfdb640 20 reqs_thread_entry: start 2024-09-14T11:32:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.840+0000 7f858c940800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.840+0000 7f858c940800 20 Filter name: none 2024-09-14T11:32:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.840+0000 7f83af7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.840+0000 7f858c940800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:32:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.840+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.841+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:32:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.841+0000 7f858c940800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:32:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.841+0000 7f858c940800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:32:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.841+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 : miss 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 info.flags=0x17 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 to cache LRU end 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.842+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 2024-09-14T11:32:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.843+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:32:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.843+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:32:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.843+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:32:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.844+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:32:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.844+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:32:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.844+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:32:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.844+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:32:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.845+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:32:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.846+0000 7f858c940800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:32:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.847+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x559d8660f758 s->prefetch_data=0 2024-09-14T11:32:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.847+0000 7f858c940800 10 manifest: total_size = 15980 2024-09-14T11:32:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.847+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17972841434779376885 2024-09-14T11:32:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.847+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x559d8660f758 s->prefetch_data=0 2024-09-14T11:32:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.847+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f758 2024-09-14T11:32:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.847+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.1 2024-09-14T11:32:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.850+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x559d8660f708 s->prefetch_data=0 2024-09-14T11:32:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.850+0000 7f858c940800 10 manifest: total_size = 7411 2024-09-14T11:32:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.850+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6310226047508981665 2024-09-14T11:32:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.850+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x559d8660f708 s->prefetch_data=0 2024-09-14T11:32:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.850+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f708 2024-09-14T11:32:41.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.850+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.2 2024-09-14T11:32:41.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.851+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:32:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.852+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x559d8660f708 s->prefetch_data=0 2024-09-14T11:32:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.853+0000 7f858c940800 10 manifest: total_size = 15948 2024-09-14T11:32:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.853+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1943285029273740629 2024-09-14T11:32:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.853+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x559d8660f708 s->prefetch_data=0 2024-09-14T11:32:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.853+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f708 2024-09-14T11:32:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.853+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.2 2024-09-14T11:32:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.854+0000 7f845effd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:32:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.855+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x559d8660f658 s->prefetch_data=0 2024-09-14T11:32:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.856+0000 7f858c940800 10 manifest: total_size = 7681 2024-09-14T11:32:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.856+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12060195804261535000 2024-09-14T11:32:41.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.856+0000 7f858c940800 20 get_obj_state: octx=0x7f8580006f10 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x559d8660f658 s->prefetch_data=0 2024-09-14T11:32:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.856+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f658 2024-09-14T11:32:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.856+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.3 2024-09-14T11:32:41.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.856+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:32:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.858+0000 7f858c940800 20 get_obj_state: octx=0x559d8659b770 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x559d8660f658 s->prefetch_data=0 2024-09-14T11:32:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.858+0000 7f858c940800 10 manifest: total_size = 13113 2024-09-14T11:32:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.858+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1662103902145848606 2024-09-14T11:32:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.858+0000 7f858c940800 20 get_obj_state: octx=0x559d8659b770 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x559d8660f658 s->prefetch_data=0 2024-09-14T11:32:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.858+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f658 2024-09-14T11:32:41.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.858+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.4 2024-09-14T11:32:41.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.859+0000 7f845effd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:32:41.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.861+0000 7f858c940800 20 get_obj_state: octx=0x559d86596210 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x559d8660f658 s->prefetch_data=0 2024-09-14T11:32:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.861+0000 7f858c940800 10 manifest: total_size = 7544 2024-09-14T11:32:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.861+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4704132919319137268 2024-09-14T11:32:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.861+0000 7f858c940800 20 get_obj_state: octx=0x559d86596210 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x559d8660f658 s->prefetch_data=0 2024-09-14T11:32:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.861+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f658 2024-09-14T11:32:41.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.861+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.4 2024-09-14T11:32:41.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.862+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:32:41.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.864+0000 7f858c940800 20 get_obj_state: octx=0x559d86599d00 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x559d8660f148 s->prefetch_data=0 2024-09-14T11:32:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.864+0000 7f858c940800 10 manifest: total_size = 4912 2024-09-14T11:32:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.864+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9643337687181917637 2024-09-14T11:32:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.864+0000 7f858c940800 20 get_obj_state: octx=0x559d86599d00 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x559d8660f148 s->prefetch_data=0 2024-09-14T11:32:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.864+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f148 2024-09-14T11:32:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.864+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.5 2024-09-14T11:32:41.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.865+0000 7f845effd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:32:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.867+0000 7f858c940800 20 get_obj_state: octx=0x559d86610fa0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x559d8660f148 s->prefetch_data=0 2024-09-14T11:32:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.867+0000 7f858c940800 10 manifest: total_size = 7905 2024-09-14T11:32:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.867+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16873230584699420002 2024-09-14T11:32:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.867+0000 7f858c940800 20 get_obj_state: octx=0x559d86610fa0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x559d8660f148 s->prefetch_data=0 2024-09-14T11:32:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.867+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f148 2024-09-14T11:32:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.867+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.7 2024-09-14T11:32:41.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.868+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:32:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.870+0000 7f858c940800 20 get_obj_state: octx=0x559d86599d00 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x559d8660f148 s->prefetch_data=0 2024-09-14T11:32:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.870+0000 7f858c940800 10 manifest: total_size = 8753 2024-09-14T11:32:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.870+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4150424028876739972 2024-09-14T11:32:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.870+0000 7f858c940800 20 get_obj_state: octx=0x559d86599d00 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x559d8660f148 s->prefetch_data=0 2024-09-14T11:32:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.870+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8660f148 2024-09-14T11:32:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.870+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5.8 2024-09-14T11:32:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.871+0000 7f845effd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:32:41.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.872+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:41.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.873+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:41.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.874+0000 7f845effd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:32:41.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.874+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:41.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.874+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:41.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.874+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:41.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.874+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:41.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.874+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:41.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.876+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:32:41.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.876+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.877+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:32:41.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.877+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:32:41.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.877+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:32:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.878+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:32:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.878+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:32:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.878+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 94135051948080 notifier 5913 bl.length()=162 2024-09-14T11:32:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.879+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 from cache 2024-09-14T11:32:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.879+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5, ofs0, ns] 2024-09-14T11:32:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.880+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 94135051963776 notifier 5913 bl.length()=219 2024-09-14T11:32:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.883+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 : miss 2024-09-14T11:32:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.883+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.883+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.883+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 info.flags=0x0 2024-09-14T11:32:41.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.883+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5 to cache LRU end 2024-09-14T11:32:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.885+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 : miss 2024-09-14T11:32:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.885+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.886+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:32:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.886+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 info.flags=0x17 2024-09-14T11:32:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.886+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 to cache LRU end 2024-09-14T11:32:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.886+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.886+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:41.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.886+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 2024-09-14T11:32:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.890+0000 7f858c940800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:32:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.890+0000 7f858c940800 20 get_obj_state: octx=0x7f857806e2b0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559d86596a48 s->prefetch_data=0 2024-09-14T11:32:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.890+0000 7f858c940800 10 manifest: total_size = 26081 2024-09-14T11:32:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.890+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5869986532604102600 2024-09-14T11:32:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.890+0000 7f858c940800 20 get_obj_state: octx=0x7f857806e2b0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559d86596a48 s->prefetch_data=0 2024-09-14T11:32:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.890+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86596a48 2024-09-14T11:32:41.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.890+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12.10 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7671 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7671 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7671 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4209647 part_ofs=15343 rule->part_size=7671 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4217318 part_ofs=23014 rule->part_size=3067 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2024-09-14T11:32:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5869986532604102600 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.1 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.2 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.3 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.4 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.893+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5869986532604102600 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.894+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.894+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.894+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.895+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.895+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.895+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.895+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.895+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.897+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:32:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.897+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.897+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:32:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.897+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:32:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.897+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:32:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.898+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:32:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.898+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:32:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.899+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595128 cookie 94135051950208 notifier 5913 bl.length()=191 2024-09-14T11:32:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.901+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 from cache 2024-09-14T11:32:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.901+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12, ofs0, ns] 2024-09-14T11:32:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.901+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595139 cookie 94135051970512 notifier 5913 bl.length()=249 2024-09-14T11:32:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.903+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 : miss 2024-09-14T11:32:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.903+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.904+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.904+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 info.flags=0x0 2024-09-14T11:32:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.904+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12 to cache LRU end 2024-09-14T11:32:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 : miss 2024-09-14T11:32:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:32:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 info.flags=0x17 2024-09-14T11:32:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 to cache LRU end 2024-09-14T11:32:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.906+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 2024-09-14T11:32:41.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.911+0000 7f858c940800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:32:41.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.911+0000 7f858c940800 20 get_obj_state: octx=0x7f8578069860 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x559d86593748 s->prefetch_data=0 2024-09-14T11:32:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.911+0000 7f858c940800 10 manifest: total_size = 18874368 2024-09-14T11:32:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.911+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10874185749575984377 2024-09-14T11:32:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.911+0000 7f858c940800 20 get_obj_state: octx=0x7f8578069860 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x559d86593748 s->prefetch_data=0 2024-09-14T11:32:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.911+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86593748 2024-09-14T11:32:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.911+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13.10 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10874185749575984377 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.1 2024-09-14T11:32:41.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__shadow_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.1_1 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.2 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__shadow_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.2_1 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.3 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__shadow_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.3_1 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.4 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.914+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10874185749575984377 2024-09-14T11:32:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.915+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:32:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.915+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.915+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.916+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.916+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.916+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.916+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.916+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.918+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:32:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.918+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.918+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:32:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.918+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:32:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.918+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:32:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.920+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:32:41.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.920+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:32:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.920+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595088 cookie 94135051958016 notifier 5913 bl.length()=198 2024-09-14T11:32:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.922+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 from cache 2024-09-14T11:32:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.922+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13, ofs0, ns] 2024-09-14T11:32:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.923+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595082 cookie 94135051959072 notifier 5913 bl.length()=256 2024-09-14T11:32:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.926+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 : miss 2024-09-14T11:32:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.926+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.926+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.926+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 info.flags=0x0 2024-09-14T11:32:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.926+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13 to cache LRU end 2024-09-14T11:32:41.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.928+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 : miss 2024-09-14T11:32:41.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.928+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.929+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:32:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.929+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 info.flags=0x17 2024-09-14T11:32:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.929+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 to cache LRU end 2024-09-14T11:32:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.929+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.929+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.929+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 2024-09-14T11:32:41.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.933+0000 7f858c940800 10 cls_bucket_list_unordered: got foo[OTYJUT9CBTPfUfYA7nWdaczX4HI92hQ] 2024-09-14T11:32:41.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.933+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11.10 2024-09-14T11:32:41.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.934+0000 7f858c940800 20 get_obj_state: octx=0x559d86610a40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x559d865a26e8 s->prefetch_data=0 2024-09-14T11:32:41.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.934+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to rzseomkl38qrx3s820eko8ilgyblh5ms 2024-09-14T11:32:41.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.934+0000 7f858c940800 20 get_obj_state_impl: setting s->olh_tag to jz6cqs860bdfqoildb315jnqioy32epu 2024-09-14T11:32:41.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.934+0000 7f858c940800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jz6cqs860bdfqoildb315jnqioy32epu 2024-09-14T11:32:41.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.935+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11.10 2024-09-14T11:32:41.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11.10 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 olh_log_entry: epoch=3 op=3 key=foo[OTYJUT9CBTPfUfYA7nWdaczX4HI92hQ] 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 get_obj_state: octx=0x559d86610a40 obj=test-client.0-r-test-multipart-index-versioning.1:_:OTYJUT9CBTPfUfYA7nWdaczX4HI92hQ_foo state=0x559d865a7a48 s->prefetch_data=0 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 10 manifest: total_size = 26082 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8399970171743687933 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 get_obj_state: octx=0x559d86610a40 obj=test-client.0-r-test-multipart-index-versioning.1:_:OTYJUT9CBTPfUfYA7nWdaczX4HI92hQ_foo state=0x559d865a7a48 s->prefetch_data=0 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865a7a48 2024-09-14T11:32:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.937+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11.10 2024-09-14T11:32:41.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:32:41.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7672 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7672 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4209647 part_ofs=15343 rule->part_size=7672 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4217319 part_ofs=23015 rule->part_size=3067 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8399970171743687933 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.1 2024-09-14T11:32:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.2 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.3 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.4 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.940+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8399970171743687933 2024-09-14T11:32:41.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.941+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo[OTYJUT9CBTPfUfYA7nWdaczX4HI92hQ] 2024-09-14T11:32:41.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.942+0000 7f858c940800 20 get_obj_state: octx=0x559d86610a40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x559d865a26e8 s->prefetch_data=0 2024-09-14T11:32:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.943+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11.10 2024-09-14T11:32:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11.10 2024-09-14T11:32:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.945+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.947+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:32:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.947+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.948+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:32:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.948+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:32:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.948+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:32:41.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.948+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:32:41.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.948+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:32:41.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.949+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 94135051958016 notifier 5913 bl.length()=193 2024-09-14T11:32:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.950+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 from cache 2024-09-14T11:32:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.950+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11, ofs0, ns] 2024-09-14T11:32:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.951+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595129 cookie 94135051950208 notifier 5913 bl.length()=251 2024-09-14T11:32:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.953+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 : miss 2024-09-14T11:32:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.953+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.953+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.953+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 info.flags=0x0 2024-09-14T11:32:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.953+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11 to cache LRU end 2024-09-14T11:32:41.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.955+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 : miss 2024-09-14T11:32:41.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.955+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.956+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=449 2024-09-14T11:32:41.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.956+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 info.flags=0x17 2024-09-14T11:32:41.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.956+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 to cache LRU end 2024-09-14T11:32:41.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.956+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:41.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.956+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:41.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.956+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 2024-09-14T11:32:41.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.960+0000 7f858c940800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:32:41.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.960+0000 7f858c940800 20 get_obj_state: octx=0x559d86557930 obj=test-client.0-r-test-multipart-simple.1:foo state=0x559d8636af88 s->prefetch_data=0 2024-09-14T11:32:41.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.960+0000 7f858c940800 10 manifest: total_size = 18874368 2024-09-14T11:32:41.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.960+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9145915165871176205 2024-09-14T11:32:41.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.960+0000 7f858c940800 20 get_obj_state: octx=0x559d86557930 obj=test-client.0-r-test-multipart-simple.1:foo state=0x559d8636af88 s->prefetch_data=0 2024-09-14T11:32:41.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.960+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af88 2024-09-14T11:32:41.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.960+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10.10 2024-09-14T11:32:41.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.962+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9145915165871176205 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.1 2024-09-14T11:32:41.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__shadow_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.1_1 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 590 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.2 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 836 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__shadow_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.2_1 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1080 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.3 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1326 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__shadow_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.3_1 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1570 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.4 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1816 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.963+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9145915165871176205 2024-09-14T11:32:41.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.964+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.964+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.964+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.966+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.966+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.966+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.966+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.966+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.967+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.967+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.968+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=227 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.968+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.968+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:32:41.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.969+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:32:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.969+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:32:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.969+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595108 cookie 94135051963776 notifier 5913 bl.length()=183 2024-09-14T11:32:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.971+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 from cache 2024-09-14T11:32:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.971+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10, ofs0, ns] 2024-09-14T11:32:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.971+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595087 cookie 94135051973184 notifier 5913 bl.length()=241 2024-09-14T11:32:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.976+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 : miss 2024-09-14T11:32:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.976+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.976+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.976+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 info.flags=0x0 2024-09-14T11:32:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.976+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10 to cache LRU end 2024-09-14T11:32:41.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.978+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 : miss 2024-09-14T11:32:41.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.978+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.979+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.979+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 info.flags=0x17 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.979+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 to cache LRU end 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.979+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.979+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.979+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.979+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:32:41.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.980+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:32:41.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.980+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.981+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:32:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.981+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:32:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.981+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.982+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:32:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.982+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.982+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:32:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.982+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.982+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:32:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.982+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:32:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.983+0000 7f858c940800 20 get_obj_state: octx=0x559d86530b20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.983+0000 7f858c940800 10 manifest: total_size = 27191 2024-09-14T11:32:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.983+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _RXS_a05AQyMvyhrbH3XMLpxai_V8Dit 2024-09-14T11:32:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.983+0000 7f858c940800 20 get_obj_state: octx=0x559d86530b20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.983+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.983+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.0 2024-09-14T11:32:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=27191 stripe_ofs=27191 part_ofs=0 rule->part_size=0 2024-09-14T11:32:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _RXS_a05AQyMvyhrbH3XMLpxai_V8Dit 2024-09-14T11:32:41.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.317N7vIQJ-soF7pV3A0bMjW2cup7FMQ_0 2024-09-14T11:32:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.986+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _RXS_a05AQyMvyhrbH3XMLpxai_V8Dit 2024-09-14T11:32:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.987+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:32:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.987+0000 7f858c940800 20 get_obj_state: octx=0x559d86611080 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.987+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.987+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _e6kjYPXaD7XR-Dq0AW9aKm8RioeSxm4 2024-09-14T11:32:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.987+0000 7f858c940800 20 get_obj_state: octx=0x559d86611080 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.987+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.987+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.2 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _e6kjYPXaD7XR-Dq0AW9aKm8RioeSxm4 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.XsLf2qXir0XwZ2Fbyztk0m3GBmFpCCs_1 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.991+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _e6kjYPXaD7XR-Dq0AW9aKm8RioeSxm4 2024-09-14T11:32:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.992+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:32:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.993+0000 7f858c940800 20 get_obj_state: octx=0x7f8578066400 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.993+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.993+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15934185635502033396 2024-09-14T11:32:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.993+0000 7f858c940800 20 get_obj_state: octx=0x7f8578066400 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.993+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.993+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.3 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15934185635502033396 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__0 2024-09-14T11:32:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:32:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__1 2024-09-14T11:32:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:32:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.995+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15934185635502033396 2024-09-14T11:32:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.996+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.997+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.997+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.997+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _leOgRB-CexqFZhEKlLKyRc6iyOAjs-w 2024-09-14T11:32:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.997+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.997+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.997+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.5 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _leOgRB-CexqFZhEKlLKyRc6iyOAjs-w 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4E4-mnYgOYjymi3y2adsYv5XzzZb-nB_0 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4E4-mnYgOYjymi3y2adsYv5XzzZb-nB_1 2024-09-14T11:32:41.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:32:41.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:41.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:41.999+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _leOgRB-CexqFZhEKlLKyRc6iyOAjs-w 2024-09-14T11:32:41.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.000+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:32:41.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.000+0000 7f858c940800 20 get_obj_state: octx=0x559d8659dda0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.001+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.001+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _QUJTXWQSzSAxPz55XVEtGgIegtzI436 2024-09-14T11:32:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.001+0000 7f858c940800 20 get_obj_state: octx=0x559d8659dda0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.001+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.001+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.5 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _QUJTXWQSzSAxPz55XVEtGgIegtzI436 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.uppjZzcd7LPPsimlYF2Fhj1oi894RS8_0 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.uppjZzcd7LPPsimlYF2Fhj1oi894RS8_1 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:32:42.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.003+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _QUJTXWQSzSAxPz55XVEtGgIegtzI436 2024-09-14T11:32:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.004+0000 7f858c940800 20 get_obj_state: octx=0x559d865b8070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.004+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:32:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.005+0000 7f858c940800 10 manifest: total_size = 27191 2024-09-14T11:32:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.005+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12908384572725391445 2024-09-14T11:32:42.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.005+0000 7f858c940800 20 get_obj_state: octx=0x559d865b8070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.005+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.005+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.5 2024-09-14T11:32:42.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.007+0000 7f858c940800 20 get_obj_state: octx=0x559d86610fd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.007+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:42.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.007+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _zjyI_vXBkHS9KYf9weFs3IBey666-2i 2024-09-14T11:32:42.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.007+0000 7f858c940800 20 get_obj_state: octx=0x559d86610fd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.007+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.007+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.7 2024-09-14T11:32:42.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.008+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _zjyI_vXBkHS9KYf9weFs3IBey666-2i 2024-09-14T11:32:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.qbgugta73qIawQZhau_VjPDTAguxwlj_1 2024-09-14T11:32:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:42.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.010+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _zjyI_vXBkHS9KYf9weFs3IBey666-2i 2024-09-14T11:32:42.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.011+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.012+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:32:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.012+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.012+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7234002515447149230 2024-09-14T11:32:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.012+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.012+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.012+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.7 2024-09-14T11:32:42.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7234002515447149230 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_0 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_1 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.014+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7234002515447149230 2024-09-14T11:32:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.015+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.016+0000 7f858c940800 20 get_obj_state: octx=0x559d86611080 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.016+0000 7f858c940800 10 manifest: total_size = 27191 2024-09-14T11:32:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.016+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _ClzlMbu1JUFx4PzXkvQLEHDw3OtjhhO 2024-09-14T11:32:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.016+0000 7f858c940800 20 get_obj_state: octx=0x559d86611080 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.016+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.016+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.7 2024-09-14T11:32:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.018+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.018+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.018+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2693998878872487671 2024-09-14T11:32:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.018+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.018+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.018+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.8 2024-09-14T11:32:42.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.019+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:32:42.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.020+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2693998878872487671 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_0 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_1 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.021+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2693998878872487671 2024-09-14T11:32:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.022+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.022+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.022+0000 7f858c940800 10 manifest: total_size = 27191 2024-09-14T11:32:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.022+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _h5KjVVH4pkPtRzfORMv19jJnEVZikmZ 2024-09-14T11:32:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.022+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.022+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.022+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.8 2024-09-14T11:32:42.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=27191 stripe_ofs=27191 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _h5KjVVH4pkPtRzfORMv19jJnEVZikmZ 2024-09-14T11:32:42.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.8ZvuwRRNhbCtfbzLFqnwZV740j3R3eU_0 2024-09-14T11:32:42.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:42.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.024+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _h5KjVVH4pkPtRzfORMv19jJnEVZikmZ 2024-09-14T11:32:42.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.026+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:32:42.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.026+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.026+0000 7f858c940800 10 manifest: total_size = 5242880 2024-09-14T11:32:42.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.026+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5017961284645732713 2024-09-14T11:32:42.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.026+0000 7f858c940800 20 get_obj_state: octx=0x7f85780661a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.026+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.026+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16.9 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5017961284645732713 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__0 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__1 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.028+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5017961284645732713 2024-09-14T11:32:42.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.029+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:32:42.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.029+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:42.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.029+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:42.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.030+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:42.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.030+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:42.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.030+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:42.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.030+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:42.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.030+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:42.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.032+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:32:42.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.032+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.033+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:32:42.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.033+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:32:42.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.033+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:32:42.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.034+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:32:42.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.034+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:32:42.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.034+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595090 cookie 94135051958016 notifier 5913 bl.length()=189 2024-09-14T11:32:42.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.036+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 from cache 2024-09-14T11:32:42.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.036+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16, ofs0, ns] 2024-09-14T11:32:42.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.036+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595130 cookie 94135051950208 notifier 5913 bl.length()=247 2024-09-14T11:32:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.039+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 : miss 2024-09-14T11:32:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.039+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.039+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.039+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 info.flags=0x0 2024-09-14T11:32:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.039+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16 to cache LRU end 2024-09-14T11:32:42.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 : miss 2024-09-14T11:32:42.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:42.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 info.flags=0x17 2024-09-14T11:32:42.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 to cache LRU end 2024-09-14T11:32:42.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:42.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:42.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.042+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 2024-09-14T11:32:42.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.043+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:32:42.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.043+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:32:42.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.044+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:42.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.045+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:32:42.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.045+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:32:42.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.045+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:42.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.045+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:32:42.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.045+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:42.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.045+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:32:42.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.046+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:42.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.046+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:32:42.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.046+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:32:42.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.046+0000 7f858c940800 20 get_obj_state: octx=0x559d865b8cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.047+0000 7f858c940800 10 manifest: total_size = 16377 2024-09-14T11:32:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.047+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _Ykil0GybcWMxo2MQHO3i0r3lQzPsdhf 2024-09-14T11:32:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.047+0000 7f858c940800 20 get_obj_state: octx=0x559d865b8cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.047+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.047+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.0 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _Ykil0GybcWMxo2MQHO3i0r3lQzPsdhf 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.9BkrnxqwePSk5eKbFx-DvAemjQOUyjV_0 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.049+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _Ykil0GybcWMxo2MQHO3i0r3lQzPsdhf 2024-09-14T11:32:42.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.050+0000 7f858c940800 20 get_obj_state: octx=0x7f85780697a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.050+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:32:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.051+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.051+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _daOEt9V2imvT3OK264AdQPYQOIY3_QN 2024-09-14T11:32:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.051+0000 7f858c940800 20 get_obj_state: octx=0x7f85780697a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.051+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.051+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.2 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _daOEt9V2imvT3OK264AdQPYQOIY3_QN 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.B1uN6OgBhAp28P56KQsZCrhfSYMVwW6_1 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.B1uN6OgBhAp28P56KQsZCrhfSYMVwW6_2 2024-09-14T11:32:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:32:42.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.054+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _daOEt9V2imvT3OK264AdQPYQOIY3_QN 2024-09-14T11:32:42.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.055+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:32:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.056+0000 7f858c940800 20 get_obj_state: octx=0x7f857c05d2e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.057+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.057+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14013684162243217326 2024-09-14T11:32:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.057+0000 7f858c940800 20 get_obj_state: octx=0x7f857c05d2e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x559d8636afe8 s->prefetch_data=0 2024-09-14T11:32:42.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.057+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636afe8 2024-09-14T11:32:42.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.057+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.3 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14013684162243217326 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1_1 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2_1 2024-09-14T11:32:42.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:32:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.3 2024-09-14T11:32:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:32:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.059+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14013684162243217326 2024-09-14T11:32:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.060+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.060+0000 7f858c940800 20 get_obj_state: octx=0x559d865b7fd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x559d8636af88 s->prefetch_data=0 2024-09-14T11:32:42.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.061+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.061+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _VN0ApYc7DuzmwHdX57SeqqyO79tguq_ 2024-09-14T11:32:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.061+0000 7f858c940800 20 get_obj_state: octx=0x559d865b7fd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x559d8636af88 s->prefetch_data=0 2024-09-14T11:32:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.061+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af88 2024-09-14T11:32:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.061+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.5 2024-09-14T11:32:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _VN0ApYc7DuzmwHdX57SeqqyO79tguq_ 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Ad1qibR8rVgpyEBN-R6DrBkTmpavWkt_0 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Ad1qibR8rVgpyEBN-R6DrBkTmpavWkt_1 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Ad1qibR8rVgpyEBN-R6DrBkTmpavWkt_2 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.063+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _VN0ApYc7DuzmwHdX57SeqqyO79tguq_ 2024-09-14T11:32:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.064+0000 7f858c940800 20 get_obj_state: octx=0x7f857c05d2e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.064+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:32:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.064+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.064+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _ClrvFrWxkKywnALzyFxZUj_SkdFeJWB 2024-09-14T11:32:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.064+0000 7f858c940800 20 get_obj_state: octx=0x7f857c05d2e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.064+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.064+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.5 2024-09-14T11:32:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _ClrvFrWxkKywnALzyFxZUj_SkdFeJWB 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Eq3eyRiwvS6HRXFe11RPjWY78XPAjTj_0 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Eq3eyRiwvS6HRXFe11RPjWY78XPAjTj_1 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Eq3eyRiwvS6HRXFe11RPjWY78XPAjTj_2 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.066+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _ClrvFrWxkKywnALzyFxZUj_SkdFeJWB 2024-09-14T11:32:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.067+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:32:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.068+0000 7f858c940800 20 get_obj_state: octx=0x7f857c061290 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.068+0000 7f858c940800 10 manifest: total_size = 16377 2024-09-14T11:32:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.068+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15631989479112375834 2024-09-14T11:32:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.068+0000 7f858c940800 20 get_obj_state: octx=0x7f857c061290 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.068+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.068+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.5 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7672 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=1035 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15631989479112375834 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.1 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:32:42.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.2 2024-09-14T11:32:42.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:32:42.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.3 2024-09-14T11:32:42.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:32:42.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.070+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15631989479112375834 2024-09-14T11:32:42.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.071+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:42.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.071+0000 7f858c940800 20 get_obj_state: octx=0x7f85780697a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.072+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.072+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _xhxFueT5lpDgR02I_cLA1-hlnQWPA0F 2024-09-14T11:32:42.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.072+0000 7f858c940800 20 get_obj_state: octx=0x7f85780697a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.072+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.072+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.7 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _xhxFueT5lpDgR02I_cLA1-hlnQWPA0F 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.wGosO6RkJS0uGQfXzd_-KvIfG8XtZ-t_1 2024-09-14T11:32:42.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.wGosO6RkJS0uGQfXzd_-KvIfG8XtZ-t_2 2024-09-14T11:32:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:32:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.074+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _xhxFueT5lpDgR02I_cLA1-hlnQWPA0F 2024-09-14T11:32:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.076+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:32:42.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.076+0000 7f858c940800 20 get_obj_state: octx=0x7f8578066400 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.076+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.076+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18286927467947842341 2024-09-14T11:32:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.076+0000 7f858c940800 20 get_obj_state: octx=0x7f8578066400 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.076+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.076+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.7 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18286927467947842341 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1_1 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:32:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2 2024-09-14T11:32:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:32:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2_1 2024-09-14T11:32:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:32:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.3 2024-09-14T11:32:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:32:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.078+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18286927467947842341 2024-09-14T11:32:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.079+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.079+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.080+0000 7f858c940800 10 manifest: total_size = 16377 2024-09-14T11:32:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.080+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6245589511562896308 2024-09-14T11:32:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.080+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.080+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.080+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.7 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7672 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=1035 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6245589511562896308 2024-09-14T11:32:42.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.1 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.2 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.3 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.082+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6245589511562896308 2024-09-14T11:32:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.083+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:32:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.083+0000 7f858c940800 20 get_obj_state: octx=0x559d865b50f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.084+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.084+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6505664572589819216 2024-09-14T11:32:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.084+0000 7f858c940800 20 get_obj_state: octx=0x559d865b50f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.084+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.084+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.8 2024-09-14T11:32:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6505664572589819216 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1_1 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2_1 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.3 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.086+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6505664572589819216 2024-09-14T11:32:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.087+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.087+0000 7f858c940800 20 get_obj_state: octx=0x559d865c1830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.088+0000 7f858c940800 10 manifest: total_size = 16377 2024-09-14T11:32:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.088+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to _e-mId7770rL7Mn5MfzbNOM-jR-fvA5t 2024-09-14T11:32:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.088+0000 7f858c940800 20 get_obj_state: octx=0x559d865c1830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.088+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.088+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.8 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: _e-mId7770rL7Mn5MfzbNOM-jR-fvA5t 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.OxcygNFPqSwnW5pSKi0_TTNNCWjdDXa_0 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.090+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _e-mId7770rL7Mn5MfzbNOM-jR-fvA5t 2024-09-14T11:32:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.091+0000 7f858c940800 20 get_obj_state: octx=0x7f857c060110 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.091+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:32:42.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.092+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.092+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12742643101260751922 2024-09-14T11:32:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.092+0000 7f858c940800 20 get_obj_state: octx=0x7f857c060110 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x559d8636af28 s->prefetch_data=0 2024-09-14T11:32:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.092+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d8636af28 2024-09-14T11:32:42.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.092+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17.9 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12742643101260751922 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1_1 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2_1 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:32:42.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.3 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.094+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12742643101260751922 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.095+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.095+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.095+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.096+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:42.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.096+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.096+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.096+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.096+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.097+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:32:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.097+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.098+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:32:42.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.098+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:32:42.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.098+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:32:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.099+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:32:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.099+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:32:42.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.099+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595083 cookie 94135051959072 notifier 5913 bl.length()=199 2024-09-14T11:32:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.101+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 from cache 2024-09-14T11:32:42.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.101+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17, ofs0, ns] 2024-09-14T11:32:42.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.101+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595109 cookie 94135051963776 notifier 5913 bl.length()=257 2024-09-14T11:32:42.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.104+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 : miss 2024-09-14T11:32:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.104+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.104+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.104+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 info.flags=0x0 2024-09-14T11:32:42.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.104+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17 to cache LRU end 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 : miss 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 info.flags=0x17 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 to cache LRU end 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.106+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 2024-09-14T11:32:42.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.108+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:42.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.109+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:42.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.109+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.110+0000 7f858c940800 20 get_obj_state: octx=0x559d86599f40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.111+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.111+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.802787930951598564 2024-09-14T11:32:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.111+0000 7f858c940800 20 get_obj_state: octx=0x559d86599f40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.111+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86369dd8 2024-09-14T11:32:42.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.111+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15.3 2024-09-14T11:32:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.802787930951598564 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.1 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-14T11:32:42.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.1_1 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 631 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.2 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 898 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.2_1 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1163 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.3 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1430 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.113+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.802787930951598564 2024-09-14T11:32:42.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.114+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:42.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.114+0000 7f858c940800 20 get_obj_state: octx=0x7f857c05d2e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.115+0000 7f858c940800 10 manifest: total_size = 45360 2024-09-14T11:32:42.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.115+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2803167547595016578 2024-09-14T11:32:42.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.115+0000 7f858c940800 20 get_obj_state: octx=0x7f857c05d2e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.115+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86369dd8 2024-09-14T11:32:42.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.115+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15.5 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2803167547595016578 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-STANDARD.2~60N6nEjC_NJjYIlLC3ZzyNIBboLXkl6.1 2024-09-14T11:32:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:32:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-STANDARD.2~60N6nEjC_NJjYIlLC3ZzyNIBboLXkl6.2 2024-09-14T11:32:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:32:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-STANDARD.2~60N6nEjC_NJjYIlLC3ZzyNIBboLXkl6.3 2024-09-14T11:32:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:32:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.117+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2803167547595016578 2024-09-14T11:32:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.118+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.118+0000 7f858c940800 20 get_obj_state: octx=0x559d86591080 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.118+0000 7f858c940800 10 manifest: total_size = 11534336 2024-09-14T11:32:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.118+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4317020435304289190 2024-09-14T11:32:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.118+0000 7f858c940800 20 get_obj_state: octx=0x559d86591080 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.118+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86369dd8 2024-09-14T11:32:42.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.118+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15.7 2024-09-14T11:32:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4317020435304289190 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.1 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.1_1 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:32:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.2 2024-09-14T11:32:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:32:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.2_1 2024-09-14T11:32:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:32:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.3 2024-09-14T11:32:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:32:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.120+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4317020435304289190 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.121+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.122+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.122+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.122+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.122+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.122+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.122+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:42.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.122+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:42.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.124+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:32:42.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.124+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.125+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:32:42.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.125+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:32:42.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.125+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:32:42.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.126+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:32:42.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.126+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:32:42.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.126+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595140 cookie 94135051967840 notifier 5913 bl.length()=194 2024-09-14T11:32:42.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.128+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 from cache 2024-09-14T11:32:42.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.128+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15, ofs0, ns] 2024-09-14T11:32:42.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.128+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94135051963776 notifier 5913 bl.length()=252 2024-09-14T11:32:42.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.135+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 : miss 2024-09-14T11:32:42.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.135+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.135+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.135+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 info.flags=0x0 2024-09-14T11:32:42.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.135+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15 to cache LRU end 2024-09-14T11:32:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.138+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 : miss 2024-09-14T11:32:42.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.138+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.139+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:32:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.139+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 info.flags=0x17 2024-09-14T11:32:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.139+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 to cache LRU end 2024-09-14T11:32:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.139+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.139+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.139+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 2024-09-14T11:32:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.140+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.141+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.142+0000 7f858c940800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:42.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.143+0000 7f858c940800 20 get_obj_state: octx=0x559d865c1090 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559d865b5fe8 s->prefetch_data=0 2024-09-14T11:32:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.143+0000 7f858c940800 10 manifest: total_size = 10485760 2024-09-14T11:32:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.143+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13976167385162033488 2024-09-14T11:32:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.143+0000 7f858c940800 20 get_obj_state: octx=0x559d865c1090 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559d865b5fe8 s->prefetch_data=0 2024-09-14T11:32:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.143+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865b5fe8 2024-09-14T11:32:42.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.143+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14.3 2024-09-14T11:32:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13976167385162033488 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.WxcM6lMjl9XlMs0wRhN787NHDtQtpUz_0 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.WxcM6lMjl9XlMs0wRhN787NHDtQtpUz_1 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.WxcM6lMjl9XlMs0wRhN787NHDtQtpUz_2 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.145+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13976167385162033488 2024-09-14T11:32:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.147+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.147+0000 7f858c940800 20 get_obj_state: octx=0x559d865c1090 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559d865b5fe8 s->prefetch_data=0 2024-09-14T11:32:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.147+0000 7f858c940800 10 manifest: total_size = 44258 2024-09-14T11:32:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.147+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2583021952490885179 2024-09-14T11:32:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.147+0000 7f858c940800 20 get_obj_state: octx=0x559d865c1090 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559d865b5fe8 s->prefetch_data=0 2024-09-14T11:32:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.147+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865b5fe8 2024-09-14T11:32:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.147+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14.5 2024-09-14T11:32:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.149+0000 7f858c940800 20 get_obj_state: octx=0x7f85780697a0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559d865a2318 s->prefetch_data=0 2024-09-14T11:32:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.150+0000 7f858c940800 10 manifest: total_size = 10485760 2024-09-14T11:32:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.150+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16606933489004616442 2024-09-14T11:32:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.150+0000 7f858c940800 20 get_obj_state: octx=0x7f85780697a0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559d865a2318 s->prefetch_data=0 2024-09-14T11:32:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.150+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865a2318 2024-09-14T11:32:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.150+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14.7 2024-09-14T11:32:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.151+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16606933489004616442 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.5FLWuQZSOsHoEKTLI1zF_7Vqm2GiOLI_0 2024-09-14T11:32:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.5FLWuQZSOsHoEKTLI1zF_7Vqm2GiOLI_1 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.5FLWuQZSOsHoEKTLI1zF_7Vqm2GiOLI_2 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.152+0000 7f858c940800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16606933489004616442 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.153+0000 7f845effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.154+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.154+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.154+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.154+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.154+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.154+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.154+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.156+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:32:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.156+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.157+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:32:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.157+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:32:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.157+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:32:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.158+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:32:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.158+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:32:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.158+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595091 cookie 94135051958016 notifier 5913 bl.length()=184 2024-09-14T11:32:42.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.159+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 from cache 2024-09-14T11:32:42.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.159+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14, ofs0, ns] 2024-09-14T11:32:42.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.160+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595084 cookie 94135051959072 notifier 5913 bl.length()=242 2024-09-14T11:32:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.164+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 : miss 2024-09-14T11:32:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.164+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.164+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.164+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 info.flags=0x0 2024-09-14T11:32:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.164+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14 to cache LRU end 2024-09-14T11:32:42.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 : miss 2024-09-14T11:32:42.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:32:42.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 info.flags=0x17 2024-09-14T11:32:42.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 to cache LRU end 2024-09-14T11:32:42.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:42.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:42.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.167+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 2024-09-14T11:32:42.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.168+0000 7f858c940800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:32:42.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.169+0000 7f858c940800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:32:42.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.170+0000 7f858c940800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:32:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.170+0000 7f858c940800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:32:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.171+0000 7f858c940800 20 get_obj_state: octx=0x559d86557930 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.171+0000 7f858c940800 10 manifest: total_size = 0 2024-09-14T11:32:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.171+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7798198017824761616 2024-09-14T11:32:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.171+0000 7f858c940800 20 get_obj_state: octx=0x559d86557930 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.171+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86369dd8 2024-09-14T11:32:42.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.171+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7.2 2024-09-14T11:32:42.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.173+0000 7f858c940800 20 get_obj_state: octx=0x559d86593990 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.174+0000 7f858c940800 10 manifest: total_size = 0 2024-09-14T11:32:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.174+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16169092274688309948 2024-09-14T11:32:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.174+0000 7f858c940800 20 get_obj_state: octx=0x559d86593990 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.174+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86369dd8 2024-09-14T11:32:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.174+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7.3 2024-09-14T11:32:42.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.175+0000 7f845effd640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:32:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.177+0000 7f858c940800 20 get_obj_state: octx=0x559d86593990 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.177+0000 7f858c940800 10 manifest: total_size = 0 2024-09-14T11:32:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.177+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11398364709182420204 2024-09-14T11:32:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.177+0000 7f858c940800 20 get_obj_state: octx=0x559d86593990 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.177+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86369dd8 2024-09-14T11:32:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.177+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7.6 2024-09-14T11:32:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.178+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:32:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.179+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.179+0000 7f858c940800 10 manifest: total_size = 0 2024-09-14T11:32:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.179+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10943287490871742051 2024-09-14T11:32:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.179+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559d86369dd8 s->prefetch_data=0 2024-09-14T11:32:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.179+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86369dd8 2024-09-14T11:32:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.179+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7.8 2024-09-14T11:32:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.180+0000 7f845effd640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:32:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.182+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.182+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.183+0000 7f845effd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:32:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.183+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.183+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.183+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.183+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.183+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.185+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:32:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.185+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.185+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:32:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.185+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:32:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.185+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:32:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.186+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:32:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.186+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:32:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.186+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595131 cookie 94135051950208 notifier 5913 bl.length()=181 2024-09-14T11:32:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.188+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 from cache 2024-09-14T11:32:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.188+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7, ofs0, ns] 2024-09-14T11:32:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.188+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595088 cookie 94135051973184 notifier 5913 bl.length()=238 2024-09-14T11:32:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.192+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 : miss 2024-09-14T11:32:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.192+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.192+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.192+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 info.flags=0x0 2024-09-14T11:32:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.192+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7 to cache LRU end 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 : miss 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 info.flags=0x17 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 to cache LRU end 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.195+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 2024-09-14T11:32:42.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.196+0000 7f858c940800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:32:42.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.197+0000 7f858c940800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:32:42.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.198+0000 7f858c940800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:32:42.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.198+0000 7f858c940800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:32:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.199+0000 7f858c940800 20 get_obj_state: octx=0x559d865c11d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.200+0000 7f858c940800 10 manifest: total_size = 2078 2024-09-14T11:32:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.200+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14520029631689229216 2024-09-14T11:32:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.200+0000 7f858c940800 20 get_obj_state: octx=0x559d865c11d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.200+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86594ab8 2024-09-14T11:32:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.200+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8.2 2024-09-14T11:32:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.202+0000 7f858c940800 20 get_obj_state: octx=0x559d865c11d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.203+0000 7f858c940800 10 manifest: total_size = 24595 2024-09-14T11:32:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.203+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2791979613551828947 2024-09-14T11:32:42.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.203+0000 7f858c940800 20 get_obj_state: octx=0x559d865c11d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.203+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86594ab8 2024-09-14T11:32:42.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.203+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8.3 2024-09-14T11:32:42.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.203+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:32:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.205+0000 7f858c940800 20 get_obj_state: octx=0x559d865c11d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.205+0000 7f858c940800 10 manifest: total_size = 24595 2024-09-14T11:32:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.205+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5230220042600721146 2024-09-14T11:32:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.205+0000 7f858c940800 20 get_obj_state: octx=0x559d865c11d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.205+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86594ab8 2024-09-14T11:32:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.205+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8.6 2024-09-14T11:32:42.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.206+0000 7f845effd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:32:42.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.208+0000 7f858c940800 20 get_obj_state: octx=0x7f8578069860 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.208+0000 7f858c940800 10 manifest: total_size = 24595 2024-09-14T11:32:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.208+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2700882590642478030 2024-09-14T11:32:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.208+0000 7f858c940800 20 get_obj_state: octx=0x7f8578069860 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559d86594ab8 s->prefetch_data=0 2024-09-14T11:32:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.208+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d86594ab8 2024-09-14T11:32:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.208+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8.8 2024-09-14T11:32:42.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.209+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:32:42.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.210+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:42.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.210+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:42.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.212+0000 7f845effd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:32:42.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.212+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:42.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.212+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:42.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.212+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:42.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.212+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:42.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.212+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:42.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.214+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:32:42.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.214+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.214+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:32:42.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.214+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:32:42.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.214+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:32:42.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.215+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:32:42.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.215+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:32:42.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.216+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595132 cookie 94135051950208 notifier 5913 bl.length()=181 2024-09-14T11:32:42.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.217+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 from cache 2024-09-14T11:32:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.217+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8, ofs0, ns] 2024-09-14T11:32:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.217+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 94135051973184 notifier 5913 bl.length()=238 2024-09-14T11:32:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.221+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 : miss 2024-09-14T11:32:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.221+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.221+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.221+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 info.flags=0x0 2024-09-14T11:32:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.221+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8 to cache LRU end 2024-09-14T11:32:42.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 : miss 2024-09-14T11:32:42.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:32:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 info.flags=0x17 2024-09-14T11:32:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 to cache LRU end 2024-09-14T11:32:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:42.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.224+0000 7f858c940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 2024-09-14T11:32:42.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.225+0000 7f858c940800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:32:42.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.226+0000 7f858c940800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:32:42.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.227+0000 7f858c940800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:32:42.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.228+0000 7f858c940800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:32:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.228+0000 7f858c940800 20 get_obj_state: octx=0x559d865b5410 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.229+0000 7f858c940800 10 manifest: total_size = 55 2024-09-14T11:32:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.229+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17348082751692693455 2024-09-14T11:32:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.229+0000 7f858c940800 20 get_obj_state: octx=0x559d865b5410 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.229+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865bf8f8 2024-09-14T11:32:42.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.229+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9.2 2024-09-14T11:32:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.231+0000 7f858c940800 20 get_obj_state: octx=0x559d865b5410 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.231+0000 7f858c940800 10 manifest: total_size = 1035 2024-09-14T11:32:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.231+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4235183281876296708 2024-09-14T11:32:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.231+0000 7f858c940800 20 get_obj_state: octx=0x559d865b5410 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.231+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865bf8f8 2024-09-14T11:32:42.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.231+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9.3 2024-09-14T11:32:42.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.232+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:32:42.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.233+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.234+0000 7f858c940800 10 manifest: total_size = 1035 2024-09-14T11:32:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.234+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12033147316641701257 2024-09-14T11:32:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.234+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.234+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865bf8f8 2024-09-14T11:32:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.234+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9.6 2024-09-14T11:32:42.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.234+0000 7f845effd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:32:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.236+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.237+0000 7f858c940800 10 manifest: total_size = 49187 2024-09-14T11:32:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.237+0000 7f858c940800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.76548312934512945 2024-09-14T11:32:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.237+0000 7f858c940800 20 get_obj_state: octx=0x7f857807fe60 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559d865bf8f8 s->prefetch_data=0 2024-09-14T11:32:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.237+0000 7f858c940800 20 prepare_atomic_modification: state is not atomic. state=0x559d865bf8f8 2024-09-14T11:32:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.237+0000 7f858c940800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9.8 2024-09-14T11:32:42.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.237+0000 7f845f7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:32:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.239+0000 7f858c940800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:42.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.239+0000 7f858c940800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.240+0000 7f845effd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:32:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.240+0000 7f858c940800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.240+0000 7f858c940800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.240+0000 7f858c940800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.240+0000 7f858c940800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.240+0000 7f858c940800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.242+0000 7f858c940800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:32:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.242+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.242+0000 7f858c940800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:32:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.242+0000 7f858c940800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:32:42.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.242+0000 7f858c940800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:32:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.243+0000 7f858c940800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:32:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.243+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:32:42.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.244+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595133 cookie 94135051950208 notifier 5913 bl.length()=181 2024-09-14T11:32:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.245+0000 7f858c940800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 from cache 2024-09-14T11:32:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.245+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9, ofs0, ns] 2024-09-14T11:32:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.246+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595090 cookie 94135051973184 notifier 5913 bl.length()=238 2024-09-14T11:32:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.248+0000 7f858c940800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 : miss 2024-09-14T11:32:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.248+0000 7f858c940800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.249+0000 7f858c940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.249+0000 7f858c940800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 info.flags=0x0 2024-09-14T11:32:42.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.249+0000 7f858c940800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9 to cache LRU end 2024-09-14T11:32:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.251+0000 7f858c940800 10 removing key index: LZFGQGLAOFNZLKFJDFCC 2024-09-14T11:32:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.252+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:LZFGQGLAOFNZLKFJDFCC, ofs0, ns] 2024-09-14T11:32:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.252+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595111 cookie 94135051963776 notifier 5913 bl.length()=170 2024-09-14T11:32:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.252+0000 7f858c940800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:32:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.253+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:32:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.253+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595092 cookie 94135051958016 notifier 5913 bl.length()=182 2024-09-14T11:32:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.254+0000 7f858c940800 10 removing user buckets index 2024-09-14T11:32:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.255+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:32:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.255+0000 7f845effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595141 cookie 94135051967840 notifier 5913 bl.length()=173 2024-09-14T11:32:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.255+0000 7f858c940800 10 removing user index: ragweed.client.0 2024-09-14T11:32:42.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.256+0000 7f858c940800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:32:42.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.256+0000 7f858c940800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:32:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.257+0000 7f845f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595112 cookie 94135051963776 notifier 5913 bl.length()=165 2024-09-14T11:32:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.258+0000 7f843efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:42.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.260+0000 7f858c940800 20 remove_watcher() i=0 2024-09-14T11:32:42.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.260+0000 7f858c940800 2 removed watcher, disabling cache 2024-09-14T11:32:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.261+0000 7f858c940800 20 remove_watcher() i=1 2024-09-14T11:32:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.262+0000 7f858c940800 20 remove_watcher() i=2 2024-09-14T11:32:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.263+0000 7f858c940800 20 remove_watcher() i=3 2024-09-14T11:32:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.264+0000 7f858c940800 20 remove_watcher() i=4 2024-09-14T11:32:42.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.266+0000 7f858c940800 20 remove_watcher() i=5 2024-09-14T11:32:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.267+0000 7f858c940800 20 remove_watcher() i=6 2024-09-14T11:32:42.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.268+0000 7f858c940800 20 remove_watcher() i=7 2024-09-14T11:32:42.277 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:32:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:42.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.376+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.377+0000 7f08ff51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.377+0000 7f08ff51f800 20 realm 2024-09-14T11:32:42.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.377+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.377+0000 7f08ff51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.377+0000 7f08ff51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:42.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.377+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.378+0000 7f08ff51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.378+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.378+0000 7f08ff51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.378+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.379+0000 7f08ff51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:42.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.379+0000 7f08ff51f800 20 searching for the correct realm 2024-09-14T11:32:42.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.380+0000 7f08faaa1640 0 -- 172.21.15.7:0/4254439324 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f08ec008910 msgr2=0x7f08ec08ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.586+0000 7f08fbaa3640 0 -- 172.21.15.7:0/4254439324 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f08f0067eb0 msgr2=0x7f08f0072000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.592+0000 7f08ff51f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.592+0000 7f08ff51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.592+0000 7f08ff51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.592+0000 7f08ff51f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.592+0000 7f08ff51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.592+0000 7f08ff51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.592+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 zone default found 2024-09-14T11:32:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 4 Realm: () 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 zonegroup default 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.593+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.594+0000 7f08ff51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.594+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.594+0000 7f08ff51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.594+0000 7f08ff51f800 20 started sync module instance, tier type = 2024-09-14T11:32:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.594+0000 7f08ff51f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.603+0000 7f08ff51f800 20 add_watcher() i=0 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.603+0000 7f08ff51f800 20 add_watcher() i=1 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.603+0000 7f08ff51f800 20 add_watcher() i=2 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.603+0000 7f08ff51f800 20 add_watcher() i=3 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.603+0000 7f08ff51f800 20 add_watcher() i=4 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.603+0000 7f08ff51f800 20 add_watcher() i=5 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.603+0000 7f08ff51f800 20 add_watcher() i=6 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.604+0000 7f08ff51f800 20 add_watcher() i=7 2024-09-14T11:32:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.604+0000 7f08ff51f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.605+0000 7f07b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.606+0000 7f08ff51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.606+0000 7f08ff51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:42.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.639+0000 7f07b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:42.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.639+0000 7f08ff51f800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.639+0000 7f08ff51f800 20 Filter name: none 2024-09-14T11:32:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.639+0000 7f072a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.639+0000 7f08ff51f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:32:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.639+0000 7f08ff51f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.640+0000 7f08ff51f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:32:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.640+0000 7f08ff51f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:32:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.640+0000 7f08ff51f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:32:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.640+0000 7f08ff51f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.641+0000 7f08ff51f800 10 removing key index: MEXWHCFWEFHQSEEJIWQC 2024-09-14T11:32:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.642+0000 7f08ff51f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:MEXWHCFWEFHQSEEJIWQC, ofs0, ns] 2024-09-14T11:32:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.642+0000 7f07deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595113 cookie 94876532922048 notifier 5931 bl.length()=170 2024-09-14T11:32:42.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.642+0000 7f08ff51f800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:32:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.643+0000 7f08ff51f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:32:42.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.644+0000 7f07deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595114 cookie 94876532922048 notifier 5931 bl.length()=182 2024-09-14T11:32:42.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.644+0000 7f08ff51f800 10 removing user buckets index 2024-09-14T11:32:42.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.645+0000 7f08ff51f800 10 removing user index: sysuser.client.0 2024-09-14T11:32:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.646+0000 7f08ff51f800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:32:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.646+0000 7f08ff51f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:32:42.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.646+0000 7f07deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595093 cookie 94876532916192 notifier 5931 bl.length()=165 2024-09-14T11:32:42.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.648+0000 7f07b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.650+0000 7f08ff51f800 20 remove_watcher() i=0 2024-09-14T11:32:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.650+0000 7f08ff51f800 2 removed watcher, disabling cache 2024-09-14T11:32:42.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.651+0000 7f08ff51f800 20 remove_watcher() i=1 2024-09-14T11:32:42.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.652+0000 7f08ff51f800 20 remove_watcher() i=2 2024-09-14T11:32:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.653+0000 7f08ff51f800 20 remove_watcher() i=3 2024-09-14T11:32:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.654+0000 7f08ff51f800 20 remove_watcher() i=4 2024-09-14T11:32:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.655+0000 7f08ff51f800 20 remove_watcher() i=5 2024-09-14T11:32:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.656+0000 7f08ff51f800 20 remove_watcher() i=6 2024-09-14T11:32:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:32:42.657+0000 7f08ff51f800 20 remove_watcher() i=7 2024-09-14T11:32:42.665 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:32:42.666 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:32:42.740 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:32:42.750 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:32:42.750 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:32:42.750 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:42.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:32:42.780 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:32:42.780 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:42.850 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:42.850 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:32:42.920 INFO:tasks.workunit:timeout=3h 2024-09-14T11:32:42.920 INFO:tasks.workunit:cleanup=True 2024-09-14T11:32:42.920 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:32:42.990 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:33:39.238 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 94% (12226/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:33:39.544 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:33:39.545 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-14T11:33:39.546 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:33:39.546 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:33:39.546 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:33:39.546 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:33:39.547 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:33:39.617 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:33:39.619 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:33:39.619 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:33:39.669 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:33:39.719 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:33:39.759 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:33:39.761 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:33:39.761 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:33:39.801 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:33:39.805 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:33:39.805 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:33:39.875 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:33:39.876 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:33:39.876 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:33:39.948 INFO:tasks.workunit.client.0.smithi007.stderr:+ ulimit -c 0 2024-09-14T11:33:39.949 INFO:tasks.workunit.client.0.smithi007.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:33:39.949 INFO:tasks.workunit.client.0.smithi007.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:33:39.949 INFO:tasks.workunit.client.0.smithi007.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:33:42.306 INFO:tasks.workunit.client.0.smithi007.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:33:42.306 INFO:tasks.workunit.client.0.smithi007.stderr:++ deactivate nondestructive 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ export VIRTUAL_ENV 2024-09-14T11:33:42.307 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:33:42.308 INFO:tasks.workunit.client.0.smithi007.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:33:42.308 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PATH 2024-09-14T11:33:42.308 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:33:42.308 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -z '' ']' 2024-09-14T11:33:42.309 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:33:42.309 INFO:tasks.workunit.client.0.smithi007.stderr:++ PS1='(rgw) ' 2024-09-14T11:33:42.309 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PS1 2024-09-14T11:33:42.309 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:33:42.309 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:33:42.309 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install pip --upgrade 2024-09-14T11:33:42.551 INFO:tasks.workunit.client.0.smithi007.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:33:42.751 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting pip 2024-09-14T11:33:42.757 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:33:42.805 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: pip 2024-09-14T11:33:42.806 INFO:tasks.workunit.client.0.smithi007.stdout: Attempting uninstall: pip 2024-09-14T11:33:42.806 INFO:tasks.workunit.client.0.smithi007.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:33:42.971 INFO:tasks.workunit.client.0.smithi007.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:33:42.976 INFO:tasks.workunit.client.0.smithi007.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:33:43.746 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed pip-24.2 2024-09-14T11:33:43.793 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install boto3 2024-09-14T11:33:44.689 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting boto3 2024-09-14T11:33:44.690 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:33:45.241 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:33:45.242 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:33:45.296 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:33:45.297 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:33:45.351 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:33:45.352 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:33:45.403 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:45.404 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:33:45.481 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:45.481 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:33:45.691 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:45.693 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:33:45.697 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:33:45.699 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:33:45.708 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:33:45.709 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:33:45.710 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:33:45.712 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:33:45.713 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:33:45.789 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:33:46.879 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:33:46.997 INFO:tasks.workunit.client.0.smithi007.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:33:47.137 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:33:47.187 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:47.187 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:47.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.230+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 20 realm 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.232+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.233+0000 7fee996bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:47.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.233+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.234+0000 7fee996bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:47.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.234+0000 7fee996bb800 20 searching for the correct realm 2024-09-14T11:33:47.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.234+0000 7fee971a5640 0 -- 172.21.15.7:0/3794789360 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x560473593fc0 msgr2=0x560473596480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:47.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.439+0000 7fee971a5640 0 -- 172.21.15.7:0/3794789360 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x560473593fc0 msgr2=0x560473596480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:47.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:33:47.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.448+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:47.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:47.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 zone default found 2024-09-14T11:33:47.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 4 Realm: () 2024-09-14T11:33:47.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:33:47.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 zonegroup default 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.449+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.450+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.450+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.450+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.450+0000 7fee996bb800 20 started sync module instance, tier type = 2024-09-14T11:33:47.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.450+0000 7fee996bb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:33:47.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.460+0000 7fee996bb800 20 add_watcher() i=0 2024-09-14T11:33:47.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.460+0000 7fee996bb800 20 add_watcher() i=1 2024-09-14T11:33:47.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.460+0000 7fee996bb800 20 add_watcher() i=2 2024-09-14T11:33:47.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.460+0000 7fee996bb800 20 add_watcher() i=3 2024-09-14T11:33:47.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.460+0000 7fee996bb800 20 add_watcher() i=4 2024-09-14T11:33:47.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.460+0000 7fee996bb800 20 add_watcher() i=5 2024-09-14T11:33:47.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.460+0000 7fee996bb800 20 add_watcher() i=6 2024-09-14T11:33:47.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.461+0000 7fee996bb800 20 add_watcher() i=7 2024-09-14T11:33:47.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.461+0000 7fee996bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:47.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.463+0000 7fed4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.463+0000 7fee996bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.463+0000 7fee996bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.463+0000 7fee996bb800 5 note: GC not initialized 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.463+0000 7fed4cfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 20 Filter name: none 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fecc67fc640 20 reqs_thread_entry: start 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:33:47.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:47.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:33:47.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:33:47.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:33:47.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 20 rados_obj.operate() r=0 bl.length=22 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.464+0000 7fee996bb800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.465+0000 7fee996bb800 20 rados->read ofs=0 len=0 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.465+0000 7fee996bb800 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.465+0000 7fee996bb800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-14T11:33:47.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.465+0000 7fee996bb800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-14T11:33:47.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.465+0000 7fee996bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:47.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.465+0000 7fee996bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-14T11:33:47.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.465+0000 7fee996bb800 20 get_user_info_from_index found 0 xattrs 2024-09-14T11:33:47.465 INFO:tasks.workunit.client.0.smithi007.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-14T11:33:47.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.466+0000 7fed4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:47.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.468+0000 7fee996bb800 20 remove_watcher() i=0 2024-09-14T11:33:47.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.468+0000 7fee996bb800 2 removed watcher, disabling cache 2024-09-14T11:33:47.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.470+0000 7fee996bb800 20 remove_watcher() i=1 2024-09-14T11:33:47.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.471+0000 7fee996bb800 20 remove_watcher() i=2 2024-09-14T11:33:47.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.472+0000 7fee996bb800 20 remove_watcher() i=3 2024-09-14T11:33:47.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.473+0000 7fee996bb800 20 remove_watcher() i=4 2024-09-14T11:33:47.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.474+0000 7fee996bb800 20 remove_watcher() i=5 2024-09-14T11:33:47.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.475+0000 7fee996bb800 20 remove_watcher() i=6 2024-09-14T11:33:47.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:33:47.476+0000 7fee996bb800 20 remove_watcher() i=7 2024-09-14T11:34:01.975 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:01.976 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:02.022 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:02.023 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:02.036 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:02.037 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:02.050 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:02.050 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:02.056 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:02.056 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:02.141 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard add 2024-09-14T11:34:02.141 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:02.142 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:02.174 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:02.174 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:02.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.219+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.221+0000 7f752f22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.221+0000 7f752f22f800 20 realm 2024-09-14T11:34:02.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.221+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.221+0000 7f752f22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.221+0000 7f752f22f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:02.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.221+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.222+0000 7f752f22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.222+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.223+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.223+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.224+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:02.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.224+0000 7f752f22f800 20 searching for the correct realm 2024-09-14T11:34:02.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.226+0000 7f752d51a640 0 -- 172.21.15.7:0/3654460621 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f7520068000 msgr2=0x7f7520066a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.230+0000 7f752c518640 0 -- 172.21.15.7:0/3654460621 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f751c0a0040 msgr2=0x7f751c0b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:02.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:02.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.438+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:02.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 zone default found 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 4 Realm: () 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 zonegroup default 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.439+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.440+0000 7f752f22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.440+0000 7f752f22f800 20 started sync module instance, tier type = 2024-09-14T11:34:02.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.440+0000 7f752f22f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:02.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.450+0000 7f752f22f800 20 add_watcher() i=0 2024-09-14T11:34:02.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.450+0000 7f752f22f800 20 add_watcher() i=1 2024-09-14T11:34:02.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.450+0000 7f752f22f800 20 add_watcher() i=2 2024-09-14T11:34:02.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.450+0000 7f752f22f800 20 add_watcher() i=3 2024-09-14T11:34:02.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.450+0000 7f752f22f800 20 add_watcher() i=4 2024-09-14T11:34:02.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.450+0000 7f752f22f800 20 add_watcher() i=5 2024-09-14T11:34:02.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.450+0000 7f752f22f800 20 add_watcher() i=6 2024-09-14T11:34:02.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.451+0000 7f752f22f800 20 add_watcher() i=7 2024-09-14T11:34:02.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.451+0000 7f752f22f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:02.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.453+0000 7f73e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.453+0000 7f752f22f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:02.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.453+0000 7f752f22f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:02.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.453+0000 7f752f22f800 5 note: GC not initialized 2024-09-14T11:34:02.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.453+0000 7f73e1fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:02.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.453+0000 7f752f22f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:02.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.454+0000 7f752f22f800 20 Filter name: none 2024-09-14T11:34:02.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.454+0000 7f73537fe640 20 reqs_thread_entry: start 2024-09-14T11:34:02.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.454+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.454+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:02.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.454+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.455+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:02.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.455+0000 7f752f22f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:02.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.455+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.456+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:02.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.456+0000 7f752f22f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.456+0000 7f752f22f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:02.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.456+0000 7f752f22f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:02.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.458+0000 7f73e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.460+0000 7f752f22f800 20 remove_watcher() i=0 2024-09-14T11:34:02.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.460+0000 7f752f22f800 2 removed watcher, disabling cache 2024-09-14T11:34:02.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.461+0000 7f752f22f800 20 remove_watcher() i=1 2024-09-14T11:34:02.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.462+0000 7f752f22f800 20 remove_watcher() i=2 2024-09-14T11:34:02.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.463+0000 7f752f22f800 20 remove_watcher() i=3 2024-09-14T11:34:02.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.465+0000 7f752f22f800 20 remove_watcher() i=4 2024-09-14T11:34:02.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.466+0000 7f752f22f800 20 remove_watcher() i=5 2024-09-14T11:34:02.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.467+0000 7f752f22f800 20 remove_watcher() i=6 2024-09-14T11:34:02.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.468+0000 7f752f22f800 20 remove_watcher() i=7 2024-09-14T11:34:02.479 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:02.479 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:02.479 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:34:02.479 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:02.480 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:34:02.512 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:02.512 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:02.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.555+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.557+0000 7f18abf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.557+0000 7f18abf25800 20 realm 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.557+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.558+0000 7f18abf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.558+0000 7f18abf25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.558+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.558+0000 7f18abf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.558+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.559+0000 7f18abf25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.559+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.761+0000 7f18abf25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:02.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.761+0000 7f18abf25800 20 searching for the correct realm 2024-09-14T11:34:02.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.762+0000 7f18a7332640 0 -- 172.21.15.7:0/4123058856 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f18980636d0 msgr2=0x7f1898062140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:02.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.968+0000 7f18a8334640 0 -- 172.21.15.7:0/4123058856 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f189c082020 msgr2=0x7f189c0b5540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.975+0000 7f18abf25800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.975+0000 7f18abf25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.975+0000 7f18abf25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.975+0000 7f18abf25800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.975+0000 7f18abf25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.975+0000 7f18abf25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.975+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.976+0000 7f18abf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.976+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.976+0000 7f18abf25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.976+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:02.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 zone default found 2024-09-14T11:34:02.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 4 Realm: () 2024-09-14T11:34:02.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:02.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 zonegroup default 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.977+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.978+0000 7f18abf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.978+0000 7f18abf25800 20 started sync module instance, tier type = 2024-09-14T11:34:02.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.978+0000 7f18abf25800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:02.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=0 2024-09-14T11:34:02.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=1 2024-09-14T11:34:02.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=2 2024-09-14T11:34:02.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=3 2024-09-14T11:34:02.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=4 2024-09-14T11:34:02.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=5 2024-09-14T11:34:02.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=6 2024-09-14T11:34:02.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 20 add_watcher() i=7 2024-09-14T11:34:02.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.988+0000 7f18abf25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:02.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.991+0000 7f175dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.991+0000 7f18abf25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.991+0000 7f18abf25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.991+0000 7f18abf25800 5 note: GC not initialized 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.991+0000 7f175cfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.991+0000 7f18abf25800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.991+0000 7f18abf25800 20 Filter name: none 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f16d67fc640 20 reqs_thread_entry: start 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f18abf25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:02.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f18abf25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:02.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f18abf25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:02.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f18abf25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:02.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f18abf25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:34:02.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.992+0000 7f18abf25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.993+0000 7f18abf25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:02.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.993+0000 7f18abf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:02.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.993+0000 7f18abf25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:02.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.993+0000 7f18abf25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:02.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.993+0000 7f18abf25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:02.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.993+0000 7f18abf25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:02.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.995+0000 7f175dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.997+0000 7f18abf25800 20 remove_watcher() i=0 2024-09-14T11:34:02.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.997+0000 7f18abf25800 2 removed watcher, disabling cache 2024-09-14T11:34:02.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.998+0000 7f18abf25800 20 remove_watcher() i=1 2024-09-14T11:34:02.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:02.999+0000 7f18abf25800 20 remove_watcher() i=2 2024-09-14T11:34:02.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.001+0000 7f18abf25800 20 remove_watcher() i=3 2024-09-14T11:34:02.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.002+0000 7f18abf25800 20 remove_watcher() i=4 2024-09-14T11:34:03.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.003+0000 7f18abf25800 20 remove_watcher() i=5 2024-09-14T11:34:03.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.004+0000 7f18abf25800 20 remove_watcher() i=6 2024-09-14T11:34:03.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.005+0000 7f18abf25800 20 remove_watcher() i=7 2024-09-14T11:34:03.016 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshard list 2024-09-14T11:34:03.044 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:03.044 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:03.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.086+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.087+0000 7fe642a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.087+0000 7fe642a0e800 20 realm 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.087+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.088+0000 7fe642a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.088+0000 7fe642a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.088+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.088+0000 7fe642a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.088+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.089+0000 7fe642a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:03.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.089+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.090+0000 7fe642a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:03.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.090+0000 7fe642a0e800 20 searching for the correct realm 2024-09-14T11:34:03.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.092+0000 7fe63e85a640 0 -- 172.21.15.7:0/1984822349 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe63407d040 msgr2=0x7fe63407d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:03.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.298+0000 7fe63e85a640 0 -- 172.21.15.7:0/1984822349 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe63407d040 msgr2=0x7fe63407d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:03.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.304+0000 7fe642a0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:03.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.304+0000 7fe642a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:03.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.304+0000 7fe642a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:03.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.304+0000 7fe642a0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:03.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.304+0000 7fe642a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:03.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.304+0000 7fe642a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:03.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.304+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.305+0000 7fe642a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.305+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.305+0000 7fe642a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.305+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 zone default found 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 4 Realm: () 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 zonegroup default 2024-09-14T11:34:03.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.306+0000 7fe642a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.307+0000 7fe642a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.307+0000 7fe642a0e800 20 started sync module instance, tier type = 2024-09-14T11:34:03.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.307+0000 7fe642a0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:03.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=0 2024-09-14T11:34:03.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=1 2024-09-14T11:34:03.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=2 2024-09-14T11:34:03.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=3 2024-09-14T11:34:03.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=4 2024-09-14T11:34:03.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=5 2024-09-14T11:34:03.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=6 2024-09-14T11:34:03.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 20 add_watcher() i=7 2024-09-14T11:34:03.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.317+0000 7fe642a0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:03.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.319+0000 7fe4f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:03.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.320+0000 7fe642a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:03.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.320+0000 7fe642a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:03.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.320+0000 7fe642a0e800 5 note: GC not initialized 2024-09-14T11:34:03.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.320+0000 7fe46f7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:03.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.320+0000 7fe642a0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:03.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.320+0000 7fe642a0e800 20 Filter name: none 2024-09-14T11:34:03.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.320+0000 7fe46d7fa640 20 reqs_thread_entry: start 2024-09-14T11:34:03.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.327+0000 7fe4f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:03.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.330+0000 7fe642a0e800 20 remove_watcher() i=0 2024-09-14T11:34:03.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.330+0000 7fe642a0e800 2 removed watcher, disabling cache 2024-09-14T11:34:03.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.331+0000 7fe642a0e800 20 remove_watcher() i=1 2024-09-14T11:34:03.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.332+0000 7fe642a0e800 20 remove_watcher() i=2 2024-09-14T11:34:03.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.333+0000 7fe642a0e800 20 remove_watcher() i=3 2024-09-14T11:34:03.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.334+0000 7fe642a0e800 20 remove_watcher() i=4 2024-09-14T11:34:03.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.335+0000 7fe642a0e800 20 remove_watcher() i=5 2024-09-14T11:34:03.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.336+0000 7fe642a0e800 20 remove_watcher() i=6 2024-09-14T11:34:03.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.337+0000 7fe642a0e800 20 remove_watcher() i=7 2024-09-14T11:34:03.346 INFO:tasks.workunit.client.0.smithi007.stderr:bucket name a-bucket 2024-09-14T11:34:03.346 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard process 2024-09-14T11:34:03.346 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:03.347 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshard process 2024-09-14T11:34:03.375 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:03.375 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:03.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.418+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 20 realm 2024-09-14T11:34:03.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:03.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.420+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.421+0000 7f002ab37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:03.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.421+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.422+0000 7f002ab37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:03.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.422+0000 7f002ab37800 20 searching for the correct realm 2024-09-14T11:34:03.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.423+0000 7f002687d640 0 -- 172.21.15.7:0/3462069996 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x561ee835a680 msgr2=0x561ee835cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:03.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.426+0000 7f002687d640 0 -- 172.21.15.7:0/3462069996 >> [v2:172.21.15.7:6800/3296984494,v1:172.21.15.7:6801/3296984494] conn(0x561ee834e280 msgr2=0x561ee8350710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.433+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 zone default found 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 4 Realm: () 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 zonegroup default 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.434+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.435+0000 7f002ab37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.435+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.435+0000 7f002ab37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.435+0000 7f002ab37800 20 started sync module instance, tier type = 2024-09-14T11:34:03.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.435+0000 7f002ab37800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:03.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=0 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=1 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=2 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=3 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=4 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=5 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=6 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 20 add_watcher() i=7 2024-09-14T11:34:03.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.444+0000 7f002ab37800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.446+0000 7efedd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.446+0000 7f002ab37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.446+0000 7f002ab37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.446+0000 7f002ab37800 5 note: GC not initialized 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.447+0000 7efe57fff640 20 reqs_thread_entry: start 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.447+0000 7f002ab37800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.447+0000 7f002ab37800 20 Filter name: none 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.447+0000 7efe55ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:03.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.447+0000 7f002ab37800 20 processing logshard = reshard.0000000000 2024-09-14T11:34:03.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.450+0000 7f002ab37800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:34:03.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.450+0000 7f002ab37800 20 processing logshard = reshard.0000000001 2024-09-14T11:34:03.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.452+0000 7f002ab37800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:34:03.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.452+0000 7f002ab37800 20 processing logshard = reshard.0000000002 2024-09-14T11:34:03.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.455+0000 7f002ab37800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:34:03.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.455+0000 7f002ab37800 20 processing logshard = reshard.0000000003 2024-09-14T11:34:03.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.457+0000 7f002ab37800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:34:03.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.457+0000 7f002ab37800 20 processing logshard = reshard.0000000004 2024-09-14T11:34:03.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.460+0000 7f002ab37800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:34:03.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.460+0000 7f002ab37800 20 processing logshard = reshard.0000000005 2024-09-14T11:34:03.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.462+0000 7f002ab37800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:34:03.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.462+0000 7f002ab37800 20 processing logshard = reshard.0000000006 2024-09-14T11:34:03.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 20 process_entry resharding a-bucket 2024-09-14T11:34:03.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:03.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:03.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:34:03.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:03.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:34:03.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:03.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:03.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:03.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:03.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:03.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.464+0000 7f002ab37800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7eff09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529735 cookie 94690744844928 notifier 5789 bl.length()=911 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7eff09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7eff09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:03.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7eff09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:03.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:34:03.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:34:03.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:34:03.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.473+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.0 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.0 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.1 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.1 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.2 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.2 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.3 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.3 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.4 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.4 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.5 2024-09-14T11:34:03.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.5 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.6 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.6 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.7 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.7 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.8 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.8 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.9 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.9 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.10 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.10 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.11 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.11 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.0 2024-09-14T11:34:03.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1 2024-09-14T11:34:03.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.479+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2 2024-09-14T11:34:03.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.480+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3 2024-09-14T11:34:03.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.480+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.4 2024-09-14T11:34:03.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.481+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.5 2024-09-14T11:34:03.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.481+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.6 2024-09-14T11:34:03.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.482+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.7 2024-09-14T11:34:03.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.483+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.8 2024-09-14T11:34:03.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.483+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.9 2024-09-14T11:34:03.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.484+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.10 2024-09-14T11:34:03.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.484+0000 7f002ab37800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:03.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.484+0000 7f002ab37800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7eff0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529736 cookie 94690744844928 notifier 5789 bl.length()=911 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7eff0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7eff0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:03.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7eff0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:03.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:34:03.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:34:03.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:34:03.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.486+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:34:03.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.489+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.0 2024-09-14T11:34:03.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.489+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1 2024-09-14T11:34:03.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.490+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2 2024-09-14T11:34:03.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.490+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3 2024-09-14T11:34:03.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.490+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.4 2024-09-14T11:34:03.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.490+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.5 2024-09-14T11:34:03.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.491+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.6 2024-09-14T11:34:03.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.491+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.7 2024-09-14T11:34:03.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.491+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.8 2024-09-14T11:34:03.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.492+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.9 2024-09-14T11:34:03.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.492+0000 7f002ab37800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.10 2024-09-14T11:34:03.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.493+0000 7f002ab37800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:03.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.493+0000 7f002ab37800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7eff09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529737 cookie 94690744844928 notifier 5789 bl.length()=879 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7eff09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7eff09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:03.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7eff09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:03.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:34:03.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:34:03.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:34:03.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.494+0000 7f002ab37800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:34:03.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.497+0000 7f002ab37800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:03.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.498+0000 7f002ab37800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:34:03.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.500+0000 7f002ab37800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:34:03.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.500+0000 7f002ab37800 20 processing logshard = reshard.0000000007 2024-09-14T11:34:03.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.502+0000 7f002ab37800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:34:03.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.502+0000 7f002ab37800 20 processing logshard = reshard.0000000008 2024-09-14T11:34:03.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.504+0000 7f002ab37800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:34:03.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.504+0000 7f002ab37800 20 processing logshard = reshard.0000000009 2024-09-14T11:34:03.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.506+0000 7f002ab37800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:34:03.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.506+0000 7f002ab37800 20 processing logshard = reshard.0000000010 2024-09-14T11:34:03.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.509+0000 7f002ab37800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:34:03.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.509+0000 7f002ab37800 20 processing logshard = reshard.0000000011 2024-09-14T11:34:03.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.511+0000 7f002ab37800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:34:03.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.511+0000 7f002ab37800 20 processing logshard = reshard.0000000012 2024-09-14T11:34:03.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.514+0000 7f002ab37800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:34:03.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.514+0000 7f002ab37800 20 processing logshard = reshard.0000000013 2024-09-14T11:34:03.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.516+0000 7f002ab37800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:34:03.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.516+0000 7f002ab37800 20 processing logshard = reshard.0000000014 2024-09-14T11:34:03.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.518+0000 7f002ab37800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:34:03.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.518+0000 7f002ab37800 20 processing logshard = reshard.0000000015 2024-09-14T11:34:03.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.521+0000 7f002ab37800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:34:03.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.522+0000 7efedd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:03.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.524+0000 7f002ab37800 20 remove_watcher() i=0 2024-09-14T11:34:03.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.524+0000 7f002ab37800 2 removed watcher, disabling cache 2024-09-14T11:34:03.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.525+0000 7f002ab37800 20 remove_watcher() i=1 2024-09-14T11:34:03.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.526+0000 7f002ab37800 20 remove_watcher() i=2 2024-09-14T11:34:03.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.527+0000 7f002ab37800 20 remove_watcher() i=3 2024-09-14T11:34:03.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.528+0000 7f002ab37800 20 remove_watcher() i=4 2024-09-14T11:34:03.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.529+0000 7f002ab37800 20 remove_watcher() i=5 2024-09-14T11:34:03.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.529+0000 7f002ab37800 20 remove_watcher() i=6 2024-09-14T11:34:03.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:03.530+0000 7f002ab37800 20 remove_watcher() i=7 2024-09-14T11:34:08.547 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:08.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.823+0000 7fbd25998640 0 --2- 172.21.15.7:0/3743793452 >> [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] conn(0x558daf139820 0x558daf13faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:34:08.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.833+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 20 realm 2024-09-14T11:34:08.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.835+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.836+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.837+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.837+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.838+0000 7fbd2a533800 20 searching for the correct realm 2024-09-14T11:34:08.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.838+0000 7fbd26199640 0 -- 172.21.15.7:0/1335308611 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x558daf1ad180 msgr2=0x558daf1af640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.842+0000 7fbd26199640 0 -- 172.21.15.7:0/1335308611 >> [v2:172.21.15.7:6800/3296984494,v1:172.21.15.7:6801/3296984494] conn(0x558daf1a0970 msgr2=0x558daf1a2d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.850+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 zone default found 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 4 Realm: () 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 zonegroup default 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.851+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.852+0000 7fbd2a533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.852+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.852+0000 7fbd2a533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.852+0000 7fbd2a533800 20 started sync module instance, tier type = 2024-09-14T11:34:08.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.852+0000 7fbd2a533800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.862+0000 7fbd2a533800 20 add_watcher() i=0 2024-09-14T11:34:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.862+0000 7fbd2a533800 20 add_watcher() i=1 2024-09-14T11:34:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.862+0000 7fbd2a533800 20 add_watcher() i=2 2024-09-14T11:34:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.862+0000 7fbd2a533800 20 add_watcher() i=3 2024-09-14T11:34:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.862+0000 7fbd2a533800 20 add_watcher() i=4 2024-09-14T11:34:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.862+0000 7fbd2a533800 20 add_watcher() i=5 2024-09-14T11:34:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.862+0000 7fbd2a533800 20 add_watcher() i=6 2024-09-14T11:34:08.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.863+0000 7fbd2a533800 20 add_watcher() i=7 2024-09-14T11:34:08.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.863+0000 7fbd2a533800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.865+0000 7fbbdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbd2a533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbd2a533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbd2a533800 5 note: GC not initialized 2024-09-14T11:34:08.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbb577fe640 20 reqs_thread_entry: start 2024-09-14T11:34:08.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbd2a533800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbd2a533800 20 Filter name: none 2024-09-14T11:34:08.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbb557fa640 20 reqs_thread_entry: start 2024-09-14T11:34:08.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.866+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.867+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.867+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.867+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.867+0000 7fbd2a533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.867+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.868+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.868+0000 7fbd2a533800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.868+0000 7fbd2a533800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.868+0000 7fbd2a533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.870+0000 7fbbdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.874+0000 7fbd2a533800 20 remove_watcher() i=0 2024-09-14T11:34:08.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.874+0000 7fbd2a533800 2 removed watcher, disabling cache 2024-09-14T11:34:08.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.875+0000 7fbd2a533800 20 remove_watcher() i=1 2024-09-14T11:34:08.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.876+0000 7fbd2a533800 20 remove_watcher() i=2 2024-09-14T11:34:08.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.878+0000 7fbd2a533800 20 remove_watcher() i=3 2024-09-14T11:34:08.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.879+0000 7fbd2a533800 20 remove_watcher() i=4 2024-09-14T11:34:08.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.880+0000 7fbd2a533800 20 remove_watcher() i=5 2024-09-14T11:34:08.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.881+0000 7fbd2a533800 20 remove_watcher() i=6 2024-09-14T11:34:08.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:08.882+0000 7fbd2a533800 20 remove_watcher() i=7 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard add non empty bucket 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:08.897 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.897 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.905 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.905 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.912 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.912 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.918 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.918 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.925 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.925 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.931 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.931 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.937 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.938 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.944 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.944 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:08.949 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:08.978 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.978 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:09.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.020+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.022+0000 7f4867cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.022+0000 7f4867cbb800 20 realm 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.022+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.023+0000 7f4867cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.023+0000 7f4867cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.023+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.023+0000 7f4867cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.023+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.024+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:09.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.024+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.025+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:09.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.025+0000 7f4867cbb800 20 searching for the correct realm 2024-09-14T11:34:09.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.026+0000 7f4865fa6640 0 -- 172.21.15.7:0/786762132 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f485c009ca0 msgr2=0x7f485c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:09.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.233+0000 7f4864fa4640 0 -- 172.21.15.7:0/786762132 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f485804e130 msgr2=0x7f48580671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:09.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.440+0000 7f4867cbb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:09.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.440+0000 7f4867cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:09.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.440+0000 7f4867cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:09.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.440+0000 7f4867cbb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:09.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.440+0000 7f4867cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:09.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.440+0000 7f4867cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:09.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.440+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:09.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:09.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 zone default found 2024-09-14T11:34:09.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 4 Realm: () 2024-09-14T11:34:09.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:09.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 zonegroup default 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.441+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.442+0000 7f4867cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.442+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.442+0000 7f4867cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.442+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.442+0000 7f4867cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.442+0000 7f4867cbb800 20 started sync module instance, tier type = 2024-09-14T11:34:09.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.442+0000 7f4867cbb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:09.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.452+0000 7f4867cbb800 20 add_watcher() i=0 2024-09-14T11:34:09.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.452+0000 7f4867cbb800 20 add_watcher() i=1 2024-09-14T11:34:09.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.452+0000 7f4867cbb800 20 add_watcher() i=2 2024-09-14T11:34:09.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.452+0000 7f4867cbb800 20 add_watcher() i=3 2024-09-14T11:34:09.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.452+0000 7f4867cbb800 20 add_watcher() i=4 2024-09-14T11:34:09.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.452+0000 7f4867cbb800 20 add_watcher() i=5 2024-09-14T11:34:09.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.452+0000 7f4867cbb800 20 add_watcher() i=6 2024-09-14T11:34:09.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.454+0000 7f4867cbb800 20 add_watcher() i=7 2024-09-14T11:34:09.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.454+0000 7f4867cbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:09.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.455+0000 7f471b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f4867cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f4867cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f4867cbb800 5 note: GC not initialized 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f471a7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f4867cbb800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f4867cbb800 20 Filter name: none 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f468bfff640 20 reqs_thread_entry: start 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.456+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.457+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.457+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.458+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.458+0000 7f4867cbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.458+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.458+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.458+0000 7f4867cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.459+0000 7f4867cbb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.459+0000 7f4867cbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:09.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.461+0000 7f471b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:09.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.463+0000 7f4867cbb800 20 remove_watcher() i=0 2024-09-14T11:34:09.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.463+0000 7f4867cbb800 2 removed watcher, disabling cache 2024-09-14T11:34:09.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.464+0000 7f4867cbb800 20 remove_watcher() i=1 2024-09-14T11:34:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.465+0000 7f4867cbb800 20 remove_watcher() i=2 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.467+0000 7f4867cbb800 20 remove_watcher() i=3 2024-09-14T11:34:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.468+0000 7f4867cbb800 20 remove_watcher() i=4 2024-09-14T11:34:09.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.469+0000 7f4867cbb800 20 remove_watcher() i=5 2024-09-14T11:34:09.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.470+0000 7f4867cbb800 20 remove_watcher() i=6 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.471+0000 7f4867cbb800 20 remove_watcher() i=7 2024-09-14T11:34:09.480 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:34:09.481 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:09.482 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:34:09.514 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:09.514 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:09.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.558+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 20 realm 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.559+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.560+0000 7f41bcd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:09.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.560+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.561+0000 7f41bcd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:09.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.561+0000 7f41bcd2e800 20 searching for the correct realm 2024-09-14T11:34:09.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.563+0000 7f41b92de640 0 -- 172.21.15.7:0/1886398568 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f41a009b040 msgr2=0x7f41a007e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:09.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.770+0000 7f41b82dc640 0 -- 172.21.15.7:0/1886398568 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f41a801c920 msgr2=0x7f41a8046400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.978+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:09.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 zone default found 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 4 Realm: () 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 zonegroup default 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.979+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.980+0000 7f41bcd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.980+0000 7f41bcd2e800 20 started sync module instance, tier type = 2024-09-14T11:34:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.980+0000 7f41bcd2e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.990+0000 7f41bcd2e800 20 add_watcher() i=0 2024-09-14T11:34:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.990+0000 7f41bcd2e800 20 add_watcher() i=1 2024-09-14T11:34:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.990+0000 7f41bcd2e800 20 add_watcher() i=2 2024-09-14T11:34:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.990+0000 7f41bcd2e800 20 add_watcher() i=3 2024-09-14T11:34:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.990+0000 7f41bcd2e800 20 add_watcher() i=4 2024-09-14T11:34:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.990+0000 7f41bcd2e800 20 add_watcher() i=5 2024-09-14T11:34:09.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.990+0000 7f41bcd2e800 20 add_watcher() i=6 2024-09-14T11:34:09.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.991+0000 7f41bcd2e800 20 add_watcher() i=7 2024-09-14T11:34:09.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.991+0000 7f41bcd2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:09.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.993+0000 7f406efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.993+0000 7f41bcd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.993+0000 7f41bcd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.993+0000 7f41bcd2e800 5 note: GC not initialized 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f406dfe3640 20 reqs_thread_entry: start 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 20 Filter name: none 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f3fdf7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:09.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:09.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:09.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:09.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:34:09.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.994+0000 7f41bcd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.995+0000 7f41bcd2e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:09.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.995+0000 7f41bcd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:09.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.995+0000 7f41bcd2e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:09.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.995+0000 7f41bcd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:09.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.995+0000 7f41bcd2e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:09.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.995+0000 7f41bcd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:09.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.997+0000 7f406efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:09.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.999+0000 7f41bcd2e800 20 remove_watcher() i=0 2024-09-14T11:34:09.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:09.999+0000 7f41bcd2e800 2 removed watcher, disabling cache 2024-09-14T11:34:09.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.001+0000 7f41bcd2e800 20 remove_watcher() i=1 2024-09-14T11:34:09.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.002+0000 7f41bcd2e800 20 remove_watcher() i=2 2024-09-14T11:34:10.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.003+0000 7f41bcd2e800 20 remove_watcher() i=3 2024-09-14T11:34:10.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.004+0000 7f41bcd2e800 20 remove_watcher() i=4 2024-09-14T11:34:10.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.005+0000 7f41bcd2e800 20 remove_watcher() i=5 2024-09-14T11:34:10.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.006+0000 7f41bcd2e800 20 remove_watcher() i=6 2024-09-14T11:34:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.007+0000 7f41bcd2e800 20 remove_watcher() i=7 2024-09-14T11:34:10.018 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshard list 2024-09-14T11:34:10.045 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:10.045 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:10.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.087+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 20 realm 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.089+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.090+0000 7f45deb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:10.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.090+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.091+0000 7f45deb46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:10.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.091+0000 7f45deb46800 20 searching for the correct realm 2024-09-14T11:34:10.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.093+0000 7f45dc637640 0 -- 172.21.15.7:0/2667450830 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f45d4081070 msgr2=0x7f45d40ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:10.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.299+0000 7f45dc637640 0 -- 172.21.15.7:0/2667450830 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f45d4081070 msgr2=0x7f45d40ae9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:10.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.303+0000 7f45deb46800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:10.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.303+0000 7f45deb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:10.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.303+0000 7f45deb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:10.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.303+0000 7f45deb46800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:10.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.303+0000 7f45deb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:10.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.303+0000 7f45deb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:10.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.303+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:10.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:10.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 zone default found 2024-09-14T11:34:10.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 4 Realm: () 2024-09-14T11:34:10.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 zonegroup default 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.304+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.305+0000 7f45deb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.305+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.305+0000 7f45deb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.305+0000 7f45deb46800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.305+0000 7f45deb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.305+0000 7f45deb46800 20 started sync module instance, tier type = 2024-09-14T11:34:10.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.305+0000 7f45deb46800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.315+0000 7f45deb46800 20 add_watcher() i=0 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.315+0000 7f45deb46800 20 add_watcher() i=1 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.315+0000 7f45deb46800 20 add_watcher() i=2 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.315+0000 7f45deb46800 20 add_watcher() i=3 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.315+0000 7f45deb46800 20 add_watcher() i=4 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.315+0000 7f45deb46800 20 add_watcher() i=5 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.315+0000 7f45deb46800 20 add_watcher() i=6 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.316+0000 7f45deb46800 20 add_watcher() i=7 2024-09-14T11:34:10.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.316+0000 7f45deb46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:10.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.318+0000 7f4492fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:10.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.318+0000 7f45deb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:10.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.318+0000 7f45deb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:10.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.318+0000 7f45deb46800 5 note: GC not initialized 2024-09-14T11:34:10.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.318+0000 7f4491fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:10.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.318+0000 7f45deb46800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:10.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.318+0000 7f45deb46800 20 Filter name: none 2024-09-14T11:34:10.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.319+0000 7f44037fe640 20 reqs_thread_entry: start 2024-09-14T11:34:10.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.326+0000 7f4492fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:10.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.328+0000 7f45deb46800 20 remove_watcher() i=0 2024-09-14T11:34:10.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.328+0000 7f45deb46800 2 removed watcher, disabling cache 2024-09-14T11:34:10.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.330+0000 7f45deb46800 20 remove_watcher() i=1 2024-09-14T11:34:10.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.331+0000 7f45deb46800 20 remove_watcher() i=2 2024-09-14T11:34:10.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.332+0000 7f45deb46800 20 remove_watcher() i=3 2024-09-14T11:34:10.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.334+0000 7f45deb46800 20 remove_watcher() i=4 2024-09-14T11:34:10.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.334+0000 7f45deb46800 20 remove_watcher() i=5 2024-09-14T11:34:10.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.335+0000 7f45deb46800 20 remove_watcher() i=6 2024-09-14T11:34:10.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.336+0000 7f45deb46800 20 remove_watcher() i=7 2024-09-14T11:34:10.345 INFO:tasks.workunit.client.0.smithi007.stderr:bucket name a-bucket 2024-09-14T11:34:10.345 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard process non empty bucket 2024-09-14T11:34:10.345 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:10.346 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshard process 2024-09-14T11:34:10.374 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:10.374 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:10.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.417+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 20 realm 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.419+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.420+0000 7fc3dff40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:10.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.420+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.421+0000 7fc3dff40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:10.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.421+0000 7fc3dff40800 20 searching for the correct realm 2024-09-14T11:34:10.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.422+0000 7fc3dc4c1640 0 -- 172.21.15.7:0/4221288999 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc3d003d060 msgr2=0x7fc3d0067d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:10.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.628+0000 7fc3db4bf640 0 -- 172.21.15.7:0/4221288999 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc3cc0a92c0 msgr2=0x7fc3cc0567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:10.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.835+0000 7fc3dff40800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.835+0000 7fc3dff40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.835+0000 7fc3dff40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.835+0000 7fc3dff40800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.835+0000 7fc3dff40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.835+0000 7fc3dff40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.835+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.836+0000 7fc3dff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.836+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.836+0000 7fc3dff40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.836+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.836+0000 7fc3dff40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 20 zone default found 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 4 Realm: () 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 20 zonegroup default 2024-09-14T11:34:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.837+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.838+0000 7fc3dff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.838+0000 7fc3dff40800 20 started sync module instance, tier type = 2024-09-14T11:34:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.838+0000 7fc3dff40800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:10.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.848+0000 7fc3dff40800 20 add_watcher() i=0 2024-09-14T11:34:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.848+0000 7fc3dff40800 20 add_watcher() i=1 2024-09-14T11:34:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.848+0000 7fc3dff40800 20 add_watcher() i=2 2024-09-14T11:34:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.848+0000 7fc3dff40800 20 add_watcher() i=3 2024-09-14T11:34:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.848+0000 7fc3dff40800 20 add_watcher() i=4 2024-09-14T11:34:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.848+0000 7fc3dff40800 20 add_watcher() i=5 2024-09-14T11:34:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.848+0000 7fc3dff40800 20 add_watcher() i=6 2024-09-14T11:34:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.849+0000 7fc3dff40800 20 add_watcher() i=7 2024-09-14T11:34:10.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.849+0000 7fc3dff40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:10.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.850+0000 7fc291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc3dff40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc3dff40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc3dff40800 5 note: GC not initialized 2024-09-14T11:34:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc290fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc3dff40800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc3dff40800 20 Filter name: none 2024-09-14T11:34:10.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc20a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:10.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.851+0000 7fc3dff40800 20 processing logshard = reshard.0000000000 2024-09-14T11:34:10.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.854+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:34:10.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.854+0000 7fc3dff40800 20 processing logshard = reshard.0000000001 2024-09-14T11:34:10.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.857+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:34:10.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.857+0000 7fc3dff40800 20 processing logshard = reshard.0000000002 2024-09-14T11:34:10.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.860+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:34:10.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.860+0000 7fc3dff40800 20 processing logshard = reshard.0000000003 2024-09-14T11:34:10.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.862+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:34:10.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.862+0000 7fc3dff40800 20 processing logshard = reshard.0000000004 2024-09-14T11:34:10.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.866+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:34:10.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.866+0000 7fc3dff40800 20 processing logshard = reshard.0000000005 2024-09-14T11:34:10.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.868+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:34:10.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.868+0000 7fc3dff40800 20 processing logshard = reshard.0000000006 2024-09-14T11:34:10.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.870+0000 7fc3dff40800 20 process_entry resharding a-bucket 2024-09-14T11:34:10.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.870+0000 7fc3dff40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:10.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.870+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:10.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:34:10.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:10.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:34:10.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:10.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:10.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:10.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:10.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:10.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:10.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.871+0000 7fc3dff40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc3dff40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc3dff40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc3dff40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc3dff40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc2baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94692006237568 notifier 5867 bl.length()=911 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc2baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc2baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:10.876 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.878+0000 7fc2baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:10.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.879+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:34:10.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.879+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:34:10.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.879+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:34:10.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.879+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:34:10.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:34:10.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:34:10.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:34:10.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:34:10.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:34:10.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.0 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.0 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.1 2024-09-14T11:34:10.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.884+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.1 2024-09-14T11:34:10.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.885+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.2 2024-09-14T11:34:10.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.885+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.2 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.885+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.3 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.885+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.3 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.886+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.4 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.886+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.4 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.886+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.5 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.886+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.5 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.887+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.6 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.887+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.6 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.887+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.7 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.887+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.7 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.888+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.8 2024-09-14T11:34:10.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.888+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.8 2024-09-14T11:34:10.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.888+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.9 2024-09-14T11:34:10.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.888+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.9 2024-09-14T11:34:10.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.889+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.10 2024-09-14T11:34:10.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.889+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.10 2024-09-14T11:34:10.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.889+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.11 2024-09-14T11:34:10.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.889+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.11 2024-09-14T11:34:10.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.892+0000 7fc3dff40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:10.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.892+0000 7fc3dff40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:10.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc3dff40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:10.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc3dff40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:10.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc3dff40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:10.891 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc3dff40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc2baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529739 cookie 94692006237568 notifier 5867 bl.length()=911 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc2baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc2baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.893+0000 7fc2baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.894+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.894+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.894+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:34:10.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.894+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:34:10.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.896+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.0 2024-09-14T11:34:10.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.896+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.0 2024-09-14T11:34:10.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.897+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.1 2024-09-14T11:34:10.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.897+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.1 2024-09-14T11:34:10.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.897+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.2 2024-09-14T11:34:10.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.897+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.2 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.897+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.3 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.897+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.3 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.898+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.4 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.898+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.4 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.898+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.5 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.898+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.5 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.898+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.6 2024-09-14T11:34:10.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.898+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.6 2024-09-14T11:34:10.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.899+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.7 2024-09-14T11:34:10.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.899+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.7 2024-09-14T11:34:10.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.899+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.8 2024-09-14T11:34:10.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.899+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.8 2024-09-14T11:34:10.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.899+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.9 2024-09-14T11:34:10.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.899+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.9 2024-09-14T11:34:10.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.900+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.10 2024-09-14T11:34:10.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.900+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.10 2024-09-14T11:34:10.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.900+0000 7fc3dff40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.11 2024-09-14T11:34:10.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.900+0000 7fc3dff40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.1.11 2024-09-14T11:34:10.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.901+0000 7fc3dff40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:10.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.901+0000 7fc3dff40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc3dff40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc3dff40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc3dff40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc3dff40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc2baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529740 cookie 94692006237568 notifier 5867 bl.length()=879 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc2baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc2baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:34:10.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.902+0000 7fc2baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:10.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.903+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:34:10.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.903+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:34:10.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.903+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:34:10.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.903+0000 7fc3dff40800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:34:10.903 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.905+0000 7fc3dff40800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:34:10.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.906+0000 7fc3dff40800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:34:10.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.908+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:34:10.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.908+0000 7fc3dff40800 20 processing logshard = reshard.0000000007 2024-09-14T11:34:10.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.910+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:34:10.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.910+0000 7fc3dff40800 20 processing logshard = reshard.0000000008 2024-09-14T11:34:10.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.913+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:34:10.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.913+0000 7fc3dff40800 20 processing logshard = reshard.0000000009 2024-09-14T11:34:10.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.915+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:34:10.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.915+0000 7fc3dff40800 20 processing logshard = reshard.0000000010 2024-09-14T11:34:10.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.917+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:34:10.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.917+0000 7fc3dff40800 20 processing logshard = reshard.0000000011 2024-09-14T11:34:10.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.920+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:34:10.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.920+0000 7fc3dff40800 20 processing logshard = reshard.0000000012 2024-09-14T11:34:10.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.923+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:34:10.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.923+0000 7fc3dff40800 20 processing logshard = reshard.0000000013 2024-09-14T11:34:10.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.925+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:34:10.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.925+0000 7fc3dff40800 20 processing logshard = reshard.0000000014 2024-09-14T11:34:10.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.927+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:34:10.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.927+0000 7fc3dff40800 20 processing logshard = reshard.0000000015 2024-09-14T11:34:10.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.930+0000 7fc3dff40800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:34:10.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.931+0000 7fc291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.933+0000 7fc3dff40800 20 remove_watcher() i=0 2024-09-14T11:34:10.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.933+0000 7fc3dff40800 2 removed watcher, disabling cache 2024-09-14T11:34:10.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.935+0000 7fc3dff40800 20 remove_watcher() i=1 2024-09-14T11:34:10.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.936+0000 7fc3dff40800 20 remove_watcher() i=2 2024-09-14T11:34:10.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.937+0000 7fc3dff40800 20 remove_watcher() i=3 2024-09-14T11:34:10.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.938+0000 7fc3dff40800 20 remove_watcher() i=4 2024-09-14T11:34:10.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.939+0000 7fc3dff40800 20 remove_watcher() i=5 2024-09-14T11:34:10.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.940+0000 7fc3dff40800 20 remove_watcher() i=6 2024-09-14T11:34:10.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:10.941+0000 7fc3dff40800 20 remove_watcher() i=7 2024-09-14T11:34:10.951 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:10.980 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:10.980 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:11.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.022+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 20 realm 2024-09-14T11:34:11.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:11.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.024+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.025+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:11.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.025+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.026+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:11.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.026+0000 7f9bab813800 20 searching for the correct realm 2024-09-14T11:34:11.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.028+0000 7f9ba7749640 0 -- 172.21.15.7:0/758938729 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f9b9c035070 msgr2=0x7f9b9c009250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:11.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.235+0000 7f9ba6747640 0 -- 172.21.15.7:0/758938729 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f9b98068460 msgr2=0x7f9b98043000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:11.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:11.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:11.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:11.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:11.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:11.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:11.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.442+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 zone default found 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 4 Realm: () 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:11.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 zonegroup default 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.443+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.444+0000 7f9bab813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.444+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.444+0000 7f9bab813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.444+0000 7f9bab813800 20 started sync module instance, tier type = 2024-09-14T11:34:11.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.444+0000 7f9bab813800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.454+0000 7f9bab813800 20 add_watcher() i=0 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.454+0000 7f9bab813800 20 add_watcher() i=1 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.454+0000 7f9bab813800 20 add_watcher() i=2 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.454+0000 7f9bab813800 20 add_watcher() i=3 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.454+0000 7f9bab813800 20 add_watcher() i=4 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.454+0000 7f9bab813800 20 add_watcher() i=5 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.455+0000 7f9bab813800 20 add_watcher() i=6 2024-09-14T11:34:11.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.456+0000 7f9bab813800 20 add_watcher() i=7 2024-09-14T11:34:11.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.456+0000 7f9bab813800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.457+0000 7f9a5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f9bab813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f9bab813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f9bab813800 5 note: GC not initialized 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f99d7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f9bab813800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f9bab813800 20 Filter name: none 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f99d5ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:11.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.458+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.459+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.459+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.459+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.459+0000 7f9bab813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.459+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.460+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.460+0000 7f9bab813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.460+0000 7f9bab813800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:11.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.460+0000 7f9bab813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:11.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.462+0000 7f9a5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:11.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.464+0000 7f9bab813800 20 remove_watcher() i=0 2024-09-14T11:34:11.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.464+0000 7f9bab813800 2 removed watcher, disabling cache 2024-09-14T11:34:11.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.465+0000 7f9bab813800 20 remove_watcher() i=1 2024-09-14T11:34:11.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.466+0000 7f9bab813800 20 remove_watcher() i=2 2024-09-14T11:34:11.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.467+0000 7f9bab813800 20 remove_watcher() i=3 2024-09-14T11:34:11.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.468+0000 7f9bab813800 20 remove_watcher() i=4 2024-09-14T11:34:11.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.469+0000 7f9bab813800 20 remove_watcher() i=5 2024-09-14T11:34:11.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.470+0000 7f9bab813800 20 remove_watcher() i=6 2024-09-14T11:34:11.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.472+0000 7f9bab813800 20 remove_watcher() i=7 2024-09-14T11:34:11.481 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:11.481 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:11.482 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:34:11.482 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:11.482 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:34:11.482 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:11.484 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.484 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.496 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.496 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.539 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.539 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.547 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.547 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.553 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.553 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.560 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.560 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.566 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.566 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.573 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.573 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.579 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.579 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.585 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.585 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.591 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.591 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.598 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.598 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.604 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.604 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.611 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.611 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.617 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.617 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.624 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.624 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.630 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.630 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.636 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.636 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.643 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.643 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.649 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.649 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.655 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.656 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.662 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:11.662 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:11.668 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:34:11.698 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:11.698 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:11.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.742+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 20 realm 2024-09-14T11:34:11.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:11.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:11.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.744+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.745+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:11.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.745+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:11.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.746+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:11.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.746+0000 7fbfa791f800 20 searching for the correct realm 2024-09-14T11:34:11.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.748+0000 7fbfa3ea3640 0 -- 172.21.15.7:0/2526079956 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fbf98047040 msgr2=0x7fbf98038430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:11.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:11.954+0000 7fbfa2ea1640 0 -- 172.21.15.7:0/2526079956 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fbf94071bc0 msgr2=0x7fbf94090430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.161+0000 7fbfa791f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.161+0000 7fbfa791f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.161+0000 7fbfa791f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.161+0000 7fbfa791f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.161+0000 7fbfa791f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.161+0000 7fbfa791f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.161+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:12.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 zone default found 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 4 Realm: () 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 zonegroup default 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.162+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.163+0000 7fbfa791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.163+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.163+0000 7fbfa791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.163+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.163+0000 7fbfa791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.163+0000 7fbfa791f800 20 started sync module instance, tier type = 2024-09-14T11:34:12.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.163+0000 7fbfa791f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:12.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.174+0000 7fbfa791f800 20 add_watcher() i=0 2024-09-14T11:34:12.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.174+0000 7fbfa791f800 20 add_watcher() i=1 2024-09-14T11:34:12.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.174+0000 7fbfa791f800 20 add_watcher() i=2 2024-09-14T11:34:12.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.174+0000 7fbfa791f800 20 add_watcher() i=3 2024-09-14T11:34:12.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.174+0000 7fbfa791f800 20 add_watcher() i=4 2024-09-14T11:34:12.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.174+0000 7fbfa791f800 20 add_watcher() i=5 2024-09-14T11:34:12.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.174+0000 7fbfa791f800 20 add_watcher() i=6 2024-09-14T11:34:12.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.175+0000 7fbfa791f800 20 add_watcher() i=7 2024-09-14T11:34:12.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.175+0000 7fbfa791f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:12.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.177+0000 7fbe59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:12.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.177+0000 7fbfa791f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:12.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.177+0000 7fbfa791f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:12.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.177+0000 7fbfa791f800 5 note: GC not initialized 2024-09-14T11:34:12.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.177+0000 7fbe58fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:12.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.178+0000 7fbfa791f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:12.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.178+0000 7fbfa791f800 20 Filter name: none 2024-09-14T11:34:12.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.178+0000 7fbdd27fc640 20 reqs_thread_entry: start 2024-09-14T11:34:12.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.178+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.178+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:12.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.178+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.179+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:12.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.179+0000 7fbfa791f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:12.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.179+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.180+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:12.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.180+0000 7fbfa791f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.180+0000 7fbfa791f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:12.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.180+0000 7fbfa791f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:12.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.182+0000 7fbe59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:12.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.185+0000 7fbfa791f800 20 remove_watcher() i=0 2024-09-14T11:34:12.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.185+0000 7fbfa791f800 2 removed watcher, disabling cache 2024-09-14T11:34:12.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.186+0000 7fbfa791f800 20 remove_watcher() i=1 2024-09-14T11:34:12.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.187+0000 7fbfa791f800 20 remove_watcher() i=2 2024-09-14T11:34:12.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.188+0000 7fbfa791f800 20 remove_watcher() i=3 2024-09-14T11:34:12.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.189+0000 7fbfa791f800 20 remove_watcher() i=4 2024-09-14T11:34:12.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.190+0000 7fbfa791f800 20 remove_watcher() i=5 2024-09-14T11:34:12.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.191+0000 7fbfa791f800 20 remove_watcher() i=6 2024-09-14T11:34:12.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.192+0000 7fbfa791f800 20 remove_watcher() i=7 2024-09-14T11:34:12.202 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:12.202 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:12.202 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-init-index id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:12.202 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:12.203 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:34:12.238 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:12.238 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:12.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.281+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.282+0000 7f6a64719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.282+0000 7f6a64719800 20 realm 2024-09-14T11:34:12.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.282+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.282+0000 7f6a64719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.282+0000 7f6a64719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:12.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.282+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.283+0000 7f6a64719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.283+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.284+0000 7f6a64719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:12.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.284+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.284+0000 7f6a64719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:12.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.284+0000 7f6a64719800 20 searching for the correct realm 2024-09-14T11:34:12.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.286+0000 7f6a62a0b640 0 -- 172.21.15.7:0/2403148777 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6a58071040 msgr2=0x7f6a58096a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:12.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.291+0000 7f6a61a09640 0 -- 172.21.15.7:0/2403148777 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f6a54073ea0 msgr2=0x7f6a54080920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.499+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:12.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:12.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 zone default found 2024-09-14T11:34:12.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 4 Realm: () 2024-09-14T11:34:12.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:12.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 zonegroup default 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.500+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.501+0000 7f6a64719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.501+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.501+0000 7f6a64719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.501+0000 7f6a64719800 20 started sync module instance, tier type = 2024-09-14T11:34:12.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.501+0000 7f6a64719800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:12.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.511+0000 7f6a64719800 20 add_watcher() i=0 2024-09-14T11:34:12.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.511+0000 7f6a64719800 20 add_watcher() i=1 2024-09-14T11:34:12.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.511+0000 7f6a64719800 20 add_watcher() i=2 2024-09-14T11:34:12.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.511+0000 7f6a64719800 20 add_watcher() i=3 2024-09-14T11:34:12.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.511+0000 7f6a64719800 20 add_watcher() i=4 2024-09-14T11:34:12.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.511+0000 7f6a64719800 20 add_watcher() i=5 2024-09-14T11:34:12.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.511+0000 7f6a64719800 20 add_watcher() i=6 2024-09-14T11:34:12.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.512+0000 7f6a64719800 20 add_watcher() i=7 2024-09-14T11:34:12.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.512+0000 7f6a64719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.513+0000 7f6918fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.513+0000 7f6a64719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.513+0000 7f6a64719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.514+0000 7f6a64719800 5 note: GC not initialized 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.514+0000 7f68937fe640 20 reqs_thread_entry: start 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.514+0000 7f6a64719800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.514+0000 7f6a64719800 20 Filter name: none 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.514+0000 7f68917fa640 20 reqs_thread_entry: start 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.514+0000 7f6a64719800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:34:12.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.514+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:12.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:34:12.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:34:12.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 : miss 2024-09-14T11:34:12.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.515+0000 7f6a64719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.516+0000 7f6a64719800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:34:12.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.516+0000 7f6a64719800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:34:12.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.518+0000 7f6918fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:12.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.521+0000 7f6a64719800 20 remove_watcher() i=0 2024-09-14T11:34:12.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.521+0000 7f6a64719800 2 removed watcher, disabling cache 2024-09-14T11:34:12.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.522+0000 7f6a64719800 20 remove_watcher() i=1 2024-09-14T11:34:12.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.523+0000 7f6a64719800 20 remove_watcher() i=2 2024-09-14T11:34:12.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.525+0000 7f6a64719800 20 remove_watcher() i=3 2024-09-14T11:34:12.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.526+0000 7f6a64719800 20 remove_watcher() i=4 2024-09-14T11:34:12.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.527+0000 7f6a64719800 20 remove_watcher() i=5 2024-09-14T11:34:12.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.528+0000 7f6a64719800 20 remove_watcher() i=6 2024-09-14T11:34:12.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.529+0000 7f6a64719800 20 remove_watcher() i=7 2024-09-14T11:34:12.539 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:34:12.569 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:12.569 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:12.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.610+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 20 realm 2024-09-14T11:34:12.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:12.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:12.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.612+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.613+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:12.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.613+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:12.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.614+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:12.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.614+0000 7f090700e800 20 searching for the correct realm 2024-09-14T11:34:12.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.616+0000 7f0902e5a640 0 -- 172.21.15.7:0/3952689079 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f08f8025040 msgr2=0x7f08f80a6aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:12.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:12.823+0000 7f0901e58640 0 -- 172.21.15.7:0/3952689079 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f08f40bf190 msgr2=0x7f08f40c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.031+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 zone default found 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 4 Realm: () 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 zonegroup default 2024-09-14T11:34:13.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.032+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.033+0000 7f090700e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.033+0000 7f090700e800 20 started sync module instance, tier type = 2024-09-14T11:34:13.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.033+0000 7f090700e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:13.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.043+0000 7f090700e800 20 add_watcher() i=0 2024-09-14T11:34:13.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.043+0000 7f090700e800 20 add_watcher() i=1 2024-09-14T11:34:13.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.043+0000 7f090700e800 20 add_watcher() i=2 2024-09-14T11:34:13.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.043+0000 7f090700e800 20 add_watcher() i=3 2024-09-14T11:34:13.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.043+0000 7f090700e800 20 add_watcher() i=4 2024-09-14T11:34:13.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.043+0000 7f090700e800 20 add_watcher() i=5 2024-09-14T11:34:13.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.043+0000 7f090700e800 20 add_watcher() i=6 2024-09-14T11:34:13.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.044+0000 7f090700e800 20 add_watcher() i=7 2024-09-14T11:34:13.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.044+0000 7f090700e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:13.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.046+0000 7f07b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:13.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.046+0000 7f090700e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:13.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.046+0000 7f090700e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:13.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.046+0000 7f090700e800 5 note: GC not initialized 2024-09-14T11:34:13.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.046+0000 7f07337fe640 20 reqs_thread_entry: start 2024-09-14T11:34:13.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.047+0000 7f090700e800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:13.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.047+0000 7f090700e800 20 Filter name: none 2024-09-14T11:34:13.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.047+0000 7f07317fa640 20 reqs_thread_entry: start 2024-09-14T11:34:13.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.047+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.047+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:13.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.048+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.048+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:13.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.048+0000 7f090700e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:13.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.048+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.049+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:13.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.049+0000 7f090700e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.049+0000 7f090700e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:13.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.049+0000 7f090700e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:13.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.051+0000 7f07b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:13.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.054+0000 7f090700e800 20 remove_watcher() i=0 2024-09-14T11:34:13.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.054+0000 7f090700e800 2 removed watcher, disabling cache 2024-09-14T11:34:13.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.055+0000 7f090700e800 20 remove_watcher() i=1 2024-09-14T11:34:13.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.056+0000 7f090700e800 20 remove_watcher() i=2 2024-09-14T11:34:13.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.057+0000 7f090700e800 20 remove_watcher() i=3 2024-09-14T11:34:13.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.058+0000 7f090700e800 20 remove_watcher() i=4 2024-09-14T11:34:13.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.059+0000 7f090700e800 20 remove_watcher() i=5 2024-09-14T11:34:13.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.060+0000 7f090700e800 20 remove_watcher() i=6 2024-09-14T11:34:13.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.061+0000 7f090700e800 20 remove_watcher() i=7 2024-09-14T11:34:13.071 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:13.071 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:13.071 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-init-index id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:13.071 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:13.073 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:13.073 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:13.080 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:13.080 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:13.123 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:13.156 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:13.156 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:13.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.199+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.200+0000 7f3924612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.200+0000 7f3924612800 20 realm 2024-09-14T11:34:13.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.200+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.201+0000 7f3924612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.201+0000 7f3924612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:13.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.201+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.201+0000 7f3924612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.201+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.202+0000 7f3924612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:13.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.202+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.203+0000 7f3924612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:13.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.203+0000 7f3924612800 20 searching for the correct realm 2024-09-14T11:34:13.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.204+0000 7f39205e1640 0 -- 172.21.15.7:0/4148124490 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f39140d0070 msgr2=0x7f39140b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:13.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.410+0000 7f391f5df640 0 -- 172.21.15.7:0/4148124490 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f3910051040 msgr2=0x7f3910041420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:13.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.617+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:13.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 zone default found 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 4 Realm: () 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 zonegroup default 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.618+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.619+0000 7f3924612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.619+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.619+0000 7f3924612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.619+0000 7f3924612800 20 started sync module instance, tier type = 2024-09-14T11:34:13.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.619+0000 7f3924612800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:13.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.630+0000 7f3924612800 20 add_watcher() i=0 2024-09-14T11:34:13.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.630+0000 7f3924612800 20 add_watcher() i=1 2024-09-14T11:34:13.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.630+0000 7f3924612800 20 add_watcher() i=2 2024-09-14T11:34:13.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.630+0000 7f3924612800 20 add_watcher() i=3 2024-09-14T11:34:13.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.630+0000 7f3924612800 20 add_watcher() i=4 2024-09-14T11:34:13.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.630+0000 7f3924612800 20 add_watcher() i=5 2024-09-14T11:34:13.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.630+0000 7f3924612800 20 add_watcher() i=6 2024-09-14T11:34:13.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.631+0000 7f3924612800 20 add_watcher() i=7 2024-09-14T11:34:13.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.631+0000 7f3924612800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:13.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.633+0000 7f37d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.633+0000 7f3924612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.633+0000 7f3924612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.633+0000 7f3924612800 5 note: GC not initialized 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f37d4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 20 Filter name: none 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f374e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:13.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:34:13.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:13.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 : miss 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.634+0000 7f3924612800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.635+0000 7f3924612800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.635+0000 7f3924612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.635+0000 7f3924612800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.635+0000 7f3924612800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.635+0000 7f3924612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:13.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.635+0000 7f3924612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 2024-09-14T11:34:13.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:13.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:13.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:13.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20, ofs0, ns] 2024-09-14T11:34:13.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f37feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529709 cookie 93892876198992 notifier 6219 bl.length()=995 2024-09-14T11:34:13.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f37feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:13.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f37feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:13.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f37feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:13.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): orig_sources= new_sources= 2024-09-14T11:34:13.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): potential sources added=[] removed=[] 2024-09-14T11:34:13.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): orig_dests= new_dests= 2024-09-14T11:34:13.640 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.641+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): potential dests added=[] removed=[] 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.0 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.0 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.1 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.1 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.2 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.2 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.3 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.3 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.4 2024-09-14T11:34:13.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.4 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.5 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.5 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.6 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.6 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.7 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.7 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.8 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.8 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.9 2024-09-14T11:34:13.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.9 2024-09-14T11:34:13.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.10 2024-09-14T11:34:13.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.10 2024-09-14T11:34:13.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.11 2024-09-14T11:34:13.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1.11 2024-09-14T11:34:13.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.646+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.0 2024-09-14T11:34:13.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.647+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1 2024-09-14T11:34:13.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.647+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.2 2024-09-14T11:34:13.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.648+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.3 2024-09-14T11:34:13.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.648+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.4 2024-09-14T11:34:13.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.649+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.5 2024-09-14T11:34:13.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.650+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.6 2024-09-14T11:34:13.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.651+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.7 2024-09-14T11:34:13.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.651+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.8 2024-09-14T11:34:13.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.652+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.9 2024-09-14T11:34:13.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.652+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.10 2024-09-14T11:34:13.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.656+0000 7f3924612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:13.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.656+0000 7f3924612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 2024-09-14T11:34:13.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.657+0000 7f3924612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:13.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.657+0000 7f3924612800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:13.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.657+0000 7f3924612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:13.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.657+0000 7f3924612800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20, ofs0, ns] 2024-09-14T11:34:13.655 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f37feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529710 cookie 93892876198992 notifier 6219 bl.length()=995 2024-09-14T11:34:13.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f37feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:13.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f37feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:13.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f37feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:13.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): orig_sources= new_sources= 2024-09-14T11:34:13.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): potential sources added=[] removed=[] 2024-09-14T11:34:13.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): orig_dests= new_dests= 2024-09-14T11:34:13.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.658+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): potential dests added=[] removed=[] 2024-09-14T11:34:13.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.660+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.0 2024-09-14T11:34:13.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.661+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.1 2024-09-14T11:34:13.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.661+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.2 2024-09-14T11:34:13.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.661+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.3 2024-09-14T11:34:13.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.662+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.4 2024-09-14T11:34:13.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.662+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.5 2024-09-14T11:34:13.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.663+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.6 2024-09-14T11:34:13.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.663+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.7 2024-09-14T11:34:13.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.663+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.8 2024-09-14T11:34:13.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.664+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.9 2024-09-14T11:34:13.664 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.664+0000 7f3924612800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20.10 2024-09-14T11:34:13.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.664+0000 7f3924612800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:13.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.664+0000 7f3924612800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 2024-09-14T11:34:13.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.665+0000 7f3924612800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:13.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.665+0000 7f3924612800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:13.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.665+0000 7f3924612800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:13.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.665+0000 7f3924612800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20, ofs0, ns] 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f37fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529711 cookie 93892876198992 notifier 6219 bl.length()=963 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f37fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 info.flags=0x17 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f37fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 to cache LRU end 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f37fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): orig_sources= new_sources= 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): potential sources added=[] removed=[] 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): orig_dests= new_dests= 2024-09-14T11:34:13.666 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.666+0000 7f3924612800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20]): potential dests added=[] removed=[] 2024-09-14T11:34:13.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.668+0000 7f3924612800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:13.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.671+0000 7f37d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:13.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.673+0000 7f3924612800 20 remove_watcher() i=0 2024-09-14T11:34:13.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.673+0000 7f3924612800 2 removed watcher, disabling cache 2024-09-14T11:34:13.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.674+0000 7f3924612800 20 remove_watcher() i=1 2024-09-14T11:34:13.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.675+0000 7f3924612800 20 remove_watcher() i=2 2024-09-14T11:34:13.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.676+0000 7f3924612800 20 remove_watcher() i=3 2024-09-14T11:34:13.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.678+0000 7f3924612800 20 remove_watcher() i=4 2024-09-14T11:34:13.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.679+0000 7f3924612800 20 remove_watcher() i=5 2024-09-14T11:34:13.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.680+0000 7f3924612800 20 remove_watcher() i=6 2024-09-14T11:34:13.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.681+0000 7f3924612800 20 remove_watcher() i=7 2024-09-14T11:34:13.692 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:34:13.722 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:13.722 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:13.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.764+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 20 realm 2024-09-14T11:34:13.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:13.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:13.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.765+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.766+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:13.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.766+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:13.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.767+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:13.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.767+0000 7f8dcca10800 20 searching for the correct realm 2024-09-14T11:34:13.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.769+0000 7f8dc88cc640 0 -- 172.21.15.7:0/3807477578 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8dbc06c070 msgr2=0x7f8dbc0db930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:13.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:13.976+0000 7f8dc78ca640 0 -- 172.21.15.7:0/3807477578 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8db804f910 msgr2=0x7f8db8041400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:14.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:14.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:14.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.182+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:14.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:14.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 zone default found 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 4 Realm: () 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 zonegroup default 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.183+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.184+0000 7f8dcca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.184+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.184+0000 7f8dcca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.184+0000 7f8dcca10800 20 started sync module instance, tier type = 2024-09-14T11:34:14.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.184+0000 7f8dcca10800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:14.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.194+0000 7f8dcca10800 20 add_watcher() i=0 2024-09-14T11:34:14.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.194+0000 7f8dcca10800 20 add_watcher() i=1 2024-09-14T11:34:14.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.194+0000 7f8dcca10800 20 add_watcher() i=2 2024-09-14T11:34:14.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.194+0000 7f8dcca10800 20 add_watcher() i=3 2024-09-14T11:34:14.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.194+0000 7f8dcca10800 20 add_watcher() i=4 2024-09-14T11:34:14.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.194+0000 7f8dcca10800 20 add_watcher() i=5 2024-09-14T11:34:14.193 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.194+0000 7f8dcca10800 20 add_watcher() i=6 2024-09-14T11:34:14.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.195+0000 7f8dcca10800 20 add_watcher() i=7 2024-09-14T11:34:14.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.195+0000 7f8dcca10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:14.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.197+0000 7f8c7e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.197+0000 7f8dcca10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.197+0000 7f8dcca10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.197+0000 7f8dcca10800 5 note: GC not initialized 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.198+0000 7f8c7d7e2640 20 reqs_thread_entry: start 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.198+0000 7f8dcca10800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.198+0000 7f8dcca10800 20 Filter name: none 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.198+0000 7f8beeffd640 20 reqs_thread_entry: start 2024-09-14T11:34:14.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.198+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.198+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.198+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.199+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.199+0000 7f8dcca10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.199+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.200+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:14.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.200+0000 7f8dcca10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.200+0000 7f8dcca10800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:14.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.200+0000 7f8dcca10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:14.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.202+0000 7f8c7e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:14.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.204+0000 7f8dcca10800 20 remove_watcher() i=0 2024-09-14T11:34:14.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.204+0000 7f8dcca10800 2 removed watcher, disabling cache 2024-09-14T11:34:14.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.206+0000 7f8dcca10800 20 remove_watcher() i=1 2024-09-14T11:34:14.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.207+0000 7f8dcca10800 20 remove_watcher() i=2 2024-09-14T11:34:14.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.208+0000 7f8dcca10800 20 remove_watcher() i=3 2024-09-14T11:34:14.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.210+0000 7f8dcca10800 20 remove_watcher() i=4 2024-09-14T11:34:14.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.211+0000 7f8dcca10800 20 remove_watcher() i=5 2024-09-14T11:34:14.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.212+0000 7f8dcca10800 20 remove_watcher() i=6 2024-09-14T11:34:14.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.213+0000 7f8dcca10800 20 remove_watcher() i=7 2024-09-14T11:34:14.223 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:14.224 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:14.224 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-init-index id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:14.224 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:14.226 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.226 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.230 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.230 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.274 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.274 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.305 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:34:14.305 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:14.306 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.307 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.318 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.318 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.361 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.361 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.366 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.367 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.373 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.373 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.380 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.386 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.386 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.392 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.392 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.397 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.398 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.404 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.404 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.409 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.409 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.416 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.416 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.422 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.422 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.427 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.427 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.433 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.433 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.439 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.439 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.444 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.444 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.450 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.450 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.456 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.456 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.462 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.462 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.467 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.468 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.474 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:14.474 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:14.480 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:34:14.510 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:14.510 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:14.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.550+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.552+0000 7f12c0a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.552+0000 7f12c0a2f800 20 realm 2024-09-14T11:34:14.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.552+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.552+0000 7f12c0a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.552+0000 7f12c0a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:14.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.552+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.553+0000 7f12c0a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.553+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.553+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:14.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.553+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.554+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:14.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.554+0000 7f12c0a2f800 20 searching for the correct realm 2024-09-14T11:34:14.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.556+0000 7f12bed21640 0 -- 172.21.15.7:0/1643553140 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f12b4075070 msgr2=0x7f12b4068440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:14.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.761+0000 7f12bdd1f640 0 -- 172.21.15.7:0/1643553140 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f12b0013030 msgr2=0x7f12b00a31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:14.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.967+0000 7f12c0a2f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:14.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.967+0000 7f12c0a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:14.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.967+0000 7f12c0a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:14.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.967+0000 7f12c0a2f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:14.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.967+0000 7f12c0a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:14.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.967+0000 7f12c0a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:14.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.967+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:14.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:14.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 zone default found 2024-09-14T11:34:14.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 4 Realm: () 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 zonegroup default 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.968+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.969+0000 7f12c0a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.969+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.969+0000 7f12c0a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.969+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.969+0000 7f12c0a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.969+0000 7f12c0a2f800 20 started sync module instance, tier type = 2024-09-14T11:34:14.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.969+0000 7f12c0a2f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:14.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.984+0000 7f12c0a2f800 20 add_watcher() i=0 2024-09-14T11:34:14.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.984+0000 7f12c0a2f800 20 add_watcher() i=1 2024-09-14T11:34:14.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.984+0000 7f12c0a2f800 20 add_watcher() i=2 2024-09-14T11:34:14.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.984+0000 7f12c0a2f800 20 add_watcher() i=3 2024-09-14T11:34:14.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.984+0000 7f12c0a2f800 20 add_watcher() i=4 2024-09-14T11:34:14.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.984+0000 7f12c0a2f800 20 add_watcher() i=5 2024-09-14T11:34:14.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.985+0000 7f12c0a2f800 20 add_watcher() i=6 2024-09-14T11:34:14.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.986+0000 7f12c0a2f800 20 add_watcher() i=7 2024-09-14T11:34:14.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.986+0000 7f12c0a2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:14.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.987+0000 7f1174fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:14.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.988+0000 7f12c0a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:14.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.988+0000 7f12c0a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:14.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.988+0000 7f12c0a2f800 5 note: GC not initialized 2024-09-14T11:34:14.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.988+0000 7f10ef7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:14.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.988+0000 7f12c0a2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:14.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.988+0000 7f12c0a2f800 20 Filter name: none 2024-09-14T11:34:14.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.989+0000 7f10ed7fa640 20 reqs_thread_entry: start 2024-09-14T11:34:14.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.989+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.989+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:14.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.989+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.990+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:14.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.990+0000 7f12c0a2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:14.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.990+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.990+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:14.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.990+0000 7f12c0a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:14.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.991+0000 7f12c0a2f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:14.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.991+0000 7f12c0a2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:14.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.993+0000 7f1174fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:14.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.995+0000 7f12c0a2f800 20 remove_watcher() i=0 2024-09-14T11:34:14.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.995+0000 7f12c0a2f800 2 removed watcher, disabling cache 2024-09-14T11:34:14.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.996+0000 7f12c0a2f800 20 remove_watcher() i=1 2024-09-14T11:34:14.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.997+0000 7f12c0a2f800 20 remove_watcher() i=2 2024-09-14T11:34:14.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.998+0000 7f12c0a2f800 20 remove_watcher() i=3 2024-09-14T11:34:14.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:14.999+0000 7f12c0a2f800 20 remove_watcher() i=4 2024-09-14T11:34:14.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.000+0000 7f12c0a2f800 20 remove_watcher() i=5 2024-09-14T11:34:15.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.001+0000 7f12c0a2f800 20 remove_watcher() i=6 2024-09-14T11:34:15.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.002+0000 7f12c0a2f800 20 remove_watcher() i=7 2024-09-14T11:34:15.012 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:15.012 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:15.012 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-init-index id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:15.013 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:15.014 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:34:15.052 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:15.052 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:15.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.095+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 20 realm 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.096+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.097+0000 7f7ca85af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:15.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.097+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.098+0000 7f7ca85af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:15.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.098+0000 7f7ca85af800 20 searching for the correct realm 2024-09-14T11:34:15.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.099+0000 7f7ca589f640 0 -- 172.21.15.7:0/2412381362 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f7c98087020 msgr2=0x7f7c980ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:15.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.304+0000 7f7ca68a1640 0 -- 172.21.15.7:0/2412381362 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f7c9c047430 msgr2=0x7f7c9c047850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.310+0000 7f7ca85af800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.310+0000 7f7ca85af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.310+0000 7f7ca85af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.310+0000 7f7ca85af800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.310+0000 7f7ca85af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.310+0000 7f7ca85af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:15.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 zone default found 2024-09-14T11:34:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 4 Realm: () 2024-09-14T11:34:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:15.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 zonegroup default 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.311+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.312+0000 7f7ca85af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.312+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.312+0000 7f7ca85af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.312+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.312+0000 7f7ca85af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.312+0000 7f7ca85af800 20 started sync module instance, tier type = 2024-09-14T11:34:15.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.312+0000 7f7ca85af800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:15.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.321+0000 7f7ca85af800 20 add_watcher() i=0 2024-09-14T11:34:15.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.321+0000 7f7ca85af800 20 add_watcher() i=1 2024-09-14T11:34:15.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.321+0000 7f7ca85af800 20 add_watcher() i=2 2024-09-14T11:34:15.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.321+0000 7f7ca85af800 20 add_watcher() i=3 2024-09-14T11:34:15.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.321+0000 7f7ca85af800 20 add_watcher() i=4 2024-09-14T11:34:15.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.321+0000 7f7ca85af800 20 add_watcher() i=5 2024-09-14T11:34:15.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.321+0000 7f7ca85af800 20 add_watcher() i=6 2024-09-14T11:34:15.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.322+0000 7f7ca85af800 20 add_watcher() i=7 2024-09-14T11:34:15.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.322+0000 7f7ca85af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:15.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.324+0000 7f7b5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.324+0000 7f7ca85af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.324+0000 7f7ca85af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.324+0000 7f7ca85af800 5 note: GC not initialized 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.324+0000 7f7ad77fe640 20 reqs_thread_entry: start 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 20 Filter name: none 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ad57fa640 20 reqs_thread_entry: start 2024-09-14T11:34:15.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:34:15.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 : miss 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.325+0000 7f7ca85af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.326+0000 7f7ca85af800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.326+0000 7f7ca85af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 info.flags=0x17 2024-09-14T11:34:15.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.326+0000 7f7ca85af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 to cache LRU end 2024-09-14T11:34:15.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.326+0000 7f7ca85af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:15.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.326+0000 7f7ca85af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:15.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.326+0000 7f7ca85af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 2024-09-14T11:34:15.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.327+0000 7f7ca85af800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:34:15.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.327+0000 7f7ca85af800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:34:15.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7ca85af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 info.flags=0x17 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7ca85af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 to cache LRU end 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7ca85af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7ca85af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21, ofs0, ns] 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7b89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529714 cookie 94107942419568 notifier 5996 bl.length()=995 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7b89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 info.flags=0x17 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7b89ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 to cache LRU end 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.331+0000 7f7b89ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.332+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): orig_sources= new_sources= 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.332+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): potential sources added=[] removed=[] 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.332+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): orig_dests= new_dests= 2024-09-14T11:34:15.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.332+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): potential dests added=[] removed=[] 2024-09-14T11:34:15.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.0 2024-09-14T11:34:15.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.0 2024-09-14T11:34:15.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.1 2024-09-14T11:34:15.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.1 2024-09-14T11:34:15.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.2 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.2 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.3 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.3 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.4 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.4 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.5 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.5 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.6 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.6 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.7 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.7 2024-09-14T11:34:15.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.8 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.8 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.9 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.9 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.10 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.10 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.11 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1.11 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.0 2024-09-14T11:34:15.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.334+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.1 2024-09-14T11:34:15.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.335+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.2 2024-09-14T11:34:15.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.335+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.3 2024-09-14T11:34:15.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.336+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.4 2024-09-14T11:34:15.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.336+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.5 2024-09-14T11:34:15.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.337+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.6 2024-09-14T11:34:15.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.338+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.7 2024-09-14T11:34:15.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.339+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.8 2024-09-14T11:34:15.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.339+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.9 2024-09-14T11:34:15.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.340+0000 7f7ca85af800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21.10 2024-09-14T11:34:15.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.343+0000 7f7ca85af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:15.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.343+0000 7f7ca85af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 2024-09-14T11:34:15.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.344+0000 7f7ca85af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 info.flags=0x17 2024-09-14T11:34:15.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.344+0000 7f7ca85af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 to cache LRU end 2024-09-14T11:34:15.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.344+0000 7f7ca85af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:15.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.344+0000 7f7ca85af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21, ofs0, ns] 2024-09-14T11:34:15.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7b89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 94107942419568 notifier 5996 bl.length()=963 2024-09-14T11:34:15.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7b89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 info.flags=0x17 2024-09-14T11:34:15.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7b89ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 to cache LRU end 2024-09-14T11:34:15.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7b89ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:15.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): orig_sources= new_sources= 2024-09-14T11:34:15.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): potential sources added=[] removed=[] 2024-09-14T11:34:15.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): orig_dests= new_dests= 2024-09-14T11:34:15.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.345+0000 7f7ca85af800 20 handle_bi_update(): bucket=:error-at-init-index[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21]): potential dests added=[] removed=[] 2024-09-14T11:34:15.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.347+0000 7f7ca85af800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:15.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.349+0000 7f7b5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:15.350 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.351+0000 7f7ca85af800 20 remove_watcher() i=0 2024-09-14T11:34:15.350 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.351+0000 7f7ca85af800 2 removed watcher, disabling cache 2024-09-14T11:34:15.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.352+0000 7f7ca85af800 20 remove_watcher() i=1 2024-09-14T11:34:15.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.354+0000 7f7ca85af800 20 remove_watcher() i=2 2024-09-14T11:34:15.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.355+0000 7f7ca85af800 20 remove_watcher() i=3 2024-09-14T11:34:15.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.356+0000 7f7ca85af800 20 remove_watcher() i=4 2024-09-14T11:34:15.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.357+0000 7f7ca85af800 20 remove_watcher() i=5 2024-09-14T11:34:15.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.358+0000 7f7ca85af800 20 remove_watcher() i=6 2024-09-14T11:34:15.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.359+0000 7f7ca85af800 20 remove_watcher() i=7 2024-09-14T11:34:15.370 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:34:15.399 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:15.399 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:15.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.440+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 20 realm 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.442+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.443+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:15.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.443+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.444+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:15.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.444+0000 7f9f3cc0e800 20 searching for the correct realm 2024-09-14T11:34:15.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.446+0000 7f9f38bbd640 0 -- 172.21.15.7:0/4125038723 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f9f2c025020 msgr2=0x7f9f2c069760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:15.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.450+0000 7f9f37bbb640 0 -- 172.21.15.7:0/4125038723 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f9f28041960 msgr2=0x7f9f2800d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:15.656 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.657+0000 7f9f3cc0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.657+0000 7f9f3cc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.657+0000 7f9f3cc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.657+0000 7f9f3cc0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.657+0000 7f9f3cc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.657+0000 7f9f3cc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.657+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:15.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:15.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 zone default found 2024-09-14T11:34:15.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 4 Realm: () 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 zonegroup default 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.658+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.659+0000 7f9f3cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.659+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.659+0000 7f9f3cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.659+0000 7f9f3cc0e800 20 started sync module instance, tier type = 2024-09-14T11:34:15.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.659+0000 7f9f3cc0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:15.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.668+0000 7f9f3cc0e800 20 add_watcher() i=0 2024-09-14T11:34:15.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.668+0000 7f9f3cc0e800 20 add_watcher() i=1 2024-09-14T11:34:15.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.668+0000 7f9f3cc0e800 20 add_watcher() i=2 2024-09-14T11:34:15.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.668+0000 7f9f3cc0e800 20 add_watcher() i=3 2024-09-14T11:34:15.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.668+0000 7f9f3cc0e800 20 add_watcher() i=4 2024-09-14T11:34:15.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.668+0000 7f9f3cc0e800 20 add_watcher() i=5 2024-09-14T11:34:15.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.668+0000 7f9f3cc0e800 20 add_watcher() i=6 2024-09-14T11:34:15.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.669+0000 7f9f3cc0e800 20 add_watcher() i=7 2024-09-14T11:34:15.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.669+0000 7f9f3cc0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:15.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.671+0000 7f9dee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9f3cc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9f3cc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9f3cc0e800 5 note: GC not initialized 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9ded7e2640 20 reqs_thread_entry: start 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9f3cc0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9f3cc0e800 20 Filter name: none 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9d5effd640 20 reqs_thread_entry: start 2024-09-14T11:34:15.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.672+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.673+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:15.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.673+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.673+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:15.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.673+0000 7f9f3cc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:15.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.673+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.674+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:34:15.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.674+0000 7f9f3cc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:15.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.674+0000 7f9f3cc0e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:34:15.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.674+0000 7f9f3cc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:15.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.676+0000 7f9dee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:15.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.678+0000 7f9f3cc0e800 20 remove_watcher() i=0 2024-09-14T11:34:15.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.678+0000 7f9f3cc0e800 2 removed watcher, disabling cache 2024-09-14T11:34:15.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.679+0000 7f9f3cc0e800 20 remove_watcher() i=1 2024-09-14T11:34:15.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.680+0000 7f9f3cc0e800 20 remove_watcher() i=2 2024-09-14T11:34:15.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.681+0000 7f9f3cc0e800 20 remove_watcher() i=3 2024-09-14T11:34:15.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.682+0000 7f9f3cc0e800 20 remove_watcher() i=4 2024-09-14T11:34:15.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.683+0000 7f9f3cc0e800 20 remove_watcher() i=5 2024-09-14T11:34:15.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.684+0000 7f9f3cc0e800 20 remove_watcher() i=6 2024-09-14T11:34:15.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:15.685+0000 7f9f3cc0e800 20 remove_watcher() i=7 2024-09-14T11:34:15.695 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:15.695 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:15.695 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-init-index id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:34:15.695 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:15.697 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.697 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.701 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.701 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.744 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.744 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.772 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:34:15.772 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:15.773 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.773 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.786 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.786 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.829 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.829 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.837 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.837 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.842 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.843 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.848 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.848 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.854 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.854 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.860 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.860 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.866 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.866 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.872 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.872 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.878 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.878 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.884 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.884 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.891 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.892 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.896 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.896 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.903 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.903 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.909 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.909 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.914 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.914 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.920 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.920 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.926 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.932 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.933 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.938 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.938 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.944 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:15.944 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:15.951 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:34:15.980 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:15.980 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:16.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.020+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 20 realm 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.022+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.023+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.023+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.023+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:16.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.023+0000 7f1927522800 20 searching for the correct realm 2024-09-14T11:34:16.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.026+0000 7f19239d3640 0 -- 172.21.15.7:0/3305222588 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f1918038050 msgr2=0x7f191801a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:16.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.030+0000 7f19229d1640 0 -- 172.21.15.7:0/3305222588 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f1914072340 msgr2=0x7f1914067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:16.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:16.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:16.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:16.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:16.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:16.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:16.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.237+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:16.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 zone default found 2024-09-14T11:34:16.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 4 Realm: () 2024-09-14T11:34:16.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:16.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:16.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 zonegroup default 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 started sync module instance, tier type = 2024-09-14T11:34:16.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.238+0000 7f1927522800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:16.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.247+0000 7f1927522800 20 add_watcher() i=0 2024-09-14T11:34:16.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.247+0000 7f1927522800 20 add_watcher() i=1 2024-09-14T11:34:16.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.247+0000 7f1927522800 20 add_watcher() i=2 2024-09-14T11:34:16.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.247+0000 7f1927522800 20 add_watcher() i=3 2024-09-14T11:34:16.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.247+0000 7f1927522800 20 add_watcher() i=4 2024-09-14T11:34:16.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.247+0000 7f1927522800 20 add_watcher() i=5 2024-09-14T11:34:16.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.247+0000 7f1927522800 20 add_watcher() i=6 2024-09-14T11:34:16.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.248+0000 7f1927522800 20 add_watcher() i=7 2024-09-14T11:34:16.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.248+0000 7f1927522800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.249+0000 7f17d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f1927522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f1927522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f1927522800 5 note: GC not initialized 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f17d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f1927522800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f1927522800 20 Filter name: none 2024-09-14T11:34:16.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f17527fc640 20 reqs_thread_entry: start 2024-09-14T11:34:16.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.250+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.251+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.251+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.251+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.251+0000 7f1927522800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.251+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.251+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.251+0000 7f1927522800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.252+0000 7f1927522800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:16.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.252+0000 7f1927522800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:16.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.254+0000 7f17d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:16.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.256+0000 7f1927522800 20 remove_watcher() i=0 2024-09-14T11:34:16.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.256+0000 7f1927522800 2 removed watcher, disabling cache 2024-09-14T11:34:16.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.256+0000 7f1927522800 20 remove_watcher() i=1 2024-09-14T11:34:16.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.258+0000 7f1927522800 20 remove_watcher() i=2 2024-09-14T11:34:16.257 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.259+0000 7f1927522800 20 remove_watcher() i=3 2024-09-14T11:34:16.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.260+0000 7f1927522800 20 remove_watcher() i=4 2024-09-14T11:34:16.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.261+0000 7f1927522800 20 remove_watcher() i=5 2024-09-14T11:34:16.260 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.261+0000 7f1927522800 20 remove_watcher() i=6 2024-09-14T11:34:16.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.262+0000 7f1927522800 20 remove_watcher() i=7 2024-09-14T11:34:16.272 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.273 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:16.273 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-init-indext id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:16.273 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.274 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:34:16.309 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:16.309 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:16.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.350+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.351+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.351+0000 7f84f1546800 20 realm 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.351+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.352+0000 7f84f1546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:16.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.353+0000 7f84f1546800 20 searching for the correct realm 2024-09-14T11:34:16.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.355+0000 7f84ef831640 0 -- 172.21.15.7:0/1665406579 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f84e40ba4c0 msgr2=0x7f84e40b9e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:16.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.561+0000 7f84ee82f640 0 -- 172.21.15.7:0/1665406579 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f84e004d040 msgr2=0x7f84e00243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:16.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:16.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:16.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:16.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:16.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:16.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:16.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 zone default found 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 4 Realm: () 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:16.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:16.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 zonegroup default 2024-09-14T11:34:16.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.770+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.770+0000 7f84f1546800 20 started sync module instance, tier type = 2024-09-14T11:34:16.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.770+0000 7f84f1546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:16.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=0 2024-09-14T11:34:16.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=1 2024-09-14T11:34:16.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=2 2024-09-14T11:34:16.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=3 2024-09-14T11:34:16.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=4 2024-09-14T11:34:16.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=5 2024-09-14T11:34:16.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=6 2024-09-14T11:34:16.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.780+0000 7f84f1546800 20 add_watcher() i=7 2024-09-14T11:34:16.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.780+0000 7f84f1546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:16.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.782+0000 7f83a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:16.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f84f1546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:16.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f84f1546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:16.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f84f1546800 5 note: GC not initialized 2024-09-14T11:34:16.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f83a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:16.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f84f1546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:16.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f84f1546800 20 Filter name: none 2024-09-14T11:34:16.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f831e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:16.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f84f1546800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:34:16.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.783+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 : miss 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:16.784 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:16.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:16.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:16.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.784+0000 7f84f1546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 2024-09-14T11:34:16.785 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84f1546800 time 2024-09-14T11:34:16.787538+0000 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84f4b8c76a] 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:16.786 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.786+0000 7f84f1546800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84f1546800 time 2024-09-14T11:34:16.787538+0000 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84f4b8c76a] 2024-09-14T11:34:16.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:16.788 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.789 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:16.789 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f84f1546800 thread_name:radosgw-admin 2024-09-14T11:34:16.810 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.810 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84f383e6f0] 2024-09-14T11:34:16.810 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84f388b99c] 2024-09-14T11:34:16.810 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:16.810 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:16.810 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84f4b8c7c4] 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.787+0000 7f84f1546800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:16.811 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f84f1546800 thread_name:radosgw-admin 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84f383e6f0] 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84f388b99c] 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84f4b8c7c4] 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.812 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:34:16.331+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:34:16.331+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:34:16.331+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:34:16.331+0000 7f84ee82f640 10 monclient(hunting): handle_auth_done global_id 6038 payload 274 2024-09-14T11:34:16.813 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:34:16.331+0000 7f84ee82f640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:34:16.331+0000 7f84ee82f640 1 monclient: found mon.noname-c 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:34:16.331+0000 7f84ee82f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: dump: 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: dump: 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.815 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:34:16.331+0000 7f84f1546800 5 monclient: authenticate success, global_id 6038 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:34:16.331+0000 7f84f1546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:34:16.331+0000 7f84f1546800 4 set_mon_vals no callback set 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:34:16.332+0000 7f84f1546800 10 monclient: shutdown 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 asok(0x55b75643c270) unregister_commands rotate-key 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:34:16.332+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.816 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:34:16.332+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:34:16.332+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.817 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding auth protocol: cephx 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding auth protocol: cephx 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding auth protocol: cephx 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.818 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:34:16.332+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:34:16.332+0000 7f84f1546800 1 librados: starting msgr at 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:34:16.332+0000 7f84f1546800 1 librados: starting objecter 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 asok(0x55b75643c270) register_command objecter_requests hook 0x55b75668d5d0 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:34:16.333+0000 7f84f1546800 1 librados: setting wanted keys 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:34:16.333+0000 7f84f1546800 1 librados: calling monclient init 2024-09-14T11:34:16.819 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding auth protocol: cephx 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding auth protocol: cephx 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding auth protocol: cephx 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.820 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:34:16.333+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:34:16.333+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key hook 0x55b75665c368 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b7564e7780 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b75659f0c0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.821 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b7565a55a0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.890796s 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b7564e7780 auth_method 0 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b7565a55a0 auth_method 0 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.822 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b75659f0c0 auth_method 0 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.823 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_done global_id 6321 payload 824 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:34:16.334+0000 7f84ef831640 1 monclient: found mon.noname-a 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: dump: 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.824 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:16.825 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: dump: 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:34:16.334+0000 7f84f1546800 5 monclient: authenticate success, global_id 6321 2024-09-14T11:34:16.826 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:34:16.334+0000 7f83dd60a640 4 set_mon_vals no callback set 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:34:16.334+0000 7f84f1546800 1 librados: init done 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:34:16.336+0000 7f83dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:34:16.336+0000 7f83dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:34:16.336+0000 7f83dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:34:16.337+0000 7f84ef030640 10 monclient: get_auth_request con 0x7f83d4077230 auth_method 0 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:34:16.337+0000 7f84ee82f640 10 monclient: get_auth_request con 0x55b7566a4a70 auth_method 0 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:34:16.338+0000 7f84ef030640 10 monclient: get_auth_request con 0x55b7566a7c50 auth_method 0 2024-09-14T11:34:16.827 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:34:16.338+0000 7f84ee82f640 10 monclient: get_auth_request con 0x55b7566abe90 auth_method 0 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:34:16.340+0000 7f84ef831640 10 monclient: get_auth_request con 0x55b7566ab530 auth_method 0 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:34:16.340+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:34:16.340+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:34:16.340+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.828 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding auth protocol: cephx 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding auth protocol: cephx 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding auth protocol: cephx 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.829 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:34:16.341+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 asok(0x55b75643c270) register_command objecter_requests cmddesc objecter_requests hook 0x55b7566b7650 EEXIST 2024-09-14T11:34:16.830 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding auth protocol: cephx 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding auth protocol: cephx 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding auth protocol: cephx 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.831 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:34:16.341+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:34:16.341+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key cmddesc rotate-key hook 0x55b7566b3090 EEXIST 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b7566db970 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b7566dbd50 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b7566da680 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.832 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.899006s 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b7566dbd50 auth_method 0 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.833 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b7566db970 auth_method 0 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b7566da680 auth_method 0 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.834 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:34:16.342+0000 7f84ef831640 1 monclient: found mon.noname-c 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: dump: 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.835 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:34:16.342+0000 7f84f1546800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.836 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: dump: 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.837 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:34:16.342+0000 7f84f0032640 4 set_mon_vals no callback set 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:34:16.344+0000 7f83d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:34:16.344+0000 7f83d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:34:16.344+0000 7f83d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:34:16.344+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f83c8077140 auth_method 0 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:34:16.344+0000 7f84f1546800 10 monclient: get_monmap_and_config 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:34:16.344+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:34:16.344+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.838 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:34:16.344+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding auth protocol: cephx 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding auth protocol: cephx 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding auth protocol: cephx 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.839 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:34:16.345+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.840 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding auth protocol: cephx 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding auth protocol: cephx 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding auth protocol: cephx 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.841 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:34:16.345+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:34:16.345+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key cmddesc rotate-key hook 0x7ffd7fe92d18 EEXIST 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b75672fe90 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b7567207e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b75672b2c0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.842 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.902656s 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b75672b2c0 auth_method 0 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b75672fe90 auth_method 0 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.843 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b7567207e0 auth_method 0 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_done global_id 6327 payload 274 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:34:16.345+0000 7f84ef030640 1 monclient: found mon.noname-a 2024-09-14T11:34:16.844 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: dump: 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.845 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: dump: 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.846 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:34:16.346+0000 7f84f1546800 5 monclient: authenticate success, global_id 6327 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:34:16.346+0000 7f84f1546800 4 set_mon_vals no callback set 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: shutdown 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.847 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:34:16.346+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding auth protocol: cephx 2024-09-14T11:34:16.848 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding auth protocol: cephx 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding auth protocol: cephx 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.849 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:34:16.347+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: starting msgr at 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: starting objecter 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 asok(0x55b75643c270) register_command objecter_requests cmddesc objecter_requests hook 0x55b756720bc0 EEXIST 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: setting wanted keys 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: calling monclient init 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding auth protocol: cephx 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding auth protocol: cephx 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding auth protocol: cephx 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.850 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:34:16.347+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:34:16.347+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.851 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key cmddesc rotate-key hook 0x55b7566f0378 EEXIST 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b7567207e0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b75672b2c0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b75672fe90 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.852 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.905031s 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b7567207e0 auth_method 0 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b75672b2c0 auth_method 0 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.853 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b75672fe90 auth_method 0 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:34:16.348+0000 7f84ee82f640 1 monclient: found mon.noname-a 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: dump: 2024-09-14T11:34:16.854 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.855 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: dump: 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.856 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:34:16.348+0000 7f84f1546800 5 monclient: authenticate success, global_id 6330 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:34:16.348+0000 7f83d2ffd640 4 set_mon_vals no callback set 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:34:16.348+0000 7f84f1546800 1 librados: init done 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:34:16.348+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cr dump hook 0x55b756729628 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:34:16.350+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:34:16.350+0000 7f83d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:34:16.350+0000 7f83d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.857 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:34:16.350+0000 7f83d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:34:16.351+0000 7f84ef831640 10 monclient: get_auth_request con 0x7f83b8077230 auth_method 0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:34:16.351+0000 7f84ef030640 10 monclient: get_auth_request con 0x55b75674a3c0 auth_method 0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:34:16.351+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:34:16.351+0000 7f84f1546800 20 realm 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:34:16.351+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:34:16.352+0000 7f84f1546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:34:16.352+0000 7f84ee82f640 10 monclient: get_auth_request con 0x55b75674e610 auth_method 0 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.858 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:34:16.353+0000 7f84ef831640 10 monclient: get_auth_request con 0x55b756751e70 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 searching for the correct realm 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:34:16.354+0000 7f84ef030640 10 monclient: get_auth_request con 0x55b756756c30 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:34:16.354+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f84e003b040 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:34:16.355+0000 7f84ef831640 10 monclient: get_auth_request con 0x7f84e40ba4c0 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:34:16.355+0000 7f84ef831640 0 -- 172.21.15.7:0/1665406579 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f84e40ba4c0 msgr2=0x7f84e40b9e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:34:16.556+0000 7f84ef831640 10 monclient: get_auth_request con 0x7f84e40ba4c0 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:34:16.557+0000 7f84ef030640 10 monclient: get_auth_request con 0x7f84e8005070 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:34:16.561+0000 7f84ee82f640 0 -- 172.21.15.7:0/1665406579 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f84e004d040 msgr2=0x7f84e00243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:34:16.561+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f84e004d040 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:34:16.762+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f84e004d040 auth_method 0 2024-09-14T11:34:16.859 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:16.860 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 zone default found 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:34:16.769+0000 7f84f1546800 4 Realm: () 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:34:16.769+0000 7f84f1546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:34:16.769+0000 7f84f1546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:34:16.769+0000 7f84f1546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 zonegroup default 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.861 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:34:16.770+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:34:16.770+0000 7f84f1546800 20 started sync module instance, tier type = 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:34:16.770+0000 7f84f1546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=0 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=1 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=2 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=3 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=4 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=5 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=6 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:34:16.780+0000 7f84f1546800 20 add_watcher() i=7 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:34:16.780+0000 7f84f1546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding auth protocol: cephx 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding auth protocol: cephx 2024-09-14T11:34:16.862 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding auth protocol: cephx 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:34:16.782+0000 7f83a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:16.863 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:34:16.783+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache list hook 0x55b7567284e0 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache inspect hook 0x55b7567284e0 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache erase hook 0x55b7567284e0 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache zap hook 0x55b7567284e0 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 note: GC not initialized 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:34:16.783+0000 7f83a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace show hook 0x7f84e000de20 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace history hook 0x7f84e000de20 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace active hook 0x7f84e000de20 2024-09-14T11:34:16.864 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace active_short hook 0x7f84e000de20 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 Filter name: none 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:34:16.783+0000 7f831e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:34:16.783+0000 7f84f1546800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 : miss 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:16.865 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:34:16.786+0000 7f84f1546800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84f1546800 time 2024-09-14T11:34:16.787538+0000 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84f4b8c76a] 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:16.866 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:34:16.787+0000 7f84f1546800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f84f1546800 thread_name:radosgw-admin 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84f383e6f0] 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84f388b99c] 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84f4b8c7c4] 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.867 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:34:16.868 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:16.869 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:34:16.870 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:16.871 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:34:16.872 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:16.873 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:34:16.874 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 7f831e7fc640 / http_manager 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83a4fe1640 / http_manager 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83a5fe3640 / rgw_dt_lg_renew 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83d17fa640 / ms_dispatch 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83d2ffd640 / io_context_pool 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83d9602640 / ms_dispatch 2024-09-14T11:34:16.875 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83dbe07640 / ms_dispatch 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83dd60a640 / io_context_pool 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84ee82f640 / msgr-worker-2 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84ef030640 / msgr-worker-1 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84ef831640 / msgr-worker-0 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84f0032640 / io_context_pool 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84f1546800 / radosgw-admin 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.90350.log 2024-09-14T11:34:16.876 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:34:16.331+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:34:16.331+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:34:16.331+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:34:16.331+0000 7f84ee82f640 10 monclient(hunting): handle_auth_done global_id 6038 payload 274 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:34:16.331+0000 7f84ee82f640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:34:16.331+0000 7f84ee82f640 1 monclient: found mon.noname-c 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:34:16.331+0000 7f84ee82f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: dump: 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.877 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:34:16.331+0000 7f83dd60a640 10 monclient: dump: 2024-09-14T11:34:16.878 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:34:16.331+0000 7f84f1546800 5 monclient: authenticate success, global_id 6038 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:34:16.331+0000 7f84f1546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:34:16.331+0000 7f84f1546800 4 set_mon_vals no callback set 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:34:16.332+0000 7f84f1546800 10 monclient: shutdown 2024-09-14T11:34:16.879 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 asok(0x55b75643c270) unregister_commands rotate-key 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:34:16.332+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:34:16.332+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:34:16.332+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.880 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding auth protocol: cephx 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding auth protocol: cephx 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding auth protocol: cephx 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.881 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: crc 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:34:16.332+0000 7f84f1546800 5 AuthRegistry(0x55b756661f00) adding con mode: secure 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:34:16.332+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:34:16.332+0000 7f84f1546800 1 librados: starting msgr at 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:34:16.332+0000 7f84f1546800 1 librados: starting objecter 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 asok(0x55b75643c270) register_command objecter_requests hook 0x55b75668d5d0 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:34:16.333+0000 7f84f1546800 1 librados: setting wanted keys 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:34:16.333+0000 7f84f1546800 1 librados: calling monclient init 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding auth protocol: cephx 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding auth protocol: cephx 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding auth protocol: cephx 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.882 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: crc 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 AuthRegistry(0x55b75665c220) adding con mode: secure 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:34:16.333+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.883 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:34:16.333+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:34:16.333+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key hook 0x55b75665c368 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b7564e7780 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b75659f0c0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b7565a55a0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:34:16.333+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.890796s 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b7564e7780 auth_method 0 2024-09-14T11:34:16.884 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b7565a55a0 auth_method 0 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:34:16.333+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:34:16.333+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.885 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b75659f0c0 auth_method 0 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:34:16.334+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient(hunting): handle_auth_done global_id 6321 payload 824 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:34:16.334+0000 7f84ef831640 1 monclient: found mon.noname-a 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:34:16.334+0000 7f84ef831640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: dump: 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.886 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.887 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:34:16.334+0000 7f83dbe07640 10 monclient: dump: 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.888 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:34:16.334+0000 7f84f1546800 5 monclient: authenticate success, global_id 6321 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:34:16.334+0000 7f83dd60a640 4 set_mon_vals no callback set 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:34:16.334+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:34:16.334+0000 7f84f1546800 1 librados: init done 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:34:16.336+0000 7f83dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:34:16.336+0000 7f83dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:34:16.336+0000 7f83dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:34:16.337+0000 7f84ef030640 10 monclient: get_auth_request con 0x7f83d4077230 auth_method 0 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:34:16.337+0000 7f84ee82f640 10 monclient: get_auth_request con 0x55b7566a4a70 auth_method 0 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:34:16.338+0000 7f84ef030640 10 monclient: get_auth_request con 0x55b7566a7c50 auth_method 0 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:34:16.338+0000 7f84ee82f640 10 monclient: get_auth_request con 0x55b7566abe90 auth_method 0 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:34:16.340+0000 7f84ef831640 10 monclient: get_auth_request con 0x55b7566ab530 auth_method 0 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:34:16.340+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.889 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:34:16.340+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:34:16.340+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding auth protocol: cephx 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding auth protocol: cephx 2024-09-14T11:34:16.890 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding auth protocol: cephx 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: crc 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:34:16.340+0000 7f84f1546800 5 AuthRegistry(0x55b7566b4140) adding con mode: secure 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:34:16.341+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.891 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 asok(0x55b75643c270) register_command objecter_requests cmddesc objecter_requests hook 0x55b7566b7650 EEXIST 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding auth protocol: cephx 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding auth protocol: cephx 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding auth protocol: cephx 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.892 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: crc 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 AuthRegistry(0x55b7566b2f48) adding con mode: secure 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:34:16.341+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:34:16.341+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:34:16.341+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key cmddesc rotate-key hook 0x55b7566b3090 EEXIST 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b7566db970 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b7566dbd50 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b7566da680 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.893 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:34:16.341+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.899006s 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b7566dbd50 auth_method 0 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b7566db970 auth_method 0 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.894 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:34:16.342+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b7566da680 auth_method 0 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:34:16.342+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:34:16.342+0000 7f84ef831640 1 monclient: found mon.noname-c 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:34:16.342+0000 7f84ef831640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: dump: 2024-09-14T11:34:16.895 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:34:16.342+0000 7f84f1546800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.896 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:34:16.342+0000 7f83d9602640 10 monclient: dump: 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.897 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:34:16.342+0000 7f84f0032640 4 set_mon_vals no callback set 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:34:16.342+0000 7f84f1546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:34:16.344+0000 7f83d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:34:16.344+0000 7f83d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:34:16.344+0000 7f83d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:34:16.344+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f83c8077140 auth_method 0 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:34:16.344+0000 7f84f1546800 10 monclient: get_monmap_and_config 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:34:16.344+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.898 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:34:16.344+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:34:16.344+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding auth protocol: cephx 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding auth protocol: cephx 2024-09-14T11:34:16.899 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding auth protocol: cephx 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: crc 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:34:16.344+0000 7f84f1546800 5 AuthRegistry(0x55b7566fb870) adding con mode: secure 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:34:16.345+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.900 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding auth protocol: cephx 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding auth protocol: cephx 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding auth protocol: cephx 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: crc 2024-09-14T11:34:16.901 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe92bd0) adding con mode: secure 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:34:16.345+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:34:16.345+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:34:16.345+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key cmddesc rotate-key hook 0x7ffd7fe92d18 EEXIST 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b75672fe90 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b7567207e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b75672b2c0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.902 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:34:16.345+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.902656s 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b75672b2c0 auth_method 0 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b75672fe90 auth_method 0 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.903 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:34:16.345+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b7567207e0 auth_method 0 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:34:16.345+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient(hunting): handle_auth_done global_id 6327 payload 274 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:34:16.345+0000 7f84ef030640 1 monclient: found mon.noname-a 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:34:16.345+0000 7f84ef030640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: dump: 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.904 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:34:16.346+0000 7f83d2ffd640 10 monclient: dump: 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.905 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:34:16.346+0000 7f84f1546800 5 monclient: authenticate success, global_id 6327 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:34:16.346+0000 7f84f1546800 4 set_mon_vals no callback set 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: shutdown 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: build_initial_monmap 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:34:16.346+0000 7f84f1546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:34:16.346+0000 7f84f1546800 10 monclient: monmap: 2024-09-14T11:34:16.906 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding auth protocol: cephx 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding auth protocol: cephx 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding auth protocol: cephx 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.907 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: crc 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566ff3f0) adding con mode: secure 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:34:16.347+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: starting msgr at 2024-09-14T11:34:16.908 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: starting objecter 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 asok(0x55b75643c270) register_command objecter_requests cmddesc objecter_requests hook 0x55b756720bc0 EEXIST 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: setting wanted keys 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:34:16.347+0000 7f84f1546800 1 librados: calling monclient init 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient: init 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding auth protocol: cephx 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding auth protocol: cephx 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding auth protocol: cephx 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.909 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.910 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.910 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.910 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: crc 2024-09-14T11:34:16.910 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 AuthRegistry(0x55b7566f0230) adding con mode: secure 2024-09-14T11:34:16.910 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:34:16.347+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.910 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:34:16.347+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.910 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:34:16.347+0000 7f84f1546800 5 asok(0x55b75643c270) register_command rotate-key cmddesc rotate-key hook 0x55b7566f0378 EEXIST 2024-09-14T11:34:16.911 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:16.911 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:16.911 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-a con 0x55b7567207e0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:34:16.347+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-c con 0x55b75672b2c0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): picked mon.noname-b con 0x55b75672fe90 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient(hunting): authenticate will time out at 1956.905031s 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): get_auth_request con 0x55b7567207e0 auth_method 0 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.912 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): get_auth_request con 0x55b75672b2c0 auth_method 0 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:34:16.348+0000 7f84ef831640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): get_auth_request con 0x55b75672fe90 auth_method 0 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:34:16.348+0000 7f84ef030640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient: _finish_hunting 0 2024-09-14T11:34:16.913 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:34:16.348+0000 7f84ee82f640 1 monclient: found mon.noname-a 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:34:16.348+0000 7f84ee82f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: dump: 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:16.914 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:34:16.348+0000 7f83d17fa640 10 monclient: dump: 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:34:16.348+0000 7f84f1546800 5 monclient: authenticate success, global_id 6330 2024-09-14T11:34:16.915 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:34:16.348+0000 7f83d2ffd640 4 set_mon_vals no callback set 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _renew_subs 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:34:16.348+0000 7f84f1546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:34:16.348+0000 7f84f1546800 1 librados: init done 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:34:16.348+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cr dump hook 0x55b756729628 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:34:16.350+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:34:16.350+0000 7f83d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:34:16.350+0000 7f83d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:34:16.350+0000 7f83d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:34:16.351+0000 7f84ef831640 10 monclient: get_auth_request con 0x7f83b8077230 auth_method 0 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:34:16.351+0000 7f84ef030640 10 monclient: get_auth_request con 0x55b75674a3c0 auth_method 0 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:34:16.351+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:34:16.351+0000 7f84f1546800 20 realm 2024-09-14T11:34:16.916 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:34:16.351+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:34:16.352+0000 7f84f1546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:34:16.352+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:34:16.352+0000 7f84ee82f640 10 monclient: get_auth_request con 0x55b75674e610 auth_method 0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:34:16.353+0000 7f84ef831640 10 monclient: get_auth_request con 0x55b756751e70 auth_method 0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:34:16.353+0000 7f84f1546800 20 searching for the correct realm 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:34:16.354+0000 7f84ef030640 10 monclient: get_auth_request con 0x55b756756c30 auth_method 0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:34:16.354+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f84e003b040 auth_method 0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:34:16.355+0000 7f84ef831640 10 monclient: get_auth_request con 0x7f84e40ba4c0 auth_method 0 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:34:16.355+0000 7f84ef831640 0 -- 172.21.15.7:0/1665406579 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f84e40ba4c0 msgr2=0x7f84e40b9e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:16.917 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:34:16.556+0000 7f84ef831640 10 monclient: get_auth_request con 0x7f84e40ba4c0 auth_method 0 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:34:16.557+0000 7f84ef030640 10 monclient: get_auth_request con 0x7f84e8005070 auth_method 0 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:34:16.561+0000 7f84ee82f640 0 -- 172.21.15.7:0/1665406579 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f84e004d040 msgr2=0x7f84e00243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:34:16.561+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f84e004d040 auth_method 0 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:34:16.762+0000 7f84ee82f640 10 monclient: get_auth_request con 0x7f84e004d040 auth_method 0 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.918 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:34:16.768+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 zone default found 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:34:16.769+0000 7f84f1546800 4 Realm: () 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:34:16.769+0000 7f84f1546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:34:16.769+0000 7f84f1546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:34:16.769+0000 7f84f1546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 zonegroup default 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.919 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:34:16.769+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:34:16.770+0000 7f84f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:34:16.770+0000 7f84f1546800 20 started sync module instance, tier type = 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:34:16.770+0000 7f84f1546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=0 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=1 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=2 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=3 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=4 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=5 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:34:16.779+0000 7f84f1546800 20 add_watcher() i=6 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:34:16.780+0000 7f84f1546800 20 add_watcher() i=7 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:34:16.780+0000 7f84f1546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:16.920 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding auth protocol: cephx 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding auth protocol: cephx 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding auth protocol: cephx 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: crc 2024-09-14T11:34:16.921 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:34:16.782+0000 7f84f1546800 5 AuthRegistry(0x7ffd7fe930b0) adding con mode: secure 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:34:16.782+0000 7f83a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:34:16.783+0000 7f84f1546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache list hook 0x55b7567284e0 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache inspect hook 0x55b7567284e0 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache erase hook 0x55b7567284e0 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command cache zap hook 0x55b7567284e0 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 note: GC not initialized 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:34:16.783+0000 7f83a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace show hook 0x7f84e000de20 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace history hook 0x7f84e000de20 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace active hook 0x7f84e000de20 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:34:16.783+0000 7f84f1546800 5 asok(0x55b75643c270) register_command sync trace active_short hook 0x7f84e000de20 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:16.922 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 Filter name: none 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:34:16.783+0000 7f831e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:34:16.783+0000 7f84f1546800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:34:16.783+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 : miss 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:34:16.784+0000 7f84f1546800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:34:16.784+0000 7f84f1546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 2024-09-14T11:34:16.923 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:34:16.786+0000 7f84f1546800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84f1546800 time 2024-09-14T11:34:16.787538+0000 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84f4b8c76a] 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:34:16.787+0000 7f84f1546800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:16.924 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f84f1546800 thread_name:radosgw-admin 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84f383e6f0] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84f388b99c] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84f4b8c7c4] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f84f4b8c928] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7558670b1] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd882d4) [0x55b755d7a2d4] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b755876efd] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84f3829590] 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:16.925 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:34:16.926 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:34:16.927 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:34:16.928 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:34:16.929 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:16.930 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:34:16.931 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f831e7fc640 / http_manager 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83a4fe1640 / http_manager 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83a5fe3640 / rgw_dt_lg_renew 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83d17fa640 / ms_dispatch 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83d2ffd640 / io_context_pool 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83d9602640 / ms_dispatch 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83dbe07640 / ms_dispatch 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f83dd60a640 / io_context_pool 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84ee82f640 / msgr-worker-2 2024-09-14T11:34:16.932 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84ef030640 / msgr-worker-1 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84ef831640 / msgr-worker-0 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84f0032640 / io_context_pool 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr: 7f84f1546800 / radosgw-admin 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:16.789311Z_7c4c1293-c3fc-4d8a-85b9-f6e470a30a5a/log 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:34:16.933 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.871+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.873+0000 7f61d9724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.873+0000 7f61d9724800 20 realm 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.873+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.873+0000 7f61d9724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.873+0000 7f61d9724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.873+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.874+0000 7f61d9724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:16.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.874+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.875+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:16.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.875+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:16.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.875+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:16.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.875+0000 7f61d9724800 20 searching for the correct realm 2024-09-14T11:34:16.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:16.877+0000 7f61d5302640 0 -- 172.21.15.7:0/2674904911 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f61d004b040 msgr2=0x7f61d003e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:17.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.083+0000 7f61d5302640 0 -- 172.21.15.7:0/2674904911 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f61d004b040 msgr2=0x7f61d003e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:17.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.087+0000 7f61d9724800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:17.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.087+0000 7f61d9724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:17.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.087+0000 7f61d9724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:17.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.087+0000 7f61d9724800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:17.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.087+0000 7f61d9724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:17.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.087+0000 7f61d9724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:17.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.087+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 zone default found 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 4 Realm: () 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 zonegroup default 2024-09-14T11:34:17.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.088+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.089+0000 7f61d9724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.089+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.089+0000 7f61d9724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.089+0000 7f61d9724800 20 started sync module instance, tier type = 2024-09-14T11:34:17.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.089+0000 7f61d9724800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.099+0000 7f61d9724800 20 add_watcher() i=0 2024-09-14T11:34:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.099+0000 7f61d9724800 20 add_watcher() i=1 2024-09-14T11:34:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.099+0000 7f61d9724800 20 add_watcher() i=2 2024-09-14T11:34:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.099+0000 7f61d9724800 20 add_watcher() i=3 2024-09-14T11:34:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.099+0000 7f61d9724800 20 add_watcher() i=4 2024-09-14T11:34:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.099+0000 7f61d9724800 20 add_watcher() i=5 2024-09-14T11:34:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.099+0000 7f61d9724800 20 add_watcher() i=6 2024-09-14T11:34:17.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.100+0000 7f61d9724800 20 add_watcher() i=7 2024-09-14T11:34:17.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.100+0000 7f61d9724800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:17.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f608bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:17.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f61d9724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f61d9724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f61d9724800 5 note: GC not initialized 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f608afe5640 20 reqs_thread_entry: start 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f61d9724800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f61d9724800 20 Filter name: none 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.102+0000 7f6088fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.103+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.103+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:17.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.103+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.103+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:17.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.103+0000 7f61d9724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:17.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.103+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.104+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:17.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.104+0000 7f61d9724800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.104+0000 7f61d9724800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:17.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.104+0000 7f61d9724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:17.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.106+0000 7f608bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:17.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.108+0000 7f61d9724800 20 remove_watcher() i=0 2024-09-14T11:34:17.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.108+0000 7f61d9724800 2 removed watcher, disabling cache 2024-09-14T11:34:17.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.109+0000 7f61d9724800 20 remove_watcher() i=1 2024-09-14T11:34:17.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.110+0000 7f61d9724800 20 remove_watcher() i=2 2024-09-14T11:34:17.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.111+0000 7f61d9724800 20 remove_watcher() i=3 2024-09-14T11:34:17.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.112+0000 7f61d9724800 20 remove_watcher() i=4 2024-09-14T11:34:17.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.113+0000 7f61d9724800 20 remove_watcher() i=5 2024-09-14T11:34:17.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.114+0000 7f61d9724800 20 remove_watcher() i=6 2024-09-14T11:34:17.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.115+0000 7f61d9724800 20 remove_watcher() i=7 2024-09-14T11:34:17.125 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:17.125 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:17.125 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-init-indext id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:17.125 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:17.127 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:17.127 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:17.133 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:17.133 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:17.176 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:17.209 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:17.209 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:17.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.250+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 20 realm 2024-09-14T11:34:17.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:17.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.252+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.253+0000 7f5c52d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:17.252 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.253+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.253 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.254+0000 7f5c52d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:17.253 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.254+0000 7f5c52d23800 20 searching for the correct realm 2024-09-14T11:34:17.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.256+0000 7f5c4f20d640 0 -- 172.21.15.7:0/2772270710 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f5c4409b070 msgr2=0x7f5c44089a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:17.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.462+0000 7f5c4e20b640 0 -- 172.21.15.7:0/2772270710 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f5c40073dd0 msgr2=0x7f5c4006bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:17.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:17.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:17.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:17.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:17.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:17.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:17.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.669+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 zone default found 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 4 Realm: () 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 zonegroup default 2024-09-14T11:34:17.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.670+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.671+0000 7f5c52d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.671+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.671+0000 7f5c52d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:17.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.671+0000 7f5c52d23800 20 started sync module instance, tier type = 2024-09-14T11:34:17.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.671+0000 7f5c52d23800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:17.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.680+0000 7f5c52d23800 20 add_watcher() i=0 2024-09-14T11:34:17.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.680+0000 7f5c52d23800 20 add_watcher() i=1 2024-09-14T11:34:17.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.680+0000 7f5c52d23800 20 add_watcher() i=2 2024-09-14T11:34:17.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.680+0000 7f5c52d23800 20 add_watcher() i=3 2024-09-14T11:34:17.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.680+0000 7f5c52d23800 20 add_watcher() i=4 2024-09-14T11:34:17.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.680+0000 7f5c52d23800 20 add_watcher() i=5 2024-09-14T11:34:17.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.680+0000 7f5c52d23800 20 add_watcher() i=6 2024-09-14T11:34:17.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.681+0000 7f5c52d23800 20 add_watcher() i=7 2024-09-14T11:34:17.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.681+0000 7f5c52d23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.683+0000 7f5b057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.683+0000 7f5c52d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.683+0000 7f5c52d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.683+0000 7f5c52d23800 5 note: GC not initialized 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.683+0000 7f5a7ffff640 20 reqs_thread_entry: start 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 20 Filter name: none 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5a7dffb640 20 reqs_thread_entry: start 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:34:17.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 : miss 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.684+0000 7f5c52d23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.685+0000 7f5c52d23800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.685+0000 7f5c52d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.685+0000 7f5c52d23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.685+0000 7f5c52d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.685+0000 7f5c52d23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:17.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.685+0000 7f5c52d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 2024-09-14T11:34:17.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.686+0000 7f5c52d23800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to be held by another RGW process; skipping for now 2024-09-14T11:34:17.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.687+0000 7f5b057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:17.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.689+0000 7f5c52d23800 20 remove_watcher() i=0 2024-09-14T11:34:17.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.689+0000 7f5c52d23800 2 removed watcher, disabling cache 2024-09-14T11:34:17.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.690+0000 7f5c52d23800 20 remove_watcher() i=1 2024-09-14T11:34:17.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.691+0000 7f5c52d23800 20 remove_watcher() i=2 2024-09-14T11:34:17.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.692+0000 7f5c52d23800 20 remove_watcher() i=3 2024-09-14T11:34:17.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.693+0000 7f5c52d23800 20 remove_watcher() i=4 2024-09-14T11:34:17.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.694+0000 7f5c52d23800 20 remove_watcher() i=5 2024-09-14T11:34:17.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.695+0000 7f5c52d23800 20 remove_watcher() i=6 2024-09-14T11:34:17.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:17.696+0000 7f5c52d23800 20 remove_watcher() i=7 2024-09-14T11:34:17.707 INFO:tasks.workunit.client.0.smithi007.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:34:47.740 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:47.776 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:47.776 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:47.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.824+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.825+0000 7f3711925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.826+0000 7f3711925800 20 realm 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.826+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.826+0000 7f3711925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.826+0000 7f3711925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.826+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.826+0000 7f3711925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:47.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.826+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:47.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.827+0000 7f3711925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:47.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.827+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:47.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.828+0000 7f3711925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:47.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.828+0000 7f3711925800 20 searching for the correct realm 2024-09-14T11:34:47.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:47.829+0000 7f370d533640 0 -- 172.21.15.7:0/4199952689 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x560e0b07d230 msgr2=0x560e0b07f6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:48.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.032+0000 7f370d533640 0 -- 172.21.15.7:0/4199952689 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f370802b040 msgr2=0x7f3708037920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:48.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:48.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:48.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:48.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:48.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:48.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:48.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.245+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.246+0000 7f3711925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.246+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 zone default found 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 4 Realm: () 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 zonegroup default 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.247+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.248+0000 7f3711925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.248+0000 7f3711925800 20 started sync module instance, tier type = 2024-09-14T11:34:48.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.248+0000 7f3711925800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:48.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.259+0000 7f3711925800 20 add_watcher() i=0 2024-09-14T11:34:48.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.259+0000 7f3711925800 20 add_watcher() i=1 2024-09-14T11:34:48.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.259+0000 7f3711925800 20 add_watcher() i=2 2024-09-14T11:34:48.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.259+0000 7f3711925800 20 add_watcher() i=3 2024-09-14T11:34:48.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.259+0000 7f3711925800 20 add_watcher() i=4 2024-09-14T11:34:48.258 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.259+0000 7f3711925800 20 add_watcher() i=5 2024-09-14T11:34:48.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.259+0000 7f3711925800 20 add_watcher() i=6 2024-09-14T11:34:48.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.260+0000 7f3711925800 20 add_watcher() i=7 2024-09-14T11:34:48.259 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.260+0000 7f3711925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:48.261 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.263+0000 7f35c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:48.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.263+0000 7f3711925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:48.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.263+0000 7f3711925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:48.262 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.263+0000 7f3711925800 5 note: GC not initialized 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.263+0000 7f35c2fe5640 20 reqs_thread_entry: start 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.263+0000 7f3711925800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.263+0000 7f3711925800 20 Filter name: none 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f35c0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f3711925800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f3711925800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:48.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f3711925800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:34:48.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f3711925800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:34:48.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f3711925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 : miss 2024-09-14T11:34:48.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.264+0000 7f3711925800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.265+0000 7f3711925800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:48.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.265+0000 7f3711925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:48.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.265+0000 7f3711925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:48.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.265+0000 7f3711925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:48.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.265+0000 7f3711925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:48.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.265+0000 7f3711925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 2024-09-14T11:34:48.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f3711925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:48.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f3711925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:48.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f3711925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:48.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f3711925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22, ofs0, ns] 2024-09-14T11:34:48.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f35f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 94618314608608 notifier 6381 bl.length()=997 2024-09-14T11:34:48.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f35f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:48.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f35f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:48.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.272+0000 7f35f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:48.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.273+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): orig_sources= new_sources= 2024-09-14T11:34:48.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.273+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): potential sources added=[] removed=[] 2024-09-14T11:34:48.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.273+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): orig_dests= new_dests= 2024-09-14T11:34:48.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.273+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): potential dests added=[] removed=[] 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.0 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.0 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.1 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.1 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.2 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.2 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.3 2024-09-14T11:34:48.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.3 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.4 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.4 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.5 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.5 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.6 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.6 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.7 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.7 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.8 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.8 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.9 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.9 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.10 2024-09-14T11:34:48.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.10 2024-09-14T11:34:48.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.11 2024-09-14T11:34:48.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1.11 2024-09-14T11:34:48.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.278+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.0 2024-09-14T11:34:48.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.279+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1 2024-09-14T11:34:48.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.279+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.2 2024-09-14T11:34:48.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.280+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.3 2024-09-14T11:34:48.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.280+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.4 2024-09-14T11:34:48.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.281+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.5 2024-09-14T11:34:48.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.281+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.6 2024-09-14T11:34:48.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.282+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.7 2024-09-14T11:34:48.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.282+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.8 2024-09-14T11:34:48.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.283+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.9 2024-09-14T11:34:48.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.284+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.10 2024-09-14T11:34:48.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.288+0000 7f3711925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:48.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.288+0000 7f3711925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22, ofs0, ns] 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f35f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 94618314608608 notifier 6381 bl.length()=997 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f35f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f35f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f35f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:48.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): orig_sources= new_sources= 2024-09-14T11:34:48.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): potential sources added=[] removed=[] 2024-09-14T11:34:48.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): orig_dests= new_dests= 2024-09-14T11:34:48.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.290+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): potential dests added=[] removed=[] 2024-09-14T11:34:48.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.293+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.0 2024-09-14T11:34:48.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.293+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.1 2024-09-14T11:34:48.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.294+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.2 2024-09-14T11:34:48.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.294+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.3 2024-09-14T11:34:48.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.294+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.4 2024-09-14T11:34:48.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.295+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.5 2024-09-14T11:34:48.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.295+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.6 2024-09-14T11:34:48.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.296+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.7 2024-09-14T11:34:48.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.296+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.8 2024-09-14T11:34:48.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.297+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.9 2024-09-14T11:34:48.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.297+0000 7f3711925800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22.10 2024-09-14T11:34:48.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.298+0000 7f3711925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:48.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.298+0000 7f3711925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f3711925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f3711925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f3711925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f3711925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22, ofs0, ns] 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f35f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529720 cookie 94618314608608 notifier 6381 bl.length()=965 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f35f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 info.flags=0x17 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f35f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 to cache LRU end 2024-09-14T11:34:48.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.299+0000 7f35f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:48.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.300+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): orig_sources= new_sources= 2024-09-14T11:34:48.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.300+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): potential sources added=[] removed=[] 2024-09-14T11:34:48.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.300+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): orig_dests= new_dests= 2024-09-14T11:34:48.299 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.300+0000 7f3711925800 20 handle_bi_update(): bucket=:abort-at-init-indext[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22]): potential dests added=[] removed=[] 2024-09-14T11:34:48.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.302+0000 7f3711925800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:48.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.304+0000 7f35c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:48.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.307+0000 7f3711925800 20 remove_watcher() i=0 2024-09-14T11:34:48.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.307+0000 7f3711925800 2 removed watcher, disabling cache 2024-09-14T11:34:48.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.308+0000 7f3711925800 20 remove_watcher() i=1 2024-09-14T11:34:48.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.309+0000 7f3711925800 20 remove_watcher() i=2 2024-09-14T11:34:48.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.310+0000 7f3711925800 20 remove_watcher() i=3 2024-09-14T11:34:48.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.311+0000 7f3711925800 20 remove_watcher() i=4 2024-09-14T11:34:48.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.312+0000 7f3711925800 20 remove_watcher() i=5 2024-09-14T11:34:48.312 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.313+0000 7f3711925800 20 remove_watcher() i=6 2024-09-14T11:34:48.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.314+0000 7f3711925800 20 remove_watcher() i=7 2024-09-14T11:34:48.327 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:34:48.357 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:48.357 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:48.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.400+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.402+0000 7fdaf1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.402+0000 7fdaf1325800 20 realm 2024-09-14T11:34:48.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.402+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.403+0000 7fdaf1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.403+0000 7fdaf1325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:48.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.403+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.403+0000 7fdaf1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.403+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.403+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:48.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.403+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.605+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:48.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.605+0000 7fdaf1325800 20 searching for the correct realm 2024-09-14T11:34:48.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.606+0000 7fdaec7ad640 0 -- 172.21.15.7:0/142300356 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fdadc086060 msgr2=0x7fdadc0ab7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:48.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.812+0000 7fdaed7af640 0 -- 172.21.15.7:0/142300356 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fdae0097040 msgr2=0x7fdae0068300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:48.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:48.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.819+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:48.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 zone default found 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 4 Realm: () 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 zonegroup default 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 started sync module instance, tier type = 2024-09-14T11:34:48.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.820+0000 7fdaf1325800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:48.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.830+0000 7fdaf1325800 20 add_watcher() i=0 2024-09-14T11:34:48.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.830+0000 7fdaf1325800 20 add_watcher() i=1 2024-09-14T11:34:48.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.830+0000 7fdaf1325800 20 add_watcher() i=2 2024-09-14T11:34:48.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.830+0000 7fdaf1325800 20 add_watcher() i=3 2024-09-14T11:34:48.829 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.830+0000 7fdaf1325800 20 add_watcher() i=4 2024-09-14T11:34:48.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.830+0000 7fdaf1325800 20 add_watcher() i=5 2024-09-14T11:34:48.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.830+0000 7fdaf1325800 20 add_watcher() i=6 2024-09-14T11:34:48.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.831+0000 7fdaf1325800 20 add_watcher() i=7 2024-09-14T11:34:48.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.831+0000 7fdaf1325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:48.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.833+0000 7fd9a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fdaf1325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fdaf1325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fdaf1325800 5 note: GC not initialized 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fd9a27e4640 20 reqs_thread_entry: start 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fdaf1325800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fdaf1325800 20 Filter name: none 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fd99bfff640 20 reqs_thread_entry: start 2024-09-14T11:34:48.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.834+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.835+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:48.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.835+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.835+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:48.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.835+0000 7fdaf1325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:48.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.835+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.836+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:34:48.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.836+0000 7fdaf1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:48.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.836+0000 7fdaf1325800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:34:48.835 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.836+0000 7fdaf1325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:48.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.838+0000 7fd9a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:48.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.840+0000 7fdaf1325800 20 remove_watcher() i=0 2024-09-14T11:34:48.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.840+0000 7fdaf1325800 2 removed watcher, disabling cache 2024-09-14T11:34:48.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.841+0000 7fdaf1325800 20 remove_watcher() i=1 2024-09-14T11:34:48.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.842+0000 7fdaf1325800 20 remove_watcher() i=2 2024-09-14T11:34:48.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.844+0000 7fdaf1325800 20 remove_watcher() i=3 2024-09-14T11:34:48.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.845+0000 7fdaf1325800 20 remove_watcher() i=4 2024-09-14T11:34:48.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.846+0000 7fdaf1325800 20 remove_watcher() i=5 2024-09-14T11:34:48.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.847+0000 7fdaf1325800 20 remove_watcher() i=6 2024-09-14T11:34:48.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:48.848+0000 7fdaf1325800 20 remove_watcher() i=7 2024-09-14T11:34:48.858 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:48.858 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:48.859 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-init-indext id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:48.859 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:48.861 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:48.861 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:48.864 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:48.864 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:48.908 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:48.908 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:48.938 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:34:48.938 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:48.939 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:48.939 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:48.951 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:48.951 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:48.994 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:48.994 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.001 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.001 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.007 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.007 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.013 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.014 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.020 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.020 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.027 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.027 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.033 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.033 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.039 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.040 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.046 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.046 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.052 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.052 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.058 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.058 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.064 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.064 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.070 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.070 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.076 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.076 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.082 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.082 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.088 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.089 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.094 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.094 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.100 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.100 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.106 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.106 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.112 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:49.113 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:49.119 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:49.148 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:49.149 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:49.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.189+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 20 realm 2024-09-14T11:34:49.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:49.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.191+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.192+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:49.191 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.192+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.193+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:49.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.193+0000 7fc429020800 20 searching for the correct realm 2024-09-14T11:34:49.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.195+0000 7fc42730b640 0 -- 172.21.15.7:0/1996280418 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc41c045070 msgr2=0x7fc41c023a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:49.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.401+0000 7fc426309640 0 -- 172.21.15.7:0/1996280418 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc418090040 msgr2=0x7fc418091940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:49.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:49.606 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.607+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:49.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 zone default found 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 4 Realm: () 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 zonegroup default 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.608+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.609+0000 7fc429020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.609+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.609+0000 7fc429020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.609+0000 7fc429020800 20 started sync module instance, tier type = 2024-09-14T11:34:49.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.609+0000 7fc429020800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:49.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.618+0000 7fc429020800 20 add_watcher() i=0 2024-09-14T11:34:49.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.618+0000 7fc429020800 20 add_watcher() i=1 2024-09-14T11:34:49.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.618+0000 7fc429020800 20 add_watcher() i=2 2024-09-14T11:34:49.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.618+0000 7fc429020800 20 add_watcher() i=3 2024-09-14T11:34:49.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.618+0000 7fc429020800 20 add_watcher() i=4 2024-09-14T11:34:49.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.618+0000 7fc429020800 20 add_watcher() i=5 2024-09-14T11:34:49.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.618+0000 7fc429020800 20 add_watcher() i=6 2024-09-14T11:34:49.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.619+0000 7fc429020800 20 add_watcher() i=7 2024-09-14T11:34:49.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.619+0000 7fc429020800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:49.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.621+0000 7fc2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:49.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.622+0000 7fc429020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:49.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.622+0000 7fc429020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:49.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.622+0000 7fc429020800 5 note: GC not initialized 2024-09-14T11:34:49.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.622+0000 7fc257fff640 20 reqs_thread_entry: start 2024-09-14T11:34:49.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.622+0000 7fc429020800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:49.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.622+0000 7fc429020800 20 Filter name: none 2024-09-14T11:34:49.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.622+0000 7fc255ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:49.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.623+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.623+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.623+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.623+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.623+0000 7fc429020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.624+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.624+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.624+0000 7fc429020800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.624+0000 7fc429020800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:49.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.624+0000 7fc429020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:49.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.626+0000 7fc2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:49.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.628+0000 7fc429020800 20 remove_watcher() i=0 2024-09-14T11:34:49.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.628+0000 7fc429020800 2 removed watcher, disabling cache 2024-09-14T11:34:49.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.629+0000 7fc429020800 20 remove_watcher() i=1 2024-09-14T11:34:49.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.630+0000 7fc429020800 20 remove_watcher() i=2 2024-09-14T11:34:49.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.632+0000 7fc429020800 20 remove_watcher() i=3 2024-09-14T11:34:49.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.633+0000 7fc429020800 20 remove_watcher() i=4 2024-09-14T11:34:49.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.634+0000 7fc429020800 20 remove_watcher() i=5 2024-09-14T11:34:49.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.635+0000 7fc429020800 20 remove_watcher() i=6 2024-09-14T11:34:49.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.636+0000 7fc429020800 20 remove_watcher() i=7 2024-09-14T11:34:49.646 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:49.647 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:49.647 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:49.647 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:49.649 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:34:49.684 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:49.684 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:49.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.726+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 20 realm 2024-09-14T11:34:49.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:49.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.728+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.729+0000 7f10f4813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:49.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.729+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.730+0000 7f10f4813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:49.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.730+0000 7f10f4813800 20 searching for the correct realm 2024-09-14T11:34:49.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.732+0000 7f10f0749640 0 -- 172.21.15.7:0/92815543 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f10e4018070 msgr2=0x7f10e408f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:49.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.736+0000 7f10ef747640 0 -- 172.21.15.7:0/92815543 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f10e009c920 msgr2=0x7f10e008c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.942+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 zone default found 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 4 Realm: () 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 zonegroup default 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.943+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.944+0000 7f10f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:49.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.944+0000 7f10f4813800 20 started sync module instance, tier type = 2024-09-14T11:34:49.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.944+0000 7f10f4813800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:49.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.952+0000 7f10f4813800 20 add_watcher() i=0 2024-09-14T11:34:49.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.952+0000 7f10f4813800 20 add_watcher() i=1 2024-09-14T11:34:49.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.952+0000 7f10f4813800 20 add_watcher() i=2 2024-09-14T11:34:49.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.952+0000 7f10f4813800 20 add_watcher() i=3 2024-09-14T11:34:49.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.952+0000 7f10f4813800 20 add_watcher() i=4 2024-09-14T11:34:49.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.952+0000 7f10f4813800 20 add_watcher() i=5 2024-09-14T11:34:49.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.952+0000 7f10f4813800 20 add_watcher() i=6 2024-09-14T11:34:49.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.953+0000 7f10f4813800 20 add_watcher() i=7 2024-09-14T11:34:49.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.953+0000 7f10f4813800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:49.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.955+0000 7f0fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.955+0000 7f10f4813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.955+0000 7f10f4813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 5 note: GC not initialized 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f0fa4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 20 Filter name: none 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f0f1e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:49.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:34:49.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:49.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:34:49.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:34:49.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 : miss 2024-09-14T11:34:49.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.956+0000 7f10f4813800 20 rados->read ofs=0 len=0 2024-09-14T11:34:49.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.957+0000 7f10f4813800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:49.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.957+0000 7f10f4813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:49.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.957+0000 7f10f4813800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:49.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.957+0000 7f10f4813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:49.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.957+0000 7f10f4813800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:49.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.957+0000 7f10f4813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 2024-09-14T11:34:49.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.961+0000 7f10f4813800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:34:49.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.961+0000 7f10f4813800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:34:49.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.965+0000 7f0fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:49.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.968+0000 7f10f4813800 20 remove_watcher() i=0 2024-09-14T11:34:49.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.968+0000 7f10f4813800 2 removed watcher, disabling cache 2024-09-14T11:34:49.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.969+0000 7f10f4813800 20 remove_watcher() i=1 2024-09-14T11:34:49.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.970+0000 7f10f4813800 20 remove_watcher() i=2 2024-09-14T11:34:49.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.970+0000 7f10f4813800 20 remove_watcher() i=3 2024-09-14T11:34:49.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.971+0000 7f10f4813800 20 remove_watcher() i=4 2024-09-14T11:34:49.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.972+0000 7f10f4813800 20 remove_watcher() i=5 2024-09-14T11:34:49.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.973+0000 7f10f4813800 20 remove_watcher() i=6 2024-09-14T11:34:49.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:49.974+0000 7f10f4813800 20 remove_watcher() i=7 2024-09-14T11:34:49.986 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:50.015 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:50.015 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:50.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.055+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.057+0000 7f580c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.057+0000 7f580c546800 20 realm 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.057+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.057+0000 7f580c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.057+0000 7f580c546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.057+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.058+0000 7f580c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.058+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.060+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:50.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.060+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.060+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:50.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.060+0000 7f580c546800 20 searching for the correct realm 2024-09-14T11:34:50.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.061+0000 7f580a838640 0 -- 172.21.15.7:0/2197578379 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f58000ac7f0 msgr2=0x7f58000ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:50.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.267+0000 7f5809836640 0 -- 172.21.15.7:0/2197578379 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f57fc04c040 msgr2=0x7f57fc04c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:50.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:50.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:50.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:50.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.474+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:50.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 20 zone default found 2024-09-14T11:34:50.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 4 Realm: () 2024-09-14T11:34:50.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 20 zonegroup default 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.475+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.476+0000 7f580c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.476+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.476+0000 7f580c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.476+0000 7f580c546800 20 started sync module instance, tier type = 2024-09-14T11:34:50.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.476+0000 7f580c546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:50.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.486+0000 7f580c546800 20 add_watcher() i=0 2024-09-14T11:34:50.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.486+0000 7f580c546800 20 add_watcher() i=1 2024-09-14T11:34:50.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.486+0000 7f580c546800 20 add_watcher() i=2 2024-09-14T11:34:50.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.486+0000 7f580c546800 20 add_watcher() i=3 2024-09-14T11:34:50.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.486+0000 7f580c546800 20 add_watcher() i=4 2024-09-14T11:34:50.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.486+0000 7f580c546800 20 add_watcher() i=5 2024-09-14T11:34:50.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.486+0000 7f580c546800 20 add_watcher() i=6 2024-09-14T11:34:50.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.487+0000 7f580c546800 20 add_watcher() i=7 2024-09-14T11:34:50.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.487+0000 7f580c546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:50.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.489+0000 7f56c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.489+0000 7f580c546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.489+0000 7f580c546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.489+0000 7f580c546800 5 note: GC not initialized 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.489+0000 7f563b7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.489+0000 7f580c546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.490+0000 7f580c546800 20 Filter name: none 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.490+0000 7f56397fa640 20 reqs_thread_entry: start 2024-09-14T11:34:50.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.490+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.490+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:50.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.490+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.491+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:50.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.491+0000 7f580c546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:50.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.491+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.491+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:50.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.491+0000 7f580c546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.492+0000 7f580c546800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:50.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.492+0000 7f580c546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:50.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.493+0000 7f56c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:50.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.496+0000 7f580c546800 20 remove_watcher() i=0 2024-09-14T11:34:50.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.496+0000 7f580c546800 2 removed watcher, disabling cache 2024-09-14T11:34:50.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.497+0000 7f580c546800 20 remove_watcher() i=1 2024-09-14T11:34:50.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.498+0000 7f580c546800 20 remove_watcher() i=2 2024-09-14T11:34:50.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.499+0000 7f580c546800 20 remove_watcher() i=3 2024-09-14T11:34:50.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.500+0000 7f580c546800 20 remove_watcher() i=4 2024-09-14T11:34:50.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.501+0000 7f580c546800 20 remove_watcher() i=5 2024-09-14T11:34:50.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.502+0000 7f580c546800 20 remove_watcher() i=6 2024-09-14T11:34:50.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.503+0000 7f580c546800 20 remove_watcher() i=7 2024-09-14T11:34:50.515 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:50.515 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:50.515 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:50.515 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:50.517 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:50.517 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:50.524 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:50.524 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:50.568 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:50.604 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:50.604 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:50.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.647+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.648+0000 7f8c28abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.648+0000 7f8c28abb800 20 realm 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.648+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.649+0000 7f8c28abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.649+0000 7f8c28abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.649+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.649+0000 7f8c28abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.649+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.650+0000 7f8c28abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:50.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.650+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:50.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.651+0000 7f8c28abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:50.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.651+0000 7f8c28abb800 20 searching for the correct realm 2024-09-14T11:34:50.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.652+0000 7f8c26da6640 0 -- 172.21.15.7:0/42610125 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8c1c095bd0 msgr2=0x7f8c1c068130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:50.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:50.858+0000 7f8c25da4640 0 -- 172.21.15.7:0/42610125 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8c180b7090 msgr2=0x7f8c180b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:51.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:51.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:51.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.066+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:51.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:51.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 zone default found 2024-09-14T11:34:51.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 4 Realm: () 2024-09-14T11:34:51.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:51.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:51.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:51.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 zonegroup default 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.067+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.068+0000 7f8c28abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.068+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.068+0000 7f8c28abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.068+0000 7f8c28abb800 20 started sync module instance, tier type = 2024-09-14T11:34:51.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.068+0000 7f8c28abb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:51.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.078+0000 7f8c28abb800 20 add_watcher() i=0 2024-09-14T11:34:51.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.078+0000 7f8c28abb800 20 add_watcher() i=1 2024-09-14T11:34:51.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.078+0000 7f8c28abb800 20 add_watcher() i=2 2024-09-14T11:34:51.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.078+0000 7f8c28abb800 20 add_watcher() i=3 2024-09-14T11:34:51.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.078+0000 7f8c28abb800 20 add_watcher() i=4 2024-09-14T11:34:51.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.078+0000 7f8c28abb800 20 add_watcher() i=5 2024-09-14T11:34:51.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.078+0000 7f8c28abb800 20 add_watcher() i=6 2024-09-14T11:34:51.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.080+0000 7f8c28abb800 20 add_watcher() i=7 2024-09-14T11:34:51.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.080+0000 7f8c28abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:51.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.082+0000 7f8adcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:51.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.082+0000 7f8c28abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:51.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.082+0000 7f8c28abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:51.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.082+0000 7f8c28abb800 5 note: GC not initialized 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.082+0000 7f8a577fe640 20 reqs_thread_entry: start 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.082+0000 7f8c28abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.082+0000 7f8c28abb800 20 Filter name: none 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8a557fa640 20 reqs_thread_entry: start 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8c28abb800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8c28abb800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8c28abb800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:34:51.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8c28abb800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:34:51.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8c28abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 : miss 2024-09-14T11:34:51.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.083+0000 7f8c28abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.084+0000 7f8c28abb800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:51.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.084+0000 7f8c28abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:51.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.084+0000 7f8c28abb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:51.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.084+0000 7f8c28abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:51.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.084+0000 7f8c28abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:51.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.084+0000 7f8c28abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 2024-09-14T11:34:51.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.089+0000 7f8c28abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:51.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.089+0000 7f8c28abb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:51.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.089+0000 7f8c28abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:51.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.089+0000 7f8c28abb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23, ofs0, ns] 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.089+0000 7f8b09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529742 cookie 94680603650608 notifier 6188 bl.length()=1009 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.090+0000 7f8b09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.090+0000 7f8b09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.090+0000 7f8b09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.090+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): orig_sources= new_sources= 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.090+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): potential sources added=[] removed=[] 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.090+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): orig_dests= new_dests= 2024-09-14T11:34:51.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.090+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): potential dests added=[] removed=[] 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.0 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.0 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.1 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.1 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.2 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.2 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.3 2024-09-14T11:34:51.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.3 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.4 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.4 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.5 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.5 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.6 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.6 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.7 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.7 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.8 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.8 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.9 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.9 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.10 2024-09-14T11:34:51.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.10 2024-09-14T11:34:51.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.11 2024-09-14T11:34:51.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1.11 2024-09-14T11:34:51.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.0 2024-09-14T11:34:51.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.095+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1 2024-09-14T11:34:51.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.096+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.2 2024-09-14T11:34:51.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.096+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.3 2024-09-14T11:34:51.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.097+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.4 2024-09-14T11:34:51.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.098+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.5 2024-09-14T11:34:51.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.098+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.6 2024-09-14T11:34:51.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.099+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.7 2024-09-14T11:34:51.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.099+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.8 2024-09-14T11:34:51.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.100+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.9 2024-09-14T11:34:51.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.101+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.10 2024-09-14T11:34:51.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.104+0000 7f8c28abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:51.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.104+0000 7f8c28abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 2024-09-14T11:34:51.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8c28abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:51.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8c28abb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:51.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8c28abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:51.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8c28abb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23, ofs0, ns] 2024-09-14T11:34:51.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8b09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529743 cookie 94680603650608 notifier 6188 bl.length()=1009 2024-09-14T11:34:51.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8b09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:51.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8b09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:51.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.106+0000 7f8b09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:51.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.107+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): orig_sources= new_sources= 2024-09-14T11:34:51.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.107+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): potential sources added=[] removed=[] 2024-09-14T11:34:51.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.107+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): orig_dests= new_dests= 2024-09-14T11:34:51.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.107+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): potential dests added=[] removed=[] 2024-09-14T11:34:51.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.109+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.0 2024-09-14T11:34:51.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.109+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.1 2024-09-14T11:34:51.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.110+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.2 2024-09-14T11:34:51.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.110+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.3 2024-09-14T11:34:51.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.110+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.4 2024-09-14T11:34:51.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.111+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.5 2024-09-14T11:34:51.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.111+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.6 2024-09-14T11:34:51.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.111+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.7 2024-09-14T11:34:51.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.112+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.8 2024-09-14T11:34:51.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.112+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.9 2024-09-14T11:34:51.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.112+0000 7f8c28abb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23.10 2024-09-14T11:34:51.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.113+0000 7f8c28abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:51.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.113+0000 7f8c28abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 2024-09-14T11:34:51.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8c28abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:51.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8c28abb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:51.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8c28abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:51.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8c28abb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23, ofs0, ns] 2024-09-14T11:34:51.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8b09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529744 cookie 94680603650608 notifier 6188 bl.length()=977 2024-09-14T11:34:51.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8b09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 info.flags=0x17 2024-09-14T11:34:51.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8b09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 to cache LRU end 2024-09-14T11:34:51.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.114+0000 7f8b09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:51.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.115+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): orig_sources= new_sources= 2024-09-14T11:34:51.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.115+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): potential sources added=[] removed=[] 2024-09-14T11:34:51.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.115+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): orig_dests= new_dests= 2024-09-14T11:34:51.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.115+0000 7f8c28abb800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23]): potential dests added=[] removed=[] 2024-09-14T11:34:51.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.117+0000 7f8c28abb800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:51.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.119+0000 7f8adcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:51.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.121+0000 7f8c28abb800 20 remove_watcher() i=0 2024-09-14T11:34:51.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.121+0000 7f8c28abb800 2 removed watcher, disabling cache 2024-09-14T11:34:51.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.123+0000 7f8c28abb800 20 remove_watcher() i=1 2024-09-14T11:34:51.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.124+0000 7f8c28abb800 20 remove_watcher() i=2 2024-09-14T11:34:51.123 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.125+0000 7f8c28abb800 20 remove_watcher() i=3 2024-09-14T11:34:51.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.126+0000 7f8c28abb800 20 remove_watcher() i=4 2024-09-14T11:34:51.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.127+0000 7f8c28abb800 20 remove_watcher() i=5 2024-09-14T11:34:51.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.128+0000 7f8c28abb800 20 remove_watcher() i=6 2024-09-14T11:34:51.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.129+0000 7f8c28abb800 20 remove_watcher() i=7 2024-09-14T11:34:51.140 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:51.171 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:51.171 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:51.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.213+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 20 realm 2024-09-14T11:34:51.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:51.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.215+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.216+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:51.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.216+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.217+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:51.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.217+0000 7f9bb6e12800 20 searching for the correct realm 2024-09-14T11:34:51.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.219+0000 7f9bb24cb640 0 -- 172.21.15.7:0/1733912475 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f9bac019040 msgr2=0x7f9bac0671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:51.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.426+0000 7f9bb24cb640 0 -- 172.21.15.7:0/1733912475 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f9bac019040 msgr2=0x7f9bac0671a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.429+0000 7f9bb6e12800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.429+0000 7f9bb6e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.429+0000 7f9bb6e12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.429+0000 7f9bb6e12800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.429+0000 7f9bb6e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.429+0000 7f9bb6e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:51.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 zone default found 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 4 Realm: () 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 zonegroup default 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.430+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.431+0000 7f9bb6e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.431+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.431+0000 7f9bb6e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.431+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.431+0000 7f9bb6e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.431+0000 7f9bb6e12800 20 started sync module instance, tier type = 2024-09-14T11:34:51.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.431+0000 7f9bb6e12800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:51.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=0 2024-09-14T11:34:51.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=1 2024-09-14T11:34:51.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=2 2024-09-14T11:34:51.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=3 2024-09-14T11:34:51.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=4 2024-09-14T11:34:51.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=5 2024-09-14T11:34:51.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=6 2024-09-14T11:34:51.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 20 add_watcher() i=7 2024-09-14T11:34:51.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.441+0000 7f9bb6e12800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.443+0000 7f9a68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.443+0000 7f9bb6e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.443+0000 7f9bb6e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.443+0000 7f9bb6e12800 5 note: GC not initialized 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.444+0000 7f99e37fe640 20 reqs_thread_entry: start 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.444+0000 7f9bb6e12800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.444+0000 7f9bb6e12800 20 Filter name: none 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.444+0000 7f99e17fa640 20 reqs_thread_entry: start 2024-09-14T11:34:51.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.444+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.444+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:51.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.444+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.445+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:51.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.445+0000 7f9bb6e12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:51.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.445+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.445+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:51.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.445+0000 7f9bb6e12800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.445+0000 7f9bb6e12800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:51.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.445+0000 7f9bb6e12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:51.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.447+0000 7f9a68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:51.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.450+0000 7f9bb6e12800 20 remove_watcher() i=0 2024-09-14T11:34:51.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.450+0000 7f9bb6e12800 2 removed watcher, disabling cache 2024-09-14T11:34:51.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.451+0000 7f9bb6e12800 20 remove_watcher() i=1 2024-09-14T11:34:51.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.452+0000 7f9bb6e12800 20 remove_watcher() i=2 2024-09-14T11:34:51.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.453+0000 7f9bb6e12800 20 remove_watcher() i=3 2024-09-14T11:34:51.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.453+0000 7f9bb6e12800 20 remove_watcher() i=4 2024-09-14T11:34:51.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.454+0000 7f9bb6e12800 20 remove_watcher() i=5 2024-09-14T11:34:51.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.455+0000 7f9bb6e12800 20 remove_watcher() i=6 2024-09-14T11:34:51.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.456+0000 7f9bb6e12800 20 remove_watcher() i=7 2024-09-14T11:34:51.465 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:51.465 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:51.465 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:51.465 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:51.467 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.467 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.470 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.470 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.513 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.514 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.541 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:34:51.541 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:51.542 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.542 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.553 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.553 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.595 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.596 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.601 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.602 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.607 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.607 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.613 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.613 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.618 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.618 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.624 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.624 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.630 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.630 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.635 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.635 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.641 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.641 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.648 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.648 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.653 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.653 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.659 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.659 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.666 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.666 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.671 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.671 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.677 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.677 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.683 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.683 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.688 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.688 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.694 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.694 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.700 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.700 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.705 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:51.705 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:51.712 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:51.741 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:51.741 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:51.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.782+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 20 realm 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.782 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.784+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.785+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:51.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.785+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.785+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:51.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.785+0000 7f55e7719800 20 searching for the correct realm 2024-09-14T11:34:51.785 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.788+0000 7f55e5a0b640 0 -- 172.21.15.7:0/2174766474 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f55dc080020 msgr2=0x7f55dc068c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:51.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.791+0000 7f55e4a09640 0 -- 172.21.15.7:0/2174766474 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f55d801a040 msgr2=0x7f55d8048940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:51.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 zone default found 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 4 Realm: () 2024-09-14T11:34:51.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:51.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:51.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:51.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.998+0000 7f55e7719800 20 zonegroup default 2024-09-14T11:34:51.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:51.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:51.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 started sync module instance, tier type = 2024-09-14T11:34:51.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:51.999+0000 7f55e7719800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:52.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.008+0000 7f55e7719800 20 add_watcher() i=0 2024-09-14T11:34:52.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.008+0000 7f55e7719800 20 add_watcher() i=1 2024-09-14T11:34:52.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.008+0000 7f55e7719800 20 add_watcher() i=2 2024-09-14T11:34:52.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.008+0000 7f55e7719800 20 add_watcher() i=3 2024-09-14T11:34:52.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.008+0000 7f55e7719800 20 add_watcher() i=4 2024-09-14T11:34:52.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.008+0000 7f55e7719800 20 add_watcher() i=5 2024-09-14T11:34:52.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.008+0000 7f55e7719800 20 add_watcher() i=6 2024-09-14T11:34:52.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.009+0000 7f55e7719800 20 add_watcher() i=7 2024-09-14T11:34:52.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.009+0000 7f55e7719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:52.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.011+0000 7f549b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.011+0000 7f55e7719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.011+0000 7f55e7719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.011+0000 7f55e7719800 5 note: GC not initialized 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.011+0000 7f549a7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.012+0000 7f55e7719800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.012+0000 7f55e7719800 20 Filter name: none 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.012+0000 7f540bfff640 20 reqs_thread_entry: start 2024-09-14T11:34:52.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.012+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.012+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:52.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.012+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.013+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:52.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.013+0000 7f55e7719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:52.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.013+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.013+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:52.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.013+0000 7f55e7719800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.013+0000 7f55e7719800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:52.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.013+0000 7f55e7719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:52.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.015+0000 7f549b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:52.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.017+0000 7f55e7719800 20 remove_watcher() i=0 2024-09-14T11:34:52.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.017+0000 7f55e7719800 2 removed watcher, disabling cache 2024-09-14T11:34:52.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.018+0000 7f55e7719800 20 remove_watcher() i=1 2024-09-14T11:34:52.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.019+0000 7f55e7719800 20 remove_watcher() i=2 2024-09-14T11:34:52.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.020+0000 7f55e7719800 20 remove_watcher() i=3 2024-09-14T11:34:52.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.021+0000 7f55e7719800 20 remove_watcher() i=4 2024-09-14T11:34:52.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.022+0000 7f55e7719800 20 remove_watcher() i=5 2024-09-14T11:34:52.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.023+0000 7f55e7719800 20 remove_watcher() i=6 2024-09-14T11:34:52.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.024+0000 7f55e7719800 20 remove_watcher() i=7 2024-09-14T11:34:52.033 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:52.033 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:52.033 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:52.033 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:52.034 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:34:52.071 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:52.071 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:52.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.113+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 20 realm 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.115+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.116+0000 7feea6546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:52.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.116+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.117+0000 7feea6546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:52.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.117+0000 7feea6546800 20 searching for the correct realm 2024-09-14T11:34:52.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.119+0000 7feea4838640 0 -- 172.21.15.7:0/2020165964 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fee8c067ae0 msgr2=0x7fee8c071c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:52.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.325+0000 7feea3836640 0 -- 172.21.15.7:0/2020165964 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fee9403d040 msgr2=0x7fee9403e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:52.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.532+0000 7feea6546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.532+0000 7feea6546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.532+0000 7feea6546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.532+0000 7feea6546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.532+0000 7feea6546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.532+0000 7feea6546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.532+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:52.531 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 zone default found 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 4 Realm: () 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 zonegroup default 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.533+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.534+0000 7feea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.534+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.534+0000 7feea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.534+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.534+0000 7feea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.534+0000 7feea6546800 20 started sync module instance, tier type = 2024-09-14T11:34:52.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.534+0000 7feea6546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:52.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.544+0000 7feea6546800 20 add_watcher() i=0 2024-09-14T11:34:52.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.544+0000 7feea6546800 20 add_watcher() i=1 2024-09-14T11:34:52.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.544+0000 7feea6546800 20 add_watcher() i=2 2024-09-14T11:34:52.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.544+0000 7feea6546800 20 add_watcher() i=3 2024-09-14T11:34:52.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.544+0000 7feea6546800 20 add_watcher() i=4 2024-09-14T11:34:52.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.544+0000 7feea6546800 20 add_watcher() i=5 2024-09-14T11:34:52.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.544+0000 7feea6546800 20 add_watcher() i=6 2024-09-14T11:34:52.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.545+0000 7feea6546800 20 add_watcher() i=7 2024-09-14T11:34:52.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.545+0000 7feea6546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:52.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.546+0000 7fed5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:52.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feea6546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:52.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feea6546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:52.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feea6546800 5 note: GC not initialized 2024-09-14T11:34:52.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7fed59fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:52.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feea6546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:52.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feea6546800 20 Filter name: none 2024-09-14T11:34:52.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feccb7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:52.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feea6546800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:34:52.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.547+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 : miss 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 info.flags=0x17 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 to cache LRU end 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:52.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.548+0000 7feea6546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 2024-09-14T11:34:52.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.553+0000 7feea6546800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7feea6546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 info.flags=0x17 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7feea6546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 to cache LRU end 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7feea6546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7feea6546800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24, ofs0, ns] 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7fed7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529747 cookie 94555179919424 notifier 6528 bl.length()=1009 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7fed7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 info.flags=0x17 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7fed7b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 to cache LRU end 2024-09-14T11:34:52.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.554+0000 7fed7b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:52.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.555+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): orig_sources= new_sources= 2024-09-14T11:34:52.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.555+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): potential sources added=[] removed=[] 2024-09-14T11:34:52.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.555+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): orig_dests= new_dests= 2024-09-14T11:34:52.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.555+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): potential dests added=[] removed=[] 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.0 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.0 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.1 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.1 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.2 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.2 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.3 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.3 2024-09-14T11:34:52.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.4 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.4 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.5 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.5 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.6 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.6 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.7 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.7 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.8 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.8 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.9 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.9 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.10 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.10 2024-09-14T11:34:52.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.11 2024-09-14T11:34:52.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1.11 2024-09-14T11:34:52.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.0 2024-09-14T11:34:52.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.559+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1 2024-09-14T11:34:52.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.560+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.2 2024-09-14T11:34:52.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.560+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.3 2024-09-14T11:34:52.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.561+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.4 2024-09-14T11:34:52.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.561+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.5 2024-09-14T11:34:52.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.562+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.6 2024-09-14T11:34:52.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.562+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.7 2024-09-14T11:34:52.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.563+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.8 2024-09-14T11:34:52.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.563+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.9 2024-09-14T11:34:52.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.564+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.10 2024-09-14T11:34:52.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.567+0000 7feea6546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:52.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.567+0000 7feea6546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 2024-09-14T11:34:52.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.568+0000 7feea6546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 info.flags=0x17 2024-09-14T11:34:52.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.568+0000 7feea6546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 to cache LRU end 2024-09-14T11:34:52.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.568+0000 7feea6546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:52.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.568+0000 7feea6546800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24, ofs0, ns] 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7fed7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529748 cookie 94555179919424 notifier 6528 bl.length()=1009 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7fed7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 info.flags=0x17 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7fed7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 to cache LRU end 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7fed7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): orig_sources= new_sources= 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): potential sources added=[] removed=[] 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): orig_dests= new_dests= 2024-09-14T11:34:52.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.569+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): potential dests added=[] removed=[] 2024-09-14T11:34:52.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.571+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.0 2024-09-14T11:34:52.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.572+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.1 2024-09-14T11:34:52.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.572+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.2 2024-09-14T11:34:52.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.572+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.3 2024-09-14T11:34:52.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.573+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.4 2024-09-14T11:34:52.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.573+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.5 2024-09-14T11:34:52.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.573+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.6 2024-09-14T11:34:52.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.574+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.7 2024-09-14T11:34:52.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.574+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.8 2024-09-14T11:34:52.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.574+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.9 2024-09-14T11:34:52.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.574+0000 7feea6546800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24.10 2024-09-14T11:34:52.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.575+0000 7feea6546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:52.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.575+0000 7feea6546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 2024-09-14T11:34:52.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7feea6546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 info.flags=0x17 2024-09-14T11:34:52.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7feea6546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 to cache LRU end 2024-09-14T11:34:52.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7feea6546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:52.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7feea6546800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24, ofs0, ns] 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7fed7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529749 cookie 94555179919424 notifier 6528 bl.length()=977 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7fed7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 info.flags=0x17 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7fed7b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 to cache LRU end 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.576+0000 7fed7b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.577+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): orig_sources= new_sources= 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.577+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): potential sources added=[] removed=[] 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.577+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): orig_dests= new_dests= 2024-09-14T11:34:52.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.577+0000 7feea6546800 20 handle_bi_update(): bucket=:error-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24]): potential dests added=[] removed=[] 2024-09-14T11:34:52.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.579+0000 7feea6546800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:52.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.581+0000 7fed5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:52.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.583+0000 7feea6546800 20 remove_watcher() i=0 2024-09-14T11:34:52.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.583+0000 7feea6546800 2 removed watcher, disabling cache 2024-09-14T11:34:52.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.584+0000 7feea6546800 20 remove_watcher() i=1 2024-09-14T11:34:52.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.585+0000 7feea6546800 20 remove_watcher() i=2 2024-09-14T11:34:52.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.586+0000 7feea6546800 20 remove_watcher() i=3 2024-09-14T11:34:52.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.587+0000 7feea6546800 20 remove_watcher() i=4 2024-09-14T11:34:52.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.588+0000 7feea6546800 20 remove_watcher() i=5 2024-09-14T11:34:52.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.589+0000 7feea6546800 20 remove_watcher() i=6 2024-09-14T11:34:52.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.590+0000 7feea6546800 20 remove_watcher() i=7 2024-09-14T11:34:52.601 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:52.632 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:52.632 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:52.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.672+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 20 realm 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.674+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.675+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:52.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.675+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:52.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.675+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:52.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.675+0000 7ffac9926800 20 searching for the correct realm 2024-09-14T11:34:52.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.677+0000 7ffac5e70640 0 -- 172.21.15.7:0/3318316468 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ffabc01f060 msgr2=0x7ffabc05fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:52.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:52.883+0000 7ffac4e6e640 0 -- 172.21.15.7:0/3318316468 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ffab80e3fa0 msgr2=0x7ffab80b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:53.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.090+0000 7ffac9926800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.090+0000 7ffac9926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.090+0000 7ffac9926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.090+0000 7ffac9926800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.090+0000 7ffac9926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.090+0000 7ffac9926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.090+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.091+0000 7ffac9926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.091+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.091+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:53.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.091+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:53.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 zone default found 2024-09-14T11:34:53.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 4 Realm: () 2024-09-14T11:34:53.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 zonegroup default 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.092+0000 7ffac9926800 20 started sync module instance, tier type = 2024-09-14T11:34:53.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.093+0000 7ffac9926800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:53.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.102+0000 7ffac9926800 20 add_watcher() i=0 2024-09-14T11:34:53.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.102+0000 7ffac9926800 20 add_watcher() i=1 2024-09-14T11:34:53.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.102+0000 7ffac9926800 20 add_watcher() i=2 2024-09-14T11:34:53.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.102+0000 7ffac9926800 20 add_watcher() i=3 2024-09-14T11:34:53.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.102+0000 7ffac9926800 20 add_watcher() i=4 2024-09-14T11:34:53.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.102+0000 7ffac9926800 20 add_watcher() i=5 2024-09-14T11:34:53.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.102+0000 7ffac9926800 20 add_watcher() i=6 2024-09-14T11:34:53.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.103+0000 7ffac9926800 20 add_watcher() i=7 2024-09-14T11:34:53.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.103+0000 7ffac9926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:53.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.105+0000 7ff97b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:53.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.105+0000 7ffac9926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:53.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.105+0000 7ffac9926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:53.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.105+0000 7ffac9926800 5 note: GC not initialized 2024-09-14T11:34:53.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.105+0000 7ff97a7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:53.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.105+0000 7ffac9926800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:53.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.106+0000 7ffac9926800 20 Filter name: none 2024-09-14T11:34:53.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.106+0000 7ff8ebfff640 20 reqs_thread_entry: start 2024-09-14T11:34:53.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.106+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.106+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:53.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.106+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.107+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:53.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.107+0000 7ffac9926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:53.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.107+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.107+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:53.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.107+0000 7ffac9926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.107+0000 7ffac9926800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:53.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.107+0000 7ffac9926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:53.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.109+0000 7ff97b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:53.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.111+0000 7ffac9926800 20 remove_watcher() i=0 2024-09-14T11:34:53.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.111+0000 7ffac9926800 2 removed watcher, disabling cache 2024-09-14T11:34:53.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.112+0000 7ffac9926800 20 remove_watcher() i=1 2024-09-14T11:34:53.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.113+0000 7ffac9926800 20 remove_watcher() i=2 2024-09-14T11:34:53.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.114+0000 7ffac9926800 20 remove_watcher() i=3 2024-09-14T11:34:53.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.115+0000 7ffac9926800 20 remove_watcher() i=4 2024-09-14T11:34:53.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.117+0000 7ffac9926800 20 remove_watcher() i=5 2024-09-14T11:34:53.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.117+0000 7ffac9926800 20 remove_watcher() i=6 2024-09-14T11:34:53.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.119+0000 7ffac9926800 20 remove_watcher() i=7 2024-09-14T11:34:53.128 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:53.128 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:53.128 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:34:53.128 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:53.130 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.130 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.133 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.133 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.177 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.177 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.205 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:34:53.206 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:53.207 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.207 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.223 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.223 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.267 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.267 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.275 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.275 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.281 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.281 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.287 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.287 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.293 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.293 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.301 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.301 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.307 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.307 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.313 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.314 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.320 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.320 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.325 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.326 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.331 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.331 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.337 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.337 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.343 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.343 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.349 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.349 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.356 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.356 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.361 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.362 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.368 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.368 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.374 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.374 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.381 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.381 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.387 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:53.387 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:53.394 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:34:53.423 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:53.423 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:53.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.464+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 20 realm 2024-09-14T11:34:53.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:53.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.466+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.467+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:53.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.467+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.468+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:53.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.468+0000 7f16f3b26800 20 searching for the correct realm 2024-09-14T11:34:53.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.470+0000 7f16eff0a640 0 -- 172.21.15.7:0/672706196 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f16e4017040 msgr2=0x7f16e406a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:53.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.677+0000 7f16eef08640 0 -- 172.21.15.7:0/672706196 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f16e0042950 msgr2=0x7f16e0021430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:53.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:53.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.884+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:53.883 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:53.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 zone default found 2024-09-14T11:34:53.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 4 Realm: () 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 zonegroup default 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.885+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.886+0000 7f16f3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.886+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.886+0000 7f16f3b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.886+0000 7f16f3b26800 20 started sync module instance, tier type = 2024-09-14T11:34:53.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.886+0000 7f16f3b26800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:53.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.896+0000 7f16f3b26800 20 add_watcher() i=0 2024-09-14T11:34:53.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.896+0000 7f16f3b26800 20 add_watcher() i=1 2024-09-14T11:34:53.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.896+0000 7f16f3b26800 20 add_watcher() i=2 2024-09-14T11:34:53.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.896+0000 7f16f3b26800 20 add_watcher() i=3 2024-09-14T11:34:53.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.896+0000 7f16f3b26800 20 add_watcher() i=4 2024-09-14T11:34:53.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.896+0000 7f16f3b26800 20 add_watcher() i=5 2024-09-14T11:34:53.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.896+0000 7f16f3b26800 20 add_watcher() i=6 2024-09-14T11:34:53.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.897+0000 7f16f3b26800 20 add_watcher() i=7 2024-09-14T11:34:53.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.897+0000 7f16f3b26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:53.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.899+0000 7f15a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.899+0000 7f16f3b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.899+0000 7f16f3b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.899+0000 7f16f3b26800 5 note: GC not initialized 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.899+0000 7f15a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.900+0000 7f16f3b26800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.900+0000 7f16f3b26800 20 Filter name: none 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.900+0000 7f151e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.900+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.898 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.901+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:53.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.901+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.901+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:53.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.901+0000 7f16f3b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:53.899 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.901+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.902+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:53.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.902+0000 7f16f3b26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:53.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.902+0000 7f16f3b26800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:53.900 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.902+0000 7f16f3b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:53.902 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.904+0000 7f15a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:53.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.907+0000 7f16f3b26800 20 remove_watcher() i=0 2024-09-14T11:34:53.904 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.907+0000 7f16f3b26800 2 removed watcher, disabling cache 2024-09-14T11:34:53.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.908+0000 7f16f3b26800 20 remove_watcher() i=1 2024-09-14T11:34:53.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.909+0000 7f16f3b26800 20 remove_watcher() i=2 2024-09-14T11:34:53.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.910+0000 7f16f3b26800 20 remove_watcher() i=3 2024-09-14T11:34:53.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.911+0000 7f16f3b26800 20 remove_watcher() i=4 2024-09-14T11:34:53.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.912+0000 7f16f3b26800 20 remove_watcher() i=5 2024-09-14T11:34:53.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.913+0000 7f16f3b26800 20 remove_watcher() i=6 2024-09-14T11:34:53.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:53.914+0000 7f16f3b26800 20 remove_watcher() i=7 2024-09-14T11:34:53.923 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:53.924 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:53.924 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:53.924 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:53.925 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:34:53.961 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:53.961 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:54.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.004+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.005+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.005+0000 7f03e3546800 20 realm 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.005+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.006+0000 7f03e3546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:54.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:54.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.008+0000 7f03e3546800 20 searching for the correct realm 2024-09-14T11:34:54.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.009+0000 7f03e1838640 0 -- 172.21.15.7:0/3159947914 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f03cc08bb80 msgr2=0x7f03cc07a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:54.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.215+0000 7f03e0836640 0 -- 172.21.15.7:0/3159947914 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f03d40482a0 msgr2=0x7f03d40661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:54.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:54.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:54.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:54.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:54.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:54.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:54.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:54.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:54.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 zone default found 2024-09-14T11:34:54.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 4 Realm: () 2024-09-14T11:34:54.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:54.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 zonegroup default 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.424+0000 7f03e3546800 20 started sync module instance, tier type = 2024-09-14T11:34:54.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.424+0000 7f03e3546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:54.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=0 2024-09-14T11:34:54.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=1 2024-09-14T11:34:54.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=2 2024-09-14T11:34:54.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=3 2024-09-14T11:34:54.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=4 2024-09-14T11:34:54.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=5 2024-09-14T11:34:54.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=6 2024-09-14T11:34:54.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.434+0000 7f03e3546800 20 add_watcher() i=7 2024-09-14T11:34:54.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.434+0000 7f03e3546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:54.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.436+0000 7f02977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:54.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.436+0000 7f03e3546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.436+0000 7f03e3546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.436+0000 7f03e3546800 5 note: GC not initialized 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.437+0000 7f02967e4640 20 reqs_thread_entry: start 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.437+0000 7f03e3546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.437+0000 7f03e3546800 20 Filter name: none 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.437+0000 7f0207fff640 20 reqs_thread_entry: start 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.437+0000 7f03e3546800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.437+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 : miss 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:34:54.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:54.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:54.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.438+0000 7f03e3546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 2024-09-14T11:34:54.439 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03e3546800 time 2024-09-14T11:34:54.442834+0000 2024-09-14T11:34:54.440 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:54.440 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03e6b8c76a] 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.443+0000 7f03e3546800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03e3546800 time 2024-09-14T11:34:54.442834+0000 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03e6b8c76a] 2024-09-14T11:34:54.441 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:54.442 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f03e3546800 thread_name:radosgw-admin 2024-09-14T11:34:54.459 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.459 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03e583e6f0] 2024-09-14T11:34:54.459 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03e588b99c] 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03e6b8c7c4] 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.444+0000 7f03e3546800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f03e3546800 thread_name:radosgw-admin 2024-09-14T11:34:54.460 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03e583e6f0] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03e588b99c] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03e6b8c7c4] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:54.461 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:34:53.985+0000 7f03e1838640 1 monclient: found mon.noname-a 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:34:53.985+0000 7f03e1838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: dump: 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.462 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:34:53.986+0000 7f03e3546800 5 monclient: authenticate success, global_id 6573 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:34:53.986+0000 7f03e3546800 4 set_mon_vals no callback set 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: dump: 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.463 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: shutdown 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:34:53.986+0000 7f03e3546800 5 asok(0x558abf3a7270) unregister_commands rotate-key 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:34:53.986+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.464 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:34:53.986+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding auth protocol: cephx 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding auth protocol: cephx 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding auth protocol: cephx 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.465 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:34:53.987+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: starting msgr at 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: starting objecter 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command objecter_requests hook 0x558abf5cb810 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: setting wanted keys 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: calling monclient init 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding auth protocol: cephx 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding auth protocol: cephx 2024-09-14T11:34:54.466 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding auth protocol: cephx 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:34:53.987+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:34:53.987+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key hook 0x558abf5c78d8 2024-09-14T11:34:54.467 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf474b60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf47c060 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf50d6c0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.543988s 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf474b60 auth_method 0 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf47c060 auth_method 0 2024-09-14T11:34:54.468 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf50d6c0 auth_method 0 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.469 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:34:53.988+0000 7f03e1037640 1 monclient: found mon.noname-c 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: dump: 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.470 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: dump: 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.471 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:34:53.988+0000 7f02cf606640 4 set_mon_vals no callback set 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:34:53.988+0000 7f03e3546800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:34:53.988+0000 7f03e3546800 1 librados: init done 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:34:53.990+0000 7f02cde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:34:53.990+0000 7f02cde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:34:53.990+0000 7f02cde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:34:53.991+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f02c8077230 auth_method 0 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:34:53.991+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf606030 auth_method 0 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:34:53.991+0000 7f03e1037640 10 monclient: get_auth_request con 0x558abf612f00 auth_method 0 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:34:53.992+0000 7f03e0836640 10 monclient: get_auth_request con 0x558abf617350 auth_method 0 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:34:53.994+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf6167b0 auth_method 0 2024-09-14T11:34:54.472 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:34:53.994+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:34:53.994+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:34:53.994+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding auth protocol: cephx 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding auth protocol: cephx 2024-09-14T11:34:54.473 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding auth protocol: cephx 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:34:53.994+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command objecter_requests cmddesc objecter_requests hook 0x558abf6229b0 EEXIST 2024-09-14T11:34:54.474 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding auth protocol: cephx 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding auth protocol: cephx 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding auth protocol: cephx 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.475 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:34:53.995+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:34:53.995+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key cmddesc rotate-key hook 0x558abf61e540 EEXIST 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf646cd0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf6470b0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf6459e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.551748s 2024-09-14T11:34:54.476 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf6470b0 auth_method 0 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf646cd0 auth_method 0 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf6459e0 auth_method 0 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.477 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:34:53.996+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:34:53.996+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:34:53.996+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:34:53.996+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:34:53.996+0000 7f03e1838640 10 monclient(hunting): handle_auth_done global_id 6579 payload 824 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:34:53.996+0000 7f03e1838640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:34:53.996+0000 7f03e1838640 1 monclient: found mon.noname-a 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:34:53.996+0000 7f03e1838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: dump: 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.478 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: dump: 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.479 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:34:53.996+0000 7f03e3546800 5 monclient: authenticate success, global_id 6579 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:34:53.996+0000 7f03e2039640 4 set_mon_vals no callback set 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.480 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:34:53.998+0000 7f02c6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:34:53.998+0000 7f02c6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:34:53.998+0000 7f02c6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:34:53.998+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f02bc077140 auth_method 0 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:34:53.998+0000 7f03e3546800 10 monclient: get_monmap_and_config 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:34:53.998+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:34:53.998+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:34:53.998+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.481 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding auth protocol: cephx 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding auth protocol: cephx 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding auth protocol: cephx 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.482 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:34:53.999+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding auth protocol: cephx 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding auth protocol: cephx 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding auth protocol: cephx 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.483 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:34:53.999+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:34:53.999+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key cmddesc rotate-key hook 0x7ffc284a5448 EEXIST 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf66ad20 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf695790 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf696b40 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.484 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.555891s 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf695790 auth_method 0 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf696b40 auth_method 0 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf66ad20 auth_method 0 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.485 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_done global_id 6582 payload 274 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:34:54.000+0000 7f03e1838640 1 monclient: found mon.noname-a 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:54.486 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: dump: 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: dump: 2024-09-14T11:34:54.487 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:34:54.000+0000 7f03e3546800 5 monclient: authenticate success, global_id 6582 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:34:54.000+0000 7f03e3546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:34:54.000+0000 7f03e3546800 4 set_mon_vals no callback set 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: shutdown 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.488 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding auth protocol: cephx 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding auth protocol: cephx 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding auth protocol: cephx 2024-09-14T11:34:54.489 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:34:54.001+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: starting msgr at 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: starting objecter 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command objecter_requests cmddesc objecter_requests hook 0x558abf66aaf0 EEXIST 2024-09-14T11:34:54.490 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: setting wanted keys 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: calling monclient init 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding auth protocol: cephx 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding auth protocol: cephx 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding auth protocol: cephx 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.491 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:34:54.001+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:34:54.002+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:34:54.002+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key cmddesc rotate-key hook 0x558abf65b6d8 EEXIST 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf66ad20 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf696b40 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf68edd0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.558201s 2024-09-14T11:34:54.492 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf696b40 auth_method 0 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf68edd0 auth_method 0 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf66ad20 auth_method 0 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.493 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:34:54.002+0000 7f03e1037640 1 monclient: found mon.noname-c 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: dump: 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.494 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: dump: 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.495 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:34:54.002+0000 7f03e3546800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:34:54.002+0000 7f02c4ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:34:54.002+0000 7f03e3546800 1 librados: init done 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:34:54.002+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cr dump hook 0x558abf689408 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:34:54.004+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.496 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:34:54.005+0000 7f02b2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:34:54.005+0000 7f02b2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:34:54.005+0000 7f02b2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:34:54.005+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f02ac077260 auth_method 0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:34:54.005+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf6b5cf0 auth_method 0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:34:54.005+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:34:54.005+0000 7f03e3546800 20 realm 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:34:54.005+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:34:54.006+0000 7f03e3546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.497 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:34:54.006+0000 7f03e0836640 10 monclient: get_auth_request con 0x558abf6b9f90 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:34:54.007+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf6bd7d0 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:34:54.008+0000 7f03e3546800 20 searching for the correct realm 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:34:54.008+0000 7f03e1037640 10 monclient: get_auth_request con 0x558abf6c2510 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:34:54.008+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f03d403f0b0 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:34:54.009+0000 7f03e1838640 10 monclient: get_auth_request con 0x7f03cc08bb80 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:34:54.009+0000 7f03e1838640 0 -- 172.21.15.7:0/3159947914 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f03cc08bb80 msgr2=0x7f03cc07a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:34:54.210+0000 7f03e1838640 10 monclient: get_auth_request con 0x7f03cc08bb80 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:34:54.211+0000 7f03e1037640 10 monclient: get_auth_request con 0x7f03dc071010 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:34:54.215+0000 7f03e0836640 0 -- 172.21.15.7:0/3159947914 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f03d40482a0 msgr2=0x7f03d40661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:34:54.416+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f03d40482a0 auth_method 0 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:54.498 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 zone default found 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:34:54.423+0000 7f03e3546800 4 Realm: () 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:34:54.423+0000 7f03e3546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:34:54.423+0000 7f03e3546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:34:54.423+0000 7f03e3546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:54.499 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 zonegroup default 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 started sync module instance, tier type = 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=0 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=1 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=2 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=3 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=4 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=5 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=6 2024-09-14T11:34:54.500 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:34:54.434+0000 7f03e3546800 20 add_watcher() i=7 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:34:54.434+0000 7f03e3546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding auth protocol: cephx 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding auth protocol: cephx 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding auth protocol: cephx 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.501 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:34:54.436+0000 7f02977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:34:54.436+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:34:54.436+0000 7f03e3546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:34:54.436+0000 7f03e3546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache list hook 0x558abf690b40 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache inspect hook 0x558abf690b40 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache erase hook 0x558abf690b40 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache zap hook 0x558abf690b40 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 note: GC not initialized 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:34:54.437+0000 7f02967e4640 20 reqs_thread_entry: start 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace show hook 0x7f03dc029030 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace history hook 0x7f03dc029030 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace active hook 0x7f03dc029030 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace active_short hook 0x7f03dc029030 2024-09-14T11:34:54.502 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:34:54.437+0000 7f03e3546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:34:54.437+0000 7f03e3546800 20 Filter name: none 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:34:54.437+0000 7f0207fff640 20 reqs_thread_entry: start 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:34:54.437+0000 7f03e3546800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:34:54.437+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 : miss 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 2024-09-14T11:34:54.503 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:34:54.443+0000 7f03e3546800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03e3546800 time 2024-09-14T11:34:54.442834+0000 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03e6b8c76a] 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:34:54.444+0000 7f03e3546800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:54.504 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f03e3546800 thread_name:radosgw-admin 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03e583e6f0] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03e588b99c] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03e6b8c7c4] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.505 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:34:54.506 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:34:54.507 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:54.508 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:34:54.509 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:34:54.510 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:54.511 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f0207fff640 / http_manager 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02967e4640 / http_manager 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02977e6640 / rgw_dt_lg_renew 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02b2ffd640 / ms_dispatch 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02c4ff9640 / io_context_pool 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02c6ffd640 / ms_dispatch 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02cde03640 / ms_dispatch 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02cf606640 / io_context_pool 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e0836640 / msgr-worker-2 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e1037640 / msgr-worker-1 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e1838640 / msgr-worker-0 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e2039640 / io_context_pool 2024-09-14T11:34:54.512 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e3546800 / radosgw-admin 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.98596.log 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:34:53.985+0000 7f03e1838640 1 monclient: found mon.noname-a 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:34:53.985+0000 7f03e1838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: dump: 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.513 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:34:53.986+0000 7f03e3546800 5 monclient: authenticate success, global_id 6573 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:34:53.986+0000 7f03e3546800 4 set_mon_vals no callback set 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:34:53.986+0000 7f02cf606640 10 monclient: dump: 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.514 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: shutdown 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:34:53.986+0000 7f03e3546800 5 asok(0x558abf3a7270) unregister_commands rotate-key 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:34:53.986+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:34:53.986+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.515 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:34:53.986+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding auth protocol: cephx 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding auth protocol: cephx 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding auth protocol: cephx 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.516 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: crc 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5cd3a0) adding con mode: secure 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:34:53.987+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: starting msgr at 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: starting objecter 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command objecter_requests hook 0x558abf5cb810 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: setting wanted keys 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:34:53.987+0000 7f03e3546800 1 librados: calling monclient init 2024-09-14T11:34:54.517 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding auth protocol: cephx 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding auth protocol: cephx 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding auth protocol: cephx 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: crc 2024-09-14T11:34:54.518 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 AuthRegistry(0x558abf5c7790) adding con mode: secure 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:34:53.987+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:34:53.987+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:34:53.987+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key hook 0x558abf5c78d8 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf474b60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf47c060 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf50d6c0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:34:53.987+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.543988s 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf474b60 auth_method 0 2024-09-14T11:34:54.519 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf47c060 auth_method 0 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:34:53.988+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf50d6c0 auth_method 0 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.520 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:34:53.988+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:34:53.988+0000 7f03e1037640 1 monclient: found mon.noname-c 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:34:53.988+0000 7f03e1037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: dump: 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.521 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:34:53.988+0000 7f02cde03640 10 monclient: dump: 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.522 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:34:53.988+0000 7f02cf606640 4 set_mon_vals no callback set 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:34:53.988+0000 7f03e3546800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:34:53.988+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:34:53.988+0000 7f03e3546800 1 librados: init done 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:34:53.990+0000 7f02cde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:34:53.990+0000 7f02cde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:34:53.990+0000 7f02cde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:34:53.991+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f02c8077230 auth_method 0 2024-09-14T11:34:54.523 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:34:53.991+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf606030 auth_method 0 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:34:53.991+0000 7f03e1037640 10 monclient: get_auth_request con 0x558abf612f00 auth_method 0 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:34:53.992+0000 7f03e0836640 10 monclient: get_auth_request con 0x558abf617350 auth_method 0 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:34:53.994+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf6167b0 auth_method 0 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:34:53.994+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:34:53.994+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:34:53.994+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.524 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding auth protocol: cephx 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding auth protocol: cephx 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding auth protocol: cephx 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.525 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: crc 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:34:53.994+0000 7f03e3546800 5 AuthRegistry(0x558abf61f500) adding con mode: secure 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:34:53.994+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command objecter_requests cmddesc objecter_requests hook 0x558abf6229b0 EEXIST 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding auth protocol: cephx 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding auth protocol: cephx 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding auth protocol: cephx 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.526 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: crc 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 AuthRegistry(0x558abf61e3f8) adding con mode: secure 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:34:53.995+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:34:53.995+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:34:53.995+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key cmddesc rotate-key hook 0x558abf61e540 EEXIST 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf646cd0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf6470b0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf6459e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.527 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:34:53.995+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.551748s 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf6470b0 auth_method 0 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf646cd0 auth_method 0 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf6459e0 auth_method 0 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.528 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:34:53.995+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:34:53.995+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:34:53.995+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:34:53.996+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:34:53.996+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:34:53.996+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:34:53.996+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:34:53.996+0000 7f03e1838640 10 monclient(hunting): handle_auth_done global_id 6579 payload 824 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:34:53.996+0000 7f03e1838640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:34:53.996+0000 7f03e1838640 1 monclient: found mon.noname-a 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:34:53.996+0000 7f03e1838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.529 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: dump: 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.530 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:34:53.996+0000 7f02c6ffd640 10 monclient: dump: 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:34:53.996+0000 7f03e3546800 5 monclient: authenticate success, global_id 6579 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.531 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:34:53.996+0000 7f03e2039640 4 set_mon_vals no callback set 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:34:53.996+0000 7f03e3546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:34:53.998+0000 7f02c6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:34:53.998+0000 7f02c6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:34:53.998+0000 7f02c6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:34:53.998+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f02bc077140 auth_method 0 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:34:53.998+0000 7f03e3546800 10 monclient: get_monmap_and_config 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:34:53.998+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:34:53.998+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:34:53.998+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.532 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding auth protocol: cephx 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding auth protocol: cephx 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding auth protocol: cephx 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.533 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: crc 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:34:53.998+0000 7f03e3546800 5 AuthRegistry(0x558abf666be0) adding con mode: secure 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:34:53.999+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding auth protocol: cephx 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding auth protocol: cephx 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding auth protocol: cephx 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.534 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: crc 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a5300) adding con mode: secure 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:34:53.999+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:34:53.999+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:34:53.999+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key cmddesc rotate-key hook 0x7ffc284a5448 EEXIST 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf66ad20 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.535 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf695790 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf696b40 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:34:53.999+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.555891s 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf695790 auth_method 0 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf696b40 auth_method 0 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.536 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf66ad20 auth_method 0 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:34:54.000+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:34:54.000+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.537 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient(hunting): handle_auth_done global_id 6582 payload 274 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:34:54.000+0000 7f03e1838640 1 monclient: found mon.noname-a 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:34:54.000+0000 7f03e1838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: dump: 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.538 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:34:54.000+0000 7f02c4ff9640 10 monclient: dump: 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.539 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:34:54.000+0000 7f03e3546800 5 monclient: authenticate success, global_id 6582 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:34:54.000+0000 7f03e3546800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:34:54.000+0000 7f03e3546800 4 set_mon_vals no callback set 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: shutdown 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: build_initial_monmap 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 build_initial for_mkfs: 0 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: monmap: 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.540 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding auth protocol: cephx 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding auth protocol: cephx 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding auth protocol: cephx 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.541 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: crc 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf68cec0) adding con mode: secure 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:34:54.001+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: starting msgr at 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: starting objecter 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command objecter_requests cmddesc objecter_requests hook 0x558abf66aaf0 EEXIST 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: setting wanted keys 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:34:54.001+0000 7f03e3546800 1 librados: calling monclient init 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:34:54.001+0000 7f03e3546800 10 monclient: init 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding auth protocol: cephx 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding auth protocol: cephx 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding auth protocol: cephx 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.542 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: crc 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:34:54.001+0000 7f03e3546800 5 AuthRegistry(0x558abf65b590) adding con mode: secure 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:34:54.001+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:34:54.002+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:34:54.002+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command rotate-key cmddesc rotate-key hook 0x558abf65b6d8 EEXIST 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:54.543 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-b con 0x558abf66ad20 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-a con 0x558abf696b40 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): picked mon.noname-c con 0x558abf68edd0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient(hunting): authenticate will time out at 1994.558201s 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): get_auth_request con 0x558abf696b40 auth_method 0 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): get_auth_request con 0x558abf68edd0 auth_method 0 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.544 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): get_auth_request con 0x558abf66ad20 auth_method 0 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.545 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:34:54.002+0000 7f03e1838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:34:54.002+0000 7f03e0836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient: _finish_hunting 0 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:34:54.002+0000 7f03e1037640 1 monclient: found mon.noname-c 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:34:54.002+0000 7f03e1037640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: dump: 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.546 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:34:54.002+0000 7f02b2ffd640 10 monclient: dump: 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:34:54.547 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:34:54.002+0000 7f03e3546800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:34:54.002+0000 7f02c4ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _renew_subs 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:34:54.002+0000 7f03e3546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:34:54.002+0000 7f03e3546800 1 librados: init done 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:34:54.002+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cr dump hook 0x558abf689408 2024-09-14T11:34:54.548 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:34:54.004+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:34:54.005+0000 7f02b2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:34:54.005+0000 7f02b2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:34:54.005+0000 7f02b2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:34:54.005+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f02ac077260 auth_method 0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:34:54.005+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf6b5cf0 auth_method 0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:34:54.005+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:34:54.005+0000 7f03e3546800 20 realm 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:34:54.005+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:34:54.006+0000 7f03e3546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:34:54.006+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:34:54.006+0000 7f03e0836640 10 monclient: get_auth_request con 0x558abf6b9f90 auth_method 0 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:54.549 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:34:54.007+0000 7f03e1838640 10 monclient: get_auth_request con 0x558abf6bd7d0 auth_method 0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:34:54.007+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:34:54.008+0000 7f03e3546800 20 searching for the correct realm 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:34:54.008+0000 7f03e1037640 10 monclient: get_auth_request con 0x558abf6c2510 auth_method 0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:34:54.008+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f03d403f0b0 auth_method 0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:34:54.009+0000 7f03e1838640 10 monclient: get_auth_request con 0x7f03cc08bb80 auth_method 0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:34:54.009+0000 7f03e1838640 0 -- 172.21.15.7:0/3159947914 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f03cc08bb80 msgr2=0x7f03cc07a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:34:54.210+0000 7f03e1838640 10 monclient: get_auth_request con 0x7f03cc08bb80 auth_method 0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:34:54.211+0000 7f03e1037640 10 monclient: get_auth_request con 0x7f03dc071010 auth_method 0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:34:54.215+0000 7f03e0836640 0 -- 172.21.15.7:0/3159947914 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f03d40482a0 msgr2=0x7f03d40661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:34:54.416+0000 7f03e0836640 10 monclient: get_auth_request con 0x7f03d40482a0 auth_method 0 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:54.550 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:34:54.422+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 zone default found 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:34:54.423+0000 7f03e3546800 4 Realm: () 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:34:54.423+0000 7f03e3546800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:34:54.423+0000 7f03e3546800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:34:54.423+0000 7f03e3546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:54.551 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 zonegroup default 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:34:54.423+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 started sync module instance, tier type = 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:34:54.424+0000 7f03e3546800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=0 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=1 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=2 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=3 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=4 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=5 2024-09-14T11:34:54.552 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:34:54.433+0000 7f03e3546800 20 add_watcher() i=6 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:34:54.434+0000 7f03e3546800 20 add_watcher() i=7 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:34:54.434+0000 7f03e3546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding auth protocol: cephx 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding auth protocol: cephx 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding auth protocol: cephx 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.553 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: crc 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 AuthRegistry(0x7ffc284a57e0) adding con mode: secure 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:34:54.436+0000 7f02977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:34:54.436+0000 7f03e3546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:34:54.436+0000 7f03e3546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:34:54.436+0000 7f03e3546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache list hook 0x558abf690b40 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache inspect hook 0x558abf690b40 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache erase hook 0x558abf690b40 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command cache zap hook 0x558abf690b40 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:34:54.436+0000 7f03e3546800 5 note: GC not initialized 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:34:54.437+0000 7f02967e4640 20 reqs_thread_entry: start 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace show hook 0x7f03dc029030 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace history hook 0x7f03dc029030 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace active hook 0x7f03dc029030 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:34:54.437+0000 7f03e3546800 5 asok(0x558abf3a7270) register_command sync trace active_short hook 0x7f03dc029030 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:34:54.437+0000 7f03e3546800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:54.554 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:34:54.437+0000 7f03e3546800 20 Filter name: none 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:34:54.437+0000 7f0207fff640 20 reqs_thread_entry: start 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:34:54.437+0000 7f03e3546800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:34:54.437+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 : miss 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:34:54.438+0000 7f03e3546800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:34:54.438+0000 7f03e3546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:34:54.443+0000 7f03e3546800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03e3546800 time 2024-09-14T11:34:54.442834+0000 2024-09-14T11:34:54.555 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03e6b8c76a] 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:34:54.444+0000 7f03e3546800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f03e3546800 thread_name:radosgw-admin 2024-09-14T11:34:54.556 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03e583e6f0] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03e588b99c] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03e6b8c7c4] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f03e6b8c928] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558abe4e90b1] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd88418) [0x558abe9fc418] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558abe4f8efd] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f03e5829590] 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:54.557 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:34:54.558 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:34:54.559 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:54.560 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:34:54.561 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:54.562 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 7f0207fff640 / http_manager 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02967e4640 / http_manager 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02977e6640 / rgw_dt_lg_renew 2024-09-14T11:34:54.563 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02b2ffd640 / ms_dispatch 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02c4ff9640 / io_context_pool 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02c6ffd640 / ms_dispatch 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02cde03640 / ms_dispatch 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f02cf606640 / io_context_pool 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e0836640 / msgr-worker-2 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e1037640 / msgr-worker-1 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e1838640 / msgr-worker-0 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e2039640 / io_context_pool 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: 7f03e3546800 / radosgw-admin 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:54.444552Z_1ce35259-0570-4c2b-8153-4426dfb0abd9/log 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:34:54.564 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:34:54.565 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:54.565 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:54.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.727+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 20 realm 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:54.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.729+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.730+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:54.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.730+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:54.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.731+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:54.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.731+0000 7fedd0b33800 20 searching for the correct realm 2024-09-14T11:34:54.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.733+0000 7fedccf9a640 0 -- 172.21.15.7:0/2397720304 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fedc0075220 msgr2=0x7fedc0037930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:54.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:54.939+0000 7fedcbf98640 0 -- 172.21.15.7:0/2397720304 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fedbc0bab10 msgr2=0x7fedbc06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.146+0000 7fedd0b33800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.146+0000 7fedd0b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.146+0000 7fedd0b33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.146+0000 7fedd0b33800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.146+0000 7fedd0b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.146+0000 7fedd0b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:55.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 zone default found 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 4 Realm: () 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 zonegroup default 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.147+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.148+0000 7fedd0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.148+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.148+0000 7fedd0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.148+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.148+0000 7fedd0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.148+0000 7fedd0b33800 20 started sync module instance, tier type = 2024-09-14T11:34:55.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.148+0000 7fedd0b33800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:55.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.158+0000 7fedd0b33800 20 add_watcher() i=0 2024-09-14T11:34:55.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.158+0000 7fedd0b33800 20 add_watcher() i=1 2024-09-14T11:34:55.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.158+0000 7fedd0b33800 20 add_watcher() i=2 2024-09-14T11:34:55.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.158+0000 7fedd0b33800 20 add_watcher() i=3 2024-09-14T11:34:55.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.158+0000 7fedd0b33800 20 add_watcher() i=4 2024-09-14T11:34:55.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.158+0000 7fedd0b33800 20 add_watcher() i=5 2024-09-14T11:34:55.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.158+0000 7fedd0b33800 20 add_watcher() i=6 2024-09-14T11:34:55.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.159+0000 7fedd0b33800 20 add_watcher() i=7 2024-09-14T11:34:55.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.159+0000 7fedd0b33800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:55.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.161+0000 7fec82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7fedd0b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7fedd0b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7fedd0b33800 5 note: GC not initialized 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7fec81fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7fedd0b33800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7fedd0b33800 20 Filter name: none 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7febf37fe640 20 reqs_thread_entry: start 2024-09-14T11:34:55.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.162+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.163+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:55.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.163+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.163+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:55.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.163+0000 7fedd0b33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:55.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.163+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.164+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:55.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.164+0000 7fedd0b33800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.164+0000 7fedd0b33800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:55.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.164+0000 7fedd0b33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:55.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.166+0000 7fec82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:55.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.168+0000 7fedd0b33800 20 remove_watcher() i=0 2024-09-14T11:34:55.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.168+0000 7fedd0b33800 2 removed watcher, disabling cache 2024-09-14T11:34:55.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.170+0000 7fedd0b33800 20 remove_watcher() i=1 2024-09-14T11:34:55.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.171+0000 7fedd0b33800 20 remove_watcher() i=2 2024-09-14T11:34:55.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.172+0000 7fedd0b33800 20 remove_watcher() i=3 2024-09-14T11:34:55.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.173+0000 7fedd0b33800 20 remove_watcher() i=4 2024-09-14T11:34:55.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.174+0000 7fedd0b33800 20 remove_watcher() i=5 2024-09-14T11:34:55.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.175+0000 7fedd0b33800 20 remove_watcher() i=6 2024-09-14T11:34:55.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.176+0000 7fedd0b33800 20 remove_watcher() i=7 2024-09-14T11:34:55.187 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:55.187 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:34:55.187 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:55.187 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:34:55.188 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:55.189 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:55.195 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:55.196 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:34:55.238 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:55.273 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:55.273 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:55.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.317+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 20 realm 2024-09-14T11:34:55.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:55.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.318+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.319+0000 7fc793b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:55.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.319+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.320+0000 7fc793b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:55.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.320+0000 7fc793b2c800 20 searching for the correct realm 2024-09-14T11:34:55.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.322+0000 7fc790050640 0 -- 172.21.15.7:0/3893020604 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc784048920 msgr2=0x7fc78401d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:55.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.529+0000 7fc78f04e640 0 -- 172.21.15.7:0/3893020604 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc7800df6f0 msgr2=0x7fc7800cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.737+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 20 zone default found 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 4 Realm: () 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 20 zonegroup default 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.738+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.739+0000 7fc793b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.739+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.739+0000 7fc793b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:55.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.739+0000 7fc793b2c800 20 started sync module instance, tier type = 2024-09-14T11:34:55.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.739+0000 7fc793b2c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:34:55.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.750+0000 7fc793b2c800 20 add_watcher() i=0 2024-09-14T11:34:55.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.750+0000 7fc793b2c800 20 add_watcher() i=1 2024-09-14T11:34:55.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.751+0000 7fc793b2c800 20 add_watcher() i=2 2024-09-14T11:34:55.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.751+0000 7fc793b2c800 20 add_watcher() i=3 2024-09-14T11:34:55.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.751+0000 7fc793b2c800 20 add_watcher() i=4 2024-09-14T11:34:55.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.751+0000 7fc793b2c800 20 add_watcher() i=5 2024-09-14T11:34:55.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.751+0000 7fc793b2c800 20 add_watcher() i=6 2024-09-14T11:34:55.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.752+0000 7fc793b2c800 20 add_watcher() i=7 2024-09-14T11:34:55.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.752+0000 7fc793b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:55.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.754+0000 7fc645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:55.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.754+0000 7fc793b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:55.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.754+0000 7fc793b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:55.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.754+0000 7fc793b2c800 5 note: GC not initialized 2024-09-14T11:34:55.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.754+0000 7fc644fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:55.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.754+0000 7fc793b2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:55.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 20 Filter name: none 2024-09-14T11:34:55.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc5be7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:55.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:55.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 : miss 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.755+0000 7fc793b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.756+0000 7fc793b2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.756+0000 7fc793b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.756+0000 7fc793b2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.756+0000 7fc793b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.756+0000 7fc793b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:55.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.756+0000 7fc793b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 2024-09-14T11:34:55.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.757+0000 7fc793b2c800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to be held by another RGW process; skipping for now 2024-09-14T11:34:55.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.758+0000 7fc645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:55.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.760+0000 7fc793b2c800 20 remove_watcher() i=0 2024-09-14T11:34:55.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.760+0000 7fc793b2c800 2 removed watcher, disabling cache 2024-09-14T11:34:55.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.762+0000 7fc793b2c800 20 remove_watcher() i=1 2024-09-14T11:34:55.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.763+0000 7fc793b2c800 20 remove_watcher() i=2 2024-09-14T11:34:55.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.764+0000 7fc793b2c800 20 remove_watcher() i=3 2024-09-14T11:34:55.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.765+0000 7fc793b2c800 20 remove_watcher() i=4 2024-09-14T11:34:55.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.766+0000 7fc793b2c800 20 remove_watcher() i=5 2024-09-14T11:34:55.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.767+0000 7fc793b2c800 20 remove_watcher() i=6 2024-09-14T11:34:55.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:34:55.769+0000 7fc793b2c800 20 remove_watcher() i=7 2024-09-14T11:34:55.779 INFO:tasks.workunit.client.0.smithi007.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:35:25.793 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:25.829 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:25.830 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:25.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.877+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.877 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 20 realm 2024-09-14T11:35:25.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:25.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.879+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.880+0000 7f0ed5742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:25.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.880+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.881+0000 7f0ed5742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:25.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.881+0000 7f0ed5742800 20 searching for the correct realm 2024-09-14T11:35:25.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.883+0000 7f0ed1cee640 0 -- 172.21.15.7:0/1418055747 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0ebc0b5150 msgr2=0x7f0ebc0aa9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:25.887 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:25.888+0000 7f0ed0cec640 0 -- 172.21.15.7:0/1418055747 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f0ecc03f650 msgr2=0x7f0ecc068380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.095+0000 7f0ed5742800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.095+0000 7f0ed5742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.095+0000 7f0ed5742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.095+0000 7f0ed5742800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.095+0000 7f0ed5742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.095+0000 7f0ed5742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.095+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:26.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:26.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 zone default found 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 4 Realm: () 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 zonegroup default 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.096+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.097+0000 7f0ed5742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.097+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.097+0000 7f0ed5742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.097+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.098+0000 7f0ed5742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.098+0000 7f0ed5742800 20 started sync module instance, tier type = 2024-09-14T11:35:26.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.098+0000 7f0ed5742800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.109+0000 7f0ed5742800 20 add_watcher() i=0 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.109+0000 7f0ed5742800 20 add_watcher() i=1 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.109+0000 7f0ed5742800 20 add_watcher() i=2 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.109+0000 7f0ed5742800 20 add_watcher() i=3 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.109+0000 7f0ed5742800 20 add_watcher() i=4 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.109+0000 7f0ed5742800 20 add_watcher() i=5 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.109+0000 7f0ed5742800 20 add_watcher() i=6 2024-09-14T11:35:26.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.110+0000 7f0ed5742800 20 add_watcher() i=7 2024-09-14T11:35:26.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.110+0000 7f0ed5742800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:26.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.112+0000 7f0d877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:26.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.112+0000 7f0ed5742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:26.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.112+0000 7f0ed5742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:26.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.112+0000 7f0ed5742800 5 note: GC not initialized 2024-09-14T11:35:26.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.113+0000 7f0d867e4640 20 reqs_thread_entry: start 2024-09-14T11:35:26.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.113+0000 7f0ed5742800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:26.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.113+0000 7f0ed5742800 20 Filter name: none 2024-09-14T11:35:26.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.113+0000 7f0cf7fff640 20 reqs_thread_entry: start 2024-09-14T11:35:26.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.113+0000 7f0ed5742800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:35:26.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.113+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.114+0000 7f0ed5742800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.114+0000 7f0ed5742800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.114+0000 7f0ed5742800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.114+0000 7f0ed5742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 : miss 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.114+0000 7f0ed5742800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.115+0000 7f0ed5742800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.115+0000 7f0ed5742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.115+0000 7f0ed5742800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.115+0000 7f0ed5742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.115+0000 7f0ed5742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:26.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.115+0000 7f0ed5742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 2024-09-14T11:35:26.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0ed5742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:35:26.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0ed5742800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:35:26.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0ed5742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:26.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0ed5742800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25, ofs0, ns] 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0da7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529683 cookie 94625634635264 notifier 6636 bl.length()=1009 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0da7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0da7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.120+0000 7f0da7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.121+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): orig_sources= new_sources= 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.121+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): potential sources added=[] removed=[] 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.121+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): orig_dests= new_dests= 2024-09-14T11:35:26.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.121+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): potential dests added=[] removed=[] 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.0 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.0 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.1 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.1 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.2 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.2 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.3 2024-09-14T11:35:26.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.3 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.4 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.4 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.5 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.5 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.6 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.6 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.7 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.7 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.8 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.8 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.9 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.9 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.10 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.10 2024-09-14T11:35:26.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.11 2024-09-14T11:35:26.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1.11 2024-09-14T11:35:26.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.126+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.0 2024-09-14T11:35:26.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.127+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1 2024-09-14T11:35:26.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.127+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.2 2024-09-14T11:35:26.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.128+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.3 2024-09-14T11:35:26.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.128+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.4 2024-09-14T11:35:26.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.129+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.5 2024-09-14T11:35:26.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.130+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.6 2024-09-14T11:35:26.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.130+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.7 2024-09-14T11:35:26.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.131+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.8 2024-09-14T11:35:26.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.132+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.9 2024-09-14T11:35:26.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.132+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.10 2024-09-14T11:35:26.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.136+0000 7f0ed5742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:26.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.136+0000 7f0ed5742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 2024-09-14T11:35:26.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0ed5742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:35:26.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0ed5742800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:35:26.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0ed5742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:26.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0ed5742800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25, ofs0, ns] 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0db4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529684 cookie 94625634635264 notifier 6636 bl.length()=1009 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0db4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0db4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.137+0000 7f0db4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.138+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): orig_sources= new_sources= 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.138+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): potential sources added=[] removed=[] 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.138+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): orig_dests= new_dests= 2024-09-14T11:35:26.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.138+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): potential dests added=[] removed=[] 2024-09-14T11:35:26.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.140+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.0 2024-09-14T11:35:26.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.141+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.1 2024-09-14T11:35:26.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.141+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.2 2024-09-14T11:35:26.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.141+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.3 2024-09-14T11:35:26.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.142+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.4 2024-09-14T11:35:26.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.142+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.5 2024-09-14T11:35:26.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.143+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.6 2024-09-14T11:35:26.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.143+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.7 2024-09-14T11:35:26.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.144+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.8 2024-09-14T11:35:26.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.144+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.9 2024-09-14T11:35:26.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.144+0000 7f0ed5742800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25.10 2024-09-14T11:35:26.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.145+0000 7f0ed5742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:26.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.145+0000 7f0ed5742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0ed5742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0ed5742800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0ed5742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0ed5742800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25, ofs0, ns] 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0db4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529685 cookie 94625634635264 notifier 6636 bl.length()=977 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0db4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 info.flags=0x17 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0db4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 to cache LRU end 2024-09-14T11:35:26.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.146+0000 7f0db4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:26.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.147+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): orig_sources= new_sources= 2024-09-14T11:35:26.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.147+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): potential sources added=[] removed=[] 2024-09-14T11:35:26.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.147+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): orig_dests= new_dests= 2024-09-14T11:35:26.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.147+0000 7f0ed5742800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25]): potential dests added=[] removed=[] 2024-09-14T11:35:26.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.152+0000 7f0ed5742800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:26.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.154+0000 7f0d877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:26.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.156+0000 7f0ed5742800 20 remove_watcher() i=0 2024-09-14T11:35:26.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.156+0000 7f0ed5742800 2 removed watcher, disabling cache 2024-09-14T11:35:26.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.157+0000 7f0ed5742800 20 remove_watcher() i=1 2024-09-14T11:35:26.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.159+0000 7f0ed5742800 20 remove_watcher() i=2 2024-09-14T11:35:26.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.160+0000 7f0ed5742800 20 remove_watcher() i=3 2024-09-14T11:35:26.159 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.161+0000 7f0ed5742800 20 remove_watcher() i=4 2024-09-14T11:35:26.161 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.162+0000 7f0ed5742800 20 remove_watcher() i=5 2024-09-14T11:35:26.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.163+0000 7f0ed5742800 20 remove_watcher() i=6 2024-09-14T11:35:26.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.164+0000 7f0ed5742800 20 remove_watcher() i=7 2024-09-14T11:35:26.176 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:35:26.207 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:26.207 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:26.247 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.248+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 20 realm 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.250+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.252+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:26.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.252+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.252+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:26.251 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.252+0000 7f83b6a20800 20 searching for the correct realm 2024-09-14T11:35:26.253 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.254+0000 7f83b4d0b640 0 -- 172.21.15.7:0/3593535342 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f83a803bbd0 msgr2=0x7f83a802f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:26.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.461+0000 7f83b3d09640 0 -- 172.21.15.7:0/3593535342 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f83a404b910 msgr2=0x7f83a4008420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:26.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.668+0000 7f83b6a20800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:26.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.668+0000 7f83b6a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:26.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.668+0000 7f83b6a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:26.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.668+0000 7f83b6a20800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:26.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.668+0000 7f83b6a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:26.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.668+0000 7f83b6a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:26.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.668+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.669+0000 7f83b6a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.669+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.669+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.669+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 zone default found 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 4 Realm: () 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 zonegroup default 2024-09-14T11:35:26.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.670+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.671+0000 7f83b6a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:26.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.671+0000 7f83b6a20800 20 started sync module instance, tier type = 2024-09-14T11:35:26.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.671+0000 7f83b6a20800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.681+0000 7f83b6a20800 20 add_watcher() i=0 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.681+0000 7f83b6a20800 20 add_watcher() i=1 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.681+0000 7f83b6a20800 20 add_watcher() i=2 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.681+0000 7f83b6a20800 20 add_watcher() i=3 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.681+0000 7f83b6a20800 20 add_watcher() i=4 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.681+0000 7f83b6a20800 20 add_watcher() i=5 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.681+0000 7f83b6a20800 20 add_watcher() i=6 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.682+0000 7f83b6a20800 20 add_watcher() i=7 2024-09-14T11:35:26.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.682+0000 7f83b6a20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:26.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.684+0000 7f826a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:26.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.684+0000 7f83b6a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:26.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.684+0000 7f83b6a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:26.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.684+0000 7f83b6a20800 5 note: GC not initialized 2024-09-14T11:35:26.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.684+0000 7f82697e2640 20 reqs_thread_entry: start 2024-09-14T11:35:26.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.684+0000 7f83b6a20800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:26.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.684+0000 7f83b6a20800 20 Filter name: none 2024-09-14T11:35:26.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.685+0000 7f81daffd640 20 reqs_thread_entry: start 2024-09-14T11:35:26.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.685+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.685+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.685+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.686+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.686+0000 7f83b6a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.686+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.686+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.686+0000 7f83b6a20800 20 rados->read ofs=0 len=0 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.686+0000 7f83b6a20800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:35:26.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.686+0000 7f83b6a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:26.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.688+0000 7f826a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:26.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.691+0000 7f83b6a20800 20 remove_watcher() i=0 2024-09-14T11:35:26.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.691+0000 7f83b6a20800 2 removed watcher, disabling cache 2024-09-14T11:35:26.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.692+0000 7f83b6a20800 20 remove_watcher() i=1 2024-09-14T11:35:26.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.693+0000 7f83b6a20800 20 remove_watcher() i=2 2024-09-14T11:35:26.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.694+0000 7f83b6a20800 20 remove_watcher() i=3 2024-09-14T11:35:26.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.695+0000 7f83b6a20800 20 remove_watcher() i=4 2024-09-14T11:35:26.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.696+0000 7f83b6a20800 20 remove_watcher() i=5 2024-09-14T11:35:26.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.697+0000 7f83b6a20800 20 remove_watcher() i=6 2024-09-14T11:35:26.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:26.698+0000 7f83b6a20800 20 remove_watcher() i=7 2024-09-14T11:35:26.708 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:26.708 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:26.709 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-set-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:26.709 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:26.711 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.711 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.715 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.715 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.758 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.758 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.787 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:35:26.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:26.788 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.788 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.800 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.800 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.843 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.843 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.850 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.850 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.857 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.857 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.863 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.863 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.869 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.869 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.874 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.875 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.886 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.886 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.891 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.891 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.897 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.898 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.903 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.903 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.909 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.909 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.915 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.916 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.922 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.922 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.928 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.928 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.936 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.936 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.975 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.975 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.981 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.981 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.987 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.988 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:26.994 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:26.994 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:27.000 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:27.000 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:27.007 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:27.036 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:27.036 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:27.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.077+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 20 realm 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.079+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.080+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:27.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.080+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.081+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:27.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.081+0000 7f4021298800 20 searching for the correct realm 2024-09-14T11:35:27.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.082+0000 7f401f583640 0 -- 172.21.15.7:0/1036130063 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f401401e610 msgr2=0x7f401409e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:27.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.288+0000 7f401e581640 0 -- 172.21.15.7:0/1036130063 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f401002e4e0 msgr2=0x7f40100403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:27.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:27.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:27.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:27.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:27.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:27.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:27.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.495+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 20 zone default found 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 4 Realm: () 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:27.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 20 zonegroup default 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.496+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.497+0000 7f4021298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.497+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.497+0000 7f4021298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.497+0000 7f4021298800 20 started sync module instance, tier type = 2024-09-14T11:35:27.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.497+0000 7f4021298800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.507+0000 7f4021298800 20 add_watcher() i=0 2024-09-14T11:35:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.507+0000 7f4021298800 20 add_watcher() i=1 2024-09-14T11:35:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.507+0000 7f4021298800 20 add_watcher() i=2 2024-09-14T11:35:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.507+0000 7f4021298800 20 add_watcher() i=3 2024-09-14T11:35:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.507+0000 7f4021298800 20 add_watcher() i=4 2024-09-14T11:35:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.507+0000 7f4021298800 20 add_watcher() i=5 2024-09-14T11:35:27.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.507+0000 7f4021298800 20 add_watcher() i=6 2024-09-14T11:35:27.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.508+0000 7f4021298800 20 add_watcher() i=7 2024-09-14T11:35:27.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.508+0000 7f4021298800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:27.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.510+0000 7f3ed57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:27.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.510+0000 7f4021298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:27.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.510+0000 7f4021298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:27.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.510+0000 7f4021298800 5 note: GC not initialized 2024-09-14T11:35:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.510+0000 7f3e4ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.511+0000 7f4021298800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.511+0000 7f4021298800 20 Filter name: none 2024-09-14T11:35:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.511+0000 7f3e4dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.511+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.511+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:27.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.512+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.512+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:27.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.512+0000 7f4021298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:27.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.512+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.513+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:27.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.513+0000 7f4021298800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.513+0000 7f4021298800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:27.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.513+0000 7f4021298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:27.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.515+0000 7f3ed57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:27.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.517+0000 7f4021298800 20 remove_watcher() i=0 2024-09-14T11:35:27.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.517+0000 7f4021298800 2 removed watcher, disabling cache 2024-09-14T11:35:27.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.519+0000 7f4021298800 20 remove_watcher() i=1 2024-09-14T11:35:27.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.520+0000 7f4021298800 20 remove_watcher() i=2 2024-09-14T11:35:27.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.521+0000 7f4021298800 20 remove_watcher() i=3 2024-09-14T11:35:27.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.522+0000 7f4021298800 20 remove_watcher() i=4 2024-09-14T11:35:27.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.523+0000 7f4021298800 20 remove_watcher() i=5 2024-09-14T11:35:27.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.524+0000 7f4021298800 20 remove_watcher() i=6 2024-09-14T11:35:27.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.525+0000 7f4021298800 20 remove_watcher() i=7 2024-09-14T11:35:27.536 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:27.536 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:27.536 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:27.536 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:27.538 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:35:27.574 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:27.574 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:27.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.615+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 20 realm 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.617+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.618+0000 7fcf13d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:27.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.618+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.619+0000 7fcf13d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:27.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.619+0000 7fcf13d46800 20 searching for the correct realm 2024-09-14T11:35:27.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.621+0000 7fcf12031640 0 -- 172.21.15.7:0/1609818447 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fcf08035030 msgr2=0x7fcf0806ced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:27.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.625+0000 7fcf1102f640 0 -- 172.21.15.7:0/1609818447 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fcf040bb9a0 msgr2=0x7fcf04001000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.831+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 zone default found 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 4 Realm: () 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 zonegroup default 2024-09-14T11:35:27.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.832+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.833+0000 7fcf13d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.833+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.833+0000 7fcf13d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.833+0000 7fcf13d46800 20 started sync module instance, tier type = 2024-09-14T11:35:27.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.833+0000 7fcf13d46800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:27.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=0 2024-09-14T11:35:27.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=1 2024-09-14T11:35:27.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=2 2024-09-14T11:35:27.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=3 2024-09-14T11:35:27.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=4 2024-09-14T11:35:27.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=5 2024-09-14T11:35:27.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=6 2024-09-14T11:35:27.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 20 add_watcher() i=7 2024-09-14T11:35:27.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.843+0000 7fcf13d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:27.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.845+0000 7fcdc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcf13d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcf13d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcf13d46800 5 note: GC not initialized 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcdc27fc640 20 reqs_thread_entry: start 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcf13d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcf13d46800 20 Filter name: none 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcd33fff640 20 reqs_thread_entry: start 2024-09-14T11:35:27.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcf13d46800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:35:27.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.846+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:27.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 : miss 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:27.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.847+0000 7fcf13d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 2024-09-14T11:35:27.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.852+0000 7fcf13d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:27.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.852+0000 7fcf13d46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:27.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.852+0000 7fcf13d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:27.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.852+0000 7fcf13d46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26, ofs0, ns] 2024-09-14T11:35:27.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcdf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529723 cookie 94176088237136 notifier 6693 bl.length()=1023 2024-09-14T11:35:27.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcdf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:27.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcdf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:27.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcdf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:27.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcf13d46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_sources= new_sources= 2024-09-14T11:35:27.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcf13d46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential sources added=[] removed=[] 2024-09-14T11:35:27.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcf13d46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_dests= new_dests= 2024-09-14T11:35:27.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcf13d46800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential dests added=[] removed=[] 2024-09-14T11:35:27.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcf13d46800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:35:27.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.853+0000 7fcf13d46800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:35:27.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.855+0000 7fcdc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:27.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.857+0000 7fcf13d46800 20 remove_watcher() i=0 2024-09-14T11:35:27.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.857+0000 7fcf13d46800 2 removed watcher, disabling cache 2024-09-14T11:35:27.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.858+0000 7fcf13d46800 20 remove_watcher() i=1 2024-09-14T11:35:27.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.859+0000 7fcf13d46800 20 remove_watcher() i=2 2024-09-14T11:35:27.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.860+0000 7fcf13d46800 20 remove_watcher() i=3 2024-09-14T11:35:27.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.861+0000 7fcf13d46800 20 remove_watcher() i=4 2024-09-14T11:35:27.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.862+0000 7fcf13d46800 20 remove_watcher() i=5 2024-09-14T11:35:27.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.863+0000 7fcf13d46800 20 remove_watcher() i=6 2024-09-14T11:35:27.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.864+0000 7fcf13d46800 20 remove_watcher() i=7 2024-09-14T11:35:27.876 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:27.905 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:27.905 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:27.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.946+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 20 realm 2024-09-14T11:35:27.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:27.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:27.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.948+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.949+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:27.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.949+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:27.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.950+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:27.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.950+0000 7f4d7bd75800 20 searching for the correct realm 2024-09-14T11:35:27.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:27.952+0000 7f4d7a060640 0 -- 172.21.15.7:0/3182584525 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4d7009bb90 msgr2=0x7f4d700661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:28.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.158+0000 7f4d7905e640 0 -- 172.21.15.7:0/3182584525 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f4d6c0b6410 msgr2=0x7f4d6c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:28.364 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.365+0000 7f4d7bd75800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.365+0000 7f4d7bd75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.365+0000 7f4d7bd75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.365+0000 7f4d7bd75800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.365+0000 7f4d7bd75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.365+0000 7f4d7bd75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.365+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.366+0000 7f4d7bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.366+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.366+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:28.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.366+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.366+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 zone default found 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 4 Realm: () 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 zonegroup default 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 started sync module instance, tier type = 2024-09-14T11:35:28.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.367+0000 7f4d7bd75800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:28.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.377+0000 7f4d7bd75800 20 add_watcher() i=0 2024-09-14T11:35:28.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.377+0000 7f4d7bd75800 20 add_watcher() i=1 2024-09-14T11:35:28.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.377+0000 7f4d7bd75800 20 add_watcher() i=2 2024-09-14T11:35:28.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.377+0000 7f4d7bd75800 20 add_watcher() i=3 2024-09-14T11:35:28.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.377+0000 7f4d7bd75800 20 add_watcher() i=4 2024-09-14T11:35:28.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.377+0000 7f4d7bd75800 20 add_watcher() i=5 2024-09-14T11:35:28.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.377+0000 7f4d7bd75800 20 add_watcher() i=6 2024-09-14T11:35:28.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.378+0000 7f4d7bd75800 20 add_watcher() i=7 2024-09-14T11:35:28.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.378+0000 7f4d7bd75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:28.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4c2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:28.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4d7bd75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:28.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4d7bd75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:28.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4d7bd75800 5 note: GC not initialized 2024-09-14T11:35:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4c2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4d7bd75800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4d7bd75800 20 Filter name: none 2024-09-14T11:35:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.380+0000 7f4b9bfff640 20 reqs_thread_entry: start 2024-09-14T11:35:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.381+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.381+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:28.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.381+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.381+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:35:28.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.381+0000 7f4d7bd75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:28.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.381+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.382+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:28.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.382+0000 7f4d7bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.382+0000 7f4d7bd75800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:35:28.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.382+0000 7f4d7bd75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:28.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.384+0000 7f4c2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:28.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.386+0000 7f4d7bd75800 20 remove_watcher() i=0 2024-09-14T11:35:28.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.386+0000 7f4d7bd75800 2 removed watcher, disabling cache 2024-09-14T11:35:28.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.387+0000 7f4d7bd75800 20 remove_watcher() i=1 2024-09-14T11:35:28.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.389+0000 7f4d7bd75800 20 remove_watcher() i=2 2024-09-14T11:35:28.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.390+0000 7f4d7bd75800 20 remove_watcher() i=3 2024-09-14T11:35:28.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.391+0000 7f4d7bd75800 20 remove_watcher() i=4 2024-09-14T11:35:28.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.392+0000 7f4d7bd75800 20 remove_watcher() i=5 2024-09-14T11:35:28.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.393+0000 7f4d7bd75800 20 remove_watcher() i=6 2024-09-14T11:35:28.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.394+0000 7f4d7bd75800 20 remove_watcher() i=7 2024-09-14T11:35:28.404 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:28.404 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:28.404 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:28.404 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:28.406 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:28.406 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:28.413 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:28.413 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:28.456 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:28.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.533+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.535+0000 7f3462f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.535+0000 7f3462f44800 20 realm 2024-09-14T11:35:28.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.535+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.536+0000 7f3462f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.536+0000 7f3462f44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:28.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.536+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.536+0000 7f3462f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.536+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.537+0000 7f3462f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:28.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.537+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.538+0000 7f3462f44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:28.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.538+0000 7f3462f44800 20 searching for the correct realm 2024-09-14T11:35:28.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.540+0000 7f346122f640 0 -- 172.21.15.7:0/2551172034 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f34540ae150 msgr2=0x7f34540c7790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:28.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.747+0000 7f346022d640 0 -- 172.21.15.7:0/2551172034 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f3450016070 msgr2=0x7f3450072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:28.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.954+0000 7f3462f44800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:28.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.954+0000 7f3462f44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:28.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.954+0000 7f3462f44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:28.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.954+0000 7f3462f44800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:28.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.954+0000 7f3462f44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:28.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.954+0000 7f3462f44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:28.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.954+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.955+0000 7f3462f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.955+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.955+0000 7f3462f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.955+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.955+0000 7f3462f44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 20 zone default found 2024-09-14T11:35:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 4 Realm: () 2024-09-14T11:35:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:28.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:28.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:28.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 20 zonegroup default 2024-09-14T11:35:28.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.956+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.957+0000 7f3462f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:28.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.957+0000 7f3462f44800 20 started sync module instance, tier type = 2024-09-14T11:35:28.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.957+0000 7f3462f44800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.967+0000 7f3462f44800 20 add_watcher() i=0 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.967+0000 7f3462f44800 20 add_watcher() i=1 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.967+0000 7f3462f44800 20 add_watcher() i=2 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.967+0000 7f3462f44800 20 add_watcher() i=3 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.967+0000 7f3462f44800 20 add_watcher() i=4 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.967+0000 7f3462f44800 20 add_watcher() i=5 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.967+0000 7f3462f44800 20 add_watcher() i=6 2024-09-14T11:35:28.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.968+0000 7f3462f44800 20 add_watcher() i=7 2024-09-14T11:35:28.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.968+0000 7f3462f44800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:28.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.970+0000 7f33177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:28.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.970+0000 7f3462f44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:28.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.970+0000 7f3462f44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.970+0000 7f3462f44800 5 note: GC not initialized 2024-09-14T11:35:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.970+0000 7f33167e4640 20 reqs_thread_entry: start 2024-09-14T11:35:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.970+0000 7f3462f44800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.970+0000 7f3462f44800 20 Filter name: none 2024-09-14T11:35:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f330ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f3462f44800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:35:28.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f3462f44800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:28.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f3462f44800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:28.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f3462f44800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:28.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f3462f44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 : miss 2024-09-14T11:35:28.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.971+0000 7f3462f44800 20 rados->read ofs=0 len=0 2024-09-14T11:35:28.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.972+0000 7f3462f44800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:35:28.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.972+0000 7f3462f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:28.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.972+0000 7f3462f44800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:28.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.972+0000 7f3462f44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:28.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.972+0000 7f3462f44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:28.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.972+0000 7f3462f44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 2024-09-14T11:35:28.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.973+0000 7f3462f44800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:28.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3462f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:28.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3462f44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:28.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3462f44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:28.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3462f44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26, ofs0, ns] 2024-09-14T11:35:28.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3337fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94048407206256 notifier 6735 bl.length()=1023 2024-09-14T11:35:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3337fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3337fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.983+0000 7f3337fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.984+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_sources= new_sources= 2024-09-14T11:35:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.984+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential sources added=[] removed=[] 2024-09-14T11:35:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.984+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_dests= new_dests= 2024-09-14T11:35:28.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.984+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential dests added=[] removed=[] 2024-09-14T11:35:28.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.0 2024-09-14T11:35:28.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.0 2024-09-14T11:35:28.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.1 2024-09-14T11:35:28.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.1 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.2 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.2 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.3 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.3 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.4 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.4 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.5 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.5 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.6 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.6 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.7 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.7 2024-09-14T11:35:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.8 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.8 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.9 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.9 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.10 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.10 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.11 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2.11 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.989+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.0 2024-09-14T11:35:28.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.990+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.1 2024-09-14T11:35:28.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.990+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2 2024-09-14T11:35:28.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.991+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.3 2024-09-14T11:35:28.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.991+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.4 2024-09-14T11:35:28.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.992+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.5 2024-09-14T11:35:28.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.993+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.6 2024-09-14T11:35:28.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.994+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.7 2024-09-14T11:35:28.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.994+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.8 2024-09-14T11:35:28.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.995+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.9 2024-09-14T11:35:28.995 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.996+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.10 2024-09-14T11:35:28.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.999+0000 7f3462f44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:28.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:28.999+0000 7f3462f44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 2024-09-14T11:35:28.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:28.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:28.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:28.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26, ofs0, ns] 2024-09-14T11:35:29.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3337fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 94048407206256 notifier 6735 bl.length()=1023 2024-09-14T11:35:29.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3337fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:29.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3337fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:29.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3337fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:29.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_sources= new_sources= 2024-09-14T11:35:29.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential sources added=[] removed=[] 2024-09-14T11:35:29.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_dests= new_dests= 2024-09-14T11:35:29.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.001+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential dests added=[] removed=[] 2024-09-14T11:35:29.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.004+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.0 2024-09-14T11:35:29.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.004+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.1 2024-09-14T11:35:29.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.004+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.2 2024-09-14T11:35:29.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.005+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.3 2024-09-14T11:35:29.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.005+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.4 2024-09-14T11:35:29.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.005+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.5 2024-09-14T11:35:29.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.006+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.6 2024-09-14T11:35:29.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.006+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.7 2024-09-14T11:35:29.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.006+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.8 2024-09-14T11:35:29.005 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.007+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.9 2024-09-14T11:35:29.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.007+0000 7f3462f44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26.10 2024-09-14T11:35:29.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.008+0000 7f3462f44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:29.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.008+0000 7f3462f44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3462f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3462f44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3462f44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3462f44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26, ofs0, ns] 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3337fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529726 cookie 94048407206256 notifier 6735 bl.length()=991 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3337fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 info.flags=0x17 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3337fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 to cache LRU end 2024-09-14T11:35:29.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.009+0000 7f3337fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:29.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.010+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_sources= new_sources= 2024-09-14T11:35:29.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.010+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential sources added=[] removed=[] 2024-09-14T11:35:29.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.010+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): orig_dests= new_dests= 2024-09-14T11:35:29.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.010+0000 7f3462f44800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26]): potential dests added=[] removed=[] 2024-09-14T11:35:29.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.012+0000 7f3462f44800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:29.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.014+0000 7f33177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:29.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.017+0000 7f3462f44800 20 remove_watcher() i=0 2024-09-14T11:35:29.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.017+0000 7f3462f44800 2 removed watcher, disabling cache 2024-09-14T11:35:29.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.018+0000 7f3462f44800 20 remove_watcher() i=1 2024-09-14T11:35:29.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.019+0000 7f3462f44800 20 remove_watcher() i=2 2024-09-14T11:35:29.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.020+0000 7f3462f44800 20 remove_watcher() i=3 2024-09-14T11:35:29.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.021+0000 7f3462f44800 20 remove_watcher() i=4 2024-09-14T11:35:29.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.022+0000 7f3462f44800 20 remove_watcher() i=5 2024-09-14T11:35:29.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.023+0000 7f3462f44800 20 remove_watcher() i=6 2024-09-14T11:35:29.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.024+0000 7f3462f44800 20 remove_watcher() i=7 2024-09-14T11:35:29.036 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:29.065 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:29.065 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:29.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.106+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 20 realm 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.108+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.109+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:29.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.109+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.110+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:29.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.110+0000 7f210173a800 20 searching for the correct realm 2024-09-14T11:35:29.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.111+0000 7f20fdcbc640 0 -- 172.21.15.7:0/4084225804 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f20f4029070 msgr2=0x7f20f4043940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:29.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.317+0000 7f20fccba640 0 -- 172.21.15.7:0/4084225804 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f20f00a5a10 msgr2=0x7f20f00ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:29.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:29.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:29.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:29.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:29.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:29.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:29.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.524+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 20 zone default found 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 4 Realm: () 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 20 zonegroup default 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.525+0000 7f210173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.526+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.526+0000 7f210173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.526+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.526+0000 7f210173a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.526+0000 7f210173a800 20 started sync module instance, tier type = 2024-09-14T11:35:29.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.526+0000 7f210173a800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:29.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.537+0000 7f210173a800 20 add_watcher() i=0 2024-09-14T11:35:29.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.537+0000 7f210173a800 20 add_watcher() i=1 2024-09-14T11:35:29.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.537+0000 7f210173a800 20 add_watcher() i=2 2024-09-14T11:35:29.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.537+0000 7f210173a800 20 add_watcher() i=3 2024-09-14T11:35:29.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.537+0000 7f210173a800 20 add_watcher() i=4 2024-09-14T11:35:29.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.537+0000 7f210173a800 20 add_watcher() i=5 2024-09-14T11:35:29.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.537+0000 7f210173a800 20 add_watcher() i=6 2024-09-14T11:35:29.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.538+0000 7f210173a800 20 add_watcher() i=7 2024-09-14T11:35:29.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.538+0000 7f210173a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:29.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f1fb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:29.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f210173a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:29.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f210173a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:29.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f210173a800 5 note: GC not initialized 2024-09-14T11:35:29.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f1fb27e4640 20 reqs_thread_entry: start 2024-09-14T11:35:29.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f210173a800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:29.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f210173a800 20 Filter name: none 2024-09-14T11:35:29.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.540+0000 7f1f23fff640 20 reqs_thread_entry: start 2024-09-14T11:35:29.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.541+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.541+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:29.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.541+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.542+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:29.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.542+0000 7f210173a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:29.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.542+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.542+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:29.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.542+0000 7f210173a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.542+0000 7f210173a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:29.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.542+0000 7f210173a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:29.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.544+0000 7f1fb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:29.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.547+0000 7f210173a800 20 remove_watcher() i=0 2024-09-14T11:35:29.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.547+0000 7f210173a800 2 removed watcher, disabling cache 2024-09-14T11:35:29.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.548+0000 7f210173a800 20 remove_watcher() i=1 2024-09-14T11:35:29.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.549+0000 7f210173a800 20 remove_watcher() i=2 2024-09-14T11:35:29.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.550+0000 7f210173a800 20 remove_watcher() i=3 2024-09-14T11:35:29.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.551+0000 7f210173a800 20 remove_watcher() i=4 2024-09-14T11:35:29.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.552+0000 7f210173a800 20 remove_watcher() i=5 2024-09-14T11:35:29.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.553+0000 7f210173a800 20 remove_watcher() i=6 2024-09-14T11:35:29.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.554+0000 7f210173a800 20 remove_watcher() i=7 2024-09-14T11:35:29.565 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:29.565 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:29.565 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:29.565 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:29.567 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.567 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.571 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.571 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.614 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.614 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.648 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:35:29.648 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:29.649 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.649 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.661 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.661 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.704 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.704 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.710 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.710 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.717 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.717 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.722 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.722 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.728 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.728 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.733 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.733 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.739 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.739 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.745 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.745 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.752 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.752 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.757 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.757 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.763 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.763 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.768 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.769 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.774 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.774 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.780 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.780 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.786 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.786 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.792 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.792 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.798 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.798 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.804 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.804 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.810 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.810 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.815 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:29.815 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:29.822 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:29.851 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:29.851 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:29.890 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.892+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 20 realm 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:29.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.894+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.895+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:29.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.895+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:29.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.896+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:29.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.896+0000 7fc154e87800 20 searching for the correct realm 2024-09-14T11:35:29.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.898+0000 7fc153179640 0 -- 172.21.15.7:0/2744295813 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc13c021040 msgr2=0x7fc13c055400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:29.901 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:29.902+0000 7fc14bfff640 0 -- 172.21.15.7:0/2744295813 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc144030410 msgr2=0x7fc144030890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:30.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:30.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:30.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:30.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:30.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:30.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:30.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.108+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 zone default found 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 4 Realm: () 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:30.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 zonegroup default 2024-09-14T11:35:30.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.109+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.110+0000 7fc154e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.110+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.110+0000 7fc154e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.110+0000 7fc154e87800 20 started sync module instance, tier type = 2024-09-14T11:35:30.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.110+0000 7fc154e87800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:30.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.120+0000 7fc154e87800 20 add_watcher() i=0 2024-09-14T11:35:30.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.120+0000 7fc154e87800 20 add_watcher() i=1 2024-09-14T11:35:30.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.120+0000 7fc154e87800 20 add_watcher() i=2 2024-09-14T11:35:30.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.120+0000 7fc154e87800 20 add_watcher() i=3 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.120+0000 7fc154e87800 20 add_watcher() i=4 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.120+0000 7fc154e87800 20 add_watcher() i=5 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.120+0000 7fc154e87800 20 add_watcher() i=6 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.121+0000 7fc154e87800 20 add_watcher() i=7 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.121+0000 7fc154e87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.123+0000 7fc0097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.123+0000 7fc154e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.123+0000 7fc154e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.123+0000 7fc154e87800 5 note: GC not initialized 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.123+0000 7fbf83fff640 20 reqs_thread_entry: start 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.124+0000 7fc154e87800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.124+0000 7fc154e87800 20 Filter name: none 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.124+0000 7fbf81ffb640 20 reqs_thread_entry: start 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.124+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.125+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.125+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.125+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.125+0000 7fc154e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.125+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.125+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.125+0000 7fc154e87800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.126+0000 7fc154e87800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.126+0000 7fc154e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.128+0000 7fc0097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.131+0000 7fc154e87800 20 remove_watcher() i=0 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.131+0000 7fc154e87800 2 removed watcher, disabling cache 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.132+0000 7fc154e87800 20 remove_watcher() i=1 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.133+0000 7fc154e87800 20 remove_watcher() i=2 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.134+0000 7fc154e87800 20 remove_watcher() i=3 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.135+0000 7fc154e87800 20 remove_watcher() i=4 2024-09-14T11:35:30.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.136+0000 7fc154e87800 20 remove_watcher() i=5 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.137+0000 7fc154e87800 20 remove_watcher() i=6 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.138+0000 7fc154e87800 20 remove_watcher() i=7 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:30.204 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:30.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.229+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 20 realm 2024-09-14T11:35:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.230+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.231+0000 7f617a62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:30.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.231+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.232+0000 7f617a62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:30.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.232+0000 7f617a62f800 20 searching for the correct realm 2024-09-14T11:35:30.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.234+0000 7f617891a640 0 -- 172.21.15.7:0/450389834 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f616c027040 msgr2=0x7f616c088820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:30.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.440+0000 7f6177918640 0 -- 172.21.15.7:0/450389834 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f61680830c0 msgr2=0x7f6168069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.647+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 zone default found 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 4 Realm: () 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 zonegroup default 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.648+0000 7f617a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.649+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.649+0000 7f617a62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.649+0000 7f617a62f800 20 started sync module instance, tier type = 2024-09-14T11:35:30.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.649+0000 7f617a62f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:30.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.659+0000 7f617a62f800 20 add_watcher() i=0 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.659+0000 7f617a62f800 20 add_watcher() i=1 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.659+0000 7f617a62f800 20 add_watcher() i=2 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.659+0000 7f617a62f800 20 add_watcher() i=3 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.659+0000 7f617a62f800 20 add_watcher() i=4 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.659+0000 7f617a62f800 20 add_watcher() i=5 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.659+0000 7f617a62f800 20 add_watcher() i=6 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.660+0000 7f617a62f800 20 add_watcher() i=7 2024-09-14T11:35:30.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.660+0000 7f617a62f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.661+0000 7f602e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f617a62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f617a62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f617a62f800 5 note: GC not initialized 2024-09-14T11:35:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f602d7e2640 20 reqs_thread_entry: start 2024-09-14T11:35:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f617a62f800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:30.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f617a62f800 20 Filter name: none 2024-09-14T11:35:30.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f5f9effd640 20 reqs_thread_entry: start 2024-09-14T11:35:30.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f617a62f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:35:30.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.662+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:30.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 : miss 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 info.flags=0x17 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 to cache LRU end 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.663+0000 7f617a62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 2024-09-14T11:35:30.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f617a62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 info.flags=0x17 2024-09-14T11:35:30.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f617a62f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 to cache LRU end 2024-09-14T11:35:30.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f617a62f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:30.668 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f617a62f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27, ofs0, ns] 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f60577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529729 cookie 94659527572288 notifier 6482 bl.length()=1023 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f60577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 info.flags=0x17 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f60577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 to cache LRU end 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.669+0000 7f60577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.670+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): orig_sources= new_sources= 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.670+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): potential sources added=[] removed=[] 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.670+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): orig_dests= new_dests= 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.670+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): potential dests added=[] removed=[] 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.670+0000 7f617a62f800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:35:30.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.670+0000 7f617a62f800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.0 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.0 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.1 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.1 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.2 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.2 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.3 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.3 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.4 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.4 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.5 2024-09-14T11:35:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.5 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.6 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.6 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.7 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.7 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.8 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.8 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.9 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.9 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.10 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.10 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.11 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1.11 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.0 2024-09-14T11:35:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.1 2024-09-14T11:35:30.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.673+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.2 2024-09-14T11:35:30.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.674+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.3 2024-09-14T11:35:30.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.674+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.4 2024-09-14T11:35:30.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.675+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.5 2024-09-14T11:35:30.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.675+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.6 2024-09-14T11:35:30.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.676+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.7 2024-09-14T11:35:30.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.676+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.8 2024-09-14T11:35:30.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.677+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.9 2024-09-14T11:35:30.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.677+0000 7f617a62f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27.10 2024-09-14T11:35:30.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.681+0000 7f617a62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:30.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.681+0000 7f617a62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f617a62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 info.flags=0x17 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f617a62f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 to cache LRU end 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f617a62f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f617a62f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27, ofs0, ns] 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f6056ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529730 cookie 94659527572288 notifier 6482 bl.length()=991 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f6056ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 info.flags=0x17 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f6056ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 to cache LRU end 2024-09-14T11:35:30.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.682+0000 7f6056ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:30.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.683+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): orig_sources= new_sources= 2024-09-14T11:35:30.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.683+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): potential sources added=[] removed=[] 2024-09-14T11:35:30.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.683+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): orig_dests= new_dests= 2024-09-14T11:35:30.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.683+0000 7f617a62f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27]): potential dests added=[] removed=[] 2024-09-14T11:35:30.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.685+0000 7f617a62f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:30.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.687+0000 7f602e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:30.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.689+0000 7f617a62f800 20 remove_watcher() i=0 2024-09-14T11:35:30.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.689+0000 7f617a62f800 2 removed watcher, disabling cache 2024-09-14T11:35:30.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.690+0000 7f617a62f800 20 remove_watcher() i=1 2024-09-14T11:35:30.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.691+0000 7f617a62f800 20 remove_watcher() i=2 2024-09-14T11:35:30.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.692+0000 7f617a62f800 20 remove_watcher() i=3 2024-09-14T11:35:30.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.694+0000 7f617a62f800 20 remove_watcher() i=4 2024-09-14T11:35:30.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.695+0000 7f617a62f800 20 remove_watcher() i=5 2024-09-14T11:35:30.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.696+0000 7f617a62f800 20 remove_watcher() i=6 2024-09-14T11:35:30.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.697+0000 7f617a62f800 20 remove_watcher() i=7 2024-09-14T11:35:30.708 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:30.738 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:30.738 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:30.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.778+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.780+0000 7fbb0ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.780+0000 7fbb0ae0f800 20 realm 2024-09-14T11:35:30.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.780+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.780+0000 7fbb0ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.780+0000 7fbb0ae0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.780+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.781+0000 7fbb0ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.781+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.781+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:30.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.781+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.782+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:30.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.782+0000 7fbb0ae0f800 20 searching for the correct realm 2024-09-14T11:35:30.783 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.784+0000 7fbb090fa640 0 -- 172.21.15.7:0/1332723731 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fbafc099040 msgr2=0x7fbafc099930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:30.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:30.990+0000 7fbb080f8640 0 -- 172.21.15.7:0/1332723731 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fbaf8043040 msgr2=0x7fbaf8023960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.196+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 20 zone default found 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 4 Realm: () 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 20 zonegroup default 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.197+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.198+0000 7fbb0ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.198+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.198+0000 7fbb0ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.198+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.198+0000 7fbb0ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.199+0000 7fbb0ae0f800 20 started sync module instance, tier type = 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.199+0000 7fbb0ae0f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.209+0000 7fbb0ae0f800 20 add_watcher() i=0 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.209+0000 7fbb0ae0f800 20 add_watcher() i=1 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.209+0000 7fbb0ae0f800 20 add_watcher() i=2 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.209+0000 7fbb0ae0f800 20 add_watcher() i=3 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.209+0000 7fbb0ae0f800 20 add_watcher() i=4 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.209+0000 7fbb0ae0f800 20 add_watcher() i=5 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.209+0000 7fbb0ae0f800 20 add_watcher() i=6 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.210+0000 7fbb0ae0f800 20 add_watcher() i=7 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.210+0000 7fbb0ae0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.212+0000 7fb9bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.212+0000 7fbb0ae0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.212+0000 7fbb0ae0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.212+0000 7fbb0ae0f800 5 note: GC not initialized 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.212+0000 7fb9be7e4640 20 reqs_thread_entry: start 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.212+0000 7fbb0ae0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.213+0000 7fbb0ae0f800 20 Filter name: none 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.213+0000 7fb9b77fe640 20 reqs_thread_entry: start 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.213+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.213+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.213+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.214+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.214+0000 7fbb0ae0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.214+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.214+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.214+0000 7fbb0ae0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.215+0000 7fbb0ae0f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.215+0000 7fbb0ae0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.217+0000 7fb9bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.219+0000 7fbb0ae0f800 20 remove_watcher() i=0 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.219+0000 7fbb0ae0f800 2 removed watcher, disabling cache 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.221+0000 7fbb0ae0f800 20 remove_watcher() i=1 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.222+0000 7fbb0ae0f800 20 remove_watcher() i=2 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.223+0000 7fbb0ae0f800 20 remove_watcher() i=3 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.224+0000 7fbb0ae0f800 20 remove_watcher() i=4 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.225+0000 7fbb0ae0f800 20 remove_watcher() i=5 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.226+0000 7fbb0ae0f800 20 remove_watcher() i=6 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.227+0000 7fbb0ae0f800 20 remove_watcher() i=7 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.317 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:35:31.317 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:31.318 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.318 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.329 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.330 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.373 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.373 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.381 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.382 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.388 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.388 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.395 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.395 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.401 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.401 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.407 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.407 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.414 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.414 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.420 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.421 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.427 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.427 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.433 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.440 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.440 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.446 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.452 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.452 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.458 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.458 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.464 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.464 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.470 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.470 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.476 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.476 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.483 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.489 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.489 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.496 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:31.496 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:31.504 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:35:31.533 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:31.533 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:31.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.573+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.575+0000 7f2552f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.575+0000 7f2552f3e800 20 realm 2024-09-14T11:35:31.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.575+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.575+0000 7f2552f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.575+0000 7f2552f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:31.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.575+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.576+0000 7f2552f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.576+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.576+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.576+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.577+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:31.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.577+0000 7f2552f3e800 20 searching for the correct realm 2024-09-14T11:35:31.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.579+0000 7f254f4ee640 0 -- 172.21.15.7:0/3286986854 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f254408e960 msgr2=0x7f2544064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.583+0000 7f254e4ec640 0 -- 172.21.15.7:0/3286986854 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f2540048040 msgr2=0x7f2540049940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.789+0000 7f2552f3e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.789+0000 7f2552f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.789+0000 7f2552f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.789+0000 7f2552f3e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.789+0000 7f2552f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.789+0000 7f2552f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.789+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 zone default found 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 4 Realm: () 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 zonegroup default 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.790+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.791+0000 7f2552f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.791+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.791+0000 7f2552f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.791+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.791+0000 7f2552f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.791 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.791+0000 7f2552f3e800 20 started sync module instance, tier type = 2024-09-14T11:35:31.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.791+0000 7f2552f3e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:31.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.801+0000 7f2552f3e800 20 add_watcher() i=0 2024-09-14T11:35:31.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.801+0000 7f2552f3e800 20 add_watcher() i=1 2024-09-14T11:35:31.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.801+0000 7f2552f3e800 20 add_watcher() i=2 2024-09-14T11:35:31.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.801+0000 7f2552f3e800 20 add_watcher() i=3 2024-09-14T11:35:31.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.801+0000 7f2552f3e800 20 add_watcher() i=4 2024-09-14T11:35:31.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.801+0000 7f2552f3e800 20 add_watcher() i=5 2024-09-14T11:35:31.800 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.801+0000 7f2552f3e800 20 add_watcher() i=6 2024-09-14T11:35:31.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.802+0000 7f2552f3e800 20 add_watcher() i=7 2024-09-14T11:35:31.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.802+0000 7f2552f3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.804+0000 7f24057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.804+0000 7f2552f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.804+0000 7f2552f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.804+0000 7f2552f3e800 5 note: GC not initialized 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.805+0000 7f237ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.805+0000 7f2552f3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.805+0000 7f2552f3e800 20 Filter name: none 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.805+0000 7f237dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:31.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.805+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.806+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:31.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.806+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.806+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.806+0000 7f2552f3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.806+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.807+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.807+0000 7f2552f3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.807+0000 7f2552f3e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.807+0000 7f2552f3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:31.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.809+0000 7f24057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.811+0000 7f2552f3e800 20 remove_watcher() i=0 2024-09-14T11:35:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.811+0000 7f2552f3e800 2 removed watcher, disabling cache 2024-09-14T11:35:31.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.812+0000 7f2552f3e800 20 remove_watcher() i=1 2024-09-14T11:35:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.813+0000 7f2552f3e800 20 remove_watcher() i=2 2024-09-14T11:35:31.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.814+0000 7f2552f3e800 20 remove_watcher() i=3 2024-09-14T11:35:31.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.815+0000 7f2552f3e800 20 remove_watcher() i=4 2024-09-14T11:35:31.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.816+0000 7f2552f3e800 20 remove_watcher() i=5 2024-09-14T11:35:31.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.817+0000 7f2552f3e800 20 remove_watcher() i=6 2024-09-14T11:35:31.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.818+0000 7f2552f3e800 20 remove_watcher() i=7 2024-09-14T11:35:31.828 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:31.828 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:31.828 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:31.829 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:31.830 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:35:31.865 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:31.865 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:31.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.906+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.908+0000 7f8c7d523800 20 realm 2024-09-14T11:35:31.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.908+0000 7f8c7d523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:31.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.909+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.909+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:31.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.910+0000 7f8c7d523800 20 searching for the correct realm 2024-09-14T11:35:31.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:31.913+0000 7f8c79a0d640 0 -- 172.21.15.7:0/2343093828 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8c70074020 msgr2=0x7f8c700a4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:32.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.119+0000 7f8c78a0b640 0 -- 172.21.15.7:0/2343093828 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8c6c02e490 msgr2=0x7f8c6c0403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:32.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:32.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 zone default found 2024-09-14T11:35:32.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 4 Realm: () 2024-09-14T11:35:32.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:32.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 zonegroup default 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.329+0000 7f8c7d523800 20 started sync module instance, tier type = 2024-09-14T11:35:32.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.329+0000 7f8c7d523800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=0 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=1 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=2 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=3 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=4 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=5 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=6 2024-09-14T11:35:32.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.340+0000 7f8c7d523800 20 add_watcher() i=7 2024-09-14T11:35:32.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.340+0000 7f8c7d523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:32.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.342+0000 7f8b2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:32.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.344+0000 7f8c7d523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:32.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.344+0000 7f8c7d523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:32.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.344+0000 7f8c7d523800 5 note: GC not initialized 2024-09-14T11:35:32.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.344+0000 7f8b2e7e4640 20 reqs_thread_entry: start 2024-09-14T11:35:32.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.344+0000 7f8c7d523800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:32.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.344+0000 7f8c7d523800 20 Filter name: none 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8a9ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8c7d523800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 : miss 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.346+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.346+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.346+0000 7f8c7d523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.346+0000 7f8c7d523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:32.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.346+0000 7f8c7d523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.346+0000 7f8c7d523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 2024-09-14T11:35:32.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.352+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.352+0000 7f8c7d523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.352+0000 7f8c7d523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.352+0000 7f8c7d523800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28, ofs0, ns] 2024-09-14T11:35:32.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529692 cookie 94675942951792 notifier 6530 bl.length()=1023 2024-09-14T11:35:32.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_sources= new_sources= 2024-09-14T11:35:32.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential sources added=[] removed=[] 2024-09-14T11:35:32.352 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_dests= new_dests= 2024-09-14T11:35:32.353 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential dests added=[] removed=[] 2024-09-14T11:35:32.353 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8c7d523800 time 2024-09-14T11:35:32.354988+0000 2024-09-14T11:35:32.353 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:32.372 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.372 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8c7eb8c76a] 2024-09-14T11:35:32.372 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.372 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.372 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.354+0000 7f8c7d523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8c7d523800 time 2024-09-14T11:35:32.354988+0000 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8c7eb8c76a] 2024-09-14T11:35:32.373 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f8c7d523800 thread_name:radosgw-admin 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8c7d83e6f0] 2024-09-14T11:35:32.374 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8c7d88b99c] 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8c7eb8c7c4] 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.355+0000 7f8c7d523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f8c7d523800 thread_name:radosgw-admin 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.375 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8c7d83e6f0] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8c7d88b99c] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8c7eb8c7c4] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:35:32.376 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: dump: 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.377 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: dump: 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.378 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:35:31.888+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6834 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:35:31.888+0000 7f8c7d523800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:35:31.888+0000 7f8c7d523800 4 set_mon_vals no callback set 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:35:31.888+0000 7f8c7d523800 10 monclient: shutdown 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:35:31.888+0000 7f8c7d523800 5 asok(0x561b75c0b270) unregister_commands rotate-key 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:35:31.889+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:35:31.889+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.379 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding auth protocol: cephx 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding auth protocol: cephx 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding auth protocol: cephx 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.380 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:35:31.889+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: starting msgr at 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: starting objecter 2024-09-14T11:35:32.381 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command objecter_requests hook 0x561b75e32790 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: setting wanted keys 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: calling monclient init 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:35:31.889+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding auth protocol: cephx 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding auth protocol: cephx 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding auth protocol: cephx 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.382 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:35:31.889+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:35:31.890+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:35:31.890+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key hook 0x561b75e2a458 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75d6d680 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75d737b0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75e31390 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.383 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.447140s 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75e31390 auth_method 0 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75d737b0 auth_method 0 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.384 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75d6d680 auth_method 0 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_done global_id 6837 payload 824 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 1 monclient: found mon.noname-a 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:32.385 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: dump: 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.386 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: dump: 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:35:31.890+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6837 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:35:31.890+0000 7f8b67606640 4 set_mon_vals no callback set 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.387 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:35:31.890+0000 7f8c7d523800 1 librados: init done 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:35:31.892+0000 7f8b65e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:35:31.892+0000 7f8b65e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:35:31.892+0000 7f8b65e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:35:31.893+0000 7f8c7920c640 10 monclient: get_auth_request con 0x7f8b60077230 auth_method 0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:35:31.893+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x561b75e52040 auth_method 0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:35:31.894+0000 7f8c7920c640 10 monclient: get_auth_request con 0x561b75e76ee0 auth_method 0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:35:31.895+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x561b75e7b340 auth_method 0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:35:31.896+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x561b75e7a840 auth_method 0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:35:31.897+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:35:31.897+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.388 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:35:31.897+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding auth protocol: cephx 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding auth protocol: cephx 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding auth protocol: cephx 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.389 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:35:31.897+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x561b75e86b40 EEXIST 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:35:31.897+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding auth protocol: cephx 2024-09-14T11:35:32.390 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding auth protocol: cephx 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding auth protocol: cephx 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:35:31.897+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.391 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:35:31.898+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:35:31.898+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key cmddesc rotate-key hook 0x561b75e825e0 EEXIST 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75eaae60 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75eab240 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75ea9b70 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.455260s 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75eaae60 auth_method 0 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.392 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75eab240 auth_method 0 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75ea9b70 auth_method 0 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.393 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 1 monclient: found mon.noname-c 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: dump: 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.394 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: dump: 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.395 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:35:31.899+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6524 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:35:31.898+0000 7f8c7a20e640 4 set_mon_vals no callback set 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:35:31.900+0000 7f8b5effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:35:31.900+0000 7f8b5effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.396 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:35:31.900+0000 7f8b5effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:35:31.901+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8b54077140 auth_method 0 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: get_monmap_and_config 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:35:31.901+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.397 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding auth protocol: cephx 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding auth protocol: cephx 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding auth protocol: cephx 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.398 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:35:31.901+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding auth protocol: cephx 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding auth protocol: cephx 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding auth protocol: cephx 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.399 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:35:31.901+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:35:31.902+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:35:31.902+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key cmddesc rotate-key hook 0x7ffe1ad24e28 EEXIST 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75eff230 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75ed0050 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75efa5f0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.400 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.459294s 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75eff230 auth_method 0 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75ed0050 auth_method 0 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.401 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75efa5f0 auth_method 0 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_done global_id 6843 payload 274 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 1 monclient: found mon.noname-a 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: dump: 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.402 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:35:31.902+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6843 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:35:31.902+0000 7f8c7d523800 4 set_mon_vals no callback set 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:32.403 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: dump: 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:35:31.903+0000 7f8c7d523800 10 monclient: shutdown 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:35:31.903+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:35:31.903+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:35:31.903+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.404 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding auth protocol: cephx 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding auth protocol: cephx 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding auth protocol: cephx 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.405 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:35:31.903+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:35:31.903+0000 7f8c7d523800 1 librados: starting msgr at 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:35:31.903+0000 7f8c7d523800 1 librados: starting objecter 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x561b75eccba0 EEXIST 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:35:31.904+0000 7f8c7d523800 1 librados: setting wanted keys 2024-09-14T11:35:32.406 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:35:31.904+0000 7f8c7d523800 1 librados: calling monclient init 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding auth protocol: cephx 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding auth protocol: cephx 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding auth protocol: cephx 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.407 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:35:31.904+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:35:31.904+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key cmddesc rotate-key hook 0x561b75ebf868 EEXIST 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75ed0050 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75efa5f0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75eff230 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.461571s 2024-09-14T11:35:32.408 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75eff230 auth_method 0 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75efa5f0 auth_method 0 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.409 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75ed0050 auth_method 0 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_done global_id 6530 payload 824 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 1 monclient: found mon.noname-c 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: dump: 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.410 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: dump: 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.411 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:35:31.905+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6530 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:35:31.905+0000 7f8b5cff9640 4 set_mon_vals no callback set 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.412 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:35:31.905+0000 7f8c7d523800 1 librados: init done 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:35:31.905+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cr dump hook 0x561b75ef4d08 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:35:31.906+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:35:31.907+0000 7f8b4affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:35:31.907+0000 7f8b4affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:35:31.907+0000 7f8b4affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:35:31.907+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8b44077230 auth_method 0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:35:31.908+0000 7f8c7920c640 10 monclient: get_auth_request con 0x561b75f19310 auth_method 0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 realm 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:35:31.908+0000 7f8c7d523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:35:31.909+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.413 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:35:31.909+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:35:31.909+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x561b75f1d650 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:35:31.910+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x561b75f20db0 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 searching for the correct realm 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:35:31.911+0000 7f8c7920c640 10 monclient: get_auth_request con 0x561b75f25b30 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:35:31.912+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8c6c01d410 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:35:31.913+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x7f8c70074020 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:35:31.913+0000 7f8c79a0d640 0 -- 172.21.15.7:0/2343093828 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8c70074020 msgr2=0x7f8c700a4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:35:32.114+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x7f8c70074020 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:35:32.114+0000 7f8c7920c640 10 monclient: get_auth_request con 0x7f8c74076800 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:35:32.119+0000 7f8c78a0b640 0 -- 172.21.15.7:0/2343093828 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8c6c02e490 msgr2=0x7f8c6c0403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:35:32.321+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8c6c02e490 auth_method 0 2024-09-14T11:35:32.414 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 zone default found 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:35:32.328+0000 7f8c7d523800 4 Realm: () 2024-09-14T11:35:32.415 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:35:32.328+0000 7f8c7d523800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:35:32.328+0000 7f8c7d523800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:35:32.328+0000 7f8c7d523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 zonegroup default 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 started sync module instance, tier type = 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=0 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=1 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=2 2024-09-14T11:35:32.416 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=3 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=4 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=5 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=6 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:35:32.340+0000 7f8c7d523800 20 add_watcher() i=7 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:35:32.340+0000 7f8c7d523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding auth protocol: cephx 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding auth protocol: cephx 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding auth protocol: cephx 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.417 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:35:32.342+0000 7f8b2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:35:32.344+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache list hook 0x561b75eef400 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache inspect hook 0x561b75eef400 2024-09-14T11:35:32.418 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache erase hook 0x561b75eef400 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache zap hook 0x561b75eef400 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 note: GC not initialized 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:35:32.344+0000 7f8b2e7e4640 20 reqs_thread_entry: start 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace show hook 0x7f8c74002540 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace history hook 0x7f8c74002540 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace active hook 0x7f8c74002540 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace active_short hook 0x7f8c74002540 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 Filter name: none 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:35:32.345+0000 7f8a9ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:32.419 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 : miss 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:35:32.346+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28, ofs0, ns] 2024-09-14T11:35:32.420 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529692 cookie 94675942951792 notifier 6530 bl.length()=1023 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_sources= new_sources= 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential sources added=[] removed=[] 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_dests= new_dests= 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential dests added=[] removed=[] 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:35:32.354+0000 7f8c7d523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8c7d523800 time 2024-09-14T11:35:32.354988+0000 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8c7eb8c76a] 2024-09-14T11:35:32.421 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:35:32.355+0000 7f8c7d523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f8c7d523800 thread_name:radosgw-admin 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8c7d83e6f0] 2024-09-14T11:35:32.422 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8c7d88b99c] 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8c7eb8c7c4] 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:35:32.423 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:35:32.424 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:35:32.425 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:32.426 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:35:32.427 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:32.428 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:32.429 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8a9ffff640 / http_manager 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b2e7e4640 / http_manager 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b2f7e6640 / rgw_dt_lg_renew 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b4affd640 / ms_dispatch 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b4bfff640 / io_context_pool 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b5cff9640 / io_context_pool 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b5effd640 / ms_dispatch 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b65e03640 / ms_dispatch 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b67606640 / io_context_pool 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c78a0b640 / msgr-worker-2 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c7920c640 / msgr-worker-1 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c79a0d640 / msgr-worker-0 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c7a20e640 / io_context_pool 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c7d523800 / radosgw-admin 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:35:32.430 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.106842.log 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: dump: 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.431 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:35:31.888+0000 7f8b67606640 10 monclient: dump: 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.432 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:35:31.888+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6834 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:35:31.888+0000 7f8c7d523800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:35:31.888+0000 7f8c7d523800 4 set_mon_vals no callback set 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:35:31.888+0000 7f8c7d523800 10 monclient: shutdown 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:35:31.888+0000 7f8c7d523800 5 asok(0x561b75c0b270) unregister_commands rotate-key 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:35:31.889+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:35:31.889+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.433 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding auth protocol: cephx 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding auth protocol: cephx 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding auth protocol: cephx 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.434 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: crc 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2c610) adding con mode: secure 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:35:31.889+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: starting msgr at 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: starting objecter 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command objecter_requests hook 0x561b75e32790 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: setting wanted keys 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:35:31.889+0000 7f8c7d523800 1 librados: calling monclient init 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:35:31.889+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.435 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding auth protocol: cephx 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding auth protocol: cephx 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding auth protocol: cephx 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.436 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: crc 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:35:31.889+0000 7f8c7d523800 5 AuthRegistry(0x561b75e2a310) adding con mode: secure 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:35:31.889+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:35:31.890+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:35:31.890+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key hook 0x561b75e2a458 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75d6d680 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75d737b0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75e31390 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.437 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.447140s 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75e31390 auth_method 0 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75d737b0 auth_method 0 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.438 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:35:31.890+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75d6d680 auth_method 0 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:35:31.890+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_done global_id 6837 payload 824 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 1 monclient: found mon.noname-a 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:35:31.890+0000 7f8c78a0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: dump: 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.439 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.440 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:35:31.890+0000 7f8b65e03640 10 monclient: dump: 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:35:31.890+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6837 2024-09-14T11:35:32.441 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:35:31.890+0000 7f8b67606640 4 set_mon_vals no callback set 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:35:31.890+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:35:31.890+0000 7f8c7d523800 1 librados: init done 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:35:31.892+0000 7f8b65e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:35:31.892+0000 7f8b65e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:35:31.892+0000 7f8b65e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:35:31.893+0000 7f8c7920c640 10 monclient: get_auth_request con 0x7f8b60077230 auth_method 0 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:35:31.893+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x561b75e52040 auth_method 0 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:35:31.894+0000 7f8c7920c640 10 monclient: get_auth_request con 0x561b75e76ee0 auth_method 0 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:35:31.895+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x561b75e7b340 auth_method 0 2024-09-14T11:35:32.442 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:35:31.896+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x561b75e7a840 auth_method 0 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:35:31.897+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:35:31.897+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:35:31.897+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding auth protocol: cephx 2024-09-14T11:35:32.443 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding auth protocol: cephx 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding auth protocol: cephx 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: crc 2024-09-14T11:35:32.444 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e83690) adding con mode: secure 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:35:31.897+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x561b75e86b40 EEXIST 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:35:31.897+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding auth protocol: cephx 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding auth protocol: cephx 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding auth protocol: cephx 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.445 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: crc 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:35:31.897+0000 7f8c7d523800 5 AuthRegistry(0x561b75e82498) adding con mode: secure 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:35:31.897+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:35:31.898+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:35:31.898+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key cmddesc rotate-key hook 0x561b75e825e0 EEXIST 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75eaae60 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75eab240 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75ea9b70 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.446 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:35:31.898+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.455260s 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75eaae60 auth_method 0 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75eab240 auth_method 0 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.447 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:35:31.898+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75ea9b70 auth_method 0 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:35:31.898+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 1 monclient: found mon.noname-c 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:35:31.898+0000 7f8c79a0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.448 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: dump: 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.449 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:35:31.898+0000 7f8b5effd640 10 monclient: dump: 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.450 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:35:31.899+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6524 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:35:31.898+0000 7f8c7a20e640 4 set_mon_vals no callback set 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:35:31.899+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:35:31.900+0000 7f8b5effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:35:31.900+0000 7f8b5effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:35:31.900+0000 7f8b5effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:35:31.901+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8b54077140 auth_method 0 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: get_monmap_and_config 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:35:31.901+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.451 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding auth protocol: cephx 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding auth protocol: cephx 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding auth protocol: cephx 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.452 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: crc 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x561b75ecabf0) adding con mode: secure 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:35:31.901+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:35:31.901+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding auth protocol: cephx 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding auth protocol: cephx 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding auth protocol: cephx 2024-09-14T11:35:32.453 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: crc 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:35:31.901+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad24ce0) adding con mode: secure 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:35:31.901+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.454 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:35:31.902+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:35:31.902+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key cmddesc rotate-key hook 0x7ffe1ad24e28 EEXIST 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75eff230 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75ed0050 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75efa5f0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.459294s 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75eff230 auth_method 0 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.455 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75ed0050 auth_method 0 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:35:31.902+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75efa5f0 auth_method 0 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:35:31.902+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.456 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient(hunting): handle_auth_done global_id 6843 payload 274 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 1 monclient: found mon.noname-a 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:35:31.902+0000 7f8c78a0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: dump: 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.457 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:35:31.902+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6843 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:35:31.902+0000 7f8c7d523800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:35:31.902+0000 7f8c7d523800 4 set_mon_vals no callback set 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:35:31.902+0000 7f8b5cff9640 10 monclient: dump: 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.458 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:35:31.903+0000 7f8c7d523800 10 monclient: shutdown 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:35:31.903+0000 7f8c7d523800 10 monclient: build_initial_monmap 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:35:31.903+0000 7f8c7d523800 1 build_initial for_mkfs: 0 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:35:31.903+0000 7f8c7d523800 10 monclient: monmap: 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:35:32.459 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding auth protocol: cephx 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding auth protocol: cephx 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding auth protocol: cephx 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.460 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: crc 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 AuthRegistry(0x561b75ef0260) adding con mode: secure 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:35:31.903+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:35:31.903+0000 7f8c7d523800 1 librados: starting msgr at 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:35:31.903+0000 7f8c7d523800 1 librados: starting objecter 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:35:31.903+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x561b75eccba0 EEXIST 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:35:31.904+0000 7f8c7d523800 1 librados: setting wanted keys 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:35:31.904+0000 7f8c7d523800 1 librados: calling monclient init 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient: init 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding auth protocol: cephx 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding auth protocol: cephx 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding auth protocol: cephx 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.461 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: crc 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 AuthRegistry(0x561b75ebf720) adding con mode: secure 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:35:31.904+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:35:31.904+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:35:31.904+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command rotate-key cmddesc rotate-key hook 0x561b75ebf868 EEXIST 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-b con 0x561b75ed0050 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-c con 0x561b75efa5f0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:35:32.462 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): picked mon.noname-a con 0x561b75eff230 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:35:31.904+0000 7f8c7d523800 10 monclient(hunting): authenticate will time out at 2032.461571s 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): get_auth_request con 0x561b75eff230 auth_method 0 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request con 0x561b75efa5f0 auth_method 0 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.463 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:35:31.904+0000 7f8c7920c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request con 0x561b75ed0050 auth_method 0 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:35:31.904+0000 7f8c78a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient(hunting): handle_auth_done global_id 6530 payload 824 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient: _finish_hunting 0 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 1 monclient: found mon.noname-c 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:35:31.904+0000 7f8c79a0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:32.464 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: dump: 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: _finish_auth 0 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:32.465 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:35:31.905+0000 7f8b4affd640 10 monclient: dump: 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:35:31.905+0000 7f8c7d523800 5 monclient: authenticate success, global_id 6530 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:35:31.905+0000 7f8b5cff9640 4 set_mon_vals no callback set 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.466 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _renew_subs 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:35:31.905+0000 7f8c7d523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:35:31.905+0000 7f8c7d523800 1 librados: init done 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:35:31.905+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cr dump hook 0x561b75ef4d08 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:35:31.906+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:35:31.907+0000 7f8b4affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:35:31.907+0000 7f8b4affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:35:31.907+0000 7f8b4affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:35:31.907+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8b44077230 auth_method 0 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:35:31.908+0000 7f8c7920c640 10 monclient: get_auth_request con 0x561b75f19310 auth_method 0 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 realm 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.467 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:35:31.908+0000 7f8c7d523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:35:31.908+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:35:31.909+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:35:31.909+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:35:31.909+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x561b75f1d650 auth_method 0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:35:31.910+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x561b75f20db0 auth_method 0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:35:31.910+0000 7f8c7d523800 20 searching for the correct realm 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:35:31.911+0000 7f8c7920c640 10 monclient: get_auth_request con 0x561b75f25b30 auth_method 0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:35:31.912+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8c6c01d410 auth_method 0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:35:31.913+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x7f8c70074020 auth_method 0 2024-09-14T11:35:32.468 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:35:31.913+0000 7f8c79a0d640 0 -- 172.21.15.7:0/2343093828 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8c70074020 msgr2=0x7f8c700a4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:35:32.114+0000 7f8c79a0d640 10 monclient: get_auth_request con 0x7f8c70074020 auth_method 0 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:35:32.114+0000 7f8c7920c640 10 monclient: get_auth_request con 0x7f8c74076800 auth_method 0 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:35:32.119+0000 7f8c78a0b640 0 -- 172.21.15.7:0/2343093828 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8c6c02e490 msgr2=0x7f8c6c0403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:35:32.321+0000 7f8c78a0b640 10 monclient: get_auth_request con 0x7f8c6c02e490 auth_method 0 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:35:32.327+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.469 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 zone default found 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:35:32.328+0000 7f8c7d523800 4 Realm: () 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:35:32.328+0000 7f8c7d523800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:35:32.328+0000 7f8c7d523800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:35:32.328+0000 7f8c7d523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 zonegroup default 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:35:32.328+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.470 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 started sync module instance, tier type = 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:35:32.329+0000 7f8c7d523800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=0 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=1 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=2 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=3 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=4 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=5 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:35:32.339+0000 7f8c7d523800 20 add_watcher() i=6 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:35:32.340+0000 7f8c7d523800 20 add_watcher() i=7 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:35:32.340+0000 7f8c7d523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding auth protocol: cephx 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding auth protocol: cephx 2024-09-14T11:35:32.471 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding auth protocol: cephx 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: crc 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:35:32.342+0000 7f8c7d523800 5 AuthRegistry(0x7ffe1ad251c0) adding con mode: secure 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:35:32.342+0000 7f8b2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:35:32.344+0000 7f8c7d523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:32.472 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache list hook 0x561b75eef400 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache inspect hook 0x561b75eef400 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache erase hook 0x561b75eef400 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command cache zap hook 0x561b75eef400 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 note: GC not initialized 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:35:32.344+0000 7f8b2e7e4640 20 reqs_thread_entry: start 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace show hook 0x7f8c74002540 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace history hook 0x7f8c74002540 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace active hook 0x7f8c74002540 2024-09-14T11:35:32.473 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:35:32.344+0000 7f8c7d523800 5 asok(0x561b75c0b270) register_command sync trace active_short hook 0x7f8c74002540 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:35:32.344+0000 7f8c7d523800 20 Filter name: none 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:35:32.345+0000 7f8a9ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:35:32.345+0000 7f8c7d523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 : miss 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:35:32.345+0000 7f8c7d523800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:35:32.346+0000 7f8c7d523800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:32.474 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:35:32.346+0000 7f8c7d523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:35:32.352+0000 7f8c7d523800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28, ofs0, ns] 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529692 cookie 94675942951792 notifier 6530 bl.length()=1023 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:35:32.353+0000 7f8b4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_sources= new_sources= 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential sources added=[] removed=[] 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_dests= new_dests= 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:35:32.353+0000 7f8c7d523800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential dests added=[] removed=[] 2024-09-14T11:35:32.475 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:35:32.354+0000 7f8c7d523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8c7d523800 time 2024-09-14T11:35:32.354988+0000 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8c7eb8c76a] 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:35:32.476 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:35:32.355+0000 7f8c7d523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f8c7d523800 thread_name:radosgw-admin 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8c7d83e6f0] 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8c7d88b99c] 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8c7eb8c7c4] 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8c7eb8c928] 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b73a6a0b1] 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8900e) [0x561b73f7e00e] 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561b73a79efd] 2024-09-14T11:35:32.477 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8c7d829590] 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:35:32.478 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:35:32.479 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:35:32.480 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:35:32.481 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:35:32.482 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:32.483 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8a9ffff640 / http_manager 2024-09-14T11:35:32.484 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b2e7e4640 / http_manager 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b2f7e6640 / rgw_dt_lg_renew 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b4affd640 / ms_dispatch 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b4bfff640 / io_context_pool 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b5cff9640 / io_context_pool 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b5effd640 / ms_dispatch 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b65e03640 / ms_dispatch 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8b67606640 / io_context_pool 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c78a0b640 / msgr-worker-2 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c7920c640 / msgr-worker-1 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c79a0d640 / msgr-worker-0 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c7a20e640 / io_context_pool 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: 7f8c7d523800 / radosgw-admin 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:35:32.485 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:32.356757Z_9c794daf-a666-4cdb-8aac-639f69dae539/log 2024-09-14T11:35:32.486 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:35:32.486 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.436+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.437+0000 7f7272087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.437+0000 7f7272087800 20 realm 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.437+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.438+0000 7f7272087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.438+0000 7f7272087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.438+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.438+0000 7f7272087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.438+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.439+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:32.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.439+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.439+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:32.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.440+0000 7f7272087800 20 searching for the correct realm 2024-09-14T11:35:32.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.441+0000 7f7270379640 0 -- 172.21.15.7:0/1452569416 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f726405ebe0 msgr2=0x7f7264061f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:32.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.647+0000 7f726f377640 0 -- 172.21.15.7:0/1452569416 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f7260017920 msgr2=0x7f72600423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:32.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:32.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:32.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:32.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:32.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:32.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:32.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:32.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.854+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 zone default found 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 4 Realm: () 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 zonegroup default 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.855+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.856+0000 7f7272087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:32.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.856+0000 7f7272087800 20 started sync module instance, tier type = 2024-09-14T11:35:32.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.856+0000 7f7272087800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:32.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.868+0000 7f7272087800 20 add_watcher() i=0 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.868+0000 7f7272087800 20 add_watcher() i=1 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.868+0000 7f7272087800 20 add_watcher() i=2 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.868+0000 7f7272087800 20 add_watcher() i=3 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.868+0000 7f7272087800 20 add_watcher() i=4 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.868+0000 7f7272087800 20 add_watcher() i=5 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.868+0000 7f7272087800 20 add_watcher() i=6 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.869+0000 7f7272087800 20 add_watcher() i=7 2024-09-14T11:35:32.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.869+0000 7f7272087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:32.869 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.871+0000 7f7125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:32.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.871+0000 7f7272087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:32.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.871+0000 7f7272087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:32.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.871+0000 7f7272087800 5 note: GC not initialized 2024-09-14T11:35:32.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.871+0000 7f7124fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:32.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.871+0000 7f7272087800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:32.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.871+0000 7f7272087800 20 Filter name: none 2024-09-14T11:35:32.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.872+0000 7f709e7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:32.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.872+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.872+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:32.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.872+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.873+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:35:32.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.873+0000 7f7272087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:32.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.873+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.874+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:32.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.874+0000 7f7272087800 20 rados->read ofs=0 len=0 2024-09-14T11:35:32.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.874+0000 7f7272087800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:35:32.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.874+0000 7f7272087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:32.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.876+0000 7f7125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:32.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.879+0000 7f7272087800 20 remove_watcher() i=0 2024-09-14T11:35:32.878 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.879+0000 7f7272087800 2 removed watcher, disabling cache 2024-09-14T11:35:32.879 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.881+0000 7f7272087800 20 remove_watcher() i=1 2024-09-14T11:35:32.881 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.882+0000 7f7272087800 20 remove_watcher() i=2 2024-09-14T11:35:32.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.884+0000 7f7272087800 20 remove_watcher() i=3 2024-09-14T11:35:32.884 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.886+0000 7f7272087800 20 remove_watcher() i=4 2024-09-14T11:35:32.885 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.887+0000 7f7272087800 20 remove_watcher() i=5 2024-09-14T11:35:32.886 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.888+0000 7f7272087800 20 remove_watcher() i=6 2024-09-14T11:35:32.888 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:32.889+0000 7f7272087800 20 remove_watcher() i=7 2024-09-14T11:35:32.899 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.899 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:35:32.899 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:32.900 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:35:32.901 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:32.901 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:32.908 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:32.908 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:35:32.951 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:32.984 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:32.984 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:33.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.026+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 20 realm 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.028+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.029+0000 7fe2da928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:33.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.029+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.030+0000 7fe2da928800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:33.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.030+0000 7fe2da928800 20 searching for the correct realm 2024-09-14T11:35:33.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.032+0000 7fe2d6e70640 0 -- 172.21.15.7:0/947116704 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe2cc032060 msgr2=0x7fe2cc0665f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:33.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.239+0000 7fe2d5e6e640 0 -- 172.21.15.7:0/947116704 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe2c800b040 msgr2=0x7fe2c803a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.446+0000 7fe2da928800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.446+0000 7fe2da928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.446+0000 7fe2da928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.446+0000 7fe2da928800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.446+0000 7fe2da928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.446+0000 7fe2da928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.446+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.447+0000 7fe2da928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:33.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.447+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.447+0000 7fe2da928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:33.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.447+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 zone default found 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 4 Realm: () 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 zonegroup default 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:33.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.448+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.449+0000 7fe2da928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:33.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.449+0000 7fe2da928800 20 started sync module instance, tier type = 2024-09-14T11:35:33.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.449+0000 7fe2da928800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:35:33.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.461+0000 7fe2da928800 20 add_watcher() i=0 2024-09-14T11:35:33.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.461+0000 7fe2da928800 20 add_watcher() i=1 2024-09-14T11:35:33.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.461+0000 7fe2da928800 20 add_watcher() i=2 2024-09-14T11:35:33.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.461+0000 7fe2da928800 20 add_watcher() i=3 2024-09-14T11:35:33.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.461+0000 7fe2da928800 20 add_watcher() i=4 2024-09-14T11:35:33.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.461+0000 7fe2da928800 20 add_watcher() i=5 2024-09-14T11:35:33.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.461+0000 7fe2da928800 20 add_watcher() i=6 2024-09-14T11:35:33.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.462+0000 7fe2da928800 20 add_watcher() i=7 2024-09-14T11:35:33.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.462+0000 7fe2da928800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:33.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.464+0000 7fe18cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:33.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe2da928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:33.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe2da928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:33.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe2da928800 5 note: GC not initialized 2024-09-14T11:35:33.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe1077fe640 20 reqs_thread_entry: start 2024-09-14T11:35:33.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe2da928800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:33.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe2da928800 20 Filter name: none 2024-09-14T11:35:33.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe1057fa640 20 reqs_thread_entry: start 2024-09-14T11:35:33.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe2da928800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:33.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.465+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 : miss 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 20 rados->read ofs=0 len=0 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.466+0000 7fe2da928800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:33.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.467+0000 7fe2da928800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 2024-09-14T11:35:33.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.468+0000 7fe2da928800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to be held by another RGW process; skipping for now 2024-09-14T11:35:33.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.469+0000 7fe18cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:33.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.471+0000 7fe2da928800 20 remove_watcher() i=0 2024-09-14T11:35:33.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.471+0000 7fe2da928800 2 removed watcher, disabling cache 2024-09-14T11:35:33.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.472+0000 7fe2da928800 20 remove_watcher() i=1 2024-09-14T11:35:33.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.474+0000 7fe2da928800 20 remove_watcher() i=2 2024-09-14T11:35:33.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.475+0000 7fe2da928800 20 remove_watcher() i=3 2024-09-14T11:35:33.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.476+0000 7fe2da928800 20 remove_watcher() i=4 2024-09-14T11:35:33.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.477+0000 7fe2da928800 20 remove_watcher() i=5 2024-09-14T11:35:33.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.478+0000 7fe2da928800 20 remove_watcher() i=6 2024-09-14T11:35:33.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:35:33.479+0000 7fe2da928800 20 remove_watcher() i=7 2024-09-14T11:35:33.489 INFO:tasks.workunit.client.0.smithi007.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:36:03.513 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:03.552 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:03.552 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:03.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.599+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.601+0000 7f6fa6139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.601+0000 7f6fa6139800 20 realm 2024-09-14T11:36:03.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.601+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.601+0000 7f6fa6139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.601+0000 7f6fa6139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:03.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.601+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.602+0000 7f6fa6139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.602+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.603+0000 7f6fa6139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:03.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.603+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.603+0000 7f6fa6139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:03.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.603+0000 7f6fa6139800 20 searching for the correct realm 2024-09-14T11:36:03.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.605+0000 7f6fa25c8640 0 -- 172.21.15.7:0/1451292896 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6f980d4030 msgr2=0x7f6f980aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:03.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:03.813+0000 7f6fa15c6640 0 -- 172.21.15.7:0/1451292896 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f6f94040910 msgr2=0x7f6f9402f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:04.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:04.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:04.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:04.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:04.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:04.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:04.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.021+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 20 zone default found 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 4 Realm: () 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 20 zonegroup default 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.022+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.023+0000 7f6fa6139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.023+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.023+0000 7f6fa6139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.023+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.023+0000 7f6fa6139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.023+0000 7f6fa6139800 20 started sync module instance, tier type = 2024-09-14T11:36:04.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.023+0000 7f6fa6139800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:04.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.035+0000 7f6fa6139800 20 add_watcher() i=0 2024-09-14T11:36:04.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.035+0000 7f6fa6139800 20 add_watcher() i=1 2024-09-14T11:36:04.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.035+0000 7f6fa6139800 20 add_watcher() i=2 2024-09-14T11:36:04.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.035+0000 7f6fa6139800 20 add_watcher() i=3 2024-09-14T11:36:04.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.035+0000 7f6fa6139800 20 add_watcher() i=4 2024-09-14T11:36:04.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.035+0000 7f6fa6139800 20 add_watcher() i=5 2024-09-14T11:36:04.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.035+0000 7f6fa6139800 20 add_watcher() i=6 2024-09-14T11:36:04.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.036+0000 7f6fa6139800 20 add_watcher() i=7 2024-09-14T11:36:04.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.036+0000 7f6fa6139800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:04.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.038+0000 7f6e537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.038+0000 7f6fa6139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.038+0000 7f6fa6139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.038+0000 7f6fa6139800 5 note: GC not initialized 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.039+0000 7f6e527fc640 20 reqs_thread_entry: start 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.039+0000 7f6fa6139800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.039+0000 7f6fa6139800 20 Filter name: none 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.039+0000 7f6dc3fff640 20 reqs_thread_entry: start 2024-09-14T11:36:04.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.039+0000 7f6fa6139800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:36:04.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.039+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:36:04.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:36:04.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 : miss 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.040+0000 7f6fa6139800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 2024-09-14T11:36:04.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.041+0000 7f6fa6139800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:04.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:36:04.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:36:04.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:04.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28, ofs0, ns] 2024-09-14T11:36:04.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6e857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529693 cookie 93961349153760 notifier 6900 bl.length()=1023 2024-09-14T11:36:04.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6e857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:36:04.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6e857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:36:04.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6e857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:04.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_sources= new_sources= 2024-09-14T11:36:04.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential sources added=[] removed=[] 2024-09-14T11:36:04.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_dests= new_dests= 2024-09-14T11:36:04.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.050+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential dests added=[] removed=[] 2024-09-14T11:36:04.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.0 2024-09-14T11:36:04.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.0 2024-09-14T11:36:04.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.1 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.1 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.2 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.2 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.3 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.3 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.4 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.4 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.5 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.5 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.6 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.6 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.7 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.7 2024-09-14T11:36:04.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.8 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.8 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.9 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.9 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.10 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.10 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.11 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2.11 2024-09-14T11:36:04.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.055+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.0 2024-09-14T11:36:04.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.056+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.1 2024-09-14T11:36:04.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.057+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2 2024-09-14T11:36:04.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.057+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.3 2024-09-14T11:36:04.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.058+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.4 2024-09-14T11:36:04.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.058+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.5 2024-09-14T11:36:04.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.059+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.6 2024-09-14T11:36:04.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.060+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.7 2024-09-14T11:36:04.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.060+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.8 2024-09-14T11:36:04.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.061+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.9 2024-09-14T11:36:04.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.061+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.10 2024-09-14T11:36:04.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.066+0000 7f6fa6139800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:04.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.066+0000 7f6fa6139800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 2024-09-14T11:36:04.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6fa6139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:36:04.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6fa6139800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:36:04.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6fa6139800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:04.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6fa6139800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28, ofs0, ns] 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6e857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529694 cookie 93961349153760 notifier 6900 bl.length()=1023 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6e857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6e857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.067+0000 7f6e857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.068+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_sources= new_sources= 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.068+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential sources added=[] removed=[] 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.068+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_dests= new_dests= 2024-09-14T11:36:04.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.068+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential dests added=[] removed=[] 2024-09-14T11:36:04.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.071+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.0 2024-09-14T11:36:04.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.071+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.1 2024-09-14T11:36:04.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.071+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.2 2024-09-14T11:36:04.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.072+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.3 2024-09-14T11:36:04.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.072+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.4 2024-09-14T11:36:04.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.072+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.5 2024-09-14T11:36:04.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.073+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.6 2024-09-14T11:36:04.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.073+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.7 2024-09-14T11:36:04.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.074+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.8 2024-09-14T11:36:04.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.074+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.9 2024-09-14T11:36:04.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.075+0000 7f6fa6139800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28.10 2024-09-14T11:36:04.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.075+0000 7f6fa6139800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:04.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.075+0000 7f6fa6139800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 2024-09-14T11:36:04.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.076+0000 7f6fa6139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:36:04.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.076+0000 7f6fa6139800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:36:04.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.076+0000 7f6fa6139800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:04.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.076+0000 7f6fa6139800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28, ofs0, ns] 2024-09-14T11:36:04.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6e84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529695 cookie 93961349153760 notifier 6900 bl.length()=991 2024-09-14T11:36:04.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6e84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 info.flags=0x17 2024-09-14T11:36:04.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6e84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 to cache LRU end 2024-09-14T11:36:04.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6e84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:04.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_sources= new_sources= 2024-09-14T11:36:04.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential sources added=[] removed=[] 2024-09-14T11:36:04.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): orig_dests= new_dests= 2024-09-14T11:36:04.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.077+0000 7f6fa6139800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28]): potential dests added=[] removed=[] 2024-09-14T11:36:04.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.080+0000 7f6fa6139800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:04.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.082+0000 7f6e537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.084+0000 7f6fa6139800 20 remove_watcher() i=0 2024-09-14T11:36:04.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.084+0000 7f6fa6139800 2 removed watcher, disabling cache 2024-09-14T11:36:04.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.085+0000 7f6fa6139800 20 remove_watcher() i=1 2024-09-14T11:36:04.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.087+0000 7f6fa6139800 20 remove_watcher() i=2 2024-09-14T11:36:04.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.088+0000 7f6fa6139800 20 remove_watcher() i=3 2024-09-14T11:36:04.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.090+0000 7f6fa6139800 20 remove_watcher() i=4 2024-09-14T11:36:04.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.091+0000 7f6fa6139800 20 remove_watcher() i=5 2024-09-14T11:36:04.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.092+0000 7f6fa6139800 20 remove_watcher() i=6 2024-09-14T11:36:04.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.093+0000 7f6fa6139800 20 remove_watcher() i=7 2024-09-14T11:36:04.104 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:36:04.135 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:04.135 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:04.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.178+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 20 realm 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.180+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.181+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.181+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.182+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:04.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.182+0000 7faca4126800 20 searching for the correct realm 2024-09-14T11:36:04.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.184+0000 7faca0670640 0 -- 172.21.15.7:0/2618679438 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fac94028070 msgr2=0x7fac9404bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:04.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.391+0000 7fac9f66e640 0 -- 172.21.15.7:0/2618679438 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fac90046040 msgr2=0x7fac90046420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:04.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.598+0000 7faca4126800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:04.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.598+0000 7faca4126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:04.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.598+0000 7faca4126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:04.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.598+0000 7faca4126800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:04.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.598+0000 7faca4126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:04.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.598+0000 7faca4126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:04.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.598+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 zone default found 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 4 Realm: () 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 zonegroup default 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.599+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.600+0000 7faca4126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.600+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.600+0000 7faca4126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.600+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.600+0000 7faca4126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.600+0000 7faca4126800 20 started sync module instance, tier type = 2024-09-14T11:36:04.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.600+0000 7faca4126800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:04.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.612+0000 7faca4126800 20 add_watcher() i=0 2024-09-14T11:36:04.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.612+0000 7faca4126800 20 add_watcher() i=1 2024-09-14T11:36:04.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.612+0000 7faca4126800 20 add_watcher() i=2 2024-09-14T11:36:04.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.612+0000 7faca4126800 20 add_watcher() i=3 2024-09-14T11:36:04.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.612+0000 7faca4126800 20 add_watcher() i=4 2024-09-14T11:36:04.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.612+0000 7faca4126800 20 add_watcher() i=5 2024-09-14T11:36:04.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.612+0000 7faca4126800 20 add_watcher() i=6 2024-09-14T11:36:04.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.613+0000 7faca4126800 20 add_watcher() i=7 2024-09-14T11:36:04.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.613+0000 7faca4126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:04.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.614+0000 7fab55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7faca4126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:04.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7faca4126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:04.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7faca4126800 5 note: GC not initialized 2024-09-14T11:36:04.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7fab54fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:04.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7faca4126800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:04.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7faca4126800 20 Filter name: none 2024-09-14T11:36:04.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7faace7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:04.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.615+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.616+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:36:04.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.616+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.616+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:36:04.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.616+0000 7faca4126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:04.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.616+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.617+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:36:04.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.617+0000 7faca4126800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.617+0000 7faca4126800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:36:04.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.617+0000 7faca4126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:04.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.620+0000 7fab55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.622+0000 7faca4126800 20 remove_watcher() i=0 2024-09-14T11:36:04.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.622+0000 7faca4126800 2 removed watcher, disabling cache 2024-09-14T11:36:04.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.623+0000 7faca4126800 20 remove_watcher() i=1 2024-09-14T11:36:04.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.624+0000 7faca4126800 20 remove_watcher() i=2 2024-09-14T11:36:04.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.625+0000 7faca4126800 20 remove_watcher() i=3 2024-09-14T11:36:04.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.626+0000 7faca4126800 20 remove_watcher() i=4 2024-09-14T11:36:04.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.627+0000 7faca4126800 20 remove_watcher() i=5 2024-09-14T11:36:04.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.628+0000 7faca4126800 20 remove_watcher() i=6 2024-09-14T11:36:04.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.629+0000 7faca4126800 20 remove_watcher() i=7 2024-09-14T11:36:04.639 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:04.639 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:04.639 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-trim-reshard-log-entries id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:04.639 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:04.641 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.641 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.645 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.645 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.689 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.689 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.721 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:36:04.721 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:04.721 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.721 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.734 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.734 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.777 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.777 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.784 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.784 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.790 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.790 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.797 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.797 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.803 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.804 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.809 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.809 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.816 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.816 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.822 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.822 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.828 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.828 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.834 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.834 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.841 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.841 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.847 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.847 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.854 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.854 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.860 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.860 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.866 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.866 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.872 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.872 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.878 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.878 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.884 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.884 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.890 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.890 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.897 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:04.897 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:04.903 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:36:04.932 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:04.932 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:04.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.974+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 20 realm 2024-09-14T11:36:04.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:04.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.976+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.977+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.977+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.978+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:04.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.978+0000 7f4fc8946800 20 searching for the correct realm 2024-09-14T11:36:04.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:04.979+0000 7f4fc6c38640 0 -- 172.21.15.7:0/783320225 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4fbc017070 msgr2=0x7f4fbc061d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.185+0000 7f4fc5c36640 0 -- 172.21.15.7:0/783320225 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f4fb80b7040 msgr2=0x7f4fb80b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.391+0000 7f4fc8946800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.391+0000 7f4fc8946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.391+0000 7f4fc8946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.391+0000 7f4fc8946800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.391+0000 7f4fc8946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.391+0000 7f4fc8946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.391+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 zone default found 2024-09-14T11:36:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 4 Realm: () 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 zonegroup default 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.392+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.393+0000 7f4fc8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.393+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.393+0000 7f4fc8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.393+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.393+0000 7f4fc8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.393+0000 7f4fc8946800 20 started sync module instance, tier type = 2024-09-14T11:36:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.393+0000 7f4fc8946800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:05.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.403+0000 7f4fc8946800 20 add_watcher() i=0 2024-09-14T11:36:05.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.403+0000 7f4fc8946800 20 add_watcher() i=1 2024-09-14T11:36:05.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.403+0000 7f4fc8946800 20 add_watcher() i=2 2024-09-14T11:36:05.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.403+0000 7f4fc8946800 20 add_watcher() i=3 2024-09-14T11:36:05.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.403+0000 7f4fc8946800 20 add_watcher() i=4 2024-09-14T11:36:05.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.403+0000 7f4fc8946800 20 add_watcher() i=5 2024-09-14T11:36:05.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.403+0000 7f4fc8946800 20 add_watcher() i=6 2024-09-14T11:36:05.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.404+0000 7f4fc8946800 20 add_watcher() i=7 2024-09-14T11:36:05.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.404+0000 7f4fc8946800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:05.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.405+0000 7f4e7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4fc8946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4fc8946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4fc8946800 5 note: GC not initialized 2024-09-14T11:36:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4df77fe640 20 reqs_thread_entry: start 2024-09-14T11:36:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4fc8946800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4fc8946800 20 Filter name: none 2024-09-14T11:36:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4df57fa640 20 reqs_thread_entry: start 2024-09-14T11:36:05.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.406+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.407+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:05.405 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.407+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.408+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.408+0000 7f4fc8946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.408+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.408+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.408+0000 7f4fc8946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.408+0000 7f4fc8946800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.408+0000 7f4fc8946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:05.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.410+0000 7f4e7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.412+0000 7f4fc8946800 20 remove_watcher() i=0 2024-09-14T11:36:05.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.412+0000 7f4fc8946800 2 removed watcher, disabling cache 2024-09-14T11:36:05.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.413+0000 7f4fc8946800 20 remove_watcher() i=1 2024-09-14T11:36:05.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.415+0000 7f4fc8946800 20 remove_watcher() i=2 2024-09-14T11:36:05.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.416+0000 7f4fc8946800 20 remove_watcher() i=3 2024-09-14T11:36:05.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.417+0000 7f4fc8946800 20 remove_watcher() i=4 2024-09-14T11:36:05.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.418+0000 7f4fc8946800 20 remove_watcher() i=5 2024-09-14T11:36:05.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.419+0000 7f4fc8946800 20 remove_watcher() i=6 2024-09-14T11:36:05.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.420+0000 7f4fc8946800 20 remove_watcher() i=7 2024-09-14T11:36:05.429 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:05.429 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:05.429 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-block-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:05.429 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:05.431 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:36:05.466 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:05.466 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:05.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.508+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.510+0000 7fdea1319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.510+0000 7fdea1319800 20 realm 2024-09-14T11:36:05.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.510+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.510+0000 7fdea1319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.510+0000 7fdea1319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:05.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.510+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.511+0000 7fdea1319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.511+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.512+0000 7fdea1319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.512+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.512+0000 7fdea1319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:05.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.512+0000 7fdea1319800 20 searching for the correct realm 2024-09-14T11:36:05.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.715+0000 7fde9e609640 0 -- 172.21.15.7:0/753902249 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fde9003d920 msgr2=0x7fde90023410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.719+0000 7fde9e609640 0 -- 172.21.15.7:0/753902249 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fdd68087050 msgr2=0x7fdd68089480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.724+0000 7fdea1319800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:05.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.724+0000 7fdea1319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.724+0000 7fdea1319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.724+0000 7fdea1319800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.724+0000 7fdea1319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.724+0000 7fdea1319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.724+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:05.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 zone default found 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 4 Realm: () 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 zonegroup default 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.725+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.726+0000 7fdea1319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.726+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.726+0000 7fdea1319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.726+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.726+0000 7fdea1319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.726+0000 7fdea1319800 20 started sync module instance, tier type = 2024-09-14T11:36:05.725 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.726+0000 7fdea1319800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.735+0000 7fdea1319800 20 add_watcher() i=0 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.735+0000 7fdea1319800 20 add_watcher() i=1 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.735+0000 7fdea1319800 20 add_watcher() i=2 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.735+0000 7fdea1319800 20 add_watcher() i=3 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.735+0000 7fdea1319800 20 add_watcher() i=4 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.735+0000 7fdea1319800 20 add_watcher() i=5 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.735+0000 7fdea1319800 20 add_watcher() i=6 2024-09-14T11:36:05.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.736+0000 7fdea1319800 20 add_watcher() i=7 2024-09-14T11:36:05.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.736+0000 7fdea1319800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:05.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.738+0000 7fdd557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.738+0000 7fdea1319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:05.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.738+0000 7fdea1319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:05.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.738+0000 7fdea1319800 5 note: GC not initialized 2024-09-14T11:36:05.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.738+0000 7fdccffff640 20 reqs_thread_entry: start 2024-09-14T11:36:05.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.738+0000 7fdea1319800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:05.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 20 Filter name: none 2024-09-14T11:36:05.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdccdffb640 20 reqs_thread_entry: start 2024-09-14T11:36:05.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:36:05.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 : miss 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.739+0000 7fdea1319800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.740+0000 7fdea1319800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.740+0000 7fdea1319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.740+0000 7fdea1319800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.740+0000 7fdea1319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.740+0000 7fdea1319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:05.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.740+0000 7fdea1319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.744+0000 7fdea1319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.744+0000 7fdea1319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.744+0000 7fdea1319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.744+0000 7fdea1319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29, ofs0, ns] 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdd81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529735 cookie 94780339761984 notifier 6957 bl.length()=999 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdd81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdd81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:05.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdd81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:05.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_sources= new_sources= 2024-09-14T11:36:05.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential sources added=[] removed=[] 2024-09-14T11:36:05.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_dests= new_dests= 2024-09-14T11:36:05.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.745+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential dests added=[] removed=[] 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.0 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.0 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.1 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.1 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.2 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.2 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.3 2024-09-14T11:36:05.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.3 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.4 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.4 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.5 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.5 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.6 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.6 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.7 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.7 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.8 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.8 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.9 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.9 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.10 2024-09-14T11:36:05.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.10 2024-09-14T11:36:05.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.11 2024-09-14T11:36:05.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.11 2024-09-14T11:36:05.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.0 2024-09-14T11:36:05.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.752+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.753+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.2 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.753+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.3 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.754+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.4 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.754+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.5 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.755+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.6 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.756+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.7 2024-09-14T11:36:05.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.756+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.8 2024-09-14T11:36:05.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.757+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.9 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.757+0000 7fdea1319800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.10 2024-09-14T11:36:05.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.760+0000 7fdea1319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:05.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.760+0000 7fdea1319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdea1319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdea1319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdea1319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdea1319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29, ofs0, ns] 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdd827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529736 cookie 94780339761984 notifier 6957 bl.length()=999 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdd827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdd827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:05.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.761+0000 7fdd827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:05.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.762+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_sources= new_sources= 2024-09-14T11:36:05.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.762+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential sources added=[] removed=[] 2024-09-14T11:36:05.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.762+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_dests= new_dests= 2024-09-14T11:36:05.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.762+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential dests added=[] removed=[] 2024-09-14T11:36:05.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.762+0000 7fdea1319800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:36:05.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.762+0000 7fdea1319800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:36:05.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.766+0000 7fdea1319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:05.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.766+0000 7fdea1319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 2024-09-14T11:36:05.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:05.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29, ofs0, ns] 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdd827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529737 cookie 94780339761984 notifier 6957 bl.length()=967 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdd827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdd827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdd827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_sources= new_sources= 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential sources added=[] removed=[] 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_dests= new_dests= 2024-09-14T11:36:05.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.768+0000 7fdea1319800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential dests added=[] removed=[] 2024-09-14T11:36:05.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.770+0000 7fdea1319800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:36:05.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.772+0000 7fdd557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.775+0000 7fdea1319800 20 remove_watcher() i=0 2024-09-14T11:36:05.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.775+0000 7fdea1319800 2 removed watcher, disabling cache 2024-09-14T11:36:05.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.776+0000 7fdea1319800 20 remove_watcher() i=1 2024-09-14T11:36:05.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.777+0000 7fdea1319800 20 remove_watcher() i=2 2024-09-14T11:36:05.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.778+0000 7fdea1319800 20 remove_watcher() i=3 2024-09-14T11:36:05.776 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.779+0000 7fdea1319800 20 remove_watcher() i=4 2024-09-14T11:36:05.777 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.780+0000 7fdea1319800 20 remove_watcher() i=5 2024-09-14T11:36:05.778 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.781+0000 7fdea1319800 20 remove_watcher() i=6 2024-09-14T11:36:05.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.782+0000 7fdea1319800 20 remove_watcher() i=7 2024-09-14T11:36:05.792 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:36:05.821 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:05.821 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:05.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.863+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.865+0000 7f0687925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.865+0000 7f0687925800 20 realm 2024-09-14T11:36:05.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.865+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.865+0000 7f0687925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.865+0000 7f0687925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:05.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.866+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.866+0000 7f0687925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.866+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.866+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.866+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.867+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:05.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.867+0000 7f0687925800 20 searching for the correct realm 2024-09-14T11:36:05.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:05.869+0000 7f0683d34640 0 -- 172.21.15.7:0/1018193918 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0678026060 msgr2=0x7f0678076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.074+0000 7f0682d32640 0 -- 172.21.15.7:0/1018193918 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f0674076060 msgr2=0x7f06740a52f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:06.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:06.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.079+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 zone default found 2024-09-14T11:36:06.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 4 Realm: () 2024-09-14T11:36:06.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:06.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 zonegroup default 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.080+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.081+0000 7f0687925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.081+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.081+0000 7f0687925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.081+0000 7f0687925800 20 started sync module instance, tier type = 2024-09-14T11:36:06.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.081+0000 7f0687925800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:06.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.090+0000 7f0687925800 20 add_watcher() i=0 2024-09-14T11:36:06.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.090+0000 7f0687925800 20 add_watcher() i=1 2024-09-14T11:36:06.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.090+0000 7f0687925800 20 add_watcher() i=2 2024-09-14T11:36:06.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.090+0000 7f0687925800 20 add_watcher() i=3 2024-09-14T11:36:06.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.090+0000 7f0687925800 20 add_watcher() i=4 2024-09-14T11:36:06.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.090+0000 7f0687925800 20 add_watcher() i=5 2024-09-14T11:36:06.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.090+0000 7f0687925800 20 add_watcher() i=6 2024-09-14T11:36:06.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.091+0000 7f0687925800 20 add_watcher() i=7 2024-09-14T11:36:06.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.091+0000 7f0687925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.093+0000 7f0539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.093+0000 7f0687925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.093+0000 7f0687925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.093+0000 7f0687925800 5 note: GC not initialized 2024-09-14T11:36:06.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.093+0000 7f0538fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:06.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.094+0000 7f0687925800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.094+0000 7f0687925800 20 Filter name: none 2024-09-14T11:36:06.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.094+0000 7f04b27fc640 20 reqs_thread_entry: start 2024-09-14T11:36:06.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.094+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.094+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:06.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.094+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.095+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:06.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.095+0000 7f0687925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:06.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.095+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.095+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:06.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.095+0000 7f0687925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.095+0000 7f0687925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:06.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.095+0000 7f0687925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:06.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.097+0000 7f0539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.099+0000 7f0687925800 20 remove_watcher() i=0 2024-09-14T11:36:06.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.099+0000 7f0687925800 2 removed watcher, disabling cache 2024-09-14T11:36:06.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.100+0000 7f0687925800 20 remove_watcher() i=1 2024-09-14T11:36:06.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.101+0000 7f0687925800 20 remove_watcher() i=2 2024-09-14T11:36:06.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.102+0000 7f0687925800 20 remove_watcher() i=3 2024-09-14T11:36:06.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.103+0000 7f0687925800 20 remove_watcher() i=4 2024-09-14T11:36:06.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.104+0000 7f0687925800 20 remove_watcher() i=5 2024-09-14T11:36:06.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.105+0000 7f0687925800 20 remove_watcher() i=6 2024-09-14T11:36:06.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.106+0000 7f0687925800 20 remove_watcher() i=7 2024-09-14T11:36:06.115 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:06.115 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:06.115 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-block-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:06.115 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:06.116 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:06.116 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:06.123 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:06.123 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:06.166 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:06.201 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:06.201 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:06.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.242+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.244+0000 7f29ae90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.244+0000 7f29ae90c800 20 realm 2024-09-14T11:36:06.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.244+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.244+0000 7f29ae90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.244+0000 7f29ae90c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.244+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.245+0000 7f29ae90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.245+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.245+0000 7f29ae90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.245+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.246+0000 7f29ae90c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.246+0000 7f29ae90c800 20 searching for the correct realm 2024-09-14T11:36:06.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.248+0000 7f29acbf7640 0 -- 172.21.15.7:0/1455557464 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f29a0017070 msgr2=0x7f29a0075e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.455+0000 7f29abbf5640 0 -- 172.21.15.7:0/1455557464 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f299c047040 msgr2=0x7f299c051430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.662+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 20 zone default found 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 4 Realm: () 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 20 zonegroup default 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.663+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.664+0000 7f29ae90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.664+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.664+0000 7f29ae90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.664+0000 7f29ae90c800 20 started sync module instance, tier type = 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.664+0000 7f29ae90c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.673+0000 7f29ae90c800 20 add_watcher() i=0 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.673+0000 7f29ae90c800 20 add_watcher() i=1 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.673+0000 7f29ae90c800 20 add_watcher() i=2 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.673+0000 7f29ae90c800 20 add_watcher() i=3 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.673+0000 7f29ae90c800 20 add_watcher() i=4 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.673+0000 7f29ae90c800 20 add_watcher() i=5 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.673+0000 7f29ae90c800 20 add_watcher() i=6 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.674+0000 7f29ae90c800 20 add_watcher() i=7 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.674+0000 7f29ae90c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.676+0000 7f2862fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.676+0000 7f29ae90c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.676+0000 7f29ae90c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.676+0000 7f29ae90c800 5 note: GC not initialized 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.677+0000 7f2861fdb640 20 reqs_thread_entry: start 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.677+0000 7f29ae90c800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.677+0000 7f29ae90c800 20 Filter name: none 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.677+0000 7f27d37fe640 20 reqs_thread_entry: start 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.677+0000 7f29ae90c800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.677+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 : miss 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.678+0000 7f29ae90c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.683+0000 7f29ae90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.683+0000 7f29ae90c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.683+0000 7f29ae90c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.683+0000 7f29ae90c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29, ofs0, ns] 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f2882ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94535406724816 notifier 6996 bl.length()=999 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f2882ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f2882ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f2882ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_sources= new_sources= 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_dests= new_dests= 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.684+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.1 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.1 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.2 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.2 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.3 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.3 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.4 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.4 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.5 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.5 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.6 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.6 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.7 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.7 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.8 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.8 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.9 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.9 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.10 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.10 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.11 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1.11 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.688+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.0 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.689+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.689+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.2 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.690+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.3 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.690+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.4 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.691+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.5 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.692+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.6 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.692+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.7 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.693+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.8 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.693+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.9 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.694+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.10 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.697+0000 7f29ae90c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.697+0000 7f29ae90c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.698+0000 7f29ae90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.698+0000 7f29ae90c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.698+0000 7f29ae90c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.698+0000 7f29ae90c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29, ofs0, ns] 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f28837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529739 cookie 94535406724816 notifier 6996 bl.length()=999 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f28837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f28837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f28837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_sources= new_sources= 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_dests= new_dests= 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.699+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.702+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.0 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.702+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.1 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.702+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.2 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.702+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.3 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.703+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.4 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.703+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.5 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.703+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.6 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.704+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.7 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.704+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.8 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.704+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.9 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.705+0000 7f29ae90c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29.10 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.705+0000 7f29ae90c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.706+0000 7f29ae90c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29, ofs0, ns] 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f2882ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529740 cookie 94535406724816 notifier 6996 bl.length()=967 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f2882ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 info.flags=0x17 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f2882ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 to cache LRU end 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f2882ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_sources= new_sources= 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): orig_dests= new_dests= 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.707+0000 7f29ae90c800 20 handle_bi_update(): bucket=:error-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.710+0000 7f29ae90c800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.711+0000 7f2862fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.714+0000 7f29ae90c800 20 remove_watcher() i=0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.714+0000 7f29ae90c800 2 removed watcher, disabling cache 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.715+0000 7f29ae90c800 20 remove_watcher() i=1 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.716+0000 7f29ae90c800 20 remove_watcher() i=2 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.717+0000 7f29ae90c800 20 remove_watcher() i=3 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.718+0000 7f29ae90c800 20 remove_watcher() i=4 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.719+0000 7f29ae90c800 20 remove_watcher() i=5 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.720+0000 7f29ae90c800 20 remove_watcher() i=6 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.721+0000 7f29ae90c800 20 remove_watcher() i=7 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:06.799 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.801+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.803+0000 7f330ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.803+0000 7f330ca0e800 20 realm 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.803+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.803+0000 7f330ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.803+0000 7f330ca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.803+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.804+0000 7f330ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.801 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.804+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.804+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.804+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.805+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.803 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.805+0000 7f330ca0e800 20 searching for the correct realm 2024-09-14T11:36:06.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:06.807+0000 7f330885a640 0 -- 172.21.15.7:0/2035295963 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f32fc085060 msgr2=0x7f32fc0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:07.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.013+0000 7f3307858640 0 -- 172.21.15.7:0/2035295963 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f32f8008410 msgr2=0x7f32f8008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:07.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:07.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:07.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:07.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:07.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:07.218 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:07.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.220+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 zone default found 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 4 Realm: () 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 zonegroup default 2024-09-14T11:36:07.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.221+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.222+0000 7f330ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.222+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.222+0000 7f330ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.222+0000 7f330ca0e800 20 started sync module instance, tier type = 2024-09-14T11:36:07.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.222+0000 7f330ca0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.232+0000 7f330ca0e800 20 add_watcher() i=0 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.232+0000 7f330ca0e800 20 add_watcher() i=1 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.232+0000 7f330ca0e800 20 add_watcher() i=2 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.232+0000 7f330ca0e800 20 add_watcher() i=3 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.232+0000 7f330ca0e800 20 add_watcher() i=4 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.232+0000 7f330ca0e800 20 add_watcher() i=5 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.232+0000 7f330ca0e800 20 add_watcher() i=6 2024-09-14T11:36:07.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.233+0000 7f330ca0e800 20 add_watcher() i=7 2024-09-14T11:36:07.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.233+0000 7f330ca0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:07.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.235+0000 7f31befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:07.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.235+0000 7f330ca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:07.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.235+0000 7f330ca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.235+0000 7f330ca0e800 5 note: GC not initialized 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.235+0000 7f31bdfdb640 20 reqs_thread_entry: start 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.236+0000 7f330ca0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.236+0000 7f330ca0e800 20 Filter name: none 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.236+0000 7f312f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.236+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.237+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:07.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.237+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.237+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:07.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.237+0000 7f330ca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:07.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.237+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.237+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:07.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.237+0000 7f330ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.238+0000 7f330ca0e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:07.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.238+0000 7f330ca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:07.238 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.240+0000 7f31befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:07.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.243+0000 7f330ca0e800 20 remove_watcher() i=0 2024-09-14T11:36:07.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.243+0000 7f330ca0e800 2 removed watcher, disabling cache 2024-09-14T11:36:07.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.244+0000 7f330ca0e800 20 remove_watcher() i=1 2024-09-14T11:36:07.242 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.245+0000 7f330ca0e800 20 remove_watcher() i=2 2024-09-14T11:36:07.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.246+0000 7f330ca0e800 20 remove_watcher() i=3 2024-09-14T11:36:07.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.247+0000 7f330ca0e800 20 remove_watcher() i=4 2024-09-14T11:36:07.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.248+0000 7f330ca0e800 20 remove_watcher() i=5 2024-09-14T11:36:07.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.249+0000 7f330ca0e800 20 remove_watcher() i=6 2024-09-14T11:36:07.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.250+0000 7f330ca0e800 20 remove_watcher() i=7 2024-09-14T11:36:07.260 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:07.260 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:07.260 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-block-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:07.260 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:07.262 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.262 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.265 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.266 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.309 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.309 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.337 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:36:07.338 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:07.339 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.339 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.351 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.351 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.394 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.394 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.401 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.401 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.407 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.407 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.415 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.415 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.421 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.427 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.427 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.433 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.433 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.439 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.439 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.445 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.445 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.451 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.451 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.457 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.458 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.464 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.464 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.470 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.470 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.476 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.476 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.482 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.482 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.488 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.488 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.494 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.494 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.501 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.501 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.508 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.508 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.514 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:07.514 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:07.521 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:36:07.550 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:07.550 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:07.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.592+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 20 realm 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.594+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.595+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:07.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.595+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.596+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:07.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.596+0000 7fe0b133d800 20 searching for the correct realm 2024-09-14T11:36:07.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.598+0000 7fe0ad82b640 0 -- 172.21.15.7:0/232272137 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe0a401a040 msgr2=0x7fe0a404e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:07.802 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:07.804+0000 7fe0ac829640 0 -- 172.21.15.7:0/232272137 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe0a00718f0 msgr2=0x7fe0a00820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:08.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:08.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:08.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:08.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:08.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:08.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:08.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.011+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:08.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 zone default found 2024-09-14T11:36:08.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 4 Realm: () 2024-09-14T11:36:08.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:08.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:08.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 zonegroup default 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.012+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.013+0000 7fe0b133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.013+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.013+0000 7fe0b133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.013+0000 7fe0b133d800 20 started sync module instance, tier type = 2024-09-14T11:36:08.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.013+0000 7fe0b133d800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:08.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.023+0000 7fe0b133d800 20 add_watcher() i=0 2024-09-14T11:36:08.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.023+0000 7fe0b133d800 20 add_watcher() i=1 2024-09-14T11:36:08.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.023+0000 7fe0b133d800 20 add_watcher() i=2 2024-09-14T11:36:08.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.023+0000 7fe0b133d800 20 add_watcher() i=3 2024-09-14T11:36:08.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.023+0000 7fe0b133d800 20 add_watcher() i=4 2024-09-14T11:36:08.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.023+0000 7fe0b133d800 20 add_watcher() i=5 2024-09-14T11:36:08.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.023+0000 7fe0b133d800 20 add_watcher() i=6 2024-09-14T11:36:08.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.024+0000 7fe0b133d800 20 add_watcher() i=7 2024-09-14T11:36:08.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.024+0000 7fe0b133d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:08.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.025+0000 7fdf637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fe0b133d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fe0b133d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fe0b133d800 5 note: GC not initialized 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fdf627e4640 20 reqs_thread_entry: start 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fe0b133d800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fe0b133d800 20 Filter name: none 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fded3fff640 20 reqs_thread_entry: start 2024-09-14T11:36:08.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.026+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.027+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.027+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.027+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.027+0000 7fe0b133d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.027+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.028+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.028+0000 7fe0b133d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.028+0000 7fe0b133d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:08.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.028+0000 7fe0b133d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:08.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.030+0000 7fdf637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:08.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.032+0000 7fe0b133d800 20 remove_watcher() i=0 2024-09-14T11:36:08.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.032+0000 7fe0b133d800 2 removed watcher, disabling cache 2024-09-14T11:36:08.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.033+0000 7fe0b133d800 20 remove_watcher() i=1 2024-09-14T11:36:08.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.034+0000 7fe0b133d800 20 remove_watcher() i=2 2024-09-14T11:36:08.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.035+0000 7fe0b133d800 20 remove_watcher() i=3 2024-09-14T11:36:08.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.036+0000 7fe0b133d800 20 remove_watcher() i=4 2024-09-14T11:36:08.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.037+0000 7fe0b133d800 20 remove_watcher() i=5 2024-09-14T11:36:08.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.038+0000 7fe0b133d800 20 remove_watcher() i=6 2024-09-14T11:36:08.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.039+0000 7fe0b133d800 20 remove_watcher() i=7 2024-09-14T11:36:08.048 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.049 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:08.049 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-block-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:08.049 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.050 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:36:08.085 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:08.085 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:08.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.128+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.129+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.129+0000 7fe4ac332800 20 realm 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.129+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.130+0000 7fe4ac332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.128 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:08.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.131+0000 7fe4ac332800 20 searching for the correct realm 2024-09-14T11:36:08.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.133+0000 7fe4a87bd640 0 -- 172.21.15.7:0/918160772 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe490036070 msgr2=0x7fe490050940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:08.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.339+0000 7fe49ffff640 0 -- 172.21.15.7:0/918160772 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe498045860 msgr2=0x7fe498045230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 zone default found 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 4 Realm: () 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 zonegroup default 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.548+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.548+0000 7fe4ac332800 20 started sync module instance, tier type = 2024-09-14T11:36:08.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.548+0000 7fe4ac332800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:08.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=0 2024-09-14T11:36:08.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=1 2024-09-14T11:36:08.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=2 2024-09-14T11:36:08.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=3 2024-09-14T11:36:08.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=4 2024-09-14T11:36:08.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=5 2024-09-14T11:36:08.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=6 2024-09-14T11:36:08.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.558+0000 7fe4ac332800 20 add_watcher() i=7 2024-09-14T11:36:08.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.558+0000 7fe4ac332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:08.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.560+0000 7fe35dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:08.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.560+0000 7fe4ac332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:08.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.560+0000 7fe4ac332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:08.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.560+0000 7fe4ac332800 5 note: GC not initialized 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe35cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 20 Filter name: none 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe2d67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:08.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : miss 2024-09-14T11:36:08.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.562+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:08.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.562+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.562+0000 7fe4ac332800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.562+0000 7fe4ac332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:08.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.562+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.562+0000 7fe4ac332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:08.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.567+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.567+0000 7fe4ac332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.567+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.567+0000 7fe4ac332800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94180920850816 notifier 7053 bl.length()=999 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:08.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.572+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.0 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.572+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.0 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.1 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.1 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.2 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.2 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.3 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.3 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.4 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.4 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.5 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.5 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.6 2024-09-14T11:36:08.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.6 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.7 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.7 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.8 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.8 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.9 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.9 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.10 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.10 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.11 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.11 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.0 2024-09-14T11:36:08.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1 2024-09-14T11:36:08.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.574+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2 2024-09-14T11:36:08.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.574+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.3 2024-09-14T11:36:08.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.575+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.4 2024-09-14T11:36:08.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.575+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.5 2024-09-14T11:36:08.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.576+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.6 2024-09-14T11:36:08.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.576+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.7 2024-09-14T11:36:08.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.577+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.8 2024-09-14T11:36:08.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.577+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.9 2024-09-14T11:36:08.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.578+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.10 2024-09-14T11:36:08.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.582+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:08.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.582+0000 7fe4ac332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe4ac332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe4ac332800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 94180920850816 notifier 7053 bl.length()=999 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4ac332800 time 2024-09-14T11:36:08.584642+0000 2024-09-14T11:36:08.582 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4ad98c76a] 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:36:08.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.585+0000 7fe4ac332800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4ac332800 time 2024-09-14T11:36:08.584642+0000 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4ad98c76a] 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:36:08.584 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.585 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:08.585 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fe4ac332800 thread_name:radosgw-admin 2024-09-14T11:36:08.601 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.601 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4ac63e6f0] 2024-09-14T11:36:08.601 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4ac68b99c] 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4ad98c7c4] 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.586+0000 7fe4ac332800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:08.602 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fe4ac332800 thread_name:radosgw-admin 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4ac63e6f0] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4ac68b99c] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4ad98c7c4] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.603 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:36:08.111+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:36:08.111+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key hook 0x55a83444d618 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8342c6a00 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a834397130 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a834482a40 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.604 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.667906s 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a8342c6a00 auth_method 0 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a834397130 auth_method 0 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.605 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request con 0x55a834482a40 auth_method 0 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 1 monclient: found mon.noname-c 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.606 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: dump: 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.607 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: dump: 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.608 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:36:08.112+0000 7fe4ac332800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:36:08.112+0000 7fe395e0b640 4 set_mon_vals no callback set 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:36:08.112+0000 7fe4ac332800 1 librados: init done 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:36:08.114+0000 7fe38ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:36:08.114+0000 7fe38ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:36:08.114+0000 7fe38ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:36:08.114+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe390077260 auth_method 0 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:36:08.115+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a834476450 auth_method 0 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:36:08.115+0000 7fe4a7fbc640 10 monclient: get_auth_request con 0x55a83449a410 auth_method 0 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:36:08.116+0000 7fe49ffff640 10 monclient: get_auth_request con 0x55a83449eb60 auth_method 0 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:36:08.117+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a83449e1e0 auth_method 0 2024-09-14T11:36:08.609 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:36:08.118+0000 7fe4ac332800 10 monclient: build_initial_monmap 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:36:08.118+0000 7fe4ac332800 1 build_initial for_mkfs: 0 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:36:08.118+0000 7fe4ac332800 10 monclient: monmap: 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding auth protocol: cephx 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding auth protocol: cephx 2024-09-14T11:36:08.610 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding auth protocol: cephx 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:36:08.118+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command objecter_requests cmddesc objecter_requests hook 0x55a8344aa090 EEXIST 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient: init 2024-09-14T11:36:08.611 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding auth protocol: cephx 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding auth protocol: cephx 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding auth protocol: cephx 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.612 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:36:08.119+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:36:08.119+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key cmddesc rotate-key hook 0x55a8344a5c00 EEXIST 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a8344ce3b0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8344ce790 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a8344cd0c0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.613 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.675652s 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request con 0x55a8344ce790 auth_method 0 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a8344cd0c0 auth_method 0 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a8344ce3b0 auth_method 0 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.614 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 1 monclient: found mon.noname-c 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: dump: 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.615 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: dump: 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.616 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:36:08.120+0000 7fe4ac332800 5 monclient: authenticate success, global_id 6707 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:36:08.120+0000 7fe4a8fbe640 4 set_mon_vals no callback set 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:36:08.122+0000 7fe38d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:36:08.122+0000 7fe38d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.617 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:36:08.122+0000 7fe38d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:36:08.122+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe380077140 auth_method 0 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:36:08.122+0000 7fe4ac332800 10 monclient: get_monmap_and_config 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:36:08.122+0000 7fe4ac332800 10 monclient: build_initial_monmap 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:36:08.122+0000 7fe4ac332800 1 build_initial for_mkfs: 0 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:36:08.122+0000 7fe4ac332800 10 monclient: monmap: 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:08.618 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding auth protocol: cephx 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding auth protocol: cephx 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding auth protocol: cephx 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:36:08.123+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.619 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient: init 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding auth protocol: cephx 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding auth protocol: cephx 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding auth protocol: cephx 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.620 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:36:08.123+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:36:08.123+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key cmddesc rotate-key hook 0x7fff551b3578 EEXIST 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a834522870 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8345131c0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a83451dca0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.621 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.679884s 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a83451dca0 auth_method 0 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request con 0x55a8345131c0 auth_method 0 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a834522870 auth_method 0 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.622 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_done global_id 6710 payload 274 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 1 monclient: found mon.noname-c 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: dump: 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.623 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:36:08.124+0000 7fe4ac332800 5 monclient: authenticate success, global_id 6710 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:36:08.124+0000 7fe4ac332800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:36:08.124+0000 7fe4ac332800 4 set_mon_vals no callback set 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.624 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: dump: 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:36:08.124+0000 7fe4ac332800 10 monclient: shutdown 2024-09-14T11:36:08.625 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:36:08.125+0000 7fe4ac332800 10 monclient: build_initial_monmap 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 build_initial for_mkfs: 0 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:36:08.125+0000 7fe4ac332800 10 monclient: monmap: 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding auth protocol: cephx 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding auth protocol: cephx 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding auth protocol: cephx 2024-09-14T11:36:08.626 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:36:08.125+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: starting msgr at 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: starting objecter 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command objecter_requests cmddesc objecter_requests hook 0x55a8344d04b0 EEXIST 2024-09-14T11:36:08.627 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: setting wanted keys 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: calling monclient init 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:36:08.125+0000 7fe4ac332800 10 monclient: init 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding auth protocol: cephx 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding auth protocol: cephx 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding auth protocol: cephx 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.628 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:36:08.125+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:36:08.126+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:36:08.126+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key cmddesc rotate-key hook 0x55a8344e2db8 EEXIST 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8345131c0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a83451dca0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.629 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a834522870 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.682162s 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a8345131c0 auth_method 0 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a834522870 auth_method 0 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.630 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_done global_id 7053 payload 824 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 1 monclient: found mon.noname-a 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: dump: 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.631 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: dump: 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.632 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:36:08.126+0000 7fe4ac332800 5 monclient: authenticate success, global_id 7053 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:36:08.126+0000 7fe386ffd640 4 set_mon_vals no callback set 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:36:08.126+0000 7fe4ac332800 1 librados: init done 2024-09-14T11:36:08.633 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:36:08.126+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cr dump hook 0x55a83451b218 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:36:08.128+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:36:08.128+0000 7fe3857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:36:08.128+0000 7fe3857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:36:08.128+0000 7fe3857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:36:08.129+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe370077260 auth_method 0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:36:08.129+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a83453d310 auth_method 0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:36:08.129+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:36:08.129+0000 7fe4ac332800 20 realm 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:36:08.129+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:36:08.130+0000 7fe4ac332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.634 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:36:08.130+0000 7fe49ffff640 10 monclient: get_auth_request con 0x55a834541450 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:36:08.131+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a834544d40 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 searching for the correct realm 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:36:08.132+0000 7fe4a7fbc640 10 monclient: get_auth_request con 0x55a834549a40 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:36:08.132+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe498097ab0 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:36:08.133+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x7fe490036070 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:36:08.133+0000 7fe4a87bd640 0 -- 172.21.15.7:0/918160772 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe490036070 msgr2=0x7fe490050940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:36:08.334+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x7fe490036070 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:36:08.335+0000 7fe4a7fbc640 10 monclient: get_auth_request con 0x7fe4a0081060 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:36:08.339+0000 7fe49ffff640 0 -- 172.21.15.7:0/918160772 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe498045860 msgr2=0x7fe498045230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:36:08.540+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe498045860 auth_method 0 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:08.635 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 zone default found 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:36:08.547+0000 7fe4ac332800 4 Realm: () 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:36:08.547+0000 7fe4ac332800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:36:08.547+0000 7fe4ac332800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:08.636 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:36:08.547+0000 7fe4ac332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 zonegroup default 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:36:08.548+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:36:08.548+0000 7fe4ac332800 20 started sync module instance, tier type = 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:36:08.548+0000 7fe4ac332800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=0 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=1 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=2 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=3 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=4 2024-09-14T11:36:08.637 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=5 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=6 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:36:08.558+0000 7fe4ac332800 20 add_watcher() i=7 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:36:08.558+0000 7fe4ac332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding auth protocol: cephx 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding auth protocol: cephx 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding auth protocol: cephx 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.638 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:36:08.560+0000 7fe35dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:36:08.560+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:36:08.560+0000 7fe4ac332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:36:08.560+0000 7fe4ac332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache list hook 0x55a8345187b0 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache inspect hook 0x55a8345187b0 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache erase hook 0x55a8345187b0 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache zap hook 0x55a8345187b0 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 note: GC not initialized 2024-09-14T11:36:08.639 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:36:08.561+0000 7fe35cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace show hook 0x7fe498010050 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace history hook 0x7fe498010050 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace active hook 0x7fe498010050 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace active_short hook 0x7fe498010050 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 Filter name: none 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:36:08.561+0000 7fe2d67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : miss 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.640 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:36:08.562+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94180920850816 notifier 7053 bl.length()=999 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.641 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:36:08.572+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.0 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:36:08.572+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.0 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.1 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.1 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.2 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.2 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.3 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.3 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.4 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.4 2024-09-14T11:36:08.642 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.5 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.5 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.6 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.6 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.7 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.7 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.8 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.8 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.9 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.9 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.10 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.10 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.11 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.11 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.0 2024-09-14T11:36:08.643 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:36:08.574+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:36:08.574+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.3 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:36:08.575+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.4 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:36:08.575+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.5 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:36:08.576+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.6 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:36:08.576+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.7 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:36:08.577+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.8 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:36:08.577+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.9 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:36:08.578+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.10 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:36:08.582+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:36:08.582+0000 7fe4ac332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.644 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 94180920850816 notifier 7053 bl.length()=999 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:36:08.585+0000 7fe4ac332800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4ac332800 time 2024-09-14T11:36:08.584642+0000 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4ad98c76a] 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.645 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:36:08.586+0000 7fe4ac332800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fe4ac332800 thread_name:radosgw-admin 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4ac63e6f0] 2024-09-14T11:36:08.646 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4ac68b99c] 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4ad98c7c4] 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:36:08.647 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:36:08.648 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:36:08.649 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:36:08.650 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:36:08.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:08.652 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:08.653 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe2d67fc640 / http_manager 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe35cfe1640 / http_manager 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe35dfe3640 / rgw_dt_lg_renew 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe3857fa640 / ms_dispatch 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe386ffd640 / io_context_pool 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe38d7fa640 / ms_dispatch 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe38ffff640 / ms_dispatch 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe395e0b640 / io_context_pool 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe49ffff640 / msgr-worker-2 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4a7fbc640 / msgr-worker-1 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4a87bd640 / msgr-worker-0 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4a8fbe640 / io_context_pool 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4ac332800 / radosgw-admin 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:36:08.654 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.113322.log 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:36:08.111+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:36:08.111+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key hook 0x55a83444d618 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8342c6a00 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a834397130 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a834482a40 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:36:08.111+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.667906s 2024-09-14T11:36:08.655 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a8342c6a00 auth_method 0 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a834397130 auth_method 0 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.656 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:36:08.112+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request con 0x55a834482a40 auth_method 0 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:36:08.112+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 1 monclient: found mon.noname-c 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:36:08.112+0000 7fe4a7fbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:08.657 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: dump: 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.658 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:36:08.112+0000 7fe38ffff640 10 monclient: dump: 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.659 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:36:08.112+0000 7fe4ac332800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:36:08.112+0000 7fe395e0b640 4 set_mon_vals no callback set 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:36:08.112+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:36:08.112+0000 7fe4ac332800 1 librados: init done 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:36:08.114+0000 7fe38ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:36:08.114+0000 7fe38ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:36:08.114+0000 7fe38ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:36:08.114+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe390077260 auth_method 0 2024-09-14T11:36:08.660 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:36:08.115+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a834476450 auth_method 0 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:36:08.115+0000 7fe4a7fbc640 10 monclient: get_auth_request con 0x55a83449a410 auth_method 0 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:36:08.116+0000 7fe49ffff640 10 monclient: get_auth_request con 0x55a83449eb60 auth_method 0 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:36:08.117+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a83449e1e0 auth_method 0 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:36:08.118+0000 7fe4ac332800 10 monclient: build_initial_monmap 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:36:08.118+0000 7fe4ac332800 1 build_initial for_mkfs: 0 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:36:08.118+0000 7fe4ac332800 10 monclient: monmap: 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:08.661 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding auth protocol: cephx 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding auth protocol: cephx 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding auth protocol: cephx 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: crc 2024-09-14T11:36:08.662 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a6bc0) adding con mode: secure 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:36:08.118+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:36:08.118+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command objecter_requests cmddesc objecter_requests hook 0x55a8344aa090 EEXIST 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient: init 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding auth protocol: cephx 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding auth protocol: cephx 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding auth protocol: cephx 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.663 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: crc 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 AuthRegistry(0x55a8344a5ab8) adding con mode: secure 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:36:08.119+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:36:08.119+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:36:08.119+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key cmddesc rotate-key hook 0x55a8344a5c00 EEXIST 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a8344ce3b0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8344ce790 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a8344cd0c0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.664 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:36:08.119+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.675652s 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request con 0x55a8344ce790 auth_method 0 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a8344cd0c0 auth_method 0 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a8344ce3b0 auth_method 0 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.665 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:36:08.119+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:36:08.119+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:36:08.119+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 1 monclient: found mon.noname-c 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:36:08.120+0000 7fe4a87bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:08.666 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: dump: 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.667 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:36:08.120+0000 7fe38d7fa640 10 monclient: dump: 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:36:08.120+0000 7fe4ac332800 5 monclient: authenticate success, global_id 6707 2024-09-14T11:36:08.668 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:36:08.120+0000 7fe4a8fbe640 4 set_mon_vals no callback set 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:36:08.120+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:36:08.122+0000 7fe38d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:36:08.122+0000 7fe38d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:36:08.122+0000 7fe38d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:36:08.122+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe380077140 auth_method 0 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:36:08.122+0000 7fe4ac332800 10 monclient: get_monmap_and_config 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:36:08.122+0000 7fe4ac332800 10 monclient: build_initial_monmap 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:36:08.122+0000 7fe4ac332800 1 build_initial for_mkfs: 0 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:36:08.122+0000 7fe4ac332800 10 monclient: monmap: 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:08.669 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding auth protocol: cephx 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding auth protocol: cephx 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding auth protocol: cephx 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.670 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: crc 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:36:08.122+0000 7fe4ac332800 5 AuthRegistry(0x55a8344ee250) adding con mode: secure 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:36:08.123+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient: init 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding auth protocol: cephx 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding auth protocol: cephx 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding auth protocol: cephx 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.671 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: crc 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3430) adding con mode: secure 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:36:08.123+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:36:08.123+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:36:08.123+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key cmddesc rotate-key hook 0x7fff551b3578 EEXIST 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a834522870 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8345131c0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.672 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a83451dca0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:36:08.123+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.679884s 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a83451dca0 auth_method 0 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request con 0x55a8345131c0 auth_method 0 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.673 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a834522870 auth_method 0 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:36:08.124+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:36:08.124+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient(hunting): handle_auth_done global_id 6710 payload 274 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.674 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 1 monclient: found mon.noname-c 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:36:08.124+0000 7fe4a87bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: dump: 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.675 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:36:08.124+0000 7fe4ac332800 5 monclient: authenticate success, global_id 6710 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:36:08.124+0000 7fe4ac332800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:36:08.124+0000 7fe4ac332800 4 set_mon_vals no callback set 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:36:08.124+0000 7fe386ffd640 10 monclient: dump: 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:36:08.124+0000 7fe4ac332800 10 monclient: shutdown 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:36:08.125+0000 7fe4ac332800 10 monclient: build_initial_monmap 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 build_initial for_mkfs: 0 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:36:08.125+0000 7fe4ac332800 10 monclient: monmap: 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:08.677 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding auth protocol: cephx 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding auth protocol: cephx 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding auth protocol: cephx 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: crc 2024-09-14T11:36:08.678 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344f1dd0) adding con mode: secure 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:36:08.125+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: starting msgr at 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: starting objecter 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command objecter_requests cmddesc objecter_requests hook 0x55a8344d04b0 EEXIST 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: setting wanted keys 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:36:08.125+0000 7fe4ac332800 1 librados: calling monclient init 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:36:08.125+0000 7fe4ac332800 10 monclient: init 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding auth protocol: cephx 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding auth protocol: cephx 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding auth protocol: cephx 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.679 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: crc 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:36:08.125+0000 7fe4ac332800 5 AuthRegistry(0x55a8344e2c70) adding con mode: secure 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:36:08.125+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:36:08.126+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:36:08.126+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command rotate-key cmddesc rotate-key hook 0x55a8344e2db8 EEXIST 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-c con 0x55a8345131c0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-b con 0x55a83451dca0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): picked mon.noname-a con 0x55a834522870 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:08.680 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient(hunting): authenticate will time out at 2068.682162s 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): get_auth_request con 0x55a8345131c0 auth_method 0 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request con 0x55a834522870 auth_method 0 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:36:08.126+0000 7fe49ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.681 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient(hunting): handle_auth_done global_id 7053 payload 824 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient: _finish_hunting 0 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 1 monclient: found mon.noname-a 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:36:08.126+0000 7fe4a7fbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: dump: 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.682 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:36:08.126+0000 7fe3857fa640 10 monclient: dump: 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:08.683 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:36:08.126+0000 7fe4ac332800 5 monclient: authenticate success, global_id 7053 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:36:08.126+0000 7fe386ffd640 4 set_mon_vals no callback set 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _renew_subs 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:36:08.126+0000 7fe4ac332800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:36:08.126+0000 7fe4ac332800 1 librados: init done 2024-09-14T11:36:08.684 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:36:08.126+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cr dump hook 0x55a83451b218 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:36:08.128+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:36:08.128+0000 7fe3857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:36:08.128+0000 7fe3857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:36:08.128+0000 7fe3857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:36:08.129+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe370077260 auth_method 0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:36:08.129+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a83453d310 auth_method 0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:36:08.129+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:36:08.129+0000 7fe4ac332800 20 realm 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:36:08.129+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:36:08.130+0000 7fe4ac332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:36:08.130+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.685 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:36:08.130+0000 7fe49ffff640 10 monclient: get_auth_request con 0x55a834541450 auth_method 0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:36:08.131+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x55a834544d40 auth_method 0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:36:08.131+0000 7fe4ac332800 20 searching for the correct realm 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:36:08.132+0000 7fe4a7fbc640 10 monclient: get_auth_request con 0x55a834549a40 auth_method 0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:36:08.132+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe498097ab0 auth_method 0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:36:08.133+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x7fe490036070 auth_method 0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:36:08.133+0000 7fe4a87bd640 0 -- 172.21.15.7:0/918160772 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe490036070 msgr2=0x7fe490050940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:36:08.334+0000 7fe4a87bd640 10 monclient: get_auth_request con 0x7fe490036070 auth_method 0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:36:08.335+0000 7fe4a7fbc640 10 monclient: get_auth_request con 0x7fe4a0081060 auth_method 0 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:36:08.339+0000 7fe49ffff640 0 -- 172.21.15.7:0/918160772 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe498045860 msgr2=0x7fe498045230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:08.686 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:36:08.540+0000 7fe49ffff640 10 monclient: get_auth_request con 0x7fe498045860 auth_method 0 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:36:08.546+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 zone default found 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:36:08.547+0000 7fe4ac332800 4 Realm: () 2024-09-14T11:36:08.687 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:36:08.547+0000 7fe4ac332800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:36:08.547+0000 7fe4ac332800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:36:08.547+0000 7fe4ac332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 zonegroup default 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:36:08.547+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:36:08.548+0000 7fe4ac332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:36:08.548+0000 7fe4ac332800 20 started sync module instance, tier type = 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:36:08.548+0000 7fe4ac332800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=0 2024-09-14T11:36:08.688 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=1 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=2 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=3 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=4 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=5 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:36:08.557+0000 7fe4ac332800 20 add_watcher() i=6 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:36:08.558+0000 7fe4ac332800 20 add_watcher() i=7 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:36:08.558+0000 7fe4ac332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding auth protocol: cephx 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding auth protocol: cephx 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding auth protocol: cephx 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.689 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:36:08.560+0000 7fe35dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: crc 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 AuthRegistry(0x7fff551b3910) adding con mode: secure 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:36:08.560+0000 7fe4ac332800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:36:08.560+0000 7fe4ac332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:36:08.560+0000 7fe4ac332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache list hook 0x55a8345187b0 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache inspect hook 0x55a8345187b0 2024-09-14T11:36:08.690 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache erase hook 0x55a8345187b0 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command cache zap hook 0x55a8345187b0 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:36:08.560+0000 7fe4ac332800 5 note: GC not initialized 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:36:08.561+0000 7fe35cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace show hook 0x7fe498010050 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace history hook 0x7fe498010050 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace active hook 0x7fe498010050 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:36:08.561+0000 7fe4ac332800 5 asok(0x55a83422e270) register_command sync trace active_short hook 0x7fe498010050 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 Filter name: none 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:36:08.561+0000 7fe2d67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:08.691 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:36:08.561+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : miss 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:36:08.561+0000 7fe4ac332800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:36:08.562+0000 7fe4ac332800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:36:08.562+0000 7fe4ac332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:36:08.567+0000 7fe4ac332800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94180920850816 notifier 7053 bl.length()=999 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:36:08.568+0000 7fe386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.692 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:36:08.568+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:36:08.572+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.0 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:36:08.572+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.0 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.1 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.1 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.2 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.2 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.3 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.3 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.4 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.4 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.5 2024-09-14T11:36:08.693 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.5 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.6 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.6 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.7 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.7 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.8 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.8 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.9 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.9 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.10 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.10 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:36:08.573+0000 7fe4ac332800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.11 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1.11 2024-09-14T11:36:08.694 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.0 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:36:08.573+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:36:08.574+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:36:08.574+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.3 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:36:08.575+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.4 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:36:08.575+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.5 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:36:08.576+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.6 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:36:08.576+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.7 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:36:08.577+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.8 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:36:08.577+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.9 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:36:08.578+0000 7fe4ac332800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.10 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:36:08.582+0000 7fe4ac332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:36:08.582+0000 7fe4ac332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.695 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:36:08.583+0000 7fe4ac332800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 94180920850816 notifier 7053 bl.length()=999 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:36:08.583+0000 7fe386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:36:08.584+0000 7fe4ac332800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:36:08.585+0000 7fe4ac332800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe4ac332800 time 2024-09-14T11:36:08.584642+0000 2024-09-14T11:36:08.696 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe4ad98c76a] 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:36:08.697 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:36:08.586+0000 7fe4ac332800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fe4ac332800 thread_name:radosgw-admin 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe4ac63e6f0] 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe4ac68b99c] 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe4ad98c7c4] 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe4ad98c928] 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a83279e0b1] 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a8327ad18e] 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a8327adfc4] 2024-09-14T11:36:08.698 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe4ac629590] 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:36:08.699 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:08.700 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:36:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:36:08.702 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:36:08.703 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:36:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe2d67fc640 / http_manager 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe35cfe1640 / http_manager 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe35dfe3640 / rgw_dt_lg_renew 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe3857fa640 / ms_dispatch 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe386ffd640 / io_context_pool 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe38d7fa640 / ms_dispatch 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe38ffff640 / ms_dispatch 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe395e0b640 / io_context_pool 2024-09-14T11:36:08.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe49ffff640 / msgr-worker-2 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4a7fbc640 / msgr-worker-1 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4a87bd640 / msgr-worker-0 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4a8fbe640 / io_context_pool 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr: 7fe4ac332800 / radosgw-admin 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:08.586435Z_27193ddd-c644-43a5-aa2e-a8667a93da9f/log 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:36:08.706 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:36:08.707 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:08.707 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:08.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.664+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.666+0000 7fd00ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.666+0000 7fd00ca0e800 20 realm 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.666+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.666+0000 7fd00ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.666+0000 7fd00ca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.666+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.667+0000 7fd00ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.667+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.667+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.667+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.668+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.668+0000 7fd00ca0e800 20 searching for the correct realm 2024-09-14T11:36:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.670+0000 7fd008a1b640 0 -- 172.21.15.7:0/3262732459 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fcff001c5b0 msgr2=0x7fcff00a9130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:08.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:08.876+0000 7fd007a19640 0 -- 172.21.15.7:0/3262732459 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fcff803e430 msgr2=0x7fcff803e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:09.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.082+0000 7fd00ca0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:09.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.082+0000 7fd00ca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:09.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.082+0000 7fd00ca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:09.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.082+0000 7fd00ca0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:09.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.082+0000 7fd00ca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:09.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.082+0000 7fd00ca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:09.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.082+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:09.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:09.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 20 zone default found 2024-09-14T11:36:09.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 4 Realm: () 2024-09-14T11:36:09.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:09.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.083+0000 7fd00ca0e800 20 zonegroup default 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 started sync module instance, tier type = 2024-09-14T11:36:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.084+0000 7fd00ca0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:09.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.094+0000 7fd00ca0e800 20 add_watcher() i=0 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.094+0000 7fd00ca0e800 20 add_watcher() i=1 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.094+0000 7fd00ca0e800 20 add_watcher() i=2 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.094+0000 7fd00ca0e800 20 add_watcher() i=3 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.094+0000 7fd00ca0e800 20 add_watcher() i=4 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.094+0000 7fd00ca0e800 20 add_watcher() i=5 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.094+0000 7fd00ca0e800 20 add_watcher() i=6 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.095+0000 7fd00ca0e800 20 add_watcher() i=7 2024-09-14T11:36:09.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.095+0000 7fd00ca0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:09.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.097+0000 7fcebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:09.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.097+0000 7fd00ca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:09.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.097+0000 7fd00ca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:09.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.097+0000 7fd00ca0e800 5 note: GC not initialized 2024-09-14T11:36:09.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.097+0000 7fcebdfdb640 20 reqs_thread_entry: start 2024-09-14T11:36:09.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.097+0000 7fd00ca0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:09.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.098+0000 7fd00ca0e800 20 Filter name: none 2024-09-14T11:36:09.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.098+0000 7fce2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:09.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.098+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.098+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:09.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.098+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.099+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:36:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.099+0000 7fd00ca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.099+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.099+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.099+0000 7fd00ca0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.099+0000 7fd00ca0e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:36:09.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.099+0000 7fd00ca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:09.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.101+0000 7fcebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:09.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.103+0000 7fd00ca0e800 20 remove_watcher() i=0 2024-09-14T11:36:09.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.103+0000 7fd00ca0e800 2 removed watcher, disabling cache 2024-09-14T11:36:09.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.105+0000 7fd00ca0e800 20 remove_watcher() i=1 2024-09-14T11:36:09.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.106+0000 7fd00ca0e800 20 remove_watcher() i=2 2024-09-14T11:36:09.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.107+0000 7fd00ca0e800 20 remove_watcher() i=3 2024-09-14T11:36:09.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.108+0000 7fd00ca0e800 20 remove_watcher() i=4 2024-09-14T11:36:09.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.109+0000 7fd00ca0e800 20 remove_watcher() i=5 2024-09-14T11:36:09.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.110+0000 7fd00ca0e800 20 remove_watcher() i=6 2024-09-14T11:36:09.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.111+0000 7fd00ca0e800 20 remove_watcher() i=7 2024-09-14T11:36:09.120 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:09.120 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:09.120 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-block-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:09.120 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:09.122 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:09.122 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:09.129 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:09.129 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:09.173 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:09.205 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:09.206 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:09.246 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.248+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 20 realm 2024-09-14T11:36:09.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:09.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.250+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.251+0000 7f536dc98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:09.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.251+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.252+0000 7f536dc98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:09.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.252+0000 7f536dc98800 20 searching for the correct realm 2024-09-14T11:36:09.253 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.255+0000 7f536b782640 0 -- 172.21.15.7:0/2709679814 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f536408d040 msgr2=0x7f53640475e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:09.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.461+0000 7f536b782640 0 -- 172.21.15.7:0/2709679814 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f536408d040 msgr2=0x7f53640475e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.465+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:09.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 zone default found 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 4 Realm: () 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 zonegroup default 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.466+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.467+0000 7f536dc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.467+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.467+0000 7f536dc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:09.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.467+0000 7f536dc98800 20 started sync module instance, tier type = 2024-09-14T11:36:09.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.467+0000 7f536dc98800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.478+0000 7f536dc98800 20 add_watcher() i=0 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.478+0000 7f536dc98800 20 add_watcher() i=1 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.478+0000 7f536dc98800 20 add_watcher() i=2 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.478+0000 7f536dc98800 20 add_watcher() i=3 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.478+0000 7f536dc98800 20 add_watcher() i=4 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.478+0000 7f536dc98800 20 add_watcher() i=5 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.478+0000 7f536dc98800 20 add_watcher() i=6 2024-09-14T11:36:09.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.479+0000 7f536dc98800 20 add_watcher() i=7 2024-09-14T11:36:09.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.479+0000 7f536dc98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:09.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.481+0000 7f5221fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:09.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.481+0000 7f536dc98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:09.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.481+0000 7f536dc98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:09.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.481+0000 7f536dc98800 5 note: GC not initialized 2024-09-14T11:36:09.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.481+0000 7f5220fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:09.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.481+0000 7f536dc98800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:09.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.481+0000 7f536dc98800 20 Filter name: none 2024-09-14T11:36:09.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f519a7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:09.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:09.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : miss 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:09.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.482+0000 7f536dc98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:09.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.484+0000 7f536dc98800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to be held by another RGW process; skipping for now 2024-09-14T11:36:09.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.484+0000 7f5221fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:09.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.487+0000 7f536dc98800 20 remove_watcher() i=0 2024-09-14T11:36:09.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.487+0000 7f536dc98800 2 removed watcher, disabling cache 2024-09-14T11:36:09.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.488+0000 7f536dc98800 20 remove_watcher() i=1 2024-09-14T11:36:09.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.489+0000 7f536dc98800 20 remove_watcher() i=2 2024-09-14T11:36:09.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.491+0000 7f536dc98800 20 remove_watcher() i=3 2024-09-14T11:36:09.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.492+0000 7f536dc98800 20 remove_watcher() i=4 2024-09-14T11:36:09.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.493+0000 7f536dc98800 20 remove_watcher() i=5 2024-09-14T11:36:09.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.494+0000 7f536dc98800 20 remove_watcher() i=6 2024-09-14T11:36:09.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:09.495+0000 7f536dc98800 20 remove_watcher() i=7 2024-09-14T11:36:09.503 INFO:tasks.workunit.client.0.smithi007.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:36:39.536 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:39.573 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:39.573 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:39.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.623+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 20 realm 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.625+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.626+0000 7fb72aa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.626+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.627+0000 7fb72aa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:39.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.627+0000 7fb72aa0e800 20 searching for the correct realm 2024-09-14T11:36:39.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.629+0000 7fb72685a640 0 -- 172.21.15.7:0/1425120349 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fb71c090020 msgr2=0x7fb71c0c7380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:39.835+0000 7fb725858640 0 -- 172.21.15.7:0/1425120349 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fb71804e150 msgr2=0x7fb71806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.043+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:40.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 zone default found 2024-09-14T11:36:40.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 4 Realm: () 2024-09-14T11:36:40.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:40.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 zonegroup default 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.044+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.045+0000 7fb72aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.045+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.045+0000 7fb72aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.045+0000 7fb72aa0e800 20 started sync module instance, tier type = 2024-09-14T11:36:40.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.045+0000 7fb72aa0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:40.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.057+0000 7fb72aa0e800 20 add_watcher() i=0 2024-09-14T11:36:40.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.057+0000 7fb72aa0e800 20 add_watcher() i=1 2024-09-14T11:36:40.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.057+0000 7fb72aa0e800 20 add_watcher() i=2 2024-09-14T11:36:40.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.057+0000 7fb72aa0e800 20 add_watcher() i=3 2024-09-14T11:36:40.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.057+0000 7fb72aa0e800 20 add_watcher() i=4 2024-09-14T11:36:40.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.057+0000 7fb72aa0e800 20 add_watcher() i=5 2024-09-14T11:36:40.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.057+0000 7fb72aa0e800 20 add_watcher() i=6 2024-09-14T11:36:40.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.058+0000 7fb72aa0e800 20 add_watcher() i=7 2024-09-14T11:36:40.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.058+0000 7fb72aa0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:40.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.060+0000 7fb5dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.060+0000 7fb72aa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.060+0000 7fb72aa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.060+0000 7fb72aa0e800 5 note: GC not initialized 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.061+0000 7fb5577fe640 20 reqs_thread_entry: start 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.061+0000 7fb72aa0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.061+0000 7fb72aa0e800 20 Filter name: none 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.061+0000 7fb5557fa640 20 reqs_thread_entry: start 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.061+0000 7fb72aa0e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:40.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.061+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : miss 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:40.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.062+0000 7fb72aa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:40.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.064+0000 7fb72aa0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:40.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.075+0000 7fb72aa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:40.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.075+0000 7fb72aa0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:40.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.075+0000 7fb72aa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:40.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.075+0000 7fb72aa0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb6097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529702 cookie 93930054698128 notifier 6764 bl.length()=999 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb6097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb6097fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb6097fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:40.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.076+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.0 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.0 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.1 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.1 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.2 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.2 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.3 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.3 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.4 2024-09-14T11:36:40.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.4 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.5 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.5 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.6 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.6 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.7 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.7 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.8 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.8 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.9 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.9 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.10 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.10 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.11 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2.11 2024-09-14T11:36:40.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.082+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.0 2024-09-14T11:36:40.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.083+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1 2024-09-14T11:36:40.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.084+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2 2024-09-14T11:36:40.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.084+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.3 2024-09-14T11:36:40.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.085+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.4 2024-09-14T11:36:40.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.086+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.5 2024-09-14T11:36:40.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.086+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.6 2024-09-14T11:36:40.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.087+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.7 2024-09-14T11:36:40.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.088+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.8 2024-09-14T11:36:40.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.088+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.9 2024-09-14T11:36:40.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.089+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.10 2024-09-14T11:36:40.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.093+0000 7fb72aa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:40.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.093+0000 7fb72aa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb72aa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb72aa0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb72aa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb72aa0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb609ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 93930054698128 notifier 6764 bl.length()=999 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb609ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb609ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:40.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.094+0000 7fb609ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:40.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.095+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:40.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.095+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:40.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.095+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:40.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.095+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:40.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.097+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.0 2024-09-14T11:36:40.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.098+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.1 2024-09-14T11:36:40.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.098+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.2 2024-09-14T11:36:40.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.098+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.3 2024-09-14T11:36:40.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.099+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.4 2024-09-14T11:36:40.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.099+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.5 2024-09-14T11:36:40.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.100+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.6 2024-09-14T11:36:40.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.100+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.7 2024-09-14T11:36:40.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.100+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.8 2024-09-14T11:36:40.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.101+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.9 2024-09-14T11:36:40.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.101+0000 7fb72aa0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30.10 2024-09-14T11:36:40.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.102+0000 7fb72aa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:40.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.102+0000 7fb72aa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 2024-09-14T11:36:40.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb72aa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:40.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb72aa0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:40.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb72aa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:40.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb72aa0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30, ofs0, ns] 2024-09-14T11:36:40.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb609ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529704 cookie 93930054698128 notifier 6764 bl.length()=967 2024-09-14T11:36:40.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb609ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 info.flags=0x17 2024-09-14T11:36:40.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb609ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 to cache LRU end 2024-09-14T11:36:40.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.103+0000 7fb609ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:40.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.104+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_sources= new_sources= 2024-09-14T11:36:40.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.104+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential sources added=[] removed=[] 2024-09-14T11:36:40.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.104+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): orig_dests= new_dests= 2024-09-14T11:36:40.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.104+0000 7fb72aa0e800 20 handle_bi_update(): bucket=:abort-at-block-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30]): potential dests added=[] removed=[] 2024-09-14T11:36:40.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.106+0000 7fb72aa0e800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:40.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.108+0000 7fb5dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.111+0000 7fb72aa0e800 20 remove_watcher() i=0 2024-09-14T11:36:40.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.111+0000 7fb72aa0e800 2 removed watcher, disabling cache 2024-09-14T11:36:40.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.112+0000 7fb72aa0e800 20 remove_watcher() i=1 2024-09-14T11:36:40.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.113+0000 7fb72aa0e800 20 remove_watcher() i=2 2024-09-14T11:36:40.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.114+0000 7fb72aa0e800 20 remove_watcher() i=3 2024-09-14T11:36:40.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.115+0000 7fb72aa0e800 20 remove_watcher() i=4 2024-09-14T11:36:40.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.116+0000 7fb72aa0e800 20 remove_watcher() i=5 2024-09-14T11:36:40.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.117+0000 7fb72aa0e800 20 remove_watcher() i=6 2024-09-14T11:36:40.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.118+0000 7fb72aa0e800 20 remove_watcher() i=7 2024-09-14T11:36:40.130 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:36:40.161 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:40.161 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:40.203 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.204+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 20 realm 2024-09-14T11:36:40.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:40.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.206+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.207+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.206 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.207+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.208+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.208+0000 7f0e3bd2e800 20 searching for the correct realm 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.209+0000 7f0e372dc640 0 -- 172.21.15.7:0/3738838614 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f0e2806f030 msgr2=0x7f0e28072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:40.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.414+0000 7f0e382de640 0 -- 172.21.15.7:0/3738838614 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0e2c0b3040 msgr2=0x7f0e2c0ab410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:40.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.420+0000 7f0e3bd2e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.420+0000 7f0e3bd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.420+0000 7f0e3bd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.420+0000 7f0e3bd2e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.420+0000 7f0e3bd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.420+0000 7f0e3bd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.420+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:40.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 zone default found 2024-09-14T11:36:40.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 4 Realm: () 2024-09-14T11:36:40.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 zonegroup default 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.421+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.422+0000 7f0e3bd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.422+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.422+0000 7f0e3bd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.422+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.422+0000 7f0e3bd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.422+0000 7f0e3bd2e800 20 started sync module instance, tier type = 2024-09-14T11:36:40.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.422+0000 7f0e3bd2e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:40.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.431+0000 7f0e3bd2e800 20 add_watcher() i=0 2024-09-14T11:36:40.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.431+0000 7f0e3bd2e800 20 add_watcher() i=1 2024-09-14T11:36:40.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.431+0000 7f0e3bd2e800 20 add_watcher() i=2 2024-09-14T11:36:40.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.431+0000 7f0e3bd2e800 20 add_watcher() i=3 2024-09-14T11:36:40.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.431+0000 7f0e3bd2e800 20 add_watcher() i=4 2024-09-14T11:36:40.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.431+0000 7f0e3bd2e800 20 add_watcher() i=5 2024-09-14T11:36:40.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.431+0000 7f0e3bd2e800 20 add_watcher() i=6 2024-09-14T11:36:40.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.432+0000 7f0e3bd2e800 20 add_watcher() i=7 2024-09-14T11:36:40.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.432+0000 7f0e3bd2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:40.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.434+0000 7f0cedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.434+0000 7f0e3bd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.434+0000 7f0e3bd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.434+0000 7f0e3bd2e800 5 note: GC not initialized 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.435+0000 7f0cecfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.435+0000 7f0e3bd2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.435+0000 7f0e3bd2e800 20 Filter name: none 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.435+0000 7f0c667fc640 20 reqs_thread_entry: start 2024-09-14T11:36:40.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.435+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.435+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:40.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.435+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.436+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:40.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.436+0000 7f0e3bd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:40.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.436+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.436+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:36:40.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.436+0000 7f0e3bd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.437+0000 7f0e3bd2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:36:40.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.437+0000 7f0e3bd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:40.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.439+0000 7f0cedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.442+0000 7f0e3bd2e800 20 remove_watcher() i=0 2024-09-14T11:36:40.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.442+0000 7f0e3bd2e800 2 removed watcher, disabling cache 2024-09-14T11:36:40.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.443+0000 7f0e3bd2e800 20 remove_watcher() i=1 2024-09-14T11:36:40.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.444+0000 7f0e3bd2e800 20 remove_watcher() i=2 2024-09-14T11:36:40.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.445+0000 7f0e3bd2e800 20 remove_watcher() i=3 2024-09-14T11:36:40.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.446+0000 7f0e3bd2e800 20 remove_watcher() i=4 2024-09-14T11:36:40.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.447+0000 7f0e3bd2e800 20 remove_watcher() i=5 2024-09-14T11:36:40.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.448+0000 7f0e3bd2e800 20 remove_watcher() i=6 2024-09-14T11:36:40.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.449+0000 7f0e3bd2e800 20 remove_watcher() i=7 2024-09-14T11:36:40.458 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:40.459 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:40.459 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-block-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:40.459 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:40.460 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.460 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.464 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.464 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.507 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.507 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.538 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:36:40.538 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:40.540 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.540 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.553 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.553 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.596 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.596 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.604 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.604 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.610 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.610 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.616 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.616 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.622 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.622 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.628 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.628 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.633 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.633 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.640 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.640 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.646 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.646 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.651 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.652 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.658 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.658 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.665 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.665 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.671 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.671 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.676 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.676 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.683 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.683 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.690 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.690 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.695 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.696 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.702 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.702 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.708 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.708 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.714 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:40.714 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:40.721 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:40.750 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:40.750 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:40.789 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.791+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 20 realm 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.792 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.793+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.794+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.794+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.795+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:40.793 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.795+0000 7f2557f25800 20 searching for the correct realm 2024-09-14T11:36:40.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:40.796+0000 7f25543af640 0 -- 172.21.15.7:0/334069254 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f254801f040 msgr2=0x7f254808b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.002+0000 7f25533ad640 0 -- 172.21.15.7:0/334069254 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f254406d040 msgr2=0x7f2544061400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.208+0000 7f2557f25800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.208+0000 7f2557f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.208+0000 7f2557f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.208+0000 7f2557f25800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.208+0000 7f2557f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.208+0000 7f2557f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.208+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.209+0000 7f2557f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.209+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.209+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.209+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 zone default found 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 4 Realm: () 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 zonegroup default 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 started sync module instance, tier type = 2024-09-14T11:36:41.211 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.210+0000 7f2557f25800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.220+0000 7f2557f25800 20 add_watcher() i=0 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.220+0000 7f2557f25800 20 add_watcher() i=1 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.220+0000 7f2557f25800 20 add_watcher() i=2 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.220+0000 7f2557f25800 20 add_watcher() i=3 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.220+0000 7f2557f25800 20 add_watcher() i=4 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.220+0000 7f2557f25800 20 add_watcher() i=5 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.220+0000 7f2557f25800 20 add_watcher() i=6 2024-09-14T11:36:41.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.221+0000 7f2557f25800 20 add_watcher() i=7 2024-09-14T11:36:41.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.221+0000 7f2557f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:41.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.222+0000 7f2409fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f2557f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f2557f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f2557f25800 5 note: GC not initialized 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f2408fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f2557f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f2557f25800 20 Filter name: none 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f23827fc640 20 reqs_thread_entry: start 2024-09-14T11:36:41.222 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.223+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.224+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:41.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.224+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.225+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:41.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.225+0000 7f2557f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:41.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.225+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.225+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:41.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.225+0000 7f2557f25800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.225+0000 7f2557f25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:41.225 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.225+0000 7f2557f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:41.226 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.227+0000 7f2409fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.229+0000 7f2557f25800 20 remove_watcher() i=0 2024-09-14T11:36:41.228 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.229+0000 7f2557f25800 2 removed watcher, disabling cache 2024-09-14T11:36:41.229 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.231+0000 7f2557f25800 20 remove_watcher() i=1 2024-09-14T11:36:41.230 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.232+0000 7f2557f25800 20 remove_watcher() i=2 2024-09-14T11:36:41.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.233+0000 7f2557f25800 20 remove_watcher() i=3 2024-09-14T11:36:41.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.234+0000 7f2557f25800 20 remove_watcher() i=4 2024-09-14T11:36:41.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.235+0000 7f2557f25800 20 remove_watcher() i=5 2024-09-14T11:36:41.235 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.236+0000 7f2557f25800 20 remove_watcher() i=6 2024-09-14T11:36:41.236 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.237+0000 7f2557f25800 20 remove_watcher() i=7 2024-09-14T11:36:41.247 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:41.247 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:41.247 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:41.247 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:41.248 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:36:41.284 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:41.284 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:41.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.325+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 20 realm 2024-09-14T11:36:41.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:41.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.327+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.328+0000 7fc8ae92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.328+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.329+0000 7fc8ae92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:41.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.329+0000 7fc8ae92c800 20 searching for the correct realm 2024-09-14T11:36:41.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.331+0000 7fc8aad3f640 0 -- 172.21.15.7:0/2096901569 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc8a0096070 msgr2=0x7fc8a007d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.335+0000 7fc8a9d3d640 0 -- 172.21.15.7:0/2096901569 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc89c06a4d0 msgr2=0x7fc89c046b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.541+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 zone default found 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 4 Realm: () 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 zonegroup default 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.542+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.543+0000 7fc8ae92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.543+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.543+0000 7fc8ae92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.543+0000 7fc8ae92c800 20 started sync module instance, tier type = 2024-09-14T11:36:41.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.543+0000 7fc8ae92c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.552+0000 7fc8ae92c800 20 add_watcher() i=0 2024-09-14T11:36:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.552+0000 7fc8ae92c800 20 add_watcher() i=1 2024-09-14T11:36:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.552+0000 7fc8ae92c800 20 add_watcher() i=2 2024-09-14T11:36:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.552+0000 7fc8ae92c800 20 add_watcher() i=3 2024-09-14T11:36:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.552+0000 7fc8ae92c800 20 add_watcher() i=4 2024-09-14T11:36:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.552+0000 7fc8ae92c800 20 add_watcher() i=5 2024-09-14T11:36:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.552+0000 7fc8ae92c800 20 add_watcher() i=6 2024-09-14T11:36:41.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.553+0000 7fc8ae92c800 20 add_watcher() i=7 2024-09-14T11:36:41.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.553+0000 7fc8ae92c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.555+0000 7fc760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.555+0000 7fc8ae92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.555+0000 7fc8ae92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.555+0000 7fc8ae92c800 5 note: GC not initialized 2024-09-14T11:36:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.555+0000 7fc6db7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:41.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.555+0000 7fc8ae92c800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:41.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 20 Filter name: none 2024-09-14T11:36:41.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc6d97fa640 20 reqs_thread_entry: start 2024-09-14T11:36:41.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:36:41.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 : miss 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.556+0000 7fc8ae92c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.557+0000 7fc8ae92c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.557+0000 7fc8ae92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.557+0000 7fc8ae92c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.557+0000 7fc8ae92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.557+0000 7fc8ae92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:41.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.557+0000 7fc8ae92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 2024-09-14T11:36:41.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:41.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:41.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31, ofs0, ns] 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc78d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529690 cookie 94688667756944 notifier 7161 bl.length()=1015 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc78d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc78d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc78d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_sources= new_sources= 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential sources added=[] removed=[] 2024-09-14T11:36:41.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_dests= new_dests= 2024-09-14T11:36:41.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.562+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential dests added=[] removed=[] 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.0 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.0 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.1 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.1 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.2 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.2 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.3 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.3 2024-09-14T11:36:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.4 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.4 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.5 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.5 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.6 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.6 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.7 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.7 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.8 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.8 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.9 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.9 2024-09-14T11:36:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.10 2024-09-14T11:36:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.10 2024-09-14T11:36:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.11 2024-09-14T11:36:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1.11 2024-09-14T11:36:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.567+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.0 2024-09-14T11:36:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.568+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1 2024-09-14T11:36:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.568+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2 2024-09-14T11:36:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.568+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.3 2024-09-14T11:36:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.569+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.4 2024-09-14T11:36:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.570+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.5 2024-09-14T11:36:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.570+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.6 2024-09-14T11:36:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.571+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.7 2024-09-14T11:36:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.572+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.8 2024-09-14T11:36:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.573+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.9 2024-09-14T11:36:41.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.573+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.10 2024-09-14T11:36:41.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.576+0000 7fc8ae92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:41.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.576+0000 7fc8ae92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 2024-09-14T11:36:41.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.577+0000 7fc8ae92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:41.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.577+0000 7fc8ae92c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:41.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.577+0000 7fc8ae92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:41.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.577+0000 7fc8ae92c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31, ofs0, ns] 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.577+0000 7fc78dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94688667756944 notifier 7161 bl.length()=1015 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.578+0000 7fc78dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.578+0000 7fc78dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.578+0000 7fc78dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.578+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_sources= new_sources= 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.578+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential sources added=[] removed=[] 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.578+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_dests= new_dests= 2024-09-14T11:36:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.578+0000 7fc8ae92c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential dests added=[] removed=[] 2024-09-14T11:36:41.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.580+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.0 2024-09-14T11:36:41.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.580+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1 2024-09-14T11:36:41.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.581+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2 2024-09-14T11:36:41.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.581+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.3 2024-09-14T11:36:41.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.581+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.4 2024-09-14T11:36:41.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.582+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.5 2024-09-14T11:36:41.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.582+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.6 2024-09-14T11:36:41.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.582+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.7 2024-09-14T11:36:41.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.583+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.8 2024-09-14T11:36:41.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.583+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.9 2024-09-14T11:36:41.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.584+0000 7fc8ae92c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.10 2024-09-14T11:36:41.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.584+0000 7fc8ae92c800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:36:41.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.584+0000 7fc8ae92c800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:36:41.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.588+0000 7fc760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.590+0000 7fc8ae92c800 20 remove_watcher() i=0 2024-09-14T11:36:41.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.590+0000 7fc8ae92c800 2 removed watcher, disabling cache 2024-09-14T11:36:41.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.591+0000 7fc8ae92c800 20 remove_watcher() i=1 2024-09-14T11:36:41.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.592+0000 7fc8ae92c800 20 remove_watcher() i=2 2024-09-14T11:36:41.592 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.593+0000 7fc8ae92c800 20 remove_watcher() i=3 2024-09-14T11:36:41.593 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.594+0000 7fc8ae92c800 20 remove_watcher() i=4 2024-09-14T11:36:41.594 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.595+0000 7fc8ae92c800 20 remove_watcher() i=5 2024-09-14T11:36:41.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.596+0000 7fc8ae92c800 20 remove_watcher() i=6 2024-09-14T11:36:41.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.597+0000 7fc8ae92c800 20 remove_watcher() i=7 2024-09-14T11:36:41.609 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:41.638 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:41.638 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:41.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.678+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.680+0000 7f698d296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.680+0000 7f698d296800 20 realm 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.680+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.680+0000 7f698d296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.680+0000 7f698d296800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.680+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.681+0000 7f698d296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.681+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.681+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.681+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.682+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:41.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.682+0000 7f698d296800 20 searching for the correct realm 2024-09-14T11:36:41.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.685+0000 7f698b581640 0 -- 172.21.15.7:0/1181183044 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6980027060 msgr2=0x7f69800744b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.689+0000 7f698a57f640 0 -- 172.21.15.7:0/1181183044 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f697c09b940 msgr2=0x7f697c091430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:41.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:41.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:41.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:41.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:41.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:41.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:41.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.895+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 zone default found 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 4 Realm: () 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 zonegroup default 2024-09-14T11:36:41.896 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.896+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.897+0000 7f698d296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.897+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.897+0000 7f698d296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.897+0000 7f698d296800 20 started sync module instance, tier type = 2024-09-14T11:36:41.897 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.897+0000 7f698d296800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.906+0000 7f698d296800 20 add_watcher() i=0 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.906+0000 7f698d296800 20 add_watcher() i=1 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.906+0000 7f698d296800 20 add_watcher() i=2 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.906+0000 7f698d296800 20 add_watcher() i=3 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.906+0000 7f698d296800 20 add_watcher() i=4 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.906+0000 7f698d296800 20 add_watcher() i=5 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.906+0000 7f698d296800 20 add_watcher() i=6 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.907+0000 7f698d296800 20 add_watcher() i=7 2024-09-14T11:36:41.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.907+0000 7f698d296800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:41.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.909+0000 7f68417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.909+0000 7f698d296800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:41.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.909+0000 7f698d296800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:41.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.909+0000 7f698d296800 5 note: GC not initialized 2024-09-14T11:36:41.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.909+0000 7f67bbfff640 20 reqs_thread_entry: start 2024-09-14T11:36:41.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.909+0000 7f698d296800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:41.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.909+0000 7f698d296800 20 Filter name: none 2024-09-14T11:36:41.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.910+0000 7f67b9ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:41.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.910+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.910+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.910+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.910+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.910+0000 7f698d296800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.910+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.911+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.911+0000 7f698d296800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.911+0000 7f698d296800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:41.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.911+0000 7f698d296800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:41.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.913+0000 7f68417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.915+0000 7f698d296800 20 remove_watcher() i=0 2024-09-14T11:36:41.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.915+0000 7f698d296800 2 removed watcher, disabling cache 2024-09-14T11:36:41.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.916+0000 7f698d296800 20 remove_watcher() i=1 2024-09-14T11:36:41.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.917+0000 7f698d296800 20 remove_watcher() i=2 2024-09-14T11:36:41.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.918+0000 7f698d296800 20 remove_watcher() i=3 2024-09-14T11:36:41.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.919+0000 7f698d296800 20 remove_watcher() i=4 2024-09-14T11:36:41.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.920+0000 7f698d296800 20 remove_watcher() i=5 2024-09-14T11:36:41.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.921+0000 7f698d296800 20 remove_watcher() i=6 2024-09-14T11:36:41.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:41.922+0000 7f698d296800 20 remove_watcher() i=7 2024-09-14T11:36:41.932 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:41.932 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:41.932 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:41.932 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:41.934 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:41.934 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:41.941 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:41.941 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:41.984 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:42.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.058+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 20 realm 2024-09-14T11:36:42.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:42.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.060+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.061+0000 7f567d132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.061+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.062+0000 7f567d132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:42.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.062+0000 7f567d132800 20 searching for the correct realm 2024-09-14T11:36:42.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.064+0000 7f56795bd640 0 -- 172.21.15.7:0/3978714320 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f566c01f040 msgr2=0x7f566c090a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:42.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.671+0000 7f56795bd640 0 -- 172.21.15.7:0/3978714320 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f566c01f040 msgr2=0x7f566c090a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:42.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:42.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:42.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:42.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:42.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:42.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:42.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.678 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.678+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 zone default found 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 4 Realm: () 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 zonegroup default 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.679+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.680+0000 7f567d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.680+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.680+0000 7f567d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.680+0000 7f567d132800 20 started sync module instance, tier type = 2024-09-14T11:36:42.680 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.680+0000 7f567d132800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:42.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.692+0000 7f567d132800 20 add_watcher() i=0 2024-09-14T11:36:42.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.692+0000 7f567d132800 20 add_watcher() i=1 2024-09-14T11:36:42.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.692+0000 7f567d132800 20 add_watcher() i=2 2024-09-14T11:36:42.690 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.692+0000 7f567d132800 20 add_watcher() i=3 2024-09-14T11:36:42.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.692+0000 7f567d132800 20 add_watcher() i=4 2024-09-14T11:36:42.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.692+0000 7f567d132800 20 add_watcher() i=5 2024-09-14T11:36:42.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.692+0000 7f567d132800 20 add_watcher() i=6 2024-09-14T11:36:42.691 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.693+0000 7f567d132800 20 add_watcher() i=7 2024-09-14T11:36:42.692 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.693+0000 7f567d132800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:42.693 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.695+0000 7f552f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.694 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.695+0000 7f567d132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.695+0000 7f567d132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.695+0000 7f567d132800 5 note: GC not initialized 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.695+0000 7f552e7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.695+0000 7f567d132800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 20 Filter name: none 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f5527fff640 20 reqs_thread_entry: start 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:36:42.695 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:42.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:42.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:36:42.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 : miss 2024-09-14T11:36:42.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.696+0000 7f567d132800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.697+0000 7f567d132800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:42.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.697+0000 7f567d132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:42.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.697+0000 7f567d132800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:42.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.697+0000 7f567d132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:42.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.697+0000 7f567d132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:42.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.697+0000 7f567d132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 2024-09-14T11:36:42.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.698+0000 7f567d132800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:42.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.707+0000 7f567d132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:42.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.707+0000 7f567d132800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.707+0000 7f567d132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.707+0000 7f567d132800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31, ofs0, ns] 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f554f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529692 cookie 94179551698112 notifier 7200 bl.length()=1015 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f554f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f554f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f554f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_sources= new_sources= 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential sources added=[] removed=[] 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_dests= new_dests= 2024-09-14T11:36:42.707 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.708+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential dests added=[] removed=[] 2024-09-14T11:36:42.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.0 2024-09-14T11:36:42.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.0 2024-09-14T11:36:42.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.1 2024-09-14T11:36:42.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.1 2024-09-14T11:36:42.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.2 2024-09-14T11:36:42.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.2 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.3 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.3 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.4 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.4 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.5 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.5 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.6 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.6 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.7 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.7 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.8 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.8 2024-09-14T11:36:42.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.9 2024-09-14T11:36:42.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.9 2024-09-14T11:36:42.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.10 2024-09-14T11:36:42.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.10 2024-09-14T11:36:42.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.11 2024-09-14T11:36:42.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2.11 2024-09-14T11:36:42.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.713+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.0 2024-09-14T11:36:42.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.714+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1 2024-09-14T11:36:42.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.714+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2 2024-09-14T11:36:42.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.715+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.3 2024-09-14T11:36:42.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.715+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.4 2024-09-14T11:36:42.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.716+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.5 2024-09-14T11:36:42.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.717+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.6 2024-09-14T11:36:42.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.717+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.7 2024-09-14T11:36:42.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.718+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.8 2024-09-14T11:36:42.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.719+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.9 2024-09-14T11:36:42.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.719+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.10 2024-09-14T11:36:42.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.723+0000 7f567d132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.723+0000 7f567d132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 2024-09-14T11:36:42.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.724+0000 7f567d132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:42.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.724+0000 7f567d132800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:42.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.724+0000 7f567d132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:42.723 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.724+0000 7f567d132800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31, ofs0, ns] 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f554f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529693 cookie 94179551698112 notifier 7200 bl.length()=1015 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f554f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f554f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f554f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_sources= new_sources= 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential sources added=[] removed=[] 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_dests= new_dests= 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.725+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential dests added=[] removed=[] 2024-09-14T11:36:42.726 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.728+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.0 2024-09-14T11:36:42.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.728+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.1 2024-09-14T11:36:42.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.728+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.2 2024-09-14T11:36:42.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.729+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.3 2024-09-14T11:36:42.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.729+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.4 2024-09-14T11:36:42.728 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.730+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.5 2024-09-14T11:36:42.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.730+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.6 2024-09-14T11:36:42.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.730+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.7 2024-09-14T11:36:42.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.731+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.8 2024-09-14T11:36:42.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.731+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.9 2024-09-14T11:36:42.730 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.731+0000 7f567d132800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31.10 2024-09-14T11:36:42.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.732+0000 7f567d132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:42.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.732+0000 7f567d132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 2024-09-14T11:36:42.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.733+0000 7f567d132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:42.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.733+0000 7f567d132800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.733+0000 7f567d132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.733+0000 7f567d132800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31, ofs0, ns] 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f554ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529694 cookie 94179551698112 notifier 7200 bl.length()=983 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f554ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 info.flags=0x17 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f554ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 to cache LRU end 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f554ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_sources= new_sources= 2024-09-14T11:36:42.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential sources added=[] removed=[] 2024-09-14T11:36:42.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): orig_dests= new_dests= 2024-09-14T11:36:42.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.734+0000 7f567d132800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31]): potential dests added=[] removed=[] 2024-09-14T11:36:42.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.738+0000 7f567d132800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:42.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.741+0000 7f552f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.742+0000 7f567d132800 20 remove_watcher() i=0 2024-09-14T11:36:42.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.743+0000 7f567d132800 2 removed watcher, disabling cache 2024-09-14T11:36:42.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.744+0000 7f567d132800 20 remove_watcher() i=1 2024-09-14T11:36:42.743 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.745+0000 7f567d132800 20 remove_watcher() i=2 2024-09-14T11:36:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.746+0000 7f567d132800 20 remove_watcher() i=3 2024-09-14T11:36:42.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.747+0000 7f567d132800 20 remove_watcher() i=4 2024-09-14T11:36:42.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.748+0000 7f567d132800 20 remove_watcher() i=5 2024-09-14T11:36:42.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.749+0000 7f567d132800 20 remove_watcher() i=6 2024-09-14T11:36:42.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.750+0000 7f567d132800 20 remove_watcher() i=7 2024-09-14T11:36:42.763 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:42.793 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:42.794 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:42.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.835+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.837+0000 7f995492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.837+0000 7f995492c800 20 realm 2024-09-14T11:36:42.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.837+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.837+0000 7f995492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.837+0000 7f995492c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:42.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.837+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.838+0000 7f995492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.838+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.839+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.839+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.839+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:42.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.839+0000 7f995492c800 20 searching for the correct realm 2024-09-14T11:36:42.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:42.840+0000 7f995053e640 0 -- 172.21.15.7:0/3972812487 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x561ae7731fd0 msgr2=0x561ae7734490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.044+0000 7f995053e640 0 -- 172.21.15.7:0/3972812487 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x561ae7731fd0 msgr2=0x561ae7734490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.052+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 zone default found 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 4 Realm: () 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 zonegroup default 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.053+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.054+0000 7f995492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.054+0000 7f995492c800 20 started sync module instance, tier type = 2024-09-14T11:36:43.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.054+0000 7f995492c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:43.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.062+0000 7f995492c800 20 add_watcher() i=0 2024-09-14T11:36:43.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.062+0000 7f995492c800 20 add_watcher() i=1 2024-09-14T11:36:43.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.062+0000 7f995492c800 20 add_watcher() i=2 2024-09-14T11:36:43.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.062+0000 7f995492c800 20 add_watcher() i=3 2024-09-14T11:36:43.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.062+0000 7f995492c800 20 add_watcher() i=4 2024-09-14T11:36:43.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.062+0000 7f995492c800 20 add_watcher() i=5 2024-09-14T11:36:43.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.062+0000 7f995492c800 20 add_watcher() i=6 2024-09-14T11:36:43.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.063+0000 7f995492c800 20 add_watcher() i=7 2024-09-14T11:36:43.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.063+0000 7f995492c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:43.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.065+0000 7f9806fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.065+0000 7f995492c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.065+0000 7f995492c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.065+0000 7f995492c800 5 note: GC not initialized 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.066+0000 7f9805fdb640 20 reqs_thread_entry: start 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.066+0000 7f995492c800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.066+0000 7f995492c800 20 Filter name: none 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.066+0000 7f97777fe640 20 reqs_thread_entry: start 2024-09-14T11:36:43.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.066+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.066+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:43.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.066+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.067+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:43.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.067+0000 7f995492c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.067+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.067+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:43.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.067+0000 7f995492c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.068+0000 7f995492c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:43.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.068+0000 7f995492c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.069+0000 7f9806fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.071+0000 7f995492c800 20 remove_watcher() i=0 2024-09-14T11:36:43.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.071+0000 7f995492c800 2 removed watcher, disabling cache 2024-09-14T11:36:43.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.073+0000 7f995492c800 20 remove_watcher() i=1 2024-09-14T11:36:43.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.074+0000 7f995492c800 20 remove_watcher() i=2 2024-09-14T11:36:43.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.075+0000 7f995492c800 20 remove_watcher() i=3 2024-09-14T11:36:43.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.076+0000 7f995492c800 20 remove_watcher() i=4 2024-09-14T11:36:43.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.077+0000 7f995492c800 20 remove_watcher() i=5 2024-09-14T11:36:43.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.077+0000 7f995492c800 20 remove_watcher() i=6 2024-09-14T11:36:43.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.079+0000 7f995492c800 20 remove_watcher() i=7 2024-09-14T11:36:43.088 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:43.089 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:43.089 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:43.089 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:43.091 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.091 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.094 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.094 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.137 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.137 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.166 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:36:43.166 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:43.167 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.167 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.180 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.180 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.222 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.223 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.229 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.235 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.235 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.240 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.241 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.247 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.254 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.260 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.265 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.271 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.272 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.277 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.283 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.288 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.294 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.299 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.305 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.310 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.316 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.322 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.327 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.333 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:43.333 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:43.340 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:43.369 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:43.369 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:43.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.409+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 20 realm 2024-09-14T11:36:43.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:43.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.411+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.412+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.412+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.413+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:43.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.413+0000 7ff97eb2c800 20 searching for the correct realm 2024-09-14T11:36:43.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.415+0000 7ff97b0ae640 0 -- 172.21.15.7:0/3585354346 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ff9700b04f0 msgr2=0x7ff9700a49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.620+0000 7ff97a0ac640 0 -- 172.21.15.7:0/3585354346 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ff96c041ad0 msgr2=0x7ff96c0403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.826+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 20 zone default found 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 4 Realm: () 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 20 zonegroup default 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.827+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.828+0000 7ff97eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.828+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.828+0000 7ff97eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.828+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.828+0000 7ff97eb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.828+0000 7ff97eb2c800 20 started sync module instance, tier type = 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.828+0000 7ff97eb2c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.838+0000 7ff97eb2c800 20 add_watcher() i=0 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.838+0000 7ff97eb2c800 20 add_watcher() i=1 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.838+0000 7ff97eb2c800 20 add_watcher() i=2 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.838+0000 7ff97eb2c800 20 add_watcher() i=3 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.838+0000 7ff97eb2c800 20 add_watcher() i=4 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.838+0000 7ff97eb2c800 20 add_watcher() i=5 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.838+0000 7ff97eb2c800 20 add_watcher() i=6 2024-09-14T11:36:43.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.839+0000 7ff97eb2c800 20 add_watcher() i=7 2024-09-14T11:36:43.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.839+0000 7ff97eb2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:43.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.841+0000 7ff8317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.841+0000 7ff97eb2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.841+0000 7ff97eb2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.841+0000 7ff97eb2c800 5 note: GC not initialized 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.841+0000 7ff7abfff640 20 reqs_thread_entry: start 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.842+0000 7ff97eb2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.842+0000 7ff97eb2c800 20 Filter name: none 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.842+0000 7ff7a9ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.842+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.843+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:43.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.843+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.843+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.844+0000 7ff97eb2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.844+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.844+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.844+0000 7ff97eb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.844+0000 7ff97eb2c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.844+0000 7ff97eb2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.846+0000 7ff8317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.848+0000 7ff97eb2c800 20 remove_watcher() i=0 2024-09-14T11:36:43.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.848+0000 7ff97eb2c800 2 removed watcher, disabling cache 2024-09-14T11:36:43.848 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.850+0000 7ff97eb2c800 20 remove_watcher() i=1 2024-09-14T11:36:43.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.851+0000 7ff97eb2c800 20 remove_watcher() i=2 2024-09-14T11:36:43.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.852+0000 7ff97eb2c800 20 remove_watcher() i=3 2024-09-14T11:36:43.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.853+0000 7ff97eb2c800 20 remove_watcher() i=4 2024-09-14T11:36:43.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.854+0000 7ff97eb2c800 20 remove_watcher() i=5 2024-09-14T11:36:43.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.855+0000 7ff97eb2c800 20 remove_watcher() i=6 2024-09-14T11:36:43.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.856+0000 7ff97eb2c800 20 remove_watcher() i=7 2024-09-14T11:36:43.867 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:43.868 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:43.868 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:43.868 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:43.869 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:36:43.907 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:43.907 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:43.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.948+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 20 realm 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.950+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.951+0000 7f7dee12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.951+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.952+0000 7f7dee12a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:43.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.952+0000 7f7dee12a800 20 searching for the correct realm 2024-09-14T11:36:43.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:43.953+0000 7f7dea618640 0 -- 172.21.15.7:0/4024491997 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f7de0044070 msgr2=0x7f7de0050ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.159+0000 7f7de9616640 0 -- 172.21.15.7:0/4024491997 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f7ddc0af650 msgr2=0x7f7ddc0dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:44.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:44.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.366+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 zone default found 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 4 Realm: () 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 zonegroup default 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.367+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.368+0000 7f7dee12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.368+0000 7f7dee12a800 20 started sync module instance, tier type = 2024-09-14T11:36:44.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.368+0000 7f7dee12a800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.379+0000 7f7dee12a800 20 add_watcher() i=0 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.379+0000 7f7dee12a800 20 add_watcher() i=1 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.379+0000 7f7dee12a800 20 add_watcher() i=2 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.379+0000 7f7dee12a800 20 add_watcher() i=3 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.379+0000 7f7dee12a800 20 add_watcher() i=4 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.379+0000 7f7dee12a800 20 add_watcher() i=5 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.379+0000 7f7dee12a800 20 add_watcher() i=6 2024-09-14T11:36:44.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.380+0000 7f7dee12a800 20 add_watcher() i=7 2024-09-14T11:36:44.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.380+0000 7f7dee12a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.382+0000 7f7c9bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.382+0000 7f7dee12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.382+0000 7f7dee12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.382+0000 7f7dee12a800 5 note: GC not initialized 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.382+0000 7f7c9affd640 20 reqs_thread_entry: start 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7dee12a800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7dee12a800 20 Filter name: none 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7c98ff9640 20 reqs_thread_entry: start 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7dee12a800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:36:44.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7dee12a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7dee12a800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.383+0000 7f7dee12a800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 : miss 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 info.flags=0x17 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 to cache LRU end 2024-09-14T11:36:44.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:44.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:44.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.384+0000 7f7dee12a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 info.flags=0x17 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 to cache LRU end 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32, ofs0, ns] 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7ccd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529697 cookie 94911740648176 notifier 6899 bl.length()=1015 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7ccd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 info.flags=0x17 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7ccd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 to cache LRU end 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7ccd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): orig_sources= new_sources= 2024-09-14T11:36:44.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): potential sources added=[] removed=[] 2024-09-14T11:36:44.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): orig_dests= new_dests= 2024-09-14T11:36:44.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.391+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): potential dests added=[] removed=[] 2024-09-14T11:36:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.0 2024-09-14T11:36:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.0 2024-09-14T11:36:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.1 2024-09-14T11:36:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.1 2024-09-14T11:36:44.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.2 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.2 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.3 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.3 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.4 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.4 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.5 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.5 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.6 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.6 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.7 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.7 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.8 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.8 2024-09-14T11:36:44.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.9 2024-09-14T11:36:44.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.9 2024-09-14T11:36:44.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.10 2024-09-14T11:36:44.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.10 2024-09-14T11:36:44.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.11 2024-09-14T11:36:44.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1.11 2024-09-14T11:36:44.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.396+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.0 2024-09-14T11:36:44.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.397+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1 2024-09-14T11:36:44.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.397+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.2 2024-09-14T11:36:44.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.398+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.3 2024-09-14T11:36:44.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.399+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.4 2024-09-14T11:36:44.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.399+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.5 2024-09-14T11:36:44.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.400+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.6 2024-09-14T11:36:44.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.400+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.7 2024-09-14T11:36:44.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.400+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.8 2024-09-14T11:36:44.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.401+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.9 2024-09-14T11:36:44.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.402+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.10 2024-09-14T11:36:44.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.406+0000 7f7dee12a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:44.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.406+0000 7f7dee12a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 2024-09-14T11:36:44.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.407+0000 7f7dee12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 info.flags=0x17 2024-09-14T11:36:44.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.407+0000 7f7dee12a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 to cache LRU end 2024-09-14T11:36:44.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.407+0000 7f7dee12a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:44.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.407+0000 7f7dee12a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32, ofs0, ns] 2024-09-14T11:36:44.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7cccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529698 cookie 94911740648176 notifier 6899 bl.length()=1015 2024-09-14T11:36:44.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7cccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 info.flags=0x17 2024-09-14T11:36:44.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7cccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 to cache LRU end 2024-09-14T11:36:44.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7cccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:44.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): orig_sources= new_sources= 2024-09-14T11:36:44.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): potential sources added=[] removed=[] 2024-09-14T11:36:44.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): orig_dests= new_dests= 2024-09-14T11:36:44.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.408+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): potential dests added=[] removed=[] 2024-09-14T11:36:44.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.410+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.0 2024-09-14T11:36:44.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.411+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.1 2024-09-14T11:36:44.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.411+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.2 2024-09-14T11:36:44.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.411+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.3 2024-09-14T11:36:44.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.412+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.4 2024-09-14T11:36:44.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.412+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.5 2024-09-14T11:36:44.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.412+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.6 2024-09-14T11:36:44.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.413+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.7 2024-09-14T11:36:44.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.413+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.8 2024-09-14T11:36:44.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.414+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.9 2024-09-14T11:36:44.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.414+0000 7f7dee12a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32.10 2024-09-14T11:36:44.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.414+0000 7f7dee12a800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:36:44.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.414+0000 7f7dee12a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:44.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.414+0000 7f7dee12a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 info.flags=0x17 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 to cache LRU end 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32, ofs0, ns] 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7ccd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529699 cookie 94911740648176 notifier 6899 bl.length()=983 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7ccd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 info.flags=0x17 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7ccd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 to cache LRU end 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7ccd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): orig_sources= new_sources= 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): potential sources added=[] removed=[] 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): orig_dests= new_dests= 2024-09-14T11:36:44.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.416+0000 7f7dee12a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32]): potential dests added=[] removed=[] 2024-09-14T11:36:44.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.421+0000 7f7dee12a800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:44.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.423+0000 7f7c9bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.426+0000 7f7dee12a800 20 remove_watcher() i=0 2024-09-14T11:36:44.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.426+0000 7f7dee12a800 2 removed watcher, disabling cache 2024-09-14T11:36:44.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.427+0000 7f7dee12a800 20 remove_watcher() i=1 2024-09-14T11:36:44.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.428+0000 7f7dee12a800 20 remove_watcher() i=2 2024-09-14T11:36:44.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.429+0000 7f7dee12a800 20 remove_watcher() i=3 2024-09-14T11:36:44.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.430+0000 7f7dee12a800 20 remove_watcher() i=4 2024-09-14T11:36:44.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.431+0000 7f7dee12a800 20 remove_watcher() i=5 2024-09-14T11:36:44.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.432+0000 7f7dee12a800 20 remove_watcher() i=6 2024-09-14T11:36:44.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.433+0000 7f7dee12a800 20 remove_watcher() i=7 2024-09-14T11:36:44.445 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:44.475 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:44.476 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:44.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.516+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 20 realm 2024-09-14T11:36:44.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.518+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.519+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.519+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.520+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:44.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.520+0000 7ff90212e800 20 searching for the correct realm 2024-09-14T11:36:44.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.522+0000 7ff8fe6de640 0 -- 172.21.15.7:0/1225632856 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ff8f4093670 msgr2=0x7ff8f40ba720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.727 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.728+0000 7ff8fd6dc640 0 -- 172.21.15.7:0/1225632856 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ff8f004d040 msgr2=0x7ff8f004d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:44.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:44.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.935+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 zone default found 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 4 Realm: () 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 zonegroup default 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.936+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.937+0000 7ff90212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.937+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.937+0000 7ff90212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.937+0000 7ff90212e800 20 started sync module instance, tier type = 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.937+0000 7ff90212e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:44.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.947+0000 7ff90212e800 20 add_watcher() i=0 2024-09-14T11:36:44.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.947+0000 7ff90212e800 20 add_watcher() i=1 2024-09-14T11:36:44.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.947+0000 7ff90212e800 20 add_watcher() i=2 2024-09-14T11:36:44.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.947+0000 7ff90212e800 20 add_watcher() i=3 2024-09-14T11:36:44.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.947+0000 7ff90212e800 20 add_watcher() i=4 2024-09-14T11:36:44.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.947+0000 7ff90212e800 20 add_watcher() i=5 2024-09-14T11:36:44.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.947+0000 7ff90212e800 20 add_watcher() i=6 2024-09-14T11:36:44.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.948+0000 7ff90212e800 20 add_watcher() i=7 2024-09-14T11:36:44.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.948+0000 7ff90212e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.950+0000 7ff7affff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.950+0000 7ff90212e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.950+0000 7ff90212e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.950+0000 7ff90212e800 5 note: GC not initialized 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.951+0000 7ff7aeffd640 20 reqs_thread_entry: start 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.951+0000 7ff90212e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.951+0000 7ff90212e800 20 Filter name: none 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.951+0000 7ff7acff9640 20 reqs_thread_entry: start 2024-09-14T11:36:44.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.951+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.952+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:44.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.952+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.952+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:44.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.952+0000 7ff90212e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:44.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.952+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.953+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:44.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.953+0000 7ff90212e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.953+0000 7ff90212e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:44.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.953+0000 7ff90212e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:44.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.956+0000 7ff7affff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.958+0000 7ff90212e800 20 remove_watcher() i=0 2024-09-14T11:36:44.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.958+0000 7ff90212e800 2 removed watcher, disabling cache 2024-09-14T11:36:44.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.959+0000 7ff90212e800 20 remove_watcher() i=1 2024-09-14T11:36:44.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.960+0000 7ff90212e800 20 remove_watcher() i=2 2024-09-14T11:36:44.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.961+0000 7ff90212e800 20 remove_watcher() i=3 2024-09-14T11:36:44.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.962+0000 7ff90212e800 20 remove_watcher() i=4 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.963+0000 7ff90212e800 20 remove_watcher() i=5 2024-09-14T11:36:44.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.964+0000 7ff90212e800 20 remove_watcher() i=6 2024-09-14T11:36:44.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:44.965+0000 7ff90212e800 20 remove_watcher() i=7 2024-09-14T11:36:44.976 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:44.976 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:44.976 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:36:44.976 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:44.978 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:44.978 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:44.981 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:44.982 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.025 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.025 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.054 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:36:45.054 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:45.056 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.056 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.067 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.067 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.110 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.110 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.117 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.117 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.123 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.123 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.129 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.130 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.136 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.136 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.141 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.142 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.148 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.148 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.154 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.154 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.161 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.161 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.167 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.167 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.173 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.173 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.179 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.179 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.185 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.185 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.192 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.192 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.198 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.199 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.205 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.205 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.210 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.211 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.217 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.217 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.223 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.223 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.230 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:45.230 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:36:45.236 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:36:45.266 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:45.266 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:45.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.307+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.309+0000 7efdc99af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.309+0000 7efdc99af800 20 realm 2024-09-14T11:36:45.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.309+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.310+0000 7efdc99af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.310+0000 7efdc99af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:45.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.310+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.310+0000 7efdc99af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.310+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.311+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:45.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.311+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.311+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:45.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.311+0000 7efdc99af800 20 searching for the correct realm 2024-09-14T11:36:45.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.312+0000 7efdc6c98640 0 -- 172.21.15.7:0/1841857067 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7efdb808b060 msgr2=0x7efdb8049150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:45.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.517+0000 7efdc7c9a640 0 -- 172.21.15.7:0/1841857067 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7efdb0063070 msgr2=0x7efdb0094940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:45.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:45.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:45.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:45.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:45.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:45.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:45.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.523+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:45.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:45.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 zone default found 2024-09-14T11:36:45.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 4 Realm: () 2024-09-14T11:36:45.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:45.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 zonegroup default 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.524+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.525+0000 7efdc99af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.525+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.525+0000 7efdc99af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.525+0000 7efdc99af800 20 started sync module instance, tier type = 2024-09-14T11:36:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.525+0000 7efdc99af800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:45.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.534+0000 7efdc99af800 20 add_watcher() i=0 2024-09-14T11:36:45.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.534+0000 7efdc99af800 20 add_watcher() i=1 2024-09-14T11:36:45.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.534+0000 7efdc99af800 20 add_watcher() i=2 2024-09-14T11:36:45.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.534+0000 7efdc99af800 20 add_watcher() i=3 2024-09-14T11:36:45.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.534+0000 7efdc99af800 20 add_watcher() i=4 2024-09-14T11:36:45.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.534+0000 7efdc99af800 20 add_watcher() i=5 2024-09-14T11:36:45.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.534+0000 7efdc99af800 20 add_watcher() i=6 2024-09-14T11:36:45.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.535+0000 7efdc99af800 20 add_watcher() i=7 2024-09-14T11:36:45.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.535+0000 7efdc99af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:45.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.537+0000 7efc7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.537+0000 7efdc99af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.537+0000 7efdc99af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.537+0000 7efdc99af800 5 note: GC not initialized 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.538+0000 7efc7cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.538+0000 7efdc99af800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.538+0000 7efdc99af800 20 Filter name: none 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.538+0000 7efbf67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:45.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.538+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.538+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:45.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.538+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.539+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:45.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.539+0000 7efdc99af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:45.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.539+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.539+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:45.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.539+0000 7efdc99af800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.540+0000 7efdc99af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:45.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.540+0000 7efdc99af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:45.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.541+0000 7efc7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:45.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.544+0000 7efdc99af800 20 remove_watcher() i=0 2024-09-14T11:36:45.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.544+0000 7efdc99af800 2 removed watcher, disabling cache 2024-09-14T11:36:45.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.545+0000 7efdc99af800 20 remove_watcher() i=1 2024-09-14T11:36:45.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.546+0000 7efdc99af800 20 remove_watcher() i=2 2024-09-14T11:36:45.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.547+0000 7efdc99af800 20 remove_watcher() i=3 2024-09-14T11:36:45.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.548+0000 7efdc99af800 20 remove_watcher() i=4 2024-09-14T11:36:45.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.549+0000 7efdc99af800 20 remove_watcher() i=5 2024-09-14T11:36:45.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.550+0000 7efdc99af800 20 remove_watcher() i=6 2024-09-14T11:36:45.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.551+0000 7efdc99af800 20 remove_watcher() i=7 2024-09-14T11:36:45.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:45.562 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:45.562 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:45.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:45.564 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:36:45.599 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:45.599 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:45.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.640+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 20 realm 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:45.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.643+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:45.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.643+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:45.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.644+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:45.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.644+0000 7f420ef42800 20 searching for the correct realm 2024-09-14T11:36:45.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.645+0000 7f420b487640 0 -- 172.21.15.7:0/1057299583 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4200027040 msgr2=0x7f4200026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:45.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:45.851+0000 7f420a485640 0 -- 172.21.15.7:0/1057299583 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f41fc003bb0 msgr2=0x7f41fc0569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:46.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.058+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 zone default found 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 4 Realm: () 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 zonegroup default 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.060+0000 7f420ef42800 20 started sync module instance, tier type = 2024-09-14T11:36:46.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.061+0000 7f420ef42800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:46.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=0 2024-09-14T11:36:46.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=1 2024-09-14T11:36:46.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=2 2024-09-14T11:36:46.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=3 2024-09-14T11:36:46.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=4 2024-09-14T11:36:46.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=5 2024-09-14T11:36:46.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=6 2024-09-14T11:36:46.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.071+0000 7f420ef42800 20 add_watcher() i=7 2024-09-14T11:36:46.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.071+0000 7f420ef42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:46.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.073+0000 7f40c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.073+0000 7f420ef42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.073+0000 7f420ef42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.073+0000 7f420ef42800 5 note: GC not initialized 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f403bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f420ef42800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f420ef42800 20 Filter name: none 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f4039ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:36:46.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:46.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:46.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.074+0000 7f420ef42800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : miss 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.075+0000 7f420ef42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:36:46.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.080+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.080+0000 7f420ef42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.080+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f420ef42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:36:46.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 93923607522224 notifier 7314 bl.length()=1015 2024-09-14T11:36:46.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:36:46.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:36:46.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:36:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:36:46.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:36:46.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:36:46.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:36:46.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:36:46.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:36:46.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.087+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:36:46.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.087+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:36:46.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:36:46.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:36:46.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:36:46.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.089+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:36:46.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.090+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:36:46.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.090+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:36:46.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.091+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:36:46.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.091+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:36:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.095+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.095+0000 7f420ef42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:36:46.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f420ef42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f420ef42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:36:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529753 cookie 93923607522224 notifier 7314 bl.length()=1015 2024-09-14T11:36:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:36:46.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:36:46.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:36:46.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:36:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.099+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:36:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.099+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:36:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:36:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:36:46.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:36:46.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:36:46.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:36:46.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:36:46.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:36:46.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:36:46.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:36:46.101 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f420ef42800 time 2024-09-14T11:36:46.104442+0000 2024-09-14T11:36:46.101 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f421078c76a] 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.102 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f420ef42800 thread_name:radosgw-admin 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.103+0000 7f420ef42800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f420ef42800 time 2024-09-14T11:36:46.104442+0000 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f421078c76a] 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.103 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:36:46.104 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.104 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:36:46.104 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:36:46.104 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f420f43e6f0] 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f420f48b99c] 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f421078c7c4] 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.119 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.104+0000 7f420ef42800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f420ef42800 thread_name:radosgw-admin 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f420f43e6f0] 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f420f48b99c] 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f421078c7c4] 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.120 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:36:45.624+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:36:45.624+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:36:45.624+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.181303s 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b1ba780 auth_method 0 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.121 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b2720c0 auth_method 0 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b2785a0 auth_method 0 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.122 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:36:45.624+0000 7f420ac86640 1 monclient: found mon.noname-c 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: dump: 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.123 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: dump: 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.124 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:36:45.625+0000 7f420ef42800 5 monclient: authenticate success, global_id 6941 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:36:45.625+0000 7f40f8e09640 4 set_mon_vals no callback set 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:36:45.625+0000 7f420ef42800 1 librados: init done 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:36:45.627+0000 7f40f7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:36:45.627+0000 7f40f7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:36:45.627+0000 7f40f7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.125 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:36:45.627+0000 7f420a485640 10 monclient: get_auth_request con 0x7f40f0077280 auth_method 0 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:36:45.627+0000 7f420b487640 10 monclient: get_auth_request con 0x556c4b3780b0 auth_method 0 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:36:45.628+0000 7f420ac86640 10 monclient: get_auth_request con 0x556c4b37b290 auth_method 0 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:36:45.629+0000 7f420a485640 10 monclient: get_auth_request con 0x556c4b37f480 auth_method 0 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:36:45.630+0000 7f420b487640 10 monclient: get_auth_request con 0x556c4b37eb60 auth_method 0 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:36:45.630+0000 7f420ef42800 10 monclient: build_initial_monmap 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:36:45.630+0000 7f420ef42800 1 build_initial for_mkfs: 0 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:36:45.630+0000 7f420ef42800 10 monclient: monmap: 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:46.126 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding auth protocol: cephx 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding auth protocol: cephx 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding auth protocol: cephx 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.127 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:36:45.631+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command objecter_requests cmddesc objecter_requests hook 0x556c4b38aa20 EEXIST 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient: init 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding auth protocol: cephx 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding auth protocol: cephx 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding auth protocol: cephx 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.128 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:36:45.631+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:36:45.631+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command rotate-key cmddesc rotate-key hook 0x556c4b386490 EEXIST 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-b con 0x556c4b3aed40 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-c con 0x556c4b3af120 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-a con 0x556c4b3ada50 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.129 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.188985s 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b3af120 auth_method 0 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b3ada50 auth_method 0 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.130 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b3aed40 auth_method 0 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_done global_id 7308 payload 824 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:36:45.632+0000 7f420ac86640 1 monclient: found mon.noname-a 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: dump: 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.131 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:36:45.632+0000 7f420ef42800 5 monclient: authenticate success, global_id 7308 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: dump: 2024-09-14T11:36:46.132 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:36:45.632+0000 7f420bc88640 4 set_mon_vals no callback set 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:36:45.634+0000 7f40f4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:36:45.634+0000 7f40f4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.133 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:36:45.634+0000 7f40f4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:36:45.634+0000 7f420a485640 10 monclient: get_auth_request con 0x7f40e4077140 auth_method 0 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:36:45.634+0000 7f420ef42800 10 monclient: get_monmap_and_config 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:36:45.634+0000 7f420ef42800 10 monclient: build_initial_monmap 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:36:45.634+0000 7f420ef42800 1 build_initial for_mkfs: 0 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:36:45.634+0000 7f420ef42800 10 monclient: monmap: 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding auth protocol: cephx 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding auth protocol: cephx 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding auth protocol: cephx 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:36:45.635+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient: init 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding auth protocol: cephx 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding auth protocol: cephx 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding auth protocol: cephx 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:36:45.635+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:36:45.635+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command rotate-key cmddesc rotate-key hook 0x7ffcddafd968 EEXIST 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-b con 0x556c4b403020 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-a con 0x556c4b3d4030 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-c con 0x556c4b3fe500 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.192918s 2024-09-14T11:36:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b3d4030 auth_method 0 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b3fe500 auth_method 0 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b403020 auth_method 0 2024-09-14T11:36:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_done global_id 6947 payload 274 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:36:45.636+0000 7f420ac86640 1 monclient: found mon.noname-c 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: dump: 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.139 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:36:45.636+0000 7f420ef42800 5 monclient: authenticate success, global_id 6947 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:36:45.636+0000 7f420ef42800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:36:45.636+0000 7f420ef42800 4 set_mon_vals no callback set 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: dump: 2024-09-14T11:36:46.140 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: shutdown 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: build_initial_monmap 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 build_initial for_mkfs: 0 2024-09-14T11:36:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: monmap: 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding auth protocol: cephx 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding auth protocol: cephx 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding auth protocol: cephx 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:36:45.637+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: starting msgr at 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: starting objecter 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command objecter_requests cmddesc objecter_requests hook 0x556c4b371d10 EEXIST 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: setting wanted keys 2024-09-14T11:36:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: calling monclient init 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: init 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding auth protocol: cephx 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding auth protocol: cephx 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding auth protocol: cephx 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:36:45.637+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:36:45.638+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:36:45.638+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command rotate-key cmddesc rotate-key hook 0x556c4b3c3748 EEXIST 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-c con 0x556c4b3d4030 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-a con 0x556c4b3fe500 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-b con 0x556c4b403020 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.195215s 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b3fe500 auth_method 0 2024-09-14T11:36:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b3d4030 auth_method 0 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b403020 auth_method 0 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_done global_id 7314 payload 824 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:36:45.638+0000 7f420b487640 1 monclient: found mon.noname-a 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: dump: 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: dump: 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.148 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:36:45.638+0000 7f420ef42800 5 monclient: authenticate success, global_id 7314 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:36:45.638+0000 7f40ee7fc640 4 set_mon_vals no callback set 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:36:45.639+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:36:45.639+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:36:45.639+0000 7f420ef42800 1 librados: init done 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:36:45.639+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cr dump hook 0x7f41fc0ac748 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:36:45.640+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:36:45.641+0000 7f40ecff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:36:45.641+0000 7f40ecff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:36:45.641+0000 7f40ecff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:36:45.641+0000 7f420a485640 10 monclient: get_auth_request con 0x7f40d4077230 auth_method 0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:36:45.641+0000 7f420ac86640 10 monclient: get_auth_request con 0x556c4b41d1d0 auth_method 0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 realm 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:36:45.642+0000 7f420ef42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:36:45.642+0000 7f420a485640 10 monclient: get_auth_request con 0x556c4b421550 auth_method 0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:36:45.643+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:36:45.643+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:36:45.643+0000 7f420b487640 10 monclient: get_auth_request con 0x556c4b424c50 auth_method 0 2024-09-14T11:36:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:36:45.644+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:36:45.644+0000 7f420ef42800 20 searching for the correct realm 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:36:45.644+0000 7f420ac86640 10 monclient: get_auth_request con 0x556c4b4299f0 auth_method 0 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:36:45.644+0000 7f420a485640 10 monclient: get_auth_request con 0x7f41fc06b020 auth_method 0 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:36:45.645+0000 7f420b487640 10 monclient: get_auth_request con 0x7f4200027040 auth_method 0 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:36:45.645+0000 7f420b487640 0 -- 172.21.15.7:0/1057299583 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4200027040 msgr2=0x7f4200026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:36:45.846+0000 7f420b487640 10 monclient: get_auth_request con 0x7f4200027040 auth_method 0 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:36:45.847+0000 7f420ac86640 10 monclient: get_auth_request con 0x7f420406a250 auth_method 0 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:36:45.851+0000 7f420a485640 0 -- 172.21.15.7:0/1057299583 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f41fc003bb0 msgr2=0x7f41fc0569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:36:46.053+0000 7f420a485640 10 monclient: get_auth_request con 0x7f41fc003bb0 auth_method 0 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 zone default found 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:36:46.060+0000 7f420ef42800 4 Realm: () 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:36:46.060+0000 7f420ef42800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:36:46.060+0000 7f420ef42800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:36:46.060+0000 7f420ef42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 zonegroup default 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 started sync module instance, tier type = 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:36:46.061+0000 7f420ef42800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=0 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=1 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=2 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=3 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=4 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=5 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=6 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:36:46.071+0000 7f420ef42800 20 add_watcher() i=7 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:36:46.071+0000 7f420ef42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding auth protocol: cephx 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding auth protocol: cephx 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding auth protocol: cephx 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:36:46.073+0000 7f40c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:36:46.073+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:36:46.073+0000 7f420ef42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:36:46.073+0000 7f420ef42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache list hook 0x556c4b3f0740 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache inspect hook 0x556c4b3f0740 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache erase hook 0x556c4b3f0740 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache zap hook 0x556c4b3f0740 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 note: GC not initialized 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:36:46.074+0000 7f403bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace show hook 0x7f4204004e40 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace history hook 0x7f4204004e40 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace active hook 0x7f4204004e40 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace active_short hook 0x7f4204004e40 2024-09-14T11:36:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 Filter name: none 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:36:46.074+0000 7f4039ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:36:46.074+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:36:46.074+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:36:46.074+0000 7f420ef42800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : miss 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:36:46.075+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:36:46.075+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:36:46.080+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:36:46.080+0000 7f420ef42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:36:46.080+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:36:46.081+0000 7f420ef42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 93923607522224 notifier 7314 bl.length()=1015 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:36:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:36:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:36:46.087+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:36:46.087+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:36:46.089+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:36:46.090+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:36:46.090+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:36:46.091+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:36:46.091+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:36:46.095+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:36:46.095+0000 7f420ef42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529753 cookie 93923607522224 notifier 7314 bl.length()=1015 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:36:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:36:46.099+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:36:46.099+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:36:46.103+0000 7f420ef42800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f420ef42800 time 2024-09-14T11:36:46.104442+0000 2024-09-14T11:36:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f421078c76a] 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:36:46.104+0000 7f420ef42800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f420ef42800 thread_name:radosgw-admin 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f420f43e6f0] 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f420f48b99c] 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f421078c7c4] 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:36:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:36:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:36:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:36:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f4039ffb640 / http_manager 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f403bfff640 / http_manager 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40c17e2640 / rgw_dt_lg_renew 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40ecff9640 / ms_dispatch 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40edffb640 / io_context_pool 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40ee7fc640 / io_context_pool 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40f4e01640 / ms_dispatch 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40f7606640 / ms_dispatch 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40f8e09640 / io_context_pool 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420a485640 / msgr-worker-2 2024-09-14T11:36:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420ac86640 / msgr-worker-1 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420b487640 / msgr-worker-0 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420bc88640 / io_context_pool 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420ef42800 / radosgw-admin 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.121568.log 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:36:45.624+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:36:45.624+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:36:45.624+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.181303s 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b1ba780 auth_method 0 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b2720c0 auth_method 0 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:36:45.624+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b2785a0 auth_method 0 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:36:45.624+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:36:45.624+0000 7f420ac86640 1 monclient: found mon.noname-c 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:36:45.624+0000 7f420ac86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: dump: 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.173 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:36:45.625+0000 7f40f7606640 10 monclient: dump: 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.174 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:36:45.625+0000 7f420ef42800 5 monclient: authenticate success, global_id 6941 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:36:45.625+0000 7f40f8e09640 4 set_mon_vals no callback set 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:36:45.625+0000 7f420ef42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:36:45.625+0000 7f420ef42800 1 librados: init done 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:36:45.627+0000 7f40f7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:36:45.627+0000 7f40f7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:36:45.627+0000 7f40f7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:36:45.627+0000 7f420a485640 10 monclient: get_auth_request con 0x7f40f0077280 auth_method 0 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:36:45.627+0000 7f420b487640 10 monclient: get_auth_request con 0x556c4b3780b0 auth_method 0 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:36:45.628+0000 7f420ac86640 10 monclient: get_auth_request con 0x556c4b37b290 auth_method 0 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:36:45.629+0000 7f420a485640 10 monclient: get_auth_request con 0x556c4b37f480 auth_method 0 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:36:45.630+0000 7f420b487640 10 monclient: get_auth_request con 0x556c4b37eb60 auth_method 0 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:36:45.630+0000 7f420ef42800 10 monclient: build_initial_monmap 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:36:45.630+0000 7f420ef42800 1 build_initial for_mkfs: 0 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:36:45.630+0000 7f420ef42800 10 monclient: monmap: 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:46.176 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding auth protocol: cephx 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding auth protocol: cephx 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding auth protocol: cephx 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: crc 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:36:45.630+0000 7f420ef42800 5 AuthRegistry(0x556c4b387600) adding con mode: secure 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:36:45.631+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command objecter_requests cmddesc objecter_requests hook 0x556c4b38aa20 EEXIST 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient: init 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding auth protocol: cephx 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding auth protocol: cephx 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding auth protocol: cephx 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: crc 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 AuthRegistry(0x556c4b386348) adding con mode: secure 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:36:45.631+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:36:45.631+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:36:45.631+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command rotate-key cmddesc rotate-key hook 0x556c4b386490 EEXIST 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-b con 0x556c4b3aed40 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-c con 0x556c4b3af120 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-a con 0x556c4b3ada50 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:36:45.631+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.188985s 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b3af120 auth_method 0 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b3ada50 auth_method 0 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:36:45.632+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b3aed40 auth_method 0 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:36:45.632+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient(hunting): handle_auth_done global_id 7308 payload 824 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:36:45.632+0000 7f420ac86640 1 monclient: found mon.noname-a 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:36:45.632+0000 7f420ac86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: dump: 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:36:45.632+0000 7f420ef42800 5 monclient: authenticate success, global_id 7308 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:36:45.632+0000 7f40f4e01640 10 monclient: dump: 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.183 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:36:45.632+0000 7f420bc88640 4 set_mon_vals no callback set 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:36:45.632+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:36:45.634+0000 7f40f4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:36:45.634+0000 7f40f4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:36:45.634+0000 7f40f4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:36:45.634+0000 7f420a485640 10 monclient: get_auth_request con 0x7f40e4077140 auth_method 0 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:36:45.634+0000 7f420ef42800 10 monclient: get_monmap_and_config 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:36:45.634+0000 7f420ef42800 10 monclient: build_initial_monmap 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:36:45.634+0000 7f420ef42800 1 build_initial for_mkfs: 0 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:36:45.634+0000 7f420ef42800 10 monclient: monmap: 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding auth protocol: cephx 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding auth protocol: cephx 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding auth protocol: cephx 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: crc 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:36:45.634+0000 7f420ef42800 5 AuthRegistry(0x556c4b3ce9c0) adding con mode: secure 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:36:45.635+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient: init 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding auth protocol: cephx 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding auth protocol: cephx 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding auth protocol: cephx 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: crc 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafd820) adding con mode: secure 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:36:45.635+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:36:45.635+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:36:45.635+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command rotate-key cmddesc rotate-key hook 0x7ffcddafd968 EEXIST 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-b con 0x556c4b403020 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-a con 0x556c4b3d4030 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-c con 0x556c4b3fe500 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:36:45.635+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.192918s 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b3d4030 auth_method 0 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b3fe500 auth_method 0 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:36:45.636+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b403020 auth_method 0 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:36:45.636+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient(hunting): handle_auth_done global_id 6947 payload 274 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:36:45.636+0000 7f420ac86640 1 monclient: found mon.noname-c 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:36:45.636+0000 7f420ac86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: dump: 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.190 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:36:45.636+0000 7f420ef42800 5 monclient: authenticate success, global_id 6947 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:36:45.636+0000 7f420ef42800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:36:45.636+0000 7f420ef42800 4 set_mon_vals no callback set 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:36:45.636+0000 7f40ee7fc640 10 monclient: dump: 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: shutdown 2024-09-14T11:36:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: build_initial_monmap 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 build_initial for_mkfs: 0 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: monmap: 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding auth protocol: cephx 2024-09-14T11:36:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding auth protocol: cephx 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding auth protocol: cephx 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: crc 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3f4c50) adding con mode: secure 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:36:45.637+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: starting msgr at 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: starting objecter 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command objecter_requests cmddesc objecter_requests hook 0x556c4b371d10 EEXIST 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: setting wanted keys 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:36:45.637+0000 7f420ef42800 1 librados: calling monclient init 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:36:45.637+0000 7f420ef42800 10 monclient: init 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding auth protocol: cephx 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding auth protocol: cephx 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding auth protocol: cephx 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: crc 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:36:45.637+0000 7f420ef42800 5 AuthRegistry(0x556c4b3c3600) adding con mode: secure 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:36:45.637+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:36:45.638+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:36:45.638+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command rotate-key cmddesc rotate-key hook 0x556c4b3c3748 EEXIST 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-c con 0x556c4b3d4030 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:36:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-a con 0x556c4b3fe500 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): picked mon.noname-b con 0x556c4b403020 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient(hunting): authenticate will time out at 2106.195215s 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): get_auth_request con 0x556c4b3fe500 auth_method 0 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): get_auth_request con 0x556c4b3d4030 auth_method 0 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:36:45.638+0000 7f420a485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): get_auth_request con 0x556c4b403020 auth_method 0 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:36:45.638+0000 7f420ac86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient(hunting): handle_auth_done global_id 7314 payload 824 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient: _finish_hunting 0 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:36:45.638+0000 7f420b487640 1 monclient: found mon.noname-a 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:36:45.638+0000 7f420b487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: dump: 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: _finish_auth 0 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: _check_auth_tickets 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:36:45.638+0000 7f40ecff9640 10 monclient: dump: 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:36:45.638+0000 7f420ef42800 5 monclient: authenticate success, global_id 7314 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:36:45.638+0000 7f40ee7fc640 4 set_mon_vals no callback set 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:36:45.638+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:36:45.639+0000 7f420ef42800 10 monclient: _renew_subs 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:36:45.639+0000 7f420ef42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:36:45.639+0000 7f420ef42800 1 librados: init done 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:36:45.639+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cr dump hook 0x7f41fc0ac748 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:36:45.640+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:36:45.641+0000 7f40ecff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:36:45.641+0000 7f40ecff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:36:45.641+0000 7f40ecff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:36:45.641+0000 7f420a485640 10 monclient: get_auth_request con 0x7f40d4077230 auth_method 0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:36:45.641+0000 7f420ac86640 10 monclient: get_auth_request con 0x556c4b41d1d0 auth_method 0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 realm 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:36:45.642+0000 7f420ef42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:36:45.642+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:36:45.642+0000 7f420a485640 10 monclient: get_auth_request con 0x556c4b421550 auth_method 0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:36:45.643+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:36:45.643+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:36:45.643+0000 7f420b487640 10 monclient: get_auth_request con 0x556c4b424c50 auth_method 0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:36:45.644+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:36:45.644+0000 7f420ef42800 20 searching for the correct realm 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:36:45.644+0000 7f420ac86640 10 monclient: get_auth_request con 0x556c4b4299f0 auth_method 0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:36:45.644+0000 7f420a485640 10 monclient: get_auth_request con 0x7f41fc06b020 auth_method 0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:36:45.645+0000 7f420b487640 10 monclient: get_auth_request con 0x7f4200027040 auth_method 0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:36:45.645+0000 7f420b487640 0 -- 172.21.15.7:0/1057299583 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4200027040 msgr2=0x7f4200026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:36:45.846+0000 7f420b487640 10 monclient: get_auth_request con 0x7f4200027040 auth_method 0 2024-09-14T11:36:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:36:45.847+0000 7f420ac86640 10 monclient: get_auth_request con 0x7f420406a250 auth_method 0 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:36:45.851+0000 7f420a485640 0 -- 172.21.15.7:0/1057299583 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f41fc003bb0 msgr2=0x7f41fc0569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:36:46.053+0000 7f420a485640 10 monclient: get_auth_request con 0x7f41fc003bb0 auth_method 0 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:36:46.058+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:36:46.059+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 zone default found 2024-09-14T11:36:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:36:46.060+0000 7f420ef42800 4 Realm: () 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:36:46.060+0000 7f420ef42800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:36:46.060+0000 7f420ef42800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:36:46.060+0000 7f420ef42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 zonegroup default 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:36:46.060+0000 7f420ef42800 20 started sync module instance, tier type = 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:36:46.061+0000 7f420ef42800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=0 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=1 2024-09-14T11:36:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=2 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=3 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=4 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=5 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:36:46.070+0000 7f420ef42800 20 add_watcher() i=6 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:36:46.071+0000 7f420ef42800 20 add_watcher() i=7 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:36:46.071+0000 7f420ef42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding auth protocol: cephx 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding auth protocol: cephx 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding auth protocol: cephx 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:36:46.073+0000 7f40c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: crc 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 AuthRegistry(0x7ffcddafdd00) adding con mode: secure 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:36:46.073+0000 7f420ef42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:36:46.073+0000 7f420ef42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:36:46.073+0000 7f420ef42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache list hook 0x556c4b3f0740 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache inspect hook 0x556c4b3f0740 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache erase hook 0x556c4b3f0740 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command cache zap hook 0x556c4b3f0740 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:36:46.073+0000 7f420ef42800 5 note: GC not initialized 2024-09-14T11:36:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:36:46.074+0000 7f403bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace show hook 0x7f4204004e40 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace history hook 0x7f4204004e40 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace active hook 0x7f4204004e40 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:36:46.074+0000 7f420ef42800 5 asok(0x556c4b10f270) register_command sync trace active_short hook 0x7f4204004e40 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 Filter name: none 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:36:46.074+0000 7f4039ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:36:46.074+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:36:46.074+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:36:46.074+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:36:46.074+0000 7f420ef42800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : miss 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:36:46.075+0000 7f420ef42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:36:46.075+0000 7f420ef42800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:36:46.075+0000 7f420ef42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:36:46.080+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:36:46.080+0000 7f420ef42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:36:46.080+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:36:46.081+0000 7f420ef42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 93923607522224 notifier 7314 bl.length()=1015 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:36:46.081+0000 7f40edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:36:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:36:46.081+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:36:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:36:46.086+0000 7f420ef42800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:36:46.086+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:36:46.087+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:36:46.087+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:36:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:36:46.088+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:36:46.089+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:36:46.090+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:36:46.090+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:36:46.091+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:36:46.091+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:36:46.095+0000 7f420ef42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:36:46.095+0000 7f420ef42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:36:46.096+0000 7f420ef42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529753 cookie 93923607522224 notifier 7314 bl.length()=1015 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:36:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:36:46.096+0000 7f40edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:36:46.097+0000 7f420ef42800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:36:46.099+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:36:46.099+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:36:46.100+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:36:46.101+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:36:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:36:46.102+0000 7f420ef42800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:36:46.103+0000 7f420ef42800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f420ef42800 time 2024-09-14T11:36:46.104442+0000 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f421078c76a] 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:36:46.104+0000 7f420ef42800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f420ef42800 thread_name:radosgw-admin 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f420f43e6f0] 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f420f48b99c] 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f421078c7c4] 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f421078c928] 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556c49f560b1] 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556c49f66217] 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f420f429590] 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:36:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:36:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:36:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:36:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:36:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f4039ffb640 / http_manager 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f403bfff640 / http_manager 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40c17e2640 / rgw_dt_lg_renew 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40ecff9640 / ms_dispatch 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40edffb640 / io_context_pool 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40ee7fc640 / io_context_pool 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40f4e01640 / ms_dispatch 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40f7606640 / ms_dispatch 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f40f8e09640 / io_context_pool 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420a485640 / msgr-worker-2 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420ac86640 / msgr-worker-1 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420b487640 / msgr-worker-0 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420bc88640 / io_context_pool 2024-09-14T11:36:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: 7f420ef42800 / radosgw-admin 2024-09-14T11:36:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:36:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:36:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:46.105856Z_45b32bf2-14f1-422c-9b66-5033de3c92b2/log 2024-09-14T11:36:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:36:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:36:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.183+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 20 realm 2024-09-14T11:36:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.185+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.186+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.186+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.187+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.187+0000 7f5539137800 20 searching for the correct realm 2024-09-14T11:36:46.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.189+0000 7f553567e640 0 -- 172.21.15.7:0/1235883037 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f5520001c20 msgr2=0x7f5520046960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:46.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.395+0000 7f552ffff640 0 -- 172.21.15.7:0/1235883037 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f5528077650 msgr2=0x7f552806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:46.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:46.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.602+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 zone default found 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 4 Realm: () 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 zonegroup default 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 started sync module instance, tier type = 2024-09-14T11:36:46.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.603+0000 7f5539137800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:36:46.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.612+0000 7f5539137800 20 add_watcher() i=0 2024-09-14T11:36:46.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.612+0000 7f5539137800 20 add_watcher() i=1 2024-09-14T11:36:46.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.612+0000 7f5539137800 20 add_watcher() i=2 2024-09-14T11:36:46.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.612+0000 7f5539137800 20 add_watcher() i=3 2024-09-14T11:36:46.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.612+0000 7f5539137800 20 add_watcher() i=4 2024-09-14T11:36:46.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.612+0000 7f5539137800 20 add_watcher() i=5 2024-09-14T11:36:46.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.612+0000 7f5539137800 20 add_watcher() i=6 2024-09-14T11:36:46.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.613+0000 7f5539137800 20 add_watcher() i=7 2024-09-14T11:36:46.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.613+0000 7f5539137800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:46.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.615+0000 7f53eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.615+0000 7f5539137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.615+0000 7f5539137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.615+0000 7f5539137800 5 note: GC not initialized 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.616+0000 7f53ea7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.616+0000 7f5539137800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.616+0000 7f5539137800 20 Filter name: none 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.616+0000 7f53e37fe640 20 reqs_thread_entry: start 2024-09-14T11:36:46.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.616+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.616+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:46.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.616+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.617+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:46.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.617+0000 7f5539137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:46.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.617+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.617+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:46.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.617+0000 7f5539137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:46.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.617+0000 7f5539137800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:46.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.617+0000 7f5539137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:46.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.619+0000 7f53eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:46.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.621+0000 7f5539137800 20 remove_watcher() i=0 2024-09-14T11:36:46.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.621+0000 7f5539137800 2 removed watcher, disabling cache 2024-09-14T11:36:46.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.623+0000 7f5539137800 20 remove_watcher() i=1 2024-09-14T11:36:46.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.624+0000 7f5539137800 20 remove_watcher() i=2 2024-09-14T11:36:46.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.625+0000 7f5539137800 20 remove_watcher() i=3 2024-09-14T11:36:46.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.626+0000 7f5539137800 20 remove_watcher() i=4 2024-09-14T11:36:46.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.627+0000 7f5539137800 20 remove_watcher() i=5 2024-09-14T11:36:46.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.628+0000 7f5539137800 20 remove_watcher() i=6 2024-09-14T11:36:46.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:36:46.629+0000 7f5539137800 20 remove_watcher() i=7 2024-09-14T11:36:46.639 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.639 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:36:46.639 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:46.639 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:36:46.641 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:46.641 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:16.682 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:16.682 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:16.725 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:16.762 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:16.762 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:16.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.810+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 20 realm 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.812+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.813+0000 7fa4f3e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:16.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.813+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.814+0000 7fa4f3e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:16.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.814+0000 7fa4f3e0e800 20 searching for the correct realm 2024-09-14T11:37:16.814 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:16.816+0000 7fa4efd6c640 0 -- 172.21.15.7:0/3566745106 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fa4e4015070 msgr2=0x7fa4e404f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.024+0000 7fa4eed6a640 0 -- 172.21.15.7:0/3566745106 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fa4e0018b30 msgr2=0x7fa4e006c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.232+0000 7fa4f3e0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.232+0000 7fa4f3e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.232+0000 7fa4f3e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.232+0000 7fa4f3e0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.232+0000 7fa4f3e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.232+0000 7fa4f3e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.232+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.233+0000 7fa4f3e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.231 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.233+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.233+0000 7fa4f3e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.233+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:17.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 20 zone default found 2024-09-14T11:37:17.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 4 Realm: () 2024-09-14T11:37:17.232 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 20 zonegroup default 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.234+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.235+0000 7fa4f3e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.233 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.235+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.235+0000 7fa4f3e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.235+0000 7fa4f3e0e800 20 started sync module instance, tier type = 2024-09-14T11:37:17.234 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.235+0000 7fa4f3e0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:17.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.246+0000 7fa4f3e0e800 20 add_watcher() i=0 2024-09-14T11:37:17.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.246+0000 7fa4f3e0e800 20 add_watcher() i=1 2024-09-14T11:37:17.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.246+0000 7fa4f3e0e800 20 add_watcher() i=2 2024-09-14T11:37:17.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.246+0000 7fa4f3e0e800 20 add_watcher() i=3 2024-09-14T11:37:17.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.246+0000 7fa4f3e0e800 20 add_watcher() i=4 2024-09-14T11:37:17.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.246+0000 7fa4f3e0e800 20 add_watcher() i=5 2024-09-14T11:37:17.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.246+0000 7fa4f3e0e800 20 add_watcher() i=6 2024-09-14T11:37:17.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.247+0000 7fa4f3e0e800 20 add_watcher() i=7 2024-09-14T11:37:17.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.247+0000 7fa4f3e0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:17.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.249+0000 7fa3a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.250+0000 7fa4f3e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:17.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.250+0000 7fa4f3e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:17.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.250+0000 7fa4f3e0e800 5 note: GC not initialized 2024-09-14T11:37:17.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.250+0000 7fa3a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:17.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.250+0000 7fa4f3e0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:17.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.250+0000 7fa4f3e0e800 20 Filter name: none 2024-09-14T11:37:17.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.250+0000 7fa31e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:17.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.251+0000 7fa4f3e0e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:37:17.249 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.251+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.251+0000 7fa4f3e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.251+0000 7fa4f3e0e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.251+0000 7fa4f3e0e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.251+0000 7fa4f3e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : miss 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.251+0000 7fa4f3e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.252+0000 7fa4f3e0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.252+0000 7fa4f3e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.252+0000 7fa4f3e0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.252+0000 7fa4f3e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.252+0000 7fa4f3e0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:17.250 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.252+0000 7fa4f3e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:37:17.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:37:17.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:37:17.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:17.255 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa3d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529755 cookie 94237863487376 notifier 7353 bl.length()=1015 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa3d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa3d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa3d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:37:17.256 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.258+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.0 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.1 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.2 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.3 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.4 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:37:17.263 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.5 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.6 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.7 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.8 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.9 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.10 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1.11 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.264+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:37:17.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.265+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:37:17.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.266+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:37:17.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.267+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:37:17.265 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.267+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:37:17.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.268+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:37:17.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.268+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:37:17.266 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.269+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:37:17.267 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.270+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:37:17.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.270+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:37:17.268 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.271+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:37:17.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.274+0000 7fa4f3e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:17.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.274+0000 7fa4f3e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:37:17.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa3d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529756 cookie 94237863487376 notifier 7353 bl.length()=1015 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa3d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa3d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa3d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:17.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:37:17.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:37:17.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:37:17.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.276+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:37:17.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.279+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.0 2024-09-14T11:37:17.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.279+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.1 2024-09-14T11:37:17.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.280+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.2 2024-09-14T11:37:17.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.280+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.3 2024-09-14T11:37:17.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.280+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.4 2024-09-14T11:37:17.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.281+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.5 2024-09-14T11:37:17.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.281+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.6 2024-09-14T11:37:17.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.281+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.7 2024-09-14T11:37:17.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.283+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.8 2024-09-14T11:37:17.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.283+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.9 2024-09-14T11:37:17.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.283+0000 7fa4f3e0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33.10 2024-09-14T11:37:17.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.284+0000 7fa4f3e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:17.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.284+0000 7fa4f3e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa4f3e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa4f3e0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa4f3e0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa4f3e0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33, ofs0, ns] 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa3d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529757 cookie 94237863487376 notifier 7353 bl.length()=983 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa3d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 info.flags=0x17 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa3d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 to cache LRU end 2024-09-14T11:37:17.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.285+0000 7fa3d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:17.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.286+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_sources= new_sources= 2024-09-14T11:37:17.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.286+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential sources added=[] removed=[] 2024-09-14T11:37:17.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.286+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): orig_dests= new_dests= 2024-09-14T11:37:17.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.286+0000 7fa4f3e0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33]): potential dests added=[] removed=[] 2024-09-14T11:37:17.286 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.288+0000 7fa4f3e0e800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:17.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.290+0000 7fa3a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.293+0000 7fa4f3e0e800 20 remove_watcher() i=0 2024-09-14T11:37:17.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.293+0000 7fa4f3e0e800 2 removed watcher, disabling cache 2024-09-14T11:37:17.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.294+0000 7fa4f3e0e800 20 remove_watcher() i=1 2024-09-14T11:37:17.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.295+0000 7fa4f3e0e800 20 remove_watcher() i=2 2024-09-14T11:37:17.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.296+0000 7fa4f3e0e800 20 remove_watcher() i=3 2024-09-14T11:37:17.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.297+0000 7fa4f3e0e800 20 remove_watcher() i=4 2024-09-14T11:37:17.296 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.298+0000 7fa4f3e0e800 20 remove_watcher() i=5 2024-09-14T11:37:17.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.300+0000 7fa4f3e0e800 20 remove_watcher() i=6 2024-09-14T11:37:17.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.301+0000 7fa4f3e0e800 20 remove_watcher() i=7 2024-09-14T11:37:17.312 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:37:17.343 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:17.343 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:17.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.387+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 20 realm 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.389+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.390+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.390+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.391+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:17.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.391+0000 7ffbf7b46800 20 searching for the correct realm 2024-09-14T11:37:17.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.393+0000 7ffbf5e31640 0 -- 172.21.15.7:0/2949809448 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ffbec06f8c0 msgr2=0x7ffbec078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.599+0000 7ffbf4e2f640 0 -- 172.21.15.7:0/2949809448 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ffbe806a680 msgr2=0x7ffbe806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:17.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:17.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:17.804 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:17.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:17.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:17.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.805 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.806+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 zone default found 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 4 Realm: () 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 zonegroup default 2024-09-14T11:37:17.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.807+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.808+0000 7ffbf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.808+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.808+0000 7ffbf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.808+0000 7ffbf7b46800 20 started sync module instance, tier type = 2024-09-14T11:37:17.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.808+0000 7ffbf7b46800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:17.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.818+0000 7ffbf7b46800 20 add_watcher() i=0 2024-09-14T11:37:17.817 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.818+0000 7ffbf7b46800 20 add_watcher() i=1 2024-09-14T11:37:17.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.818+0000 7ffbf7b46800 20 add_watcher() i=2 2024-09-14T11:37:17.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.818+0000 7ffbf7b46800 20 add_watcher() i=3 2024-09-14T11:37:17.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.818+0000 7ffbf7b46800 20 add_watcher() i=4 2024-09-14T11:37:17.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.818+0000 7ffbf7b46800 20 add_watcher() i=5 2024-09-14T11:37:17.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.818+0000 7ffbf7b46800 20 add_watcher() i=6 2024-09-14T11:37:17.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.819+0000 7ffbf7b46800 20 add_watcher() i=7 2024-09-14T11:37:17.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.819+0000 7ffbf7b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:17.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.821+0000 7ffaabfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.821+0000 7ffbf7b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:17.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.821+0000 7ffbf7b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:17.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.821+0000 7ffbf7b46800 5 note: GC not initialized 2024-09-14T11:37:17.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.822+0000 7ffaaafe5640 20 reqs_thread_entry: start 2024-09-14T11:37:17.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.822+0000 7ffbf7b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:17.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.822+0000 7ffbf7b46800 20 Filter name: none 2024-09-14T11:37:17.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.822+0000 7ffaa8fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:17.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.822+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.822+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:37:17.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.822+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.823+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:37:17.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.823+0000 7ffbf7b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:17.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.823+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.823+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:37:17.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.823+0000 7ffbf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.824+0000 7ffbf7b46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:37:17.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.824+0000 7ffbf7b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:17.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.826+0000 7ffaabfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.828+0000 7ffbf7b46800 20 remove_watcher() i=0 2024-09-14T11:37:17.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.828+0000 7ffbf7b46800 2 removed watcher, disabling cache 2024-09-14T11:37:17.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.829+0000 7ffbf7b46800 20 remove_watcher() i=1 2024-09-14T11:37:17.828 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.831+0000 7ffbf7b46800 20 remove_watcher() i=2 2024-09-14T11:37:17.830 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.832+0000 7ffbf7b46800 20 remove_watcher() i=3 2024-09-14T11:37:17.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.833+0000 7ffbf7b46800 20 remove_watcher() i=4 2024-09-14T11:37:17.832 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.834+0000 7ffbf7b46800 20 remove_watcher() i=5 2024-09-14T11:37:17.833 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.835+0000 7ffbf7b46800 20 remove_watcher() i=6 2024-09-14T11:37:17.834 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:17.836+0000 7ffbf7b46800 20 remove_watcher() i=7 2024-09-14T11:37:17.846 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:17.846 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:17.846 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-commit-target-layout id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:17.846 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:17.848 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.848 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:17.852 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.852 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:17.895 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.895 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:17.925 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:37:17.925 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:17.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.926 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:17.938 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.939 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:17.981 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.981 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:17.988 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.988 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:17.995 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:17.995 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.001 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.001 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.008 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.008 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.015 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.015 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.022 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.023 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.029 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.029 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.072 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.072 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.079 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.079 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.085 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.085 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.092 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.092 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.097 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.098 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.104 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.104 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.110 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.110 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.116 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.116 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.123 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.123 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.129 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.129 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.135 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.136 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.141 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:18.142 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:18.148 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:37:18.177 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:18.177 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:18.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.219+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 20 realm 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.221+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.222+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:18.220 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.222+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.223+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:18.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.223+0000 7f7e97722800 20 searching for the correct realm 2024-09-14T11:37:18.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.225+0000 7f7e93bd3640 0 -- 172.21.15.7:0/1246898168 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f7e7c08cbd0 msgr2=0x7f7e7c08b500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:18.227 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.229+0000 7f7e92bd1640 0 -- 172.21.15.7:0/1246898168 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f7e840734e0 msgr2=0x7f7e840a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.435+0000 7f7e97722800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.435+0000 7f7e97722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.435+0000 7f7e97722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.435+0000 7f7e97722800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.435+0000 7f7e97722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.435+0000 7f7e97722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.435+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:18.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 zone default found 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 4 Realm: () 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 zonegroup default 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.436+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.437+0000 7f7e97722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.437+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.437+0000 7f7e97722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.437+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.437+0000 7f7e97722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.437+0000 7f7e97722800 20 started sync module instance, tier type = 2024-09-14T11:37:18.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.437+0000 7f7e97722800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:18.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.447+0000 7f7e97722800 20 add_watcher() i=0 2024-09-14T11:37:18.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.447+0000 7f7e97722800 20 add_watcher() i=1 2024-09-14T11:37:18.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.447+0000 7f7e97722800 20 add_watcher() i=2 2024-09-14T11:37:18.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.447+0000 7f7e97722800 20 add_watcher() i=3 2024-09-14T11:37:18.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.447+0000 7f7e97722800 20 add_watcher() i=4 2024-09-14T11:37:18.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.447+0000 7f7e97722800 20 add_watcher() i=5 2024-09-14T11:37:18.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.447+0000 7f7e97722800 20 add_watcher() i=6 2024-09-14T11:37:18.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.448+0000 7f7e97722800 20 add_watcher() i=7 2024-09-14T11:37:18.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.448+0000 7f7e97722800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:18.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.449+0000 7f7d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:18.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7e97722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:18.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7e97722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:18.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7e97722800 5 note: GC not initialized 2024-09-14T11:37:18.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7d48fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:18.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7e97722800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:18.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7e97722800 20 Filter name: none 2024-09-14T11:37:18.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7cc27fc640 20 reqs_thread_entry: start 2024-09-14T11:37:18.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.450+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.451+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.451+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.451+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.451+0000 7f7e97722800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.451+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.452+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.452+0000 7f7e97722800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.452+0000 7f7e97722800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:18.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.452+0000 7f7e97722800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:18.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.454+0000 7f7d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:18.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.456+0000 7f7e97722800 20 remove_watcher() i=0 2024-09-14T11:37:18.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.456+0000 7f7e97722800 2 removed watcher, disabling cache 2024-09-14T11:37:18.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.457+0000 7f7e97722800 20 remove_watcher() i=1 2024-09-14T11:37:18.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.458+0000 7f7e97722800 20 remove_watcher() i=2 2024-09-14T11:37:18.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.459+0000 7f7e97722800 20 remove_watcher() i=3 2024-09-14T11:37:18.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.460+0000 7f7e97722800 20 remove_watcher() i=4 2024-09-14T11:37:18.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.461+0000 7f7e97722800 20 remove_watcher() i=5 2024-09-14T11:37:18.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.462+0000 7f7e97722800 20 remove_watcher() i=6 2024-09-14T11:37:18.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.463+0000 7f7e97722800 20 remove_watcher() i=7 2024-09-14T11:37:18.471 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:18.471 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:18.471 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-do-reshard id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:18.471 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:18.473 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:37:18.507 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:18.507 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:18.547 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.549+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.551+0000 7f43eda87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.551+0000 7f43eda87800 20 realm 2024-09-14T11:37:18.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.551+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.551+0000 7f43eda87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.551+0000 7f43eda87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:18.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.551+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.552+0000 7f43eda87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.552+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.552+0000 7f43eda87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:18.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.553+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.553+0000 7f43eda87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:18.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.553+0000 7f43eda87800 20 searching for the correct realm 2024-09-14T11:37:18.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.555+0000 7f43ebd72640 0 -- 172.21.15.7:0/37722307 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f43e0049170 msgr2=0x7f43e006abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:18.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.762+0000 7f43ead70640 0 -- 172.21.15.7:0/37722307 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f43dc0acb80 msgr2=0x7f43dc0b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:18.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:18.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:18.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.969+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:18.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:18.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 zone default found 2024-09-14T11:37:18.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 4 Realm: () 2024-09-14T11:37:18.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:18.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:18.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:18.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 zonegroup default 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.970+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.971+0000 7f43eda87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.971+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.971+0000 7f43eda87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.971+0000 7f43eda87800 20 started sync module instance, tier type = 2024-09-14T11:37:18.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.971+0000 7f43eda87800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:18.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.982+0000 7f43eda87800 20 add_watcher() i=0 2024-09-14T11:37:18.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.982+0000 7f43eda87800 20 add_watcher() i=1 2024-09-14T11:37:18.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.982+0000 7f43eda87800 20 add_watcher() i=2 2024-09-14T11:37:18.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.982+0000 7f43eda87800 20 add_watcher() i=3 2024-09-14T11:37:18.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.982+0000 7f43eda87800 20 add_watcher() i=4 2024-09-14T11:37:18.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.982+0000 7f43eda87800 20 add_watcher() i=5 2024-09-14T11:37:18.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.982+0000 7f43eda87800 20 add_watcher() i=6 2024-09-14T11:37:18.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.983+0000 7f43eda87800 20 add_watcher() i=7 2024-09-14T11:37:18.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.983+0000 7f43eda87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:18.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.984+0000 7f42a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:18.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f43eda87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:18.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f43eda87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:18.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f43eda87800 5 note: GC not initialized 2024-09-14T11:37:18.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f42a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:18.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f43eda87800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:18.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f43eda87800 20 Filter name: none 2024-09-14T11:37:18.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f421a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:18.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f43eda87800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:37:18.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.985+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 : miss 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:18.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.986+0000 7f43eda87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f43eda87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f43eda87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f43eda87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f43eda87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34, ofs0, ns] 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f42ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 93860944809664 notifier 7407 bl.length()=995 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f42ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f42ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:18.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.994+0000 7f42ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:18.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.995+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_sources= new_sources= 2024-09-14T11:37:18.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.995+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential sources added=[] removed=[] 2024-09-14T11:37:18.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.995+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_dests= new_dests= 2024-09-14T11:37:18.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:18.995+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential dests added=[] removed=[] 2024-09-14T11:37:18.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.000+0000 7f43eda87800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:37:19.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.009+0000 7f43eda87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:19.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.009+0000 7f43eda87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 2024-09-14T11:37:19.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f43eda87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f43eda87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f43eda87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f43eda87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34, ofs0, ns] 2024-09-14T11:37:19.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f42ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529708 cookie 93860944809664 notifier 7407 bl.length()=963 2024-09-14T11:37:19.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f42ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f42ce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.010+0000 7f42ce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.011+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_sources= new_sources= 2024-09-14T11:37:19.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.011+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential sources added=[] removed=[] 2024-09-14T11:37:19.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.011+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_dests= new_dests= 2024-09-14T11:37:19.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.011+0000 7f43eda87800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential dests added=[] removed=[] 2024-09-14T11:37:19.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.011+0000 7f43eda87800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:37:19.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.013+0000 7f42a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.015+0000 7f43eda87800 20 remove_watcher() i=0 2024-09-14T11:37:19.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.015+0000 7f43eda87800 2 removed watcher, disabling cache 2024-09-14T11:37:19.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.017+0000 7f43eda87800 20 remove_watcher() i=1 2024-09-14T11:37:19.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.018+0000 7f43eda87800 20 remove_watcher() i=2 2024-09-14T11:37:19.017 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.019+0000 7f43eda87800 20 remove_watcher() i=3 2024-09-14T11:37:19.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.020+0000 7f43eda87800 20 remove_watcher() i=4 2024-09-14T11:37:19.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.021+0000 7f43eda87800 20 remove_watcher() i=5 2024-09-14T11:37:19.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.022+0000 7f43eda87800 20 remove_watcher() i=6 2024-09-14T11:37:19.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.023+0000 7f43eda87800 20 remove_watcher() i=7 2024-09-14T11:37:19.034 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:37:19.064 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:19.064 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:19.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.107+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 20 realm 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.109+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.110+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.110+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.111+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:19.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.111+0000 7f19c3e98800 20 searching for the correct realm 2024-09-14T11:37:19.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.111+0000 7f19c1982640 0 -- 172.21.15.7:0/3914303324 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55c73c261550 msgr2=0x55c73c2639f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:19.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.315+0000 7f19c1982640 0 -- 172.21.15.7:0/3914303324 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55c73c261550 msgr2=0x55c73c2639f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.323+0000 7f19c3e98800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.323+0000 7f19c3e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.323+0000 7f19c3e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:19.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.323+0000 7f19c3e98800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.323+0000 7f19c3e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.323+0000 7f19c3e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 zone default found 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 4 Realm: () 2024-09-14T11:37:19.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 zonegroup default 2024-09-14T11:37:19.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.324+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.325+0000 7f19c3e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.325+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.325+0000 7f19c3e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.325+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.325+0000 7f19c3e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.325 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.325+0000 7f19c3e98800 20 started sync module instance, tier type = 2024-09-14T11:37:19.326 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.325+0000 7f19c3e98800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.335+0000 7f19c3e98800 20 add_watcher() i=0 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.335+0000 7f19c3e98800 20 add_watcher() i=1 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.335+0000 7f19c3e98800 20 add_watcher() i=2 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.335+0000 7f19c3e98800 20 add_watcher() i=3 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.335+0000 7f19c3e98800 20 add_watcher() i=4 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.335+0000 7f19c3e98800 20 add_watcher() i=5 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.335+0000 7f19c3e98800 20 add_watcher() i=6 2024-09-14T11:37:19.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.336+0000 7f19c3e98800 20 add_watcher() i=7 2024-09-14T11:37:19.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.336+0000 7f19c3e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:19.335 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.338+0000 7f18737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.338+0000 7f19c3e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:19.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.338+0000 7f19c3e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:19.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.338+0000 7f19c3e98800 5 note: GC not initialized 2024-09-14T11:37:19.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.338+0000 7f18727fc640 20 reqs_thread_entry: start 2024-09-14T11:37:19.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.338+0000 7f19c3e98800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:19.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f19c3e98800 20 Filter name: none 2024-09-14T11:37:19.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f17e7fff640 20 reqs_thread_entry: start 2024-09-14T11:37:19.337 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f19c3e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.339+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.340+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.340+0000 7f19c3e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.340+0000 7f19c3e98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:19.338 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.340+0000 7f19c3e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:19.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.342+0000 7f18737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.344+0000 7f19c3e98800 20 remove_watcher() i=0 2024-09-14T11:37:19.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.344+0000 7f19c3e98800 2 removed watcher, disabling cache 2024-09-14T11:37:19.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.345+0000 7f19c3e98800 20 remove_watcher() i=1 2024-09-14T11:37:19.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.347+0000 7f19c3e98800 20 remove_watcher() i=2 2024-09-14T11:37:19.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.348+0000 7f19c3e98800 20 remove_watcher() i=3 2024-09-14T11:37:19.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.349+0000 7f19c3e98800 20 remove_watcher() i=4 2024-09-14T11:37:19.347 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.350+0000 7f19c3e98800 20 remove_watcher() i=5 2024-09-14T11:37:19.348 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.351+0000 7f19c3e98800 20 remove_watcher() i=6 2024-09-14T11:37:19.349 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.352+0000 7f19c3e98800 20 remove_watcher() i=7 2024-09-14T11:37:19.360 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:19.360 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:19.361 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-do-reshard id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:19.361 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:19.362 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:19.362 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:19.369 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:19.369 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:19.412 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:19.445 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:19.445 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:19.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.487+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 20 realm 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.489+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.490+0000 7fd672c0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.490+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.491+0000 7fd672c0d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:19.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.491+0000 7fd672c0d800 20 searching for the correct realm 2024-09-14T11:37:19.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.493+0000 7fd670ef8640 0 -- 172.21.15.7:0/3474920055 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fd658064030 msgr2=0x7fd658047c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.700+0000 7fd667fff640 0 -- 172.21.15.7:0/3474920055 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fd66001a3f0 msgr2=0x7fd66001a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.907+0000 7fd672c0d800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.907+0000 7fd672c0d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.907+0000 7fd672c0d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.907+0000 7fd672c0d800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.907+0000 7fd672c0d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.907+0000 7fd672c0d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:19.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.907+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.908+0000 7fd672c0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.908+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.908+0000 7fd672c0d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.908+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.908+0000 7fd672c0d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 20 zone default found 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 4 Realm: () 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 20 zonegroup default 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.907 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.909+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.910+0000 7fd672c0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.910+0000 7fd672c0d800 20 started sync module instance, tier type = 2024-09-14T11:37:19.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.910+0000 7fd672c0d800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.920+0000 7fd672c0d800 20 add_watcher() i=0 2024-09-14T11:37:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.920+0000 7fd672c0d800 20 add_watcher() i=1 2024-09-14T11:37:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.920+0000 7fd672c0d800 20 add_watcher() i=2 2024-09-14T11:37:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.920+0000 7fd672c0d800 20 add_watcher() i=3 2024-09-14T11:37:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.920+0000 7fd672c0d800 20 add_watcher() i=4 2024-09-14T11:37:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.920+0000 7fd672c0d800 20 add_watcher() i=5 2024-09-14T11:37:19.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.920+0000 7fd672c0d800 20 add_watcher() i=6 2024-09-14T11:37:19.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.921+0000 7fd672c0d800 20 add_watcher() i=7 2024-09-14T11:37:19.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.921+0000 7fd672c0d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.923+0000 7fd526fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd672c0d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd672c0d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:19.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd672c0d800 5 note: GC not initialized 2024-09-14T11:37:19.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd525fdb640 20 reqs_thread_entry: start 2024-09-14T11:37:19.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd672c0d800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd672c0d800 20 Filter name: none 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd4977fe640 20 reqs_thread_entry: start 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd672c0d800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.924+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 : miss 2024-09-14T11:37:19.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:19.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:19.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.925+0000 7fd672c0d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 2024-09-14T11:37:19.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.931+0000 7fd672c0d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.931+0000 7fd672c0d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.931+0000 7fd672c0d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.931+0000 7fd672c0d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34, ofs0, ns] 2024-09-14T11:37:19.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd5477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529709 cookie 94657601632032 notifier 7443 bl.length()=995 2024-09-14T11:37:19.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd5477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd5477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd5477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_sources= new_sources= 2024-09-14T11:37:19.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential sources added=[] removed=[] 2024-09-14T11:37:19.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_dests= new_dests= 2024-09-14T11:37:19.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.932+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential dests added=[] removed=[] 2024-09-14T11:37:19.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.0 2024-09-14T11:37:19.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.0 2024-09-14T11:37:19.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.1 2024-09-14T11:37:19.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.1 2024-09-14T11:37:19.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.2 2024-09-14T11:37:19.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.2 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.3 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.3 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.4 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.4 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.5 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.5 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.6 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.6 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.7 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.7 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.8 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.8 2024-09-14T11:37:19.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.9 2024-09-14T11:37:19.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.9 2024-09-14T11:37:19.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.10 2024-09-14T11:37:19.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.10 2024-09-14T11:37:19.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.11 2024-09-14T11:37:19.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1.11 2024-09-14T11:37:19.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.0 2024-09-14T11:37:19.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.937+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1 2024-09-14T11:37:19.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.938+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.2 2024-09-14T11:37:19.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.938+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.3 2024-09-14T11:37:19.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.939+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.4 2024-09-14T11:37:19.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.939+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.5 2024-09-14T11:37:19.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.940+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.6 2024-09-14T11:37:19.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.940+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.7 2024-09-14T11:37:19.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.941+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.8 2024-09-14T11:37:19.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.942+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.9 2024-09-14T11:37:19.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.942+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.10 2024-09-14T11:37:19.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.946+0000 7fd672c0d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:19.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.946+0000 7fd672c0d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 2024-09-14T11:37:19.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd672c0d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd672c0d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd672c0d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd672c0d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34, ofs0, ns] 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd5477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529710 cookie 94657601632032 notifier 7443 bl.length()=995 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd5477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd5477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.948+0000 7fd5477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.949+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_sources= new_sources= 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.949+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential sources added=[] removed=[] 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.949+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_dests= new_dests= 2024-09-14T11:37:19.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.949+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential dests added=[] removed=[] 2024-09-14T11:37:19.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.951+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.0 2024-09-14T11:37:19.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.951+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.1 2024-09-14T11:37:19.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.952+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.2 2024-09-14T11:37:19.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.952+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.3 2024-09-14T11:37:19.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.952+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.4 2024-09-14T11:37:19.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.953+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.5 2024-09-14T11:37:19.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.953+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.6 2024-09-14T11:37:19.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.953+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.7 2024-09-14T11:37:19.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.954+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.8 2024-09-14T11:37:19.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.954+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.9 2024-09-14T11:37:19.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.955+0000 7fd672c0d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34.10 2024-09-14T11:37:19.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.955+0000 7fd672c0d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:19.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.955+0000 7fd672c0d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.956+0000 7fd672c0d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.956+0000 7fd672c0d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.956+0000 7fd672c0d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.956+0000 7fd672c0d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34, ofs0, ns] 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd546ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529711 cookie 94657601632032 notifier 7443 bl.length()=963 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd546ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 info.flags=0x17 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd546ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 to cache LRU end 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd546ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_sources= new_sources= 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential sources added=[] removed=[] 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): orig_dests= new_dests= 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.957+0000 7fd672c0d800 20 handle_bi_update(): bucket=:error-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34]): potential dests added=[] removed=[] 2024-09-14T11:37:19.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.960+0000 7fd672c0d800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:19.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.962+0000 7fd526fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.964+0000 7fd672c0d800 20 remove_watcher() i=0 2024-09-14T11:37:19.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.964+0000 7fd672c0d800 2 removed watcher, disabling cache 2024-09-14T11:37:19.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.965+0000 7fd672c0d800 20 remove_watcher() i=1 2024-09-14T11:37:19.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.966+0000 7fd672c0d800 20 remove_watcher() i=2 2024-09-14T11:37:19.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.968+0000 7fd672c0d800 20 remove_watcher() i=3 2024-09-14T11:37:19.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.969+0000 7fd672c0d800 20 remove_watcher() i=4 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.970+0000 7fd672c0d800 20 remove_watcher() i=5 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.971+0000 7fd672c0d800 20 remove_watcher() i=6 2024-09-14T11:37:19.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:19.972+0000 7fd672c0d800 20 remove_watcher() i=7 2024-09-14T11:37:19.983 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:37:20.013 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:20.013 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:20.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.054+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 20 realm 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.056+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.057+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.057+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.058+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:20.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.058+0000 7f6945528800 20 searching for the correct realm 2024-09-14T11:37:20.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.060+0000 7f694195e640 0 -- 172.21.15.7:0/784455367 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f692c06b070 msgr2=0x7f692c0753e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.264 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.267+0000 7f694095c640 0 -- 172.21.15.7:0/784455367 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f69340782b0 msgr2=0x7f69340787b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:20.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.474+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 zone default found 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 4 Realm: () 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:20.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 zonegroup default 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.475+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.476+0000 7f6945528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.476+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.476+0000 7f6945528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.476+0000 7f6945528800 20 started sync module instance, tier type = 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.476+0000 7f6945528800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.486+0000 7f6945528800 20 add_watcher() i=0 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.486+0000 7f6945528800 20 add_watcher() i=1 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.486+0000 7f6945528800 20 add_watcher() i=2 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.486+0000 7f6945528800 20 add_watcher() i=3 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.486+0000 7f6945528800 20 add_watcher() i=4 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.486+0000 7f6945528800 20 add_watcher() i=5 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.486+0000 7f6945528800 20 add_watcher() i=6 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.487+0000 7f6945528800 20 add_watcher() i=7 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.487+0000 7f6945528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:20.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.489+0000 7f67f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.489+0000 7f6945528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:20.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.489+0000 7f6945528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:20.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.489+0000 7f6945528800 5 note: GC not initialized 2024-09-14T11:37:20.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.490+0000 7f67f67e4640 20 reqs_thread_entry: start 2024-09-14T11:37:20.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.490+0000 7f6945528800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:20.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.490+0000 7f6945528800 20 Filter name: none 2024-09-14T11:37:20.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.490+0000 7f6767fff640 20 reqs_thread_entry: start 2024-09-14T11:37:20.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.490+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.490+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.490+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.491+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.491+0000 7f6945528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.491+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.491+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.491+0000 7f6945528800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.491+0000 7f6945528800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.491+0000 7f6945528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.493+0000 7f67f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.496+0000 7f6945528800 20 remove_watcher() i=0 2024-09-14T11:37:20.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.496+0000 7f6945528800 2 removed watcher, disabling cache 2024-09-14T11:37:20.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.497+0000 7f6945528800 20 remove_watcher() i=1 2024-09-14T11:37:20.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.498+0000 7f6945528800 20 remove_watcher() i=2 2024-09-14T11:37:20.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.499+0000 7f6945528800 20 remove_watcher() i=3 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.500+0000 7f6945528800 20 remove_watcher() i=4 2024-09-14T11:37:20.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.501+0000 7f6945528800 20 remove_watcher() i=5 2024-09-14T11:37:20.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.502+0000 7f6945528800 20 remove_watcher() i=6 2024-09-14T11:37:20.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.503+0000 7f6945528800 20 remove_watcher() i=7 2024-09-14T11:37:20.512 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:20.512 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:20.512 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-do-reshard id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:20.512 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:20.514 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.514 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.518 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.518 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.561 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.561 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.591 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:37:20.591 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:20.592 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.592 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.605 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.606 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.650 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.650 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.658 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.658 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.665 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.665 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.672 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.672 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.679 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.679 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.685 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.685 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.691 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.691 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.698 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.698 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.704 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.704 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.710 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.710 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.716 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.717 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.723 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.723 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.728 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.729 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.735 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.735 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.741 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.741 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.747 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.747 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.753 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.753 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.760 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.760 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.766 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.766 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.772 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:20.773 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:20.779 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:37:20.809 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:20.809 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:20.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.851+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.853+0000 7f810040e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.853+0000 7f810040e800 20 realm 2024-09-14T11:37:20.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.853+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.853+0000 7f810040e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.853+0000 7f810040e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:20.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.853+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.854+0000 7f810040e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.854+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.855+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.855+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.856+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:20.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.856+0000 7f810040e800 20 searching for the correct realm 2024-09-14T11:37:20.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:20.857+0000 7f80fb419640 0 -- 172.21.15.7:0/1593310782 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f80ec06ae00 msgr2=0x7f80ec060680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.063+0000 7f80fc41b640 0 -- 172.21.15.7:0/1593310782 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f80f008e4c0 msgr2=0x7f80f004d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.271+0000 7f810040e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:21.269 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.271+0000 7f810040e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.271+0000 7f810040e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.271+0000 7f810040e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:21.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.271+0000 7f810040e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.271+0000 7f810040e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.271+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.270 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 zone default found 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 4 Realm: () 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:21.271 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 zonegroup default 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.272+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.273+0000 7f810040e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.273+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.273+0000 7f810040e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.273+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.273+0000 7f810040e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.273+0000 7f810040e800 20 started sync module instance, tier type = 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.273+0000 7f810040e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:21.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.286+0000 7f810040e800 20 add_watcher() i=0 2024-09-14T11:37:21.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.286+0000 7f810040e800 20 add_watcher() i=1 2024-09-14T11:37:21.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.286+0000 7f810040e800 20 add_watcher() i=2 2024-09-14T11:37:21.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.286+0000 7f810040e800 20 add_watcher() i=3 2024-09-14T11:37:21.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.286+0000 7f810040e800 20 add_watcher() i=4 2024-09-14T11:37:21.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.286+0000 7f810040e800 20 add_watcher() i=5 2024-09-14T11:37:21.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.286+0000 7f810040e800 20 add_watcher() i=6 2024-09-14T11:37:21.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.287+0000 7f810040e800 20 add_watcher() i=7 2024-09-14T11:37:21.284 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.287+0000 7f810040e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.288+0000 7f7fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f810040e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f810040e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f810040e800 5 note: GC not initialized 2024-09-14T11:37:21.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f7fb0fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:21.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f810040e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.287 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f810040e800 20 Filter name: none 2024-09-14T11:37:21.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f7f2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:21.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.289+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.290+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:21.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.290+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.291+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:21.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.291+0000 7f810040e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.289 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.291+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.291+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:21.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.291+0000 7f810040e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.292+0000 7f810040e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:21.290 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.292+0000 7f810040e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.291 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.293+0000 7f7fb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.297+0000 7f810040e800 20 remove_watcher() i=0 2024-09-14T11:37:21.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.297+0000 7f810040e800 2 removed watcher, disabling cache 2024-09-14T11:37:21.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.298+0000 7f810040e800 20 remove_watcher() i=1 2024-09-14T11:37:21.297 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.299+0000 7f810040e800 20 remove_watcher() i=2 2024-09-14T11:37:21.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.301+0000 7f810040e800 20 remove_watcher() i=3 2024-09-14T11:37:21.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.303+0000 7f810040e800 20 remove_watcher() i=4 2024-09-14T11:37:21.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.304+0000 7f810040e800 20 remove_watcher() i=5 2024-09-14T11:37:21.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.305+0000 7f810040e800 20 remove_watcher() i=6 2024-09-14T11:37:21.303 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.306+0000 7f810040e800 20 remove_watcher() i=7 2024-09-14T11:37:21.314 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.315 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:21.315 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-do-reshard id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:21.315 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.317 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.595 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.597+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 20 realm 2024-09-14T11:37:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.598 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.601+0000 7f6b09925800 20 searching for the correct realm 2024-09-14T11:37:21.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.603+0000 7f6b04dad640 0 -- 172.21.15.7:0/1532002453 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f6af8024070 msgr2=0x7f6af809aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.607+0000 7f6b04dad640 0 -- 172.21.15.7:0/1532002453 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f69d0087050 msgr2=0x7f69d0089480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 zone default found 2024-09-14T11:37:21.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 4 Realm: () 2024-09-14T11:37:21.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:21.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 zonegroup default 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.614+0000 7f6b09925800 20 started sync module instance, tier type = 2024-09-14T11:37:21.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.614+0000 7f6b09925800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:21.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=0 2024-09-14T11:37:21.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=1 2024-09-14T11:37:21.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=2 2024-09-14T11:37:21.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=3 2024-09-14T11:37:21.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=4 2024-09-14T11:37:21.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=5 2024-09-14T11:37:21.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=6 2024-09-14T11:37:21.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.625+0000 7f6b09925800 20 add_watcher() i=7 2024-09-14T11:37:21.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.625+0000 7f6b09925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.626+0000 7f69bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f6b09925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f6b09925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f6b09925800 5 note: GC not initialized 2024-09-14T11:37:21.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f69ba7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:21.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f6b09925800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f6b09925800 20 Filter name: none 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f692bfff640 20 reqs_thread_entry: start 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f6b09925800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.627+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 : miss 2024-09-14T11:37:21.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:21.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:21.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.628+0000 7f6b09925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 2024-09-14T11:37:21.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35, ofs0, ns] 2024-09-14T11:37:21.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529689 cookie 94680751266176 notifier 7121 bl.length()=995 2024-09-14T11:37:21.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_sources= new_sources= 2024-09-14T11:37:21.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential sources added=[] removed=[] 2024-09-14T11:37:21.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_dests= new_dests= 2024-09-14T11:37:21.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential dests added=[] removed=[] 2024-09-14T11:37:21.636 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b09925800 time 2024-09-14T11:37:21.639809+0000 2024-09-14T11:37:21.637 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.637 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.637 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b0af8c76a] 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.640+0000 7f6b09925800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b09925800 time 2024-09-14T11:37:21.639809+0000 2024-09-14T11:37:21.638 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b0af8c76a] 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:37:21.639 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f6b09925800 thread_name:radosgw-admin 2024-09-14T11:37:21.652 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.652 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b09c3e6f0] 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b09c8b99c] 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b0af8c7c4] 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.640+0000 7f6b09925800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:21.653 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f6b09925800 thread_name:radosgw-admin 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b09c3e6f0] 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b09c8b99c] 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b0af8c7c4] 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.654 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:37:21.376+0000 7f69f3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:37:21.376+0000 7f69f3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:37:21.376+0000 7f69f3606640 10 monclient: dump: 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:37:21.376+0000 7f6b09925800 5 monclient: authenticate success, global_id 7109 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:37:21.376+0000 7f6b09925800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:37:21.376+0000 7f6b09925800 4 set_mon_vals no callback set 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: shutdown 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 asok(0x561c9459e270) unregister_commands rotate-key 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.656 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding auth protocol: cephx 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding auth protocol: cephx 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding auth protocol: cephx 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:37:21.377+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: starting msgr at 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: starting objecter 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 asok(0x561c9459e270) register_command objecter_requests hook 0x561c947c5540 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: setting wanted keys 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: calling monclient init 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding auth protocol: cephx 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding auth protocol: cephx 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding auth protocol: cephx 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:37:21.377+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:37:21.378+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:37:21.378+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key hook 0x561c947bd3b8 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:21.660 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c94636a00 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c94700300 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c94702fb0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2141.934268s 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c94636a00 auth_method 0 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c94700300 auth_method 0 2024-09-14T11:37:21.661 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_done global_id 7112 payload 824 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:37:21.378+0000 7f6b055ae640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: dump: 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.663 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: dump: 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.664 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:37:21.378+0000 7f6b09925800 5 monclient: authenticate success, global_id 7112 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:37:21.378+0000 7f69f3606640 4 set_mon_vals no callback set 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.665 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:37:21.379+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:37:21.379+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:37:21.379+0000 7f6b09925800 1 librados: init done 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:37:21.380+0000 7f69f1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:37:21.380+0000 7f69f1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:37:21.380+0000 7f69f1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:37:21.381+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f69ec077230 auth_method 0 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:37:21.381+0000 7f6b05daf640 10 monclient: get_auth_request con 0x561c94806d90 auth_method 0 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:37:21.382+0000 7f6b055ae640 10 monclient: get_auth_request con 0x561c94809bd0 auth_method 0 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:37:21.382+0000 7f6b04dad640 10 monclient: get_auth_request con 0x561c9480e080 auth_method 0 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:37:21.585+0000 7f6b04dad640 10 monclient: get_auth_request con 0x561c9480e080 auth_method 0 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:37:21.586+0000 7f6b05daf640 10 monclient: get_auth_request con 0x561c94812100 auth_method 0 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:37:21.587+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:37:21.587+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:37:21.587+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.667 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding auth protocol: cephx 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding auth protocol: cephx 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding auth protocol: cephx 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.668 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:37:21.587+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 asok(0x561c9459e270) register_command objecter_requests cmddesc objecter_requests hook 0x561c948197f0 EEXIST 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:37:21.587+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding auth protocol: cephx 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding auth protocol: cephx 2024-09-14T11:37:21.669 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding auth protocol: cephx 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:37:21.588+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:37:21.588+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:37:21.588+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key cmddesc rotate-key hook 0x561c94815280 EEXIST 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c9483db10 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c9483def0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c9483c820 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2142.144441s 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c9483db10 auth_method 0 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c9483c820 auth_method 0 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): get_auth_request con 0x561c9483def0 auth_method 0 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:37:21.588+0000 7f6b055ae640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.674 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: dump: 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: dump: 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:37:21.589+0000 7f6b09925800 5 monclient: authenticate success, global_id 7115 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:37:21.589+0000 7f6b065b0640 4 set_mon_vals no callback set 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:37:21.591+0000 7f69eaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:37:21.591+0000 7f69eaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:37:21.591+0000 7f69eaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:37:21.591+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f69e0077140 auth_method 0 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: get_monmap_and_config 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:37:21.591+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding auth protocol: cephx 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding auth protocol: cephx 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding auth protocol: cephx 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.679 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:37:21.591+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding auth protocol: cephx 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding auth protocol: cephx 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding auth protocol: cephx 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:37:21.592+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:37:21.592+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:37:21.592+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key cmddesc rotate-key hook 0x7ffe582edd18 EEXIST 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c9488bb60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c9488bf40 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c94896ca0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2142.148486s 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c94896ca0 auth_method 0 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c9488bb60 auth_method 0 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): get_auth_request con 0x561c9488bf40 auth_method 0 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_done global_id 7494 payload 274 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:37:21.592+0000 7f6b055ae640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: dump: 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 monclient: authenticate success, global_id 7494 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:37:21.593+0000 7f6b09925800 4 set_mon_vals no callback set 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: dump: 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: shutdown 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:37:21.593+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding auth protocol: cephx 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding auth protocol: cephx 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding auth protocol: cephx 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:37:21.594+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: starting msgr at 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: starting objecter 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 asok(0x561c9459e270) register_command objecter_requests cmddesc objecter_requests hook 0x561c9488b9c0 EEXIST 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: setting wanted keys 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: calling monclient init 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding auth protocol: cephx 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding auth protocol: cephx 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding auth protocol: cephx 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:37:21.594+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:37:21.594+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key cmddesc rotate-key hook 0x561c94852518 EEXIST 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c9488bb60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c94896ca0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c9489f7a0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2142.150976s 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c9488bb60 auth_method 0 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c9489f7a0 auth_method 0 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): get_auth_request con 0x561c94896ca0 auth_method 0 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:37:21.595+0000 7f6b04dad640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: dump: 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:37:21.595+0000 7f6b09925800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: dump: 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:37:21.595+0000 7f69e8ff9640 4 set_mon_vals no callback set 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:37:21.595+0000 7f6b09925800 1 librados: init done 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:37:21.595+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cr dump hook 0x561c94888ed8 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:37:21.597+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:37:21.598+0000 7f69d6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:37:21.598+0000 7f69d6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:37:21.598+0000 7f69d6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:37:21.598+0000 7f6b05daf640 10 monclient: get_auth_request con 0x7f69d0077230 auth_method 0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:37:21.598+0000 7f6b055ae640 10 monclient: get_auth_request con 0x561c948ac2c0 auth_method 0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 realm 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:37:21.599+0000 7f6b09925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:37:21.600+0000 7f6b04dad640 10 monclient: get_auth_request con 0x561c948b0650 auth_method 0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:37:21.601+0000 7f6b05daf640 10 monclient: get_auth_request con 0x561c948b3d50 auth_method 0 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 searching for the correct realm 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:37:21.602+0000 7f6b055ae640 10 monclient: get_auth_request con 0x561c948b8b30 auth_method 0 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:37:21.602+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f6af8024070 auth_method 0 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:37:21.603+0000 7f6b04dad640 0 -- 172.21.15.7:0/1532002453 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f6af8024070 msgr2=0x7f6af809aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:37:21.603+0000 7f69d6ffd640 1 client.7121.objecter ms_handle_reset 0x7f6af8024070 session 0x7f6af80a1040 osd.7 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:37:21.603+0000 7f69d6ffd640 10 monclient: _renew_subs 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:37:21.603+0000 7f69d6ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:37:21.603+0000 7f6b05daf640 10 monclient: get_auth_request con 0x7f6af0094020 auth_method 0 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:37:21.603+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f69d0087050 auth_method 0 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:37:21.604+0000 7f6b055ae640 10 monclient: get_auth_request con 0x7f6b00031040 auth_method 0 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:37:21.607+0000 7f6b04dad640 0 -- 172.21.15.7:0/1532002453 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f69d0087050 msgr2=0x7f69d0089480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.697 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:37:21.607+0000 7f69d6ffd640 1 client.7121.objecter ms_handle_reset 0x7f69d0087050 session 0x7f6af80a1040 osd.7 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:37:21.607+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f6af8024070 auth_method 0 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:37:21.608+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f6af80710c0 auth_method 0 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.698 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 zone default found 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:37:21.613+0000 7f6b09925800 4 Realm: () 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:37:21.613+0000 7f6b09925800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:37:21.613+0000 7f6b09925800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:37:21.613+0000 7f6b09925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 zonegroup default 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 started sync module instance, tier type = 2024-09-14T11:37:21.699 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=0 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=1 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=2 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=3 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=4 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=5 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=6 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:37:21.625+0000 7f6b09925800 20 add_watcher() i=7 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:37:21.625+0000 7f6b09925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding auth protocol: cephx 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding auth protocol: cephx 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding auth protocol: cephx 2024-09-14T11:37:21.700 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:37:21.626+0000 7f69bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:37:21.627+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.701 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache list hook 0x561c94888b70 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache inspect hook 0x561c94888b70 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache erase hook 0x561c94888b70 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache zap hook 0x561c94888b70 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 note: GC not initialized 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:37:21.627+0000 7f69ba7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace show hook 0x7f6af004e890 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace history hook 0x7f6af004e890 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace active hook 0x7f6af004e890 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace active_short hook 0x7f6af004e890 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 Filter name: none 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:37:21.627+0000 7f692bfff640 20 reqs_thread_entry: start 2024-09-14T11:37:21.702 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:37:21.627+0000 7f6b09925800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 : miss 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 2024-09-14T11:37:21.703 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35, ofs0, ns] 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529689 cookie 94680751266176 notifier 7121 bl.length()=995 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_sources= new_sources= 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential sources added=[] removed=[] 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_dests= new_dests= 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential dests added=[] removed=[] 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:37:21.640+0000 7f6b09925800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b09925800 time 2024-09-14T11:37:21.639809+0000 2024-09-14T11:37:21.704 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b0af8c76a] 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.705 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:37:21.640+0000 7f6b09925800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f6b09925800 thread_name:radosgw-admin 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b09c3e6f0] 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b09c8b99c] 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b0af8c7c4] 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.706 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:37:21.707 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:37:21.708 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:21.710 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:37:21.711 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:37:21.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:21.713 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:21.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:37:21.715 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 7f692bfff640 / http_manager 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69ba7e4640 / http_manager 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69bb7e6640 / rgw_dt_lg_renew 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69d6ffd640 / ms_dispatch 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69e8ff9640 / io_context_pool 2024-09-14T11:37:21.716 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69eaffd640 / ms_dispatch 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69f1e03640 / ms_dispatch 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69f3606640 / io_context_pool 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b04dad640 / msgr-worker-2 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b055ae640 / msgr-worker-1 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b05daf640 / msgr-worker-0 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b065b0640 / io_context_pool 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b09925800 / radosgw-admin 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.127459.log 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:37:21.376+0000 7f69f3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.717 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:37:21.376+0000 7f69f3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:37:21.376+0000 7f69f3606640 10 monclient: dump: 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:37:21.376+0000 7f6b09925800 5 monclient: authenticate success, global_id 7109 2024-09-14T11:37:21.718 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:37:21.376+0000 7f6b09925800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:37:21.376+0000 7f6b09925800 4 set_mon_vals no callback set 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: shutdown 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 asok(0x561c9459e270) unregister_commands rotate-key 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding auth protocol: cephx 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding auth protocol: cephx 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding auth protocol: cephx 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: crc 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c94673820) adding con mode: secure 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:37:21.377+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: starting msgr at 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: starting objecter 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 asok(0x561c9459e270) register_command objecter_requests hook 0x561c947c5540 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: setting wanted keys 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:37:21.377+0000 7f6b09925800 1 librados: calling monclient init 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:37:21.377+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding auth protocol: cephx 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding auth protocol: cephx 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding auth protocol: cephx 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: crc 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:37:21.377+0000 7f6b09925800 5 AuthRegistry(0x561c947bd270) adding con mode: secure 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:37:21.377+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:37:21.378+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:37:21.378+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key hook 0x561c947bd3b8 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c94636a00 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c94700300 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c94702fb0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2141.934268s 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c94636a00 auth_method 0 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c94700300 auth_method 0 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:37:21.378+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient(hunting): handle_auth_done global_id 7112 payload 824 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:37:21.378+0000 7f6b055ae640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:37:21.378+0000 7f6b055ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: dump: 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:37:21.378+0000 7f69f1e03640 10 monclient: dump: 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:37:21.378+0000 7f6b09925800 5 monclient: authenticate success, global_id 7112 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:37:21.378+0000 7f69f3606640 4 set_mon_vals no callback set 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:37:21.378+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:37:21.379+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:37:21.379+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:37:21.379+0000 7f6b09925800 1 librados: init done 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:37:21.380+0000 7f69f1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:37:21.380+0000 7f69f1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:37:21.380+0000 7f69f1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:37:21.381+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f69ec077230 auth_method 0 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:37:21.381+0000 7f6b05daf640 10 monclient: get_auth_request con 0x561c94806d90 auth_method 0 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:37:21.382+0000 7f6b055ae640 10 monclient: get_auth_request con 0x561c94809bd0 auth_method 0 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:37:21.382+0000 7f6b04dad640 10 monclient: get_auth_request con 0x561c9480e080 auth_method 0 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:37:21.585+0000 7f6b04dad640 10 monclient: get_auth_request con 0x561c9480e080 auth_method 0 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:37:21.586+0000 7f6b05daf640 10 monclient: get_auth_request con 0x561c94812100 auth_method 0 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:37:21.587+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:37:21.587+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:37:21.587+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding auth protocol: cephx 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding auth protocol: cephx 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding auth protocol: cephx 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: crc 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c948163f0) adding con mode: secure 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:37:21.587+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 asok(0x561c9459e270) register_command objecter_requests cmddesc objecter_requests hook 0x561c948197f0 EEXIST 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:37:21.587+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding auth protocol: cephx 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding auth protocol: cephx 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding auth protocol: cephx 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: crc 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:37:21.587+0000 7f6b09925800 5 AuthRegistry(0x561c94815138) adding con mode: secure 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:37:21.588+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:37:21.588+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:37:21.588+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key cmddesc rotate-key hook 0x561c94815280 EEXIST 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c9483db10 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c9483def0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c9483c820 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:37:21.588+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2142.144441s 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c9483db10 auth_method 0 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c9483c820 auth_method 0 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:37:21.588+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): get_auth_request con 0x561c9483def0 auth_method 0 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:37:21.588+0000 7f6b05daf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:37:21.588+0000 7f6b055ae640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:37:21.588+0000 7f6b055ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: dump: 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:37:21.589+0000 7f69eaffd640 10 monclient: dump: 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:37:21.589+0000 7f6b09925800 5 monclient: authenticate success, global_id 7115 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:37:21.589+0000 7f6b065b0640 4 set_mon_vals no callback set 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:37:21.589+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:37:21.591+0000 7f69eaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:37:21.591+0000 7f69eaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:37:21.591+0000 7f69eaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:37:21.591+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f69e0077140 auth_method 0 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: get_monmap_and_config 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:37:21.591+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding auth protocol: cephx 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding auth protocol: cephx 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding auth protocol: cephx 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x561c9485d520) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:37:21.591+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:37:21.591+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding auth protocol: cephx 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding auth protocol: cephx 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding auth protocol: cephx 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: crc 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:37:21.591+0000 7f6b09925800 5 AuthRegistry(0x7ffe582edbd0) adding con mode: secure 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:37:21.592+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:37:21.592+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:37:21.592+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key cmddesc rotate-key hook 0x7ffe582edd18 EEXIST 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c9488bb60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c9488bf40 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c94896ca0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:37:21.592+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2142.148486s 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c94896ca0 auth_method 0 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c9488bb60 auth_method 0 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): get_auth_request con 0x561c9488bf40 auth_method 0 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:37:21.592+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:37:21.592+0000 7f6b05daf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient(hunting): handle_auth_done global_id 7494 payload 274 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:37:21.592+0000 7f6b055ae640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:37:21.592+0000 7f6b055ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: dump: 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 monclient: authenticate success, global_id 7494 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:37:21.593+0000 7f6b09925800 4 set_mon_vals no callback set 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:37:21.593+0000 7f69e8ff9640 10 monclient: dump: 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: shutdown 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:37:21.593+0000 7f6b09925800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:37:21.593+0000 7f6b09925800 10 monclient: monmap: 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding auth protocol: cephx 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding auth protocol: cephx 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding auth protocol: cephx 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:37:21.593+0000 7f6b09925800 5 AuthRegistry(0x561c948617a0) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:37:21.594+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: starting msgr at 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: starting objecter 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 asok(0x561c9459e270) register_command objecter_requests cmddesc objecter_requests hook 0x561c9488b9c0 EEXIST 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: setting wanted keys 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:37:21.594+0000 7f6b09925800 1 librados: calling monclient init 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient: init 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding auth protocol: cephx 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding auth protocol: cephx 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding auth protocol: cephx 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: crc 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 AuthRegistry(0x561c948523d0) adding con mode: secure 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:37:21.594+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:37:21.594+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:37:21.594+0000 7f6b09925800 5 asok(0x561c9459e270) register_command rotate-key cmddesc rotate-key hook 0x561c94852518 EEXIST 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-c con 0x561c9488bb60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-b con 0x561c94896ca0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): picked mon.noname-a con 0x561c9489f7a0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:37:21.594+0000 7f6b09925800 10 monclient(hunting): authenticate will time out at 2142.150976s 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): get_auth_request con 0x561c9488bb60 auth_method 0 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): get_auth_request con 0x561c9489f7a0 auth_method 0 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:37:21.595+0000 7f6b055ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): get_auth_request con 0x561c94896ca0 auth_method 0 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:37:21.595+0000 7f6b05daf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:37:21.595+0000 7f6b04dad640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:37:21.595+0000 7f6b04dad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: dump: 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:37:21.595+0000 7f6b09925800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:37:21.595+0000 7f69d6ffd640 10 monclient: dump: 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:37:21.595+0000 7f69e8ff9640 4 set_mon_vals no callback set 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _renew_subs 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:37:21.595+0000 7f6b09925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:37:21.595+0000 7f6b09925800 1 librados: init done 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:37:21.595+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cr dump hook 0x561c94888ed8 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:37:21.597+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:37:21.598+0000 7f69d6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:37:21.598+0000 7f69d6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:37:21.598+0000 7f69d6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:37:21.598+0000 7f6b05daf640 10 monclient: get_auth_request con 0x7f69d0077230 auth_method 0 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:37:21.598+0000 7f6b055ae640 10 monclient: get_auth_request con 0x561c948ac2c0 auth_method 0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 realm 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:37:21.599+0000 7f6b09925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:37:21.599+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:37:21.600+0000 7f6b04dad640 10 monclient: get_auth_request con 0x561c948b0650 auth_method 0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:37:21.601+0000 7f6b05daf640 10 monclient: get_auth_request con 0x561c948b3d50 auth_method 0 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:37:21.601+0000 7f6b09925800 20 searching for the correct realm 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:37:21.602+0000 7f6b055ae640 10 monclient: get_auth_request con 0x561c948b8b30 auth_method 0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:37:21.602+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f6af8024070 auth_method 0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:37:21.603+0000 7f6b04dad640 0 -- 172.21.15.7:0/1532002453 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f6af8024070 msgr2=0x7f6af809aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:37:21.603+0000 7f69d6ffd640 1 client.7121.objecter ms_handle_reset 0x7f6af8024070 session 0x7f6af80a1040 osd.7 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:37:21.603+0000 7f69d6ffd640 10 monclient: _renew_subs 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:37:21.603+0000 7f69d6ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:37:21.603+0000 7f6b05daf640 10 monclient: get_auth_request con 0x7f6af0094020 auth_method 0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:37:21.603+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f69d0087050 auth_method 0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:37:21.604+0000 7f6b055ae640 10 monclient: get_auth_request con 0x7f6b00031040 auth_method 0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:37:21.607+0000 7f6b04dad640 0 -- 172.21.15.7:0/1532002453 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f69d0087050 msgr2=0x7f69d0089480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:37:21.607+0000 7f69d6ffd640 1 client.7121.objecter ms_handle_reset 0x7f69d0087050 session 0x7f6af80a1040 osd.7 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:37:21.607+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f6af8024070 auth_method 0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:37:21.608+0000 7f6b04dad640 10 monclient: get_auth_request con 0x7f6af80710c0 auth_method 0 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 zone default found 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:37:21.613+0000 7f6b09925800 4 Realm: () 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:37:21.613+0000 7f6b09925800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:37:21.613+0000 7f6b09925800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:37:21.613+0000 7f6b09925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 zonegroup default 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:37:21.613+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 started sync module instance, tier type = 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:37:21.614+0000 7f6b09925800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=0 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=1 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=2 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=3 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=4 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=5 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:37:21.624+0000 7f6b09925800 20 add_watcher() i=6 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:37:21.625+0000 7f6b09925800 20 add_watcher() i=7 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:37:21.625+0000 7f6b09925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding auth protocol: cephx 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding auth protocol: cephx 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding auth protocol: cephx 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:37:21.626+0000 7f69bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: crc 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:37:21.626+0000 7f6b09925800 5 AuthRegistry(0x7ffe582ee0b0) adding con mode: secure 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:37:21.627+0000 7f6b09925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache list hook 0x561c94888b70 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache inspect hook 0x561c94888b70 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache erase hook 0x561c94888b70 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command cache zap hook 0x561c94888b70 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 note: GC not initialized 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:37:21.627+0000 7f69ba7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace show hook 0x7f6af004e890 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace history hook 0x7f6af004e890 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace active hook 0x7f6af004e890 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:37:21.627+0000 7f6b09925800 5 asok(0x561c9459e270) register_command sync trace active_short hook 0x7f6af004e890 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 Filter name: none 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:37:21.627+0000 7f692bfff640 20 reqs_thread_entry: start 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:37:21.627+0000 7f6b09925800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:37:21.627+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 : miss 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:37:21.628+0000 7f6b09925800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:37:21.628+0000 7f6b09925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:37:21.634+0000 7f6b09925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35, ofs0, ns] 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529689 cookie 94680751266176 notifier 7121 bl.length()=995 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:37:21.634+0000 7f69e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_sources= new_sources= 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential sources added=[] removed=[] 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_dests= new_dests= 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:37:21.634+0000 7f6b09925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential dests added=[] removed=[] 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:37:21.640+0000 7f6b09925800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6b09925800 time 2024-09-14T11:37:21.639809+0000 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6b0af8c76a] 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:37:21.640+0000 7f6b09925800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f6b09925800 thread_name:radosgw-admin 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6b09c3e6f0] 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6b09c8b99c] 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6b0af8c7c4] 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6b0af8c928] 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561c92a360b1] 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561c92a45f6a] 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6b09c29590] 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f692bfff640 / http_manager 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69ba7e4640 / http_manager 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69bb7e6640 / rgw_dt_lg_renew 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69d6ffd640 / ms_dispatch 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69e8ff9640 / io_context_pool 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69eaffd640 / ms_dispatch 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69f1e03640 / ms_dispatch 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f69f3606640 / io_context_pool 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b04dad640 / msgr-worker-2 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b055ae640 / msgr-worker-1 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b05daf640 / msgr-worker-0 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b065b0640 / io_context_pool 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi007.stderr: 7f6b09925800 / radosgw-admin 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:37:21.641210Z_7f01a4c9-e751-4f80-8564-db8cad810d37/log 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.719+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 20 realm 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.721+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.722+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.722+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.723+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.723+0000 7f639ca98800 20 searching for the correct realm 2024-09-14T11:37:21.923 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:21.925+0000 7f639ad83640 0 -- 172.21.15.7:0/4153071375 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6384008b70 msgr2=0x7f6384075390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.332+0000 7f6399d81640 0 -- 172.21.15.7:0/4153071375 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f638c06c920 msgr2=0x7f638c078410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:22.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.540+0000 7f639ca98800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:22.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.540+0000 7f639ca98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:22.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.540+0000 7f639ca98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:22.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.540+0000 7f639ca98800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:22.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.540+0000 7f639ca98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:22.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.540+0000 7f639ca98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:22.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.540+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.541+0000 7f639ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.541+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.541+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.541+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 zone default found 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 4 Realm: () 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 zonegroup default 2024-09-14T11:37:22.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.542+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.543+0000 7f639ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.543+0000 7f639ca98800 20 started sync module instance, tier type = 2024-09-14T11:37:22.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.543+0000 7f639ca98800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:22.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.554+0000 7f639ca98800 20 add_watcher() i=0 2024-09-14T11:37:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.554+0000 7f639ca98800 20 add_watcher() i=1 2024-09-14T11:37:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.554+0000 7f639ca98800 20 add_watcher() i=2 2024-09-14T11:37:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.554+0000 7f639ca98800 20 add_watcher() i=3 2024-09-14T11:37:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.554+0000 7f639ca98800 20 add_watcher() i=4 2024-09-14T11:37:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.554+0000 7f639ca98800 20 add_watcher() i=5 2024-09-14T11:37:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.554+0000 7f639ca98800 20 add_watcher() i=6 2024-09-14T11:37:22.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.555+0000 7f639ca98800 20 add_watcher() i=7 2024-09-14T11:37:22.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.555+0000 7f639ca98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:22.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.557+0000 7f6250fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.555 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.557+0000 7f639ca98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.557+0000 7f639ca98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.557+0000 7f639ca98800 5 note: GC not initialized 2024-09-14T11:37:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.557+0000 7f61cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.558+0000 7f639ca98800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.558+0000 7f639ca98800 20 Filter name: none 2024-09-14T11:37:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.558+0000 7f61c97fa640 20 reqs_thread_entry: start 2024-09-14T11:37:22.556 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.558+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.558+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.558+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.559+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:37:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.559+0000 7f639ca98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.559+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.559+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:22.557 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.559+0000 7f639ca98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.560+0000 7f639ca98800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:37:22.558 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.560+0000 7f639ca98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:22.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.562+0000 7f6250fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.564+0000 7f639ca98800 20 remove_watcher() i=0 2024-09-14T11:37:22.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.564+0000 7f639ca98800 2 removed watcher, disabling cache 2024-09-14T11:37:22.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.565+0000 7f639ca98800 20 remove_watcher() i=1 2024-09-14T11:37:22.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.567+0000 7f639ca98800 20 remove_watcher() i=2 2024-09-14T11:37:22.565 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.568+0000 7f639ca98800 20 remove_watcher() i=3 2024-09-14T11:37:22.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.569+0000 7f639ca98800 20 remove_watcher() i=4 2024-09-14T11:37:22.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.570+0000 7f639ca98800 20 remove_watcher() i=5 2024-09-14T11:37:22.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.571+0000 7f639ca98800 20 remove_watcher() i=6 2024-09-14T11:37:22.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.572+0000 7f639ca98800 20 remove_watcher() i=7 2024-09-14T11:37:22.583 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:22.583 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:22.583 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-do-reshard id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:22.583 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:22.585 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:22.585 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:22.593 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:22.593 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:22.638 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:22.673 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:22.673 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:22.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.719+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 20 realm 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.721+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.722+0000 7f3446719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.722+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.723+0000 7f3446719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:22.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.723+0000 7f3446719800 20 searching for the correct realm 2024-09-14T11:37:22.722 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.725+0000 7f3444a04640 0 -- 172.21.15.7:0/350364431 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f343801b040 msgr2=0x7f343806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:22.931+0000 7f3443a02640 0 -- 172.21.15.7:0/350364431 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f34340b0360 msgr2=0x7f34340b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:23.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.140+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:23.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 zone default found 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 4 Realm: () 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 zonegroup default 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.141+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.142+0000 7f3446719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:23.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.142+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.142+0000 7f3446719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:23.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.142+0000 7f3446719800 20 started sync module instance, tier type = 2024-09-14T11:37:23.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.142+0000 7f3446719800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:23.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.152+0000 7f3446719800 20 add_watcher() i=0 2024-09-14T11:37:23.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.152+0000 7f3446719800 20 add_watcher() i=1 2024-09-14T11:37:23.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.152+0000 7f3446719800 20 add_watcher() i=2 2024-09-14T11:37:23.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.152+0000 7f3446719800 20 add_watcher() i=3 2024-09-14T11:37:23.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.152+0000 7f3446719800 20 add_watcher() i=4 2024-09-14T11:37:23.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.152+0000 7f3446719800 20 add_watcher() i=5 2024-09-14T11:37:23.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.153+0000 7f3446719800 20 add_watcher() i=6 2024-09-14T11:37:23.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.154+0000 7f3446719800 20 add_watcher() i=7 2024-09-14T11:37:23.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.154+0000 7f3446719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:23.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.156+0000 7f32fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:23.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.156+0000 7f3446719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:23.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.156+0000 7f3446719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.156+0000 7f3446719800 5 note: GC not initialized 2024-09-14T11:37:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.156+0000 7f32f9fdb640 20 reqs_thread_entry: start 2024-09-14T11:37:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.156+0000 7f3446719800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.156+0000 7f3446719800 20 Filter name: none 2024-09-14T11:37:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f326b7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f3446719800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:23.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f3446719800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:23.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f3446719800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f3446719800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f3446719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 : miss 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.157+0000 7f3446719800 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.158+0000 7f3446719800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.158+0000 7f3446719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.158+0000 7f3446719800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.158+0000 7f3446719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.158+0000 7f3446719800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:23.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.158+0000 7f3446719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 2024-09-14T11:37:23.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.159+0000 7f3446719800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to be held by another RGW process; skipping for now 2024-09-14T11:37:23.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.160+0000 7f32fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:23.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.163+0000 7f3446719800 20 remove_watcher() i=0 2024-09-14T11:37:23.160 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.163+0000 7f3446719800 2 removed watcher, disabling cache 2024-09-14T11:37:23.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.164+0000 7f3446719800 20 remove_watcher() i=1 2024-09-14T11:37:23.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.165+0000 7f3446719800 20 remove_watcher() i=2 2024-09-14T11:37:23.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.167+0000 7f3446719800 20 remove_watcher() i=3 2024-09-14T11:37:23.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.168+0000 7f3446719800 20 remove_watcher() i=4 2024-09-14T11:37:23.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.169+0000 7f3446719800 20 remove_watcher() i=5 2024-09-14T11:37:23.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.170+0000 7f3446719800 20 remove_watcher() i=6 2024-09-14T11:37:23.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:23.171+0000 7f3446719800 20 remove_watcher() i=7 2024-09-14T11:37:23.181 INFO:tasks.workunit.client.0.smithi007.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:37:53.196 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:53.234 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:53.234 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:53.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.280+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 20 realm 2024-09-14T11:37:53.281 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:53.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.282 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.282+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.283+0000 7f0d96616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:53.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.283+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.284+0000 7f0d96616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:53.283 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.284+0000 7f0d96616800 20 searching for the correct realm 2024-09-14T11:37:53.285 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.286+0000 7f0d925e8640 0 -- 172.21.15.7:0/2363441376 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0d8806c070 msgr2=0x7f0d88093420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:53.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.493+0000 7f0d915e6640 0 -- 172.21.15.7:0/2363441376 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f0d840629f0 msgr2=0x7f0d84060390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:53.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.702+0000 7f0d96616800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:53.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.702+0000 7f0d96616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:53.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.702+0000 7f0d96616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:53.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.702+0000 7f0d96616800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:53.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.702+0000 7f0d96616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:53.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.702+0000 7f0d96616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:53.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.702+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 20 zone default found 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 4 Realm: () 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.703+0000 7f0d96616800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:53.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.704+0000 7f0d96616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.704+0000 7f0d96616800 20 zonegroup default 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.704+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.704+0000 7f0d96616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.704+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.704+0000 7f0d96616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.704+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.705+0000 7f0d96616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.705+0000 7f0d96616800 20 started sync module instance, tier type = 2024-09-14T11:37:53.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.705+0000 7f0d96616800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:53.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.716+0000 7f0d96616800 20 add_watcher() i=0 2024-09-14T11:37:53.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.716+0000 7f0d96616800 20 add_watcher() i=1 2024-09-14T11:37:53.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.716+0000 7f0d96616800 20 add_watcher() i=2 2024-09-14T11:37:53.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.716+0000 7f0d96616800 20 add_watcher() i=3 2024-09-14T11:37:53.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.716+0000 7f0d96616800 20 add_watcher() i=4 2024-09-14T11:37:53.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.716+0000 7f0d96616800 20 add_watcher() i=5 2024-09-14T11:37:53.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.716+0000 7f0d96616800 20 add_watcher() i=6 2024-09-14T11:37:53.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.717+0000 7f0d96616800 20 add_watcher() i=7 2024-09-14T11:37:53.715 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.717+0000 7f0d96616800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:53.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.719+0000 7f0c43fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:53.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.719+0000 7f0d96616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:53.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.719+0000 7f0d96616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:53.718 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.719+0000 7f0d96616800 5 note: GC not initialized 2024-09-14T11:37:53.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.720+0000 7f0c42ffd640 20 reqs_thread_entry: start 2024-09-14T11:37:53.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.720+0000 7f0d96616800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:53.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.720+0000 7f0d96616800 20 Filter name: none 2024-09-14T11:37:53.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.720+0000 7f0c40ff9640 20 reqs_thread_entry: start 2024-09-14T11:37:53.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.720+0000 7f0d96616800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:53.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.720+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 : miss 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:53.720 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:53.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:53.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.721+0000 7f0d96616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 2024-09-14T11:37:53.721 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.722+0000 7f0d96616800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:37:53.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0d96616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:53.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0d96616800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:53.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0d96616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:53.729 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0d96616800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35, ofs0, ns] 2024-09-14T11:37:53.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0c757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529690 cookie 94726510724832 notifier 7172 bl.length()=995 2024-09-14T11:37:53.732 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0c757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:53.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0c757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:53.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.731+0000 7f0c757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:53.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.732+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_sources= new_sources= 2024-09-14T11:37:53.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.732+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential sources added=[] removed=[] 2024-09-14T11:37:53.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.732+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_dests= new_dests= 2024-09-14T11:37:53.733 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.732+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential dests added=[] removed=[] 2024-09-14T11:37:53.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.0 2024-09-14T11:37:53.736 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.0 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.1 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.1 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.2 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.2 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.3 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.3 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.4 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.4 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.5 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.5 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.6 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.6 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.7 2024-09-14T11:37:53.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.7 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.8 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.8 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.9 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.9 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.10 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.10 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.11 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2.11 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.737+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.0 2024-09-14T11:37:53.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.738+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.1 2024-09-14T11:37:53.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.738+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2 2024-09-14T11:37:53.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.739+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.3 2024-09-14T11:37:53.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.739+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.4 2024-09-14T11:37:53.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.741+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.5 2024-09-14T11:37:53.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.741+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.6 2024-09-14T11:37:53.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.742+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.7 2024-09-14T11:37:53.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.742+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.8 2024-09-14T11:37:53.741 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.743+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.9 2024-09-14T11:37:53.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.744+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.10 2024-09-14T11:37:53.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.748+0000 7f0d96616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:53.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.748+0000 7f0d96616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 2024-09-14T11:37:53.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0d96616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:53.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0d96616800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:53.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0d96616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:53.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0d96616800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35, ofs0, ns] 2024-09-14T11:37:53.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0c74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94726510724832 notifier 7172 bl.length()=995 2024-09-14T11:37:53.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0c74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:53.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0c74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:53.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.750+0000 7f0c74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:53.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.751+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_sources= new_sources= 2024-09-14T11:37:53.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.751+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential sources added=[] removed=[] 2024-09-14T11:37:53.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.751+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_dests= new_dests= 2024-09-14T11:37:53.750 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.751+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential dests added=[] removed=[] 2024-09-14T11:37:53.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.753+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.0 2024-09-14T11:37:53.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.753+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.1 2024-09-14T11:37:53.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.754+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.2 2024-09-14T11:37:53.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.754+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.3 2024-09-14T11:37:53.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.755+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.4 2024-09-14T11:37:53.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.755+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.5 2024-09-14T11:37:53.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.755+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.6 2024-09-14T11:37:53.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.756+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.7 2024-09-14T11:37:53.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.756+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.8 2024-09-14T11:37:53.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.757+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.9 2024-09-14T11:37:53.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.757+0000 7f0d96616800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35.10 2024-09-14T11:37:53.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.757+0000 7f0d96616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:53.756 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.757+0000 7f0d96616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0d96616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0d96616800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0d96616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0d96616800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35, ofs0, ns] 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0c74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529692 cookie 94726510724832 notifier 7172 bl.length()=963 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0c74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 info.flags=0x17 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0c74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 to cache LRU end 2024-09-14T11:37:53.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.759+0000 7f0c74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:53.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.760+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_sources= new_sources= 2024-09-14T11:37:53.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.760+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential sources added=[] removed=[] 2024-09-14T11:37:53.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.760+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): orig_dests= new_dests= 2024-09-14T11:37:53.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.760+0000 7f0d96616800 20 handle_bi_update(): bucket=:abort-at-do-reshard[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35]): potential dests added=[] removed=[] 2024-09-14T11:37:53.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.762+0000 7f0d96616800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:53.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.764+0000 7f0c43fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:53.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.766+0000 7f0d96616800 20 remove_watcher() i=0 2024-09-14T11:37:53.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.766+0000 7f0d96616800 2 removed watcher, disabling cache 2024-09-14T11:37:53.766 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.767+0000 7f0d96616800 20 remove_watcher() i=1 2024-09-14T11:37:53.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.769+0000 7f0d96616800 20 remove_watcher() i=2 2024-09-14T11:37:53.769 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.770+0000 7f0d96616800 20 remove_watcher() i=3 2024-09-14T11:37:53.770 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.771+0000 7f0d96616800 20 remove_watcher() i=4 2024-09-14T11:37:53.771 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.772+0000 7f0d96616800 20 remove_watcher() i=5 2024-09-14T11:37:53.772 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.773+0000 7f0d96616800 20 remove_watcher() i=6 2024-09-14T11:37:53.773 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:53.774+0000 7f0d96616800 20 remove_watcher() i=7 2024-09-14T11:37:53.788 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:37:53.818 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:53.818 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:54.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.062+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.064+0000 7f97e9620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.064+0000 7f97e9620800 20 realm 2024-09-14T11:37:54.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.064+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.065+0000 7f97e9620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.065+0000 7f97e9620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:54.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.065+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.065+0000 7f97e9620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.065+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.066+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:54.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.066+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.067+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:54.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.067+0000 7f97e9620800 20 searching for the correct realm 2024-09-14T11:37:54.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.069+0000 7f97e790b640 0 -- 172.21.15.7:0/1287740452 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f97dc046020 msgr2=0x7f97dc08f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:54.677 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.678+0000 7f97e790b640 0 -- 172.21.15.7:0/1287740452 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f97dc046020 msgr2=0x7f97dc08f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:54.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.685+0000 7f97e9620800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:54.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.685+0000 7f97e9620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:54.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.685+0000 7f97e9620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:54.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.685+0000 7f97e9620800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:54.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.685+0000 7f97e9620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:54.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.685+0000 7f97e9620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:54.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.685+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.686+0000 7f97e9620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.686+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.686+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.686+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 zone default found 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 4 Realm: () 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 zonegroup default 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.687+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.688+0000 7f97e9620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.688+0000 7f97e9620800 20 started sync module instance, tier type = 2024-09-14T11:37:54.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.688+0000 7f97e9620800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:54.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.699+0000 7f97e9620800 20 add_watcher() i=0 2024-09-14T11:37:54.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.699+0000 7f97e9620800 20 add_watcher() i=1 2024-09-14T11:37:54.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.699+0000 7f97e9620800 20 add_watcher() i=2 2024-09-14T11:37:54.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.699+0000 7f97e9620800 20 add_watcher() i=3 2024-09-14T11:37:54.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.699+0000 7f97e9620800 20 add_watcher() i=4 2024-09-14T11:37:54.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.699+0000 7f97e9620800 20 add_watcher() i=5 2024-09-14T11:37:54.698 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.699+0000 7f97e9620800 20 add_watcher() i=6 2024-09-14T11:37:54.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.700+0000 7f97e9620800 20 add_watcher() i=7 2024-09-14T11:37:54.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.700+0000 7f97e9620800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:54.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.702+0000 7f969dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.702+0000 7f97e9620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:54.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.702+0000 7f97e9620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:54.701 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.702+0000 7f97e9620800 5 note: GC not initialized 2024-09-14T11:37:54.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.703+0000 7f969cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:54.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.703+0000 7f97e9620800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:54.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.703+0000 7f97e9620800 20 Filter name: none 2024-09-14T11:37:54.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.703+0000 7f96167fc640 20 reqs_thread_entry: start 2024-09-14T11:37:54.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.703+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.704+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:54.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.704+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.704+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:54.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.704+0000 7f97e9620800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:54.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.704+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.705+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:37:54.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.705+0000 7f97e9620800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.705+0000 7f97e9620800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:37:54.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.705+0000 7f97e9620800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:54.706 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.708+0000 7f969dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.710+0000 7f97e9620800 20 remove_watcher() i=0 2024-09-14T11:37:54.709 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.710+0000 7f97e9620800 2 removed watcher, disabling cache 2024-09-14T11:37:54.710 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.711+0000 7f97e9620800 20 remove_watcher() i=1 2024-09-14T11:37:54.711 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.712+0000 7f97e9620800 20 remove_watcher() i=2 2024-09-14T11:37:54.712 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.714+0000 7f97e9620800 20 remove_watcher() i=3 2024-09-14T11:37:54.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.715+0000 7f97e9620800 20 remove_watcher() i=4 2024-09-14T11:37:54.714 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.716+0000 7f97e9620800 20 remove_watcher() i=5 2024-09-14T11:37:54.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.717+0000 7f97e9620800 20 remove_watcher() i=6 2024-09-14T11:37:54.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:54.718+0000 7f97e9620800 20 remove_watcher() i=7 2024-09-14T11:37:54.729 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:54.730 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:54.730 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-do-reshard id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:54.730 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:54.732 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.732 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.736 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.736 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.779 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.779 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.810 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:37:54.810 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:54.811 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.811 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.823 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.823 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.866 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.866 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.873 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.874 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.880 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.881 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.888 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.888 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.894 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.894 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.900 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.900 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.906 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.906 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.913 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.913 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.919 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.919 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.926 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.932 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.932 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.939 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.939 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.945 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.945 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.951 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.951 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.960 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.960 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.963 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.963 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.970 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.970 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.975 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.975 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.981 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.982 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.988 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:54.988 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:54.994 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:37:55.023 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:55.024 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.064+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 20 realm 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.066+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.067+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:55.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.067+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.068+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:55.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.068+0000 7f9c4c4bb800 20 searching for the correct realm 2024-09-14T11:37:55.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.070+0000 7f9c4a7a6640 0 -- 172.21.15.7:0/2533342619 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f9c4003d070 msgr2=0x7f9c4000a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:55.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.276+0000 7f9c497a4640 0 -- 172.21.15.7:0/2533342619 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f9c3c073850 msgr2=0x7f9c3c06c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.483+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 20 zone default found 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 4 Realm: () 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 20 zonegroup default 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.484+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.485+0000 7f9c4c4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.485+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.485+0000 7f9c4c4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.485+0000 7f9c4c4bb800 20 started sync module instance, tier type = 2024-09-14T11:37:55.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.485+0000 7f9c4c4bb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.495+0000 7f9c4c4bb800 20 add_watcher() i=0 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.495+0000 7f9c4c4bb800 20 add_watcher() i=1 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.495+0000 7f9c4c4bb800 20 add_watcher() i=2 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.495+0000 7f9c4c4bb800 20 add_watcher() i=3 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.495+0000 7f9c4c4bb800 20 add_watcher() i=4 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.495+0000 7f9c4c4bb800 20 add_watcher() i=5 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.495+0000 7f9c4c4bb800 20 add_watcher() i=6 2024-09-14T11:37:55.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.496+0000 7f9c4c4bb800 20 add_watcher() i=7 2024-09-14T11:37:55.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.496+0000 7f9c4c4bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:55.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.498+0000 7f9afb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:55.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.498+0000 7f9c4c4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:55.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.498+0000 7f9c4c4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:55.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.498+0000 7f9c4c4bb800 5 note: GC not initialized 2024-09-14T11:37:55.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.499+0000 7f9afa7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:55.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.499+0000 7f9c4c4bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:55.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.499+0000 7f9c4c4bb800 20 Filter name: none 2024-09-14T11:37:55.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.499+0000 7f9a6bfff640 20 reqs_thread_entry: start 2024-09-14T11:37:55.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.499+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.500+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:55.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.500+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.500+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:55.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.500+0000 7f9c4c4bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:55.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.500+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.500+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:55.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.500+0000 7f9c4c4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.501+0000 7f9c4c4bb800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:55.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.501+0000 7f9c4c4bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:55.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.503+0000 7f9afb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:55.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.505+0000 7f9c4c4bb800 20 remove_watcher() i=0 2024-09-14T11:37:55.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.505+0000 7f9c4c4bb800 2 removed watcher, disabling cache 2024-09-14T11:37:55.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.506+0000 7f9c4c4bb800 20 remove_watcher() i=1 2024-09-14T11:37:55.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.507+0000 7f9c4c4bb800 20 remove_watcher() i=2 2024-09-14T11:37:55.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.508+0000 7f9c4c4bb800 20 remove_watcher() i=3 2024-09-14T11:37:55.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.509+0000 7f9c4c4bb800 20 remove_watcher() i=4 2024-09-14T11:37:55.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.510+0000 7f9c4c4bb800 20 remove_watcher() i=5 2024-09-14T11:37:55.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.511+0000 7f9c4c4bb800 20 remove_watcher() i=6 2024-09-14T11:37:55.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.512+0000 7f9c4c4bb800 20 remove_watcher() i=7 2024-09-14T11:37:55.523 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:55.523 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:55.523 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-logrecord-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:55.523 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:55.524 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:37:55.560 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:55.560 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:55.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.602+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.604+0000 7ffa95525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.604+0000 7ffa95525800 20 realm 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.604+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.605+0000 7ffa95525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.605+0000 7ffa95525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.605+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.605+0000 7ffa95525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.605+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.606+0000 7ffa95525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:55.604 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.606+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.607+0000 7ffa95525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:55.605 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.607+0000 7ffa95525800 20 searching for the correct realm 2024-09-14T11:37:55.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.608+0000 7ffa91934640 0 -- 172.21.15.7:0/1393990865 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ffa880ac000 msgr2=0x7ffa880aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:55.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:55.814+0000 7ffa90932640 0 -- 172.21.15.7:0/1393990865 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ffa840743e0 msgr2=0x7ffa84073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.021+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:56.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 20 zone default found 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 4 Realm: () 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 20 zonegroup default 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.022+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.023+0000 7ffa95525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.023+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.023+0000 7ffa95525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.023+0000 7ffa95525800 20 started sync module instance, tier type = 2024-09-14T11:37:56.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.023+0000 7ffa95525800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:56.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.033+0000 7ffa95525800 20 add_watcher() i=0 2024-09-14T11:37:56.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.033+0000 7ffa95525800 20 add_watcher() i=1 2024-09-14T11:37:56.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.033+0000 7ffa95525800 20 add_watcher() i=2 2024-09-14T11:37:56.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.033+0000 7ffa95525800 20 add_watcher() i=3 2024-09-14T11:37:56.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.033+0000 7ffa95525800 20 add_watcher() i=4 2024-09-14T11:37:56.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.033+0000 7ffa95525800 20 add_watcher() i=5 2024-09-14T11:37:56.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.033+0000 7ffa95525800 20 add_watcher() i=6 2024-09-14T11:37:56.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.034+0000 7ffa95525800 20 add_watcher() i=7 2024-09-14T11:37:56.033 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.034+0000 7ffa95525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:56.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.036+0000 7ff947fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.036+0000 7ffa95525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.036+0000 7ffa95525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.036+0000 7ffa95525800 5 note: GC not initialized 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.037+0000 7ff946fe5640 20 reqs_thread_entry: start 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.037+0000 7ffa95525800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.037+0000 7ffa95525800 20 Filter name: none 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.037+0000 7ff944fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.037+0000 7ffa95525800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:37:56.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.037+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.037+0000 7ffa95525800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 : miss 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.038+0000 7ffa95525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36, ofs0, ns] 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ff974ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529762 cookie 94403737703344 notifier 7599 bl.length()=1007 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ff974ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ff974ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ff974ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_sources= new_sources= 2024-09-14T11:37:56.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential sources added=[] removed=[] 2024-09-14T11:37:56.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_dests= new_dests= 2024-09-14T11:37:56.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.044+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential dests added=[] removed=[] 2024-09-14T11:37:56.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.047+0000 7ffa95525800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:37:56.045 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.047+0000 7ffa95525800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:37:56.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.052+0000 7ffa95525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:56.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.052+0000 7ffa95525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ffa95525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ffa95525800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ffa95525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ffa95525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36, ofs0, ns] 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ff963fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529763 cookie 94403737703344 notifier 7599 bl.length()=975 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ff963fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ff963fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.053+0000 7ff963fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.054+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_sources= new_sources= 2024-09-14T11:37:56.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.054+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential sources added=[] removed=[] 2024-09-14T11:37:56.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.054+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_dests= new_dests= 2024-09-14T11:37:56.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.054+0000 7ffa95525800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential dests added=[] removed=[] 2024-09-14T11:37:56.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.056+0000 7ff947fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.058+0000 7ffa95525800 20 remove_watcher() i=0 2024-09-14T11:37:56.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.058+0000 7ffa95525800 2 removed watcher, disabling cache 2024-09-14T11:37:56.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.059+0000 7ffa95525800 20 remove_watcher() i=1 2024-09-14T11:37:56.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.060+0000 7ffa95525800 20 remove_watcher() i=2 2024-09-14T11:37:56.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.062+0000 7ffa95525800 20 remove_watcher() i=3 2024-09-14T11:37:56.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.063+0000 7ffa95525800 20 remove_watcher() i=4 2024-09-14T11:37:56.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.064+0000 7ffa95525800 20 remove_watcher() i=5 2024-09-14T11:37:56.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.065+0000 7ffa95525800 20 remove_watcher() i=6 2024-09-14T11:37:56.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.066+0000 7ffa95525800 20 remove_watcher() i=7 2024-09-14T11:37:56.078 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:37:56.108 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:56.108 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:56.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.149+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 20 realm 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.151+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.152+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.152+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.153+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:56.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.153+0000 7f16e472e800 20 searching for the correct realm 2024-09-14T11:37:56.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.155+0000 7f16e0cde640 0 -- 172.21.15.7:0/1199307608 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f16d4069af0 msgr2=0x7f16d4068560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.159+0000 7f16dfcdc640 0 -- 172.21.15.7:0/1199307608 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f16d0007e80 msgr2=0x7f16d004de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.365+0000 7f16e472e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.365+0000 7f16e472e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.365+0000 7f16e472e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.365+0000 7f16e472e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.365+0000 7f16e472e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.365+0000 7f16e472e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.365+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.365 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:56.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 zone default found 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 4 Realm: () 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 zonegroup default 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.366+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.367+0000 7f16e472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.367+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.367+0000 7f16e472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.367+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.367+0000 7f16e472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.367+0000 7f16e472e800 20 started sync module instance, tier type = 2024-09-14T11:37:56.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.367+0000 7f16e472e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:56.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.377+0000 7f16e472e800 20 add_watcher() i=0 2024-09-14T11:37:56.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.377+0000 7f16e472e800 20 add_watcher() i=1 2024-09-14T11:37:56.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.377+0000 7f16e472e800 20 add_watcher() i=2 2024-09-14T11:37:56.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.377+0000 7f16e472e800 20 add_watcher() i=3 2024-09-14T11:37:56.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.377+0000 7f16e472e800 20 add_watcher() i=4 2024-09-14T11:37:56.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.377+0000 7f16e472e800 20 add_watcher() i=5 2024-09-14T11:37:56.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.377+0000 7f16e472e800 20 add_watcher() i=6 2024-09-14T11:37:56.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.379+0000 7f16e472e800 20 add_watcher() i=7 2024-09-14T11:37:56.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.379+0000 7f16e472e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:56.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.380+0000 7f1596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f16e472e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f16e472e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f16e472e800 5 note: GC not initialized 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f1595fdb640 20 reqs_thread_entry: start 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f16e472e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f16e472e800 20 Filter name: none 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f15077fe640 20 reqs_thread_entry: start 2024-09-14T11:37:56.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.381+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.382+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:56.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.382+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.382+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:56.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.382+0000 7f16e472e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:56.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.382+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.383+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:56.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.383+0000 7f16e472e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.383+0000 7f16e472e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:56.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.383+0000 7f16e472e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:56.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.385+0000 7f1596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.388+0000 7f16e472e800 20 remove_watcher() i=0 2024-09-14T11:37:56.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.388+0000 7f16e472e800 2 removed watcher, disabling cache 2024-09-14T11:37:56.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.389+0000 7f16e472e800 20 remove_watcher() i=1 2024-09-14T11:37:56.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.390+0000 7f16e472e800 20 remove_watcher() i=2 2024-09-14T11:37:56.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.391+0000 7f16e472e800 20 remove_watcher() i=3 2024-09-14T11:37:56.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.392+0000 7f16e472e800 20 remove_watcher() i=4 2024-09-14T11:37:56.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.393+0000 7f16e472e800 20 remove_watcher() i=5 2024-09-14T11:37:56.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.394+0000 7f16e472e800 20 remove_watcher() i=6 2024-09-14T11:37:56.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.395+0000 7f16e472e800 20 remove_watcher() i=7 2024-09-14T11:37:56.405 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:56.405 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:56.405 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-logrecord-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:56.405 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:56.407 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:56.407 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:56.414 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:56.414 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:56.457 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:56.492 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:56.492 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:56.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.534+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 20 realm 2024-09-14T11:37:56.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:56.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.535+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.536+0000 7f2715210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.536+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.537+0000 7f2715210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:56.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.537+0000 7f2715210800 20 searching for the correct realm 2024-09-14T11:37:56.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.539+0000 7f27110cc640 0 -- 172.21.15.7:0/3824370131 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f26fc03d440 msgr2=0x7f26fc03d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.746+0000 7f270bfff640 0 -- 172.21.15.7:0/3824370131 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f270406a3f0 msgr2=0x7f27040602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.953+0000 7f2715210800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.953+0000 7f2715210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.953+0000 7f2715210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.953+0000 7f2715210800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.953+0000 7f2715210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.953+0000 7f2715210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.954+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.954+0000 7f2715210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.954+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.954+0000 7f2715210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.954+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 zone default found 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 4 Realm: () 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 zonegroup default 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.955+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.956+0000 7f2715210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.956+0000 7f2715210800 20 started sync module instance, tier type = 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.956+0000 7f2715210800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.966+0000 7f2715210800 20 add_watcher() i=0 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.966+0000 7f2715210800 20 add_watcher() i=1 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.966+0000 7f2715210800 20 add_watcher() i=2 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.966+0000 7f2715210800 20 add_watcher() i=3 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.966+0000 7f2715210800 20 add_watcher() i=4 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.966+0000 7f2715210800 20 add_watcher() i=5 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.966+0000 7f2715210800 20 add_watcher() i=6 2024-09-14T11:37:56.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.967+0000 7f2715210800 20 add_watcher() i=7 2024-09-14T11:37:56.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.967+0000 7f2715210800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:56.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.969+0000 7f25c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f2715210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f2715210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f2715210800 5 note: GC not initialized 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f25c5fe3640 20 reqs_thread_entry: start 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f2715210800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f2715210800 20 Filter name: none 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f25377fe640 20 reqs_thread_entry: start 2024-09-14T11:37:56.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f2715210800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:37:56.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.970+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.971+0000 7f2715210800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:56.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.971+0000 7f2715210800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.971+0000 7f2715210800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.971+0000 7f2715210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 : miss 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.971+0000 7f2715210800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.972+0000 7f2715210800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.972+0000 7f2715210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.972+0000 7f2715210800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.972+0000 7f2715210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.972+0000 7f2715210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.972+0000 7f2715210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 2024-09-14T11:37:56.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f2715210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f2715210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f2715210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f2715210800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36, ofs0, ns] 2024-09-14T11:37:56.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f25e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529764 cookie 94707485828080 notifier 7259 bl.length()=1007 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f25e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f25e77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.978+0000 7f25e77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.979+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_sources= new_sources= 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.979+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential sources added=[] removed=[] 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.979+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_dests= new_dests= 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.979+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential dests added=[] removed=[] 2024-09-14T11:37:56.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.0 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.0 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.1 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.1 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.2 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.2 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.3 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.3 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.4 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.4 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.5 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.5 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.6 2024-09-14T11:37:56.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.6 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.7 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.7 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.8 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.8 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.9 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.9 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.10 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.10 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.11 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1.11 2024-09-14T11:37:56.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.0 2024-09-14T11:37:56.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.984+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1 2024-09-14T11:37:56.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.985+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.2 2024-09-14T11:37:56.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.985+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.3 2024-09-14T11:37:56.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.986+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.4 2024-09-14T11:37:56.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.986+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.5 2024-09-14T11:37:56.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.987+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.6 2024-09-14T11:37:56.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.987+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.7 2024-09-14T11:37:56.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.988+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.8 2024-09-14T11:37:56.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.988+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.9 2024-09-14T11:37:56.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.989+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.10 2024-09-14T11:37:56.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.993+0000 7f2715210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:56.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.993+0000 7f2715210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 2024-09-14T11:37:56.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f2715210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f2715210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f2715210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f2715210800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36, ofs0, ns] 2024-09-14T11:37:56.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f25e7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529765 cookie 94707485828080 notifier 7259 bl.length()=1007 2024-09-14T11:37:56.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f25e7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:56.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f25e7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:56.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.994+0000 7f25e7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:56.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.995+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_sources= new_sources= 2024-09-14T11:37:56.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.995+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential sources added=[] removed=[] 2024-09-14T11:37:56.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.995+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_dests= new_dests= 2024-09-14T11:37:56.994 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.995+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential dests added=[] removed=[] 2024-09-14T11:37:56.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.997+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.0 2024-09-14T11:37:56.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.998+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.1 2024-09-14T11:37:56.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.998+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.2 2024-09-14T11:37:56.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.998+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.3 2024-09-14T11:37:56.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.999+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.4 2024-09-14T11:37:56.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.999+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.5 2024-09-14T11:37:56.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:56.999+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.6 2024-09-14T11:37:56.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.000+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.7 2024-09-14T11:37:56.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.000+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.8 2024-09-14T11:37:56.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.000+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.9 2024-09-14T11:37:56.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.001+0000 7f2715210800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36.10 2024-09-14T11:37:57.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.001+0000 7f2715210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:57.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.001+0000 7f2715210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36, ofs0, ns] 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f25e7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529766 cookie 94707485828080 notifier 7259 bl.length()=975 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f25e7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 info.flags=0x17 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f25e7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 to cache LRU end 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f25e7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_sources= new_sources= 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential sources added=[] removed=[] 2024-09-14T11:37:57.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): orig_dests= new_dests= 2024-09-14T11:37:57.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.003+0000 7f2715210800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36]): potential dests added=[] removed=[] 2024-09-14T11:37:57.004 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.006+0000 7f2715210800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:57.006 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.008+0000 7f25c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.010+0000 7f2715210800 20 remove_watcher() i=0 2024-09-14T11:37:57.009 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.010+0000 7f2715210800 2 removed watcher, disabling cache 2024-09-14T11:37:57.010 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.011+0000 7f2715210800 20 remove_watcher() i=1 2024-09-14T11:37:57.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.012+0000 7f2715210800 20 remove_watcher() i=2 2024-09-14T11:37:57.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.014+0000 7f2715210800 20 remove_watcher() i=3 2024-09-14T11:37:57.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.015+0000 7f2715210800 20 remove_watcher() i=4 2024-09-14T11:37:57.014 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.016+0000 7f2715210800 20 remove_watcher() i=5 2024-09-14T11:37:57.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.017+0000 7f2715210800 20 remove_watcher() i=6 2024-09-14T11:37:57.016 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.018+0000 7f2715210800 20 remove_watcher() i=7 2024-09-14T11:37:57.029 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:37:57.059 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:57.060 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:57.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.100+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 20 realm 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.103+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.104+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.104+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.105+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:57.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.105+0000 7f14b0b23800 20 searching for the correct realm 2024-09-14T11:37:57.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.107+0000 7f14ad045640 0 -- 172.21.15.7:0/3538611011 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f14a00e3040 msgr2=0x7f14a00c1a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.112+0000 7f14ac043640 0 -- 172.21.15.7:0/3538611011 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f149c06ae00 msgr2=0x7f149c06a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.318 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.318+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 zone default found 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 4 Realm: () 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 zonegroup default 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.319+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.320+0000 7f14b0b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.320+0000 7f14b0b23800 20 started sync module instance, tier type = 2024-09-14T11:37:57.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.320+0000 7f14b0b23800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.329+0000 7f14b0b23800 20 add_watcher() i=0 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.329+0000 7f14b0b23800 20 add_watcher() i=1 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.329+0000 7f14b0b23800 20 add_watcher() i=2 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.329+0000 7f14b0b23800 20 add_watcher() i=3 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.329+0000 7f14b0b23800 20 add_watcher() i=4 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.329+0000 7f14b0b23800 20 add_watcher() i=5 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.329+0000 7f14b0b23800 20 add_watcher() i=6 2024-09-14T11:37:57.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.330+0000 7f14b0b23800 20 add_watcher() i=7 2024-09-14T11:37:57.329 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.330+0000 7f14b0b23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:57.331 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.332+0000 7f1362fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f14b0b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f14b0b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f14b0b23800 5 note: GC not initialized 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f1361fe3640 20 reqs_thread_entry: start 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f14b0b23800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f14b0b23800 20 Filter name: none 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f12d37fe640 20 reqs_thread_entry: start 2024-09-14T11:37:57.332 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.333+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.334+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:57.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.334+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.334+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:57.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.334+0000 7f14b0b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:57.333 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.334+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.335+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:57.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.335+0000 7f14b0b23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.336+0000 7f14b0b23800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:57.334 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.336+0000 7f14b0b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:57.336 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.337+0000 7f1362fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.340+0000 7f14b0b23800 20 remove_watcher() i=0 2024-09-14T11:37:57.339 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.340+0000 7f14b0b23800 2 removed watcher, disabling cache 2024-09-14T11:37:57.340 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.341+0000 7f14b0b23800 20 remove_watcher() i=1 2024-09-14T11:37:57.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.343+0000 7f14b0b23800 20 remove_watcher() i=2 2024-09-14T11:37:57.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.344+0000 7f14b0b23800 20 remove_watcher() i=3 2024-09-14T11:37:57.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.345+0000 7f14b0b23800 20 remove_watcher() i=4 2024-09-14T11:37:57.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.346+0000 7f14b0b23800 20 remove_watcher() i=5 2024-09-14T11:37:57.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.347+0000 7f14b0b23800 20 remove_watcher() i=6 2024-09-14T11:37:57.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.348+0000 7f14b0b23800 20 remove_watcher() i=7 2024-09-14T11:37:57.358 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:57.358 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:57.358 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-logrecord-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:57.358 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:57.360 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.360 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.364 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.364 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.407 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.407 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.437 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:37:57.437 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:57.440 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.441 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.451 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.452 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.495 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.495 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.503 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.503 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.509 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.509 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.517 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.517 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.524 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.524 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.530 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.530 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.537 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.537 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.543 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.543 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.549 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.549 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.556 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.556 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.562 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.562 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.568 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.568 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.574 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.574 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.580 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.580 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.586 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.586 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.592 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.593 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.598 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.598 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.605 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.605 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.612 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.612 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.618 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:57.618 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:57.625 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:37:57.655 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:57.655 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:57.696 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.698+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 20 realm 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.699 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.700+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.701+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.701+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.702+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:57.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.702+0000 7fc72c820800 20 searching for the correct realm 2024-09-14T11:37:57.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.704+0000 7fc72a30a640 0 -- 172.21.15.7:0/1606689481 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fc72402b070 msgr2=0x7fc72406de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.910+0000 7fc72a30a640 0 -- 172.21.15.7:0/1606689481 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fc72402b070 msgr2=0x7fc72406de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:57.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:57.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:57.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:57.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:57.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:57.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.914+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 zone default found 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 4 Realm: () 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 zonegroup default 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.915+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.916+0000 7fc72c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.916+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.916+0000 7fc72c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.916+0000 7fc72c820800 20 started sync module instance, tier type = 2024-09-14T11:37:57.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.916+0000 7fc72c820800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:57.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.925+0000 7fc72c820800 20 add_watcher() i=0 2024-09-14T11:37:57.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.925+0000 7fc72c820800 20 add_watcher() i=1 2024-09-14T11:37:57.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.925+0000 7fc72c820800 20 add_watcher() i=2 2024-09-14T11:37:57.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.925+0000 7fc72c820800 20 add_watcher() i=3 2024-09-14T11:37:57.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.925+0000 7fc72c820800 20 add_watcher() i=4 2024-09-14T11:37:57.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.925+0000 7fc72c820800 20 add_watcher() i=5 2024-09-14T11:37:57.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.925+0000 7fc72c820800 20 add_watcher() i=6 2024-09-14T11:37:57.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.926+0000 7fc72c820800 20 add_watcher() i=7 2024-09-14T11:37:57.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.926+0000 7fc72c820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:57.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.927+0000 7fc5e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc72c820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc72c820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc72c820800 5 note: GC not initialized 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc55b7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc72c820800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc72c820800 20 Filter name: none 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc5597fa640 20 reqs_thread_entry: start 2024-09-14T11:37:57.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.928+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.929+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:57.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.929+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.930+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:57.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.930+0000 7fc72c820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:57.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.930+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.930+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:57.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.930+0000 7fc72c820800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.931+0000 7fc72c820800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:57.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.931+0000 7fc72c820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:57.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.932+0000 7fc5e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.935+0000 7fc72c820800 20 remove_watcher() i=0 2024-09-14T11:37:57.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.935+0000 7fc72c820800 2 removed watcher, disabling cache 2024-09-14T11:37:57.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.936+0000 7fc72c820800 20 remove_watcher() i=1 2024-09-14T11:37:57.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.937+0000 7fc72c820800 20 remove_watcher() i=2 2024-09-14T11:37:57.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.938+0000 7fc72c820800 20 remove_watcher() i=3 2024-09-14T11:37:57.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.939+0000 7fc72c820800 20 remove_watcher() i=4 2024-09-14T11:37:57.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.940+0000 7fc72c820800 20 remove_watcher() i=5 2024-09-14T11:37:57.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.941+0000 7fc72c820800 20 remove_watcher() i=6 2024-09-14T11:37:57.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:57.942+0000 7fc72c820800 20 remove_watcher() i=7 2024-09-14T11:37:57.952 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:57.952 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:57.952 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-logrecord-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:57.952 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:57.954 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:37:57.988 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:57.988 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:58.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.029+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 20 realm 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.030 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.032+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.031 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.032+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.033+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.032 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.033+0000 7fa471523800 20 searching for the correct realm 2024-09-14T11:37:58.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.035+0000 7fa46d934640 0 -- 172.21.15.7:0/1113520994 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fa458083070 msgr2=0x7fa458051c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.240+0000 7fa467fff640 0 -- 172.21.15.7:0/1113520994 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fa460023960 msgr2=0x7fa460049400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:58.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.446+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 20 zone default found 2024-09-14T11:37:58.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 4 Realm: () 2024-09-14T11:37:58.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 20 zonegroup default 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.447+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.448+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.448+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.448+0000 7fa471523800 20 started sync module instance, tier type = 2024-09-14T11:37:58.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.448+0000 7fa471523800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:58.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=0 2024-09-14T11:37:58.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=1 2024-09-14T11:37:58.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=2 2024-09-14T11:37:58.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=3 2024-09-14T11:37:58.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=4 2024-09-14T11:37:58.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=5 2024-09-14T11:37:58.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=6 2024-09-14T11:37:58.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.459+0000 7fa471523800 20 add_watcher() i=7 2024-09-14T11:37:58.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.459+0000 7fa471523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.460+0000 7fa323fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa471523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa471523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa471523800 5 note: GC not initialized 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa322fe5640 20 reqs_thread_entry: start 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa471523800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa471523800 20 Filter name: none 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa320fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa471523800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:37:58.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.461+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:58.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:37:58.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:37:58.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 : miss 2024-09-14T11:37:58.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:58.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:58.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.462+0000 7fa471523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 2024-09-14T11:37:58.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa471523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa471523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa471523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37, ofs0, ns] 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529770 cookie 94425903600752 notifier 7692 bl.length()=1007 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_sources= new_sources= 2024-09-14T11:37:58.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential sources added=[] removed=[] 2024-09-14T11:37:58.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_dests= new_dests= 2024-09-14T11:37:58.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential dests added=[] removed=[] 2024-09-14T11:37:58.472 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa471523800 time 2024-09-14T11:37:58.475045+0000 2024-09-14T11:37:58.472 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa472b8c76a] 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:37:58.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.474+0000 7fa471523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa471523800 time 2024-09-14T11:37:58.475045+0000 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa472b8c76a] 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:37:58.474 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fa471523800 thread_name:radosgw-admin 2024-09-14T11:37:58.491 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa47183e6f0] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa47188b99c] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa472b8c7c4] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:37:58.492 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.475+0000 7fa471523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fa471523800 thread_name:radosgw-admin 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa47183e6f0] 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa47188b99c] 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa472b8c7c4] 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.493 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:37:58.011+0000 7fa35b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:37:58.011+0000 7fa35b606640 10 monclient: dump: 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.494 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:37:58.012+0000 7fa471523800 10 monclient: shutdown 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:37:58.012+0000 7fa471523800 5 asok(0x55e13e3ee270) unregister_commands rotate-key 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:37:58.012+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:37:58.012+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:37:58.012+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.495 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding auth protocol: cephx 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding auth protocol: cephx 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding auth protocol: cephx 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.496 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:37:58.012+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:37:58.012+0000 7fa471523800 1 librados: starting msgr at 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:37:58.012+0000 7fa471523800 1 librados: starting objecter 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:37:58.012+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command objecter_requests hook 0x55e13e6389e0 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:37:58.013+0000 7fa471523800 1 librados: setting wanted keys 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:37:58.013+0000 7fa471523800 1 librados: calling monclient init 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding auth protocol: cephx 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding auth protocol: cephx 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding auth protocol: cephx 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.497 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:37:58.013+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:37:58.013+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:37:58.013+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key hook 0x55e13e60e5e8 2024-09-14T11:37:58.498 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e498670 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e4bc0e0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e557b60 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.570565s 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e4bc0e0 auth_method 0 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e498670 auth_method 0 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.499 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e557b60 auth_method 0 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_done global_id 7683 payload 824 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.500 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:37:58.013+0000 7fa467fff640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: dump: 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.501 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: dump: 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.502 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:37:58.014+0000 7fa471523800 5 monclient: authenticate success, global_id 7683 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:37:58.014+0000 7fa35b606640 4 set_mon_vals no callback set 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:37:58.014+0000 7fa471523800 1 librados: init done 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:37:58.016+0000 7fa359e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:37:58.016+0000 7fa359e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:37:58.016+0000 7fa359e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:37:58.016+0000 7fa46d133640 10 monclient: get_auth_request con 0x7fa354077230 auth_method 0 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:37:58.016+0000 7fa46d934640 10 monclient: get_auth_request con 0x55e13e642900 auth_method 0 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:37:58.017+0000 7fa46d133640 10 monclient: get_auth_request con 0x55e13e659e70 auth_method 0 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:37:58.018+0000 7fa467fff640 10 monclient: get_auth_request con 0x55e13e65e510 auth_method 0 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:37:58.019+0000 7fa46d934640 10 monclient: get_auth_request con 0x55e13e65dbb0 auth_method 0 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:37:58.020+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.503 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:37:58.020+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:37:58.020+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding auth protocol: cephx 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding auth protocol: cephx 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding auth protocol: cephx 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.504 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:37:58.020+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:37:58.020+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command objecter_requests cmddesc objecter_requests hook 0x55e13e669a20 EEXIST 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:37:58.020+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.505 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding auth protocol: cephx 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding auth protocol: cephx 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding auth protocol: cephx 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:37:58.021+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.506 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:37:58.021+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:37:58.021+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key cmddesc rotate-key hook 0x55e13e665590 EEXIST 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e68dd40 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e68e120 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e68ca50 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.578452s 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e68dd40 auth_method 0 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.507 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e68ca50 auth_method 0 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e68e120 auth_method 0 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.508 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_done global_id 7686 payload 824 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:37:58.021+0000 7fa467fff640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: dump: 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.509 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: dump: 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.510 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:37:58.022+0000 7fa471523800 5 monclient: authenticate success, global_id 7686 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:37:58.022+0000 7fa46e135640 4 set_mon_vals no callback set 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:37:58.023+0000 7fa352ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:37:58.023+0000 7fa352ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:37:58.023+0000 7fa352ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:37:58.024+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa348077140 auth_method 0 2024-09-14T11:37:58.511 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: get_monmap_and_config 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:37:58.024+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding auth protocol: cephx 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding auth protocol: cephx 2024-09-14T11:37:58.512 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding auth protocol: cephx 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:37:58.024+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.513 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding auth protocol: cephx 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding auth protocol: cephx 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding auth protocol: cephx 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:37:58.024+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.514 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:37:58.025+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:37:58.025+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key cmddesc rotate-key hook 0x7ffce6ececb8 EEXIST 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e6e20a0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e6d29f0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e6dd4d0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.582236s 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e6dd4d0 auth_method 0 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.515 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e6d29f0 auth_method 0 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e6e20a0 auth_method 0 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.516 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_done global_id 7304 payload 274 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:37:58.025+0000 7fa46d133640 1 monclient: found mon.noname-c 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: dump: 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.517 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:37:58.025+0000 7fa471523800 5 monclient: authenticate success, global_id 7304 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:37:58.025+0000 7fa471523800 4 set_mon_vals no callback set 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: dump: 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.518 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:37:58.026+0000 7fa471523800 10 monclient: shutdown 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:37:58.026+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:37:58.026+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:37:58.026+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.519 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding auth protocol: cephx 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding auth protocol: cephx 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding auth protocol: cephx 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.520 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:37:58.026+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:37:58.026+0000 7fa471523800 1 librados: starting msgr at 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:37:58.026+0000 7fa471523800 1 librados: starting objecter 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:37:58.026+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command objecter_requests cmddesc objecter_requests hook 0x55e13e68e520 EEXIST 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:37:58.027+0000 7fa471523800 1 librados: setting wanted keys 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:37:58.027+0000 7fa471523800 1 librados: calling monclient init 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.521 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding auth protocol: cephx 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding auth protocol: cephx 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding auth protocol: cephx 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.522 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:37:58.027+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:37:58.027+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:37:58.027+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key cmddesc rotate-key hook 0x55e13e6a2748 EEXIST 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e6d29f0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e6dd4d0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e6e20a0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.584560s 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e6dd4d0 auth_method 0 2024-09-14T11:37:58.523 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e6d29f0 auth_method 0 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e6e20a0 auth_method 0 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.524 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_done global_id 7692 payload 824 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:37:58.027+0000 7fa467fff640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: dump: 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.525 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: dump: 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.526 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:37:58.028+0000 7fa471523800 5 monclient: authenticate success, global_id 7692 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:37:58.028+0000 7fa350ff9640 4 set_mon_vals no callback set 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:37:58.028+0000 7fa471523800 1 librados: init done 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:37:58.028+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cr dump hook 0x55e13e6dc1d8 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:37:58.029+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.527 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:37:58.030+0000 7fa33effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:37:58.030+0000 7fa33effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:37:58.030+0000 7fa33effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:37:58.030+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa338077260 auth_method 0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:37:58.030+0000 7fa46d133640 10 monclient: get_auth_request con 0x55e13e6fbff0 auth_method 0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:37:58.031+0000 7fa471523800 20 realm 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:37:58.031+0000 7fa471523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:37:58.032+0000 7fa467fff640 10 monclient: get_auth_request con 0x55e13e700250 auth_method 0 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:37:58.032+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.528 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:37:58.032+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:37:58.032+0000 7fa46d934640 10 monclient: get_auth_request con 0x55e13e703ad0 auth_method 0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:37:58.033+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:37:58.033+0000 7fa471523800 20 searching for the correct realm 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:37:58.033+0000 7fa46d133640 10 monclient: get_auth_request con 0x55e13e7088b0 auth_method 0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:37:58.034+0000 7fa467fff640 10 monclient: get_auth_request con 0x7fa46003a920 auth_method 0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:37:58.035+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa458083070 auth_method 0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:37:58.035+0000 7fa46d934640 0 -- 172.21.15.7:0/1113520994 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fa458083070 msgr2=0x7fa458051c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:37:58.236+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa458083070 auth_method 0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:37:58.236+0000 7fa46d133640 10 monclient: get_auth_request con 0x7fa468093410 auth_method 0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:37:58.240+0000 7fa467fff640 0 -- 172.21.15.7:0/1113520994 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fa460023960 msgr2=0x7fa460049400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:37:58.441+0000 7fa467fff640 10 monclient: get_auth_request con 0x7fa460023960 auth_method 0 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.529 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:37:58.446+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:37:58.446+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:37:58.446+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:37:58.447+0000 7fa471523800 20 zone default found 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:37:58.447+0000 7fa471523800 4 Realm: () 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:37:58.447+0000 7fa471523800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:37:58.447+0000 7fa471523800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:37:58.447+0000 7fa471523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:37:58.447+0000 7fa471523800 20 zonegroup default 2024-09-14T11:37:58.530 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:37:58.448+0000 7fa471523800 20 started sync module instance, tier type = 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:37:58.448+0000 7fa471523800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=0 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=1 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=2 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=3 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=4 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=5 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=6 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:37:58.459+0000 7fa471523800 20 add_watcher() i=7 2024-09-14T11:37:58.531 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:37:58.459+0000 7fa471523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding auth protocol: cephx 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding auth protocol: cephx 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding auth protocol: cephx 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.532 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:37:58.460+0000 7fa323fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:37:58.461+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:37:58.461+0000 7fa471523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:37:58.461+0000 7fa471523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache list hook 0x55e13e6d73c0 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache inspect hook 0x55e13e6d73c0 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache erase hook 0x55e13e6d73c0 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache zap hook 0x55e13e6d73c0 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:37:58.461+0000 7fa471523800 5 note: GC not initialized 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:37:58.461+0000 7fa322fe5640 20 reqs_thread_entry: start 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace show hook 0x7fa46000c650 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace history hook 0x7fa46000c650 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace active hook 0x7fa46000c650 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace active_short hook 0x7fa46000c650 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:37:58.461+0000 7fa471523800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:37:58.461+0000 7fa471523800 20 Filter name: none 2024-09-14T11:37:58.533 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:37:58.461+0000 7fa320fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:37:58.461+0000 7fa471523800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:37:58.461+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:37:58.462+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:37:58.462+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:37:58.462+0000 7fa471523800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:37:58.462+0000 7fa471523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 : miss 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:37:58.462+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:37:58.462+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:37:58.462+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:37:58.462+0000 7fa471523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:37:58.462+0000 7fa471523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:37:58.462+0000 7fa471523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:37:58.462+0000 7fa471523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:37:58.468+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.534 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:37:58.468+0000 7fa471523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:37:58.468+0000 7fa471523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:37:58.468+0000 7fa471523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37, ofs0, ns] 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529770 cookie 94425903600752 notifier 7692 bl.length()=1007 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_sources= new_sources= 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential sources added=[] removed=[] 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_dests= new_dests= 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential dests added=[] removed=[] 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:37:58.474+0000 7fa471523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa471523800 time 2024-09-14T11:37:58.475045+0000 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa472b8c76a] 2024-09-14T11:37:58.535 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:37:58.475+0000 7fa471523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fa471523800 thread_name:radosgw-admin 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa47183e6f0] 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa47188b99c] 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:58.536 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa472b8c7c4] 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:37:58.537 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:58.538 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:37:58.539 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:37:58.540 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:58.541 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:58.542 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa320fe1640 / http_manager 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa322fe5640 / http_manager 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa323fe7640 / rgw_dt_lg_renew 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa33effd640 / ms_dispatch 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa33ffff640 / io_context_pool 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa350ff9640 / io_context_pool 2024-09-14T11:37:58.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa352ffd640 / ms_dispatch 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa359e03640 / ms_dispatch 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa35b606640 / io_context_pool 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa467fff640 / msgr-worker-2 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa46d133640 / msgr-worker-1 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa46d934640 / msgr-worker-0 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa46e135640 / io_context_pool 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa471523800 / radosgw-admin 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.133938.log 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:37:58.011+0000 7fa35b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:37:58.011+0000 7fa35b606640 10 monclient: dump: 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.544 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:37:58.012+0000 7fa471523800 10 monclient: shutdown 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:37:58.012+0000 7fa471523800 5 asok(0x55e13e3ee270) unregister_commands rotate-key 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:37:58.012+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:37:58.012+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:37:58.012+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.545 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding auth protocol: cephx 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding auth protocol: cephx 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding auth protocol: cephx 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.546 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: crc 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:37:58.012+0000 7fa471523800 5 AuthRegistry(0x55e13e6140f0) adding con mode: secure 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:37:58.012+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:37:58.012+0000 7fa471523800 1 librados: starting msgr at 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:37:58.012+0000 7fa471523800 1 librados: starting objecter 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:37:58.012+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command objecter_requests hook 0x55e13e6389e0 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:37:58.013+0000 7fa471523800 1 librados: setting wanted keys 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:37:58.013+0000 7fa471523800 1 librados: calling monclient init 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding auth protocol: cephx 2024-09-14T11:37:58.547 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding auth protocol: cephx 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding auth protocol: cephx 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: crc 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:37:58.013+0000 7fa471523800 5 AuthRegistry(0x55e13e60e4a0) adding con mode: secure 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:37:58.013+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:37:58.013+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.548 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:37:58.013+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key hook 0x55e13e60e5e8 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e498670 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e4bc0e0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e557b60 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:37:58.013+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.570565s 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e4bc0e0 auth_method 0 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.549 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e498670 auth_method 0 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:37:58.013+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e557b60 auth_method 0 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:37:58.013+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient(hunting): handle_auth_done global_id 7683 payload 824 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.550 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:37:58.013+0000 7fa467fff640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:37:58.013+0000 7fa467fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: dump: 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.551 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:37:58.014+0000 7fa359e03640 10 monclient: dump: 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.552 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:37:58.014+0000 7fa471523800 5 monclient: authenticate success, global_id 7683 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:37:58.014+0000 7fa35b606640 4 set_mon_vals no callback set 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:37:58.014+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:37:58.014+0000 7fa471523800 1 librados: init done 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:37:58.016+0000 7fa359e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:37:58.016+0000 7fa359e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:37:58.016+0000 7fa359e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:37:58.016+0000 7fa46d133640 10 monclient: get_auth_request con 0x7fa354077230 auth_method 0 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:37:58.016+0000 7fa46d934640 10 monclient: get_auth_request con 0x55e13e642900 auth_method 0 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:37:58.017+0000 7fa46d133640 10 monclient: get_auth_request con 0x55e13e659e70 auth_method 0 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:37:58.018+0000 7fa467fff640 10 monclient: get_auth_request con 0x55e13e65e510 auth_method 0 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:37:58.019+0000 7fa46d934640 10 monclient: get_auth_request con 0x55e13e65dbb0 auth_method 0 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:37:58.020+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.553 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:37:58.020+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:37:58.020+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding auth protocol: cephx 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding auth protocol: cephx 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding auth protocol: cephx 2024-09-14T11:37:58.554 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: crc 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e666550) adding con mode: secure 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:37:58.020+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:37:58.020+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command objecter_requests cmddesc objecter_requests hook 0x55e13e669a20 EEXIST 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:37:58.020+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.555 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding auth protocol: cephx 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding auth protocol: cephx 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding auth protocol: cephx 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: crc 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:37:58.020+0000 7fa471523800 5 AuthRegistry(0x55e13e665448) adding con mode: secure 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:37:58.021+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.556 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:37:58.021+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:37:58.021+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key cmddesc rotate-key hook 0x55e13e665590 EEXIST 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e68dd40 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e68e120 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e68ca50 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:37:58.021+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.578452s 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e68dd40 auth_method 0 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.557 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e68ca50 auth_method 0 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e68e120 auth_method 0 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:37:58.021+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.558 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:37:58.021+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient(hunting): handle_auth_done global_id 7686 payload 824 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:37:58.021+0000 7fa467fff640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:37:58.021+0000 7fa467fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: dump: 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.559 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:37:58.022+0000 7fa352ffd640 10 monclient: dump: 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.560 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:37:58.022+0000 7fa471523800 5 monclient: authenticate success, global_id 7686 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:37:58.022+0000 7fa46e135640 4 set_mon_vals no callback set 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:37:58.022+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:37:58.023+0000 7fa352ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:37:58.023+0000 7fa352ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:37:58.023+0000 7fa352ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:37:58.024+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa348077140 auth_method 0 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: get_monmap_and_config 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.561 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:37:58.024+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding auth protocol: cephx 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding auth protocol: cephx 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding auth protocol: cephx 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.562 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: crc 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x55e13e6ada80) adding con mode: secure 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:37:58.024+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:37:58.024+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding auth protocol: cephx 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding auth protocol: cephx 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding auth protocol: cephx 2024-09-14T11:37:58.563 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: crc 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:37:58.024+0000 7fa471523800 5 AuthRegistry(0x7ffce6eceb70) adding con mode: secure 2024-09-14T11:37:58.564 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:37:58.024+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:37:58.025+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:37:58.025+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key cmddesc rotate-key hook 0x7ffce6ececb8 EEXIST 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e6e20a0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e6d29f0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e6dd4d0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.582236s 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e6dd4d0 auth_method 0 2024-09-14T11:37:58.565 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e6d29f0 auth_method 0 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e6e20a0 auth_method 0 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.566 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:37:58.025+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:37:58.025+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient(hunting): handle_auth_done global_id 7304 payload 274 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:37:58.025+0000 7fa46d133640 1 monclient: found mon.noname-c 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:37:58.025+0000 7fa46d133640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: dump: 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.567 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:37:58.025+0000 7fa471523800 5 monclient: authenticate success, global_id 7304 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:37:58.025+0000 7fa471523800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:37:58.025+0000 7fa471523800 4 set_mon_vals no callback set 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:37:58.025+0000 7fa350ff9640 10 monclient: dump: 2024-09-14T11:37:58.568 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:37:58.026+0000 7fa471523800 10 monclient: shutdown 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:37:58.026+0000 7fa471523800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:37:58.026+0000 7fa471523800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:37:58.026+0000 7fa471523800 10 monclient: monmap: 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:37:58.569 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding auth protocol: cephx 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding auth protocol: cephx 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding auth protocol: cephx 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.570 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: crc 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:37:58.026+0000 7fa471523800 5 AuthRegistry(0x55e13e6d2ee0) adding con mode: secure 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:37:58.026+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:37:58.026+0000 7fa471523800 1 librados: starting msgr at 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:37:58.026+0000 7fa471523800 1 librados: starting objecter 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:37:58.026+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command objecter_requests cmddesc objecter_requests hook 0x55e13e68e520 EEXIST 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:37:58.027+0000 7fa471523800 1 librados: setting wanted keys 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:37:58.027+0000 7fa471523800 1 librados: calling monclient init 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient: init 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding auth protocol: cephx 2024-09-14T11:37:58.571 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding auth protocol: cephx 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding auth protocol: cephx 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: crc 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:37:58.027+0000 7fa471523800 5 AuthRegistry(0x55e13e6a2600) adding con mode: secure 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:37:58.027+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.572 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:37:58.027+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:37:58.027+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command rotate-key cmddesc rotate-key hook 0x55e13e6a2748 EEXIST 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): picked mon.noname-a con 0x55e13e6d29f0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): picked mon.noname-b con 0x55e13e6dd4d0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): picked mon.noname-c con 0x55e13e6e20a0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:37:58.027+0000 7fa471523800 10 monclient(hunting): authenticate will time out at 2178.584560s 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): get_auth_request con 0x55e13e6dd4d0 auth_method 0 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.573 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): get_auth_request con 0x55e13e6d29f0 auth_method 0 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): get_auth_request con 0x55e13e6e20a0 auth_method 0 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:37:58.027+0000 7fa46d934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.574 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:37:58.027+0000 7fa46d133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient(hunting): handle_auth_done global_id 7692 payload 824 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:37:58.027+0000 7fa467fff640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:37:58.027+0000 7fa467fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: dump: 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.575 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:37:58.028+0000 7fa33effd640 10 monclient: dump: 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.576 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:37:58.028+0000 7fa471523800 5 monclient: authenticate success, global_id 7692 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:37:58.028+0000 7fa350ff9640 4 set_mon_vals no callback set 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _renew_subs 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:37:58.028+0000 7fa471523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:37:58.028+0000 7fa471523800 1 librados: init done 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:37:58.028+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cr dump hook 0x55e13e6dc1d8 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:37:58.029+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:37:58.030+0000 7fa33effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:37:58.030+0000 7fa33effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.577 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:37:58.030+0000 7fa33effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:37:58.030+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa338077260 auth_method 0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:37:58.030+0000 7fa46d133640 10 monclient: get_auth_request con 0x55e13e6fbff0 auth_method 0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:37:58.031+0000 7fa471523800 20 realm 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:37:58.031+0000 7fa471523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:37:58.031+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:37:58.032+0000 7fa467fff640 10 monclient: get_auth_request con 0x55e13e700250 auth_method 0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:37:58.032+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:37:58.032+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:37:58.032+0000 7fa46d934640 10 monclient: get_auth_request con 0x55e13e703ad0 auth_method 0 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:37:58.033+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.578 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:37:58.033+0000 7fa471523800 20 searching for the correct realm 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:37:58.033+0000 7fa46d133640 10 monclient: get_auth_request con 0x55e13e7088b0 auth_method 0 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:37:58.034+0000 7fa467fff640 10 monclient: get_auth_request con 0x7fa46003a920 auth_method 0 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:37:58.035+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa458083070 auth_method 0 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:37:58.035+0000 7fa46d934640 0 -- 172.21.15.7:0/1113520994 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fa458083070 msgr2=0x7fa458051c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:37:58.236+0000 7fa46d934640 10 monclient: get_auth_request con 0x7fa458083070 auth_method 0 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:37:58.236+0000 7fa46d133640 10 monclient: get_auth_request con 0x7fa468093410 auth_method 0 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:37:58.240+0000 7fa467fff640 0 -- 172.21.15.7:0/1113520994 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fa460023960 msgr2=0x7fa460049400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:37:58.441+0000 7fa467fff640 10 monclient: get_auth_request con 0x7fa460023960 auth_method 0 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.579 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:37:58.446+0000 7fa471523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:37:58.446+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:37:58.446+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:37:58.446+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:37:58.447+0000 7fa471523800 20 zone default found 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:37:58.447+0000 7fa471523800 4 Realm: () 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:37:58.447+0000 7fa471523800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:37:58.447+0000 7fa471523800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:37:58.447+0000 7fa471523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:37:58.447+0000 7fa471523800 20 zonegroup default 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:37:58.447+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.580 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:37:58.448+0000 7fa471523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:37:58.448+0000 7fa471523800 20 started sync module instance, tier type = 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:37:58.448+0000 7fa471523800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=0 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=1 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=2 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=3 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=4 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=5 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:37:58.458+0000 7fa471523800 20 add_watcher() i=6 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:37:58.459+0000 7fa471523800 20 add_watcher() i=7 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:37:58.459+0000 7fa471523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding auth protocol: cephx 2024-09-14T11:37:58.581 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding auth protocol: cephx 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding auth protocol: cephx 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: crc 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:37:58.460+0000 7fa471523800 5 AuthRegistry(0x7ffce6ecf050) adding con mode: secure 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:37:58.460+0000 7fa323fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:37:58.461+0000 7fa471523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.582 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:37:58.461+0000 7fa471523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:37:58.461+0000 7fa471523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache list hook 0x55e13e6d73c0 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache inspect hook 0x55e13e6d73c0 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache erase hook 0x55e13e6d73c0 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command cache zap hook 0x55e13e6d73c0 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:37:58.461+0000 7fa471523800 5 note: GC not initialized 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:37:58.461+0000 7fa322fe5640 20 reqs_thread_entry: start 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace show hook 0x7fa46000c650 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace history hook 0x7fa46000c650 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace active hook 0x7fa46000c650 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:37:58.461+0000 7fa471523800 5 asok(0x55e13e3ee270) register_command sync trace active_short hook 0x7fa46000c650 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:37:58.461+0000 7fa471523800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:37:58.461+0000 7fa471523800 20 Filter name: none 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:37:58.461+0000 7fa320fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:37:58.461+0000 7fa471523800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:37:58.461+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.583 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:37:58.462+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:37:58.462+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:37:58.462+0000 7fa471523800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:37:58.462+0000 7fa471523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 : miss 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:37:58.462+0000 7fa471523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:37:58.462+0000 7fa471523800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:37:58.462+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:37:58.462+0000 7fa471523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:37:58.462+0000 7fa471523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:37:58.462+0000 7fa471523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:37:58.462+0000 7fa471523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:37:58.468+0000 7fa471523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:37:58.468+0000 7fa471523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:37:58.468+0000 7fa471523800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:37:58.468+0000 7fa471523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37, ofs0, ns] 2024-09-14T11:37:58.584 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529770 cookie 94425903600752 notifier 7692 bl.length()=1007 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:37:58.468+0000 7fa33ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_sources= new_sources= 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential sources added=[] removed=[] 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_dests= new_dests= 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:37:58.469+0000 7fa471523800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential dests added=[] removed=[] 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:37:58.474+0000 7fa471523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa471523800 time 2024-09-14T11:37:58.475045+0000 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa472b8c76a] 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.585 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:37:58.475+0000 7fa471523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fa471523800 thread_name:radosgw-admin 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa47183e6f0] 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa47188b99c] 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:37:58.586 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa472b8c7c4] 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa472b8c928] 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e13d8800b1] 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x55e13dd9407c] 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e13d88fefd] 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa471829590] 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:37:58.587 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:58.588 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:37:58.589 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:58.590 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:37:58.591 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:58.592 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa320fe1640 / http_manager 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa322fe5640 / http_manager 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa323fe7640 / rgw_dt_lg_renew 2024-09-14T11:37:58.593 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa33effd640 / ms_dispatch 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa33ffff640 / io_context_pool 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa350ff9640 / io_context_pool 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa352ffd640 / ms_dispatch 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa359e03640 / ms_dispatch 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa35b606640 / io_context_pool 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa467fff640 / msgr-worker-2 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa46d133640 / msgr-worker-1 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa46d934640 / msgr-worker-0 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa46e135640 / io_context_pool 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: 7fa471523800 / radosgw-admin 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:37:58.476741Z_23b0f6cb-1720-4cf7-8679-9f11884eadd2/log 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:37:58.594 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:37:58.595 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:58.595 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:58.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.748+0000 7fd4d8dc8640 0 --2- 172.21.15.7:0/3191601213 >> [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] conn(0x55f281f48020 0x55f281f46410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:37:58.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.757+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 20 realm 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.758 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.759+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.760+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.760+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.761+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.761+0000 7fd4dc939800 20 searching for the correct realm 2024-09-14T11:37:58.760 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.762+0000 7fd4d7dc6640 0 -- 172.21.15.7:0/2201919382 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fd4c80ac130 msgr2=0x7fd4c80aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.968+0000 7fd4d8dc8640 0 -- 172.21.15.7:0/2201919382 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fd4cc049070 msgr2=0x7fd4cc04a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.975+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 zone default found 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 4 Realm: () 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 zonegroup default 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.976+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.977+0000 7fd4dc939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.977+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.977+0000 7fd4dc939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.977+0000 7fd4dc939800 20 started sync module instance, tier type = 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.977+0000 7fd4dc939800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.987+0000 7fd4dc939800 20 add_watcher() i=0 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.987+0000 7fd4dc939800 20 add_watcher() i=1 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.987+0000 7fd4dc939800 20 add_watcher() i=2 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.987+0000 7fd4dc939800 20 add_watcher() i=3 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.987+0000 7fd4dc939800 20 add_watcher() i=4 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.987+0000 7fd4dc939800 20 add_watcher() i=5 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.987+0000 7fd4dc939800 20 add_watcher() i=6 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.988+0000 7fd4dc939800 20 add_watcher() i=7 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.988+0000 7fd4dc939800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.989+0000 7fd38efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.990+0000 7fd4dc939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.990+0000 7fd4dc939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.990+0000 7fd4dc939800 5 note: GC not initialized 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.990+0000 7fd38dfdb640 20 reqs_thread_entry: start 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.990+0000 7fd4dc939800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.990+0000 7fd4dc939800 20 Filter name: none 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.990+0000 7fd2ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.991+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.991+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.991+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.992+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.992+0000 7fd4dc939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.992+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.992+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.992+0000 7fd4dc939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.993+0000 7fd4dc939800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.993+0000 7fd4dc939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.995+0000 7fd38efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.997+0000 7fd4dc939800 20 remove_watcher() i=0 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.997+0000 7fd4dc939800 2 removed watcher, disabling cache 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.998+0000 7fd4dc939800 20 remove_watcher() i=1 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:58.999+0000 7fd4dc939800 20 remove_watcher() i=2 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.000+0000 7fd4dc939800 20 remove_watcher() i=3 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.001+0000 7fd4dc939800 20 remove_watcher() i=4 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.002+0000 7fd4dc939800 20 remove_watcher() i=5 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.003+0000 7fd4dc939800 20 remove_watcher() i=6 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.005+0000 7fd4dc939800 20 remove_watcher() i=7 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-logrecord-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:37:59.066 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.141+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 20 realm 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.142+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.143+0000 7fe743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.143+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.144+0000 7fe743742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.144+0000 7fe743742800 20 searching for the correct realm 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.146+0000 7fe73fcee640 0 -- 172.21.15.7:0/1702640040 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe734001c20 msgr2=0x7fe734083110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.150+0000 7fe73ecec640 0 -- 172.21.15.7:0/1702640040 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe73001d820 msgr2=0x7fe7300615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:59.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.356+0000 7fe743742800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.356+0000 7fe743742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.356+0000 7fe743742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.356+0000 7fe743742800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.356+0000 7fe743742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.356+0000 7fe743742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.356+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.356 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 zone default found 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 4 Realm: () 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 zonegroup default 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.357+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.358+0000 7fe743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.358+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.358+0000 7fe743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.358+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.358+0000 7fe743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.358+0000 7fe743742800 20 started sync module instance, tier type = 2024-09-14T11:37:59.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.358+0000 7fe743742800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.368+0000 7fe743742800 20 add_watcher() i=0 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.368+0000 7fe743742800 20 add_watcher() i=1 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.368+0000 7fe743742800 20 add_watcher() i=2 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.368+0000 7fe743742800 20 add_watcher() i=3 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.368+0000 7fe743742800 20 add_watcher() i=4 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.368+0000 7fe743742800 20 add_watcher() i=5 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.368+0000 7fe743742800 20 add_watcher() i=6 2024-09-14T11:37:59.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.369+0000 7fe743742800 20 add_watcher() i=7 2024-09-14T11:37:59.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.369+0000 7fe743742800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.371+0000 7fe5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.371+0000 7fe743742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.371+0000 7fe743742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.371+0000 7fe743742800 5 note: GC not initialized 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.371+0000 7fe5f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 20 Filter name: none 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe56e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:37:59.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 : miss 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.372+0000 7fe743742800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.373+0000 7fe743742800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.373+0000 7fe743742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.373+0000 7fe743742800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.373+0000 7fe743742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.373+0000 7fe743742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.373+0000 7fe743742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.374+0000 7fe743742800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to be held by another RGW process; skipping for now 2024-09-14T11:37:59.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.375+0000 7fe5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.377+0000 7fe743742800 20 remove_watcher() i=0 2024-09-14T11:37:59.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.377+0000 7fe743742800 2 removed watcher, disabling cache 2024-09-14T11:37:59.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.379+0000 7fe743742800 20 remove_watcher() i=1 2024-09-14T11:37:59.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.380+0000 7fe743742800 20 remove_watcher() i=2 2024-09-14T11:37:59.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.381+0000 7fe743742800 20 remove_watcher() i=3 2024-09-14T11:37:59.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.382+0000 7fe743742800 20 remove_watcher() i=4 2024-09-14T11:37:59.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.383+0000 7fe743742800 20 remove_watcher() i=5 2024-09-14T11:37:59.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.384+0000 7fe743742800 20 remove_watcher() i=6 2024-09-14T11:37:59.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:37:59.385+0000 7fe743742800 20 remove_watcher() i=7 2024-09-14T11:37:59.395 INFO:tasks.workunit.client.0.smithi007.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:38:29.406 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:29.443 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:29.443 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:29.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.491+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.493+0000 7f3cc6840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.493+0000 7f3cc6840800 20 realm 2024-09-14T11:38:29.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.493+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.493+0000 7f3cc6840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.493+0000 7f3cc6840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:29.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.493+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.494+0000 7f3cc6840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.494+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.495+0000 7f3cc6840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.495+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.495+0000 7f3cc6840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:29.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.496+0000 7f3cc6840800 20 searching for the correct realm 2024-09-14T11:38:29.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.497+0000 7f3cc4b2b640 0 -- 172.21.15.7:0/3880369978 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f3cb802b070 msgr2=0x7f3cb8050400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.705+0000 7f3cc3b29640 0 -- 172.21.15.7:0/3880369978 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f3cb40bd2e0 msgr2=0x7f3cb40e57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.914+0000 7f3cc6840800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.914+0000 7f3cc6840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.914+0000 7f3cc6840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.914+0000 7f3cc6840800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:29.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.914+0000 7f3cc6840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:29.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.914+0000 7f3cc6840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:29.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.914+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.915+0000 7f3cc6840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.913 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.915+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.915+0000 7f3cc6840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.915+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 zone default found 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 4 Realm: () 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 zonegroup default 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.914 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.916+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.917+0000 7f3cc6840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.917+0000 7f3cc6840800 20 started sync module instance, tier type = 2024-09-14T11:38:29.915 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.917+0000 7f3cc6840800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.928+0000 7f3cc6840800 20 add_watcher() i=0 2024-09-14T11:38:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.928+0000 7f3cc6840800 20 add_watcher() i=1 2024-09-14T11:38:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.928+0000 7f3cc6840800 20 add_watcher() i=2 2024-09-14T11:38:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.928+0000 7f3cc6840800 20 add_watcher() i=3 2024-09-14T11:38:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.928+0000 7f3cc6840800 20 add_watcher() i=4 2024-09-14T11:38:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.928+0000 7f3cc6840800 20 add_watcher() i=5 2024-09-14T11:38:29.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.928+0000 7f3cc6840800 20 add_watcher() i=6 2024-09-14T11:38:29.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.929+0000 7f3cc6840800 20 add_watcher() i=7 2024-09-14T11:38:29.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.929+0000 7f3cc6840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:29.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.931+0000 7f3b7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.932+0000 7f3cc6840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:29.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.932+0000 7f3cc6840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:29.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.932+0000 7f3cc6840800 5 note: GC not initialized 2024-09-14T11:38:29.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.932+0000 7f3b79fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:29.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.932+0000 7f3cc6840800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:29.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.932+0000 7f3cc6840800 20 Filter name: none 2024-09-14T11:38:29.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3aeb7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:29.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3cc6840800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:38:29.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3cc6840800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:38:29.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3cc6840800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3cc6840800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3cc6840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 : miss 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.933+0000 7f3cc6840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.934+0000 7f3cc6840800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.934+0000 7f3cc6840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.934+0000 7f3cc6840800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.934+0000 7f3cc6840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:29.932 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.934+0000 7f3cc6840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:29.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.934+0000 7f3cc6840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 2024-09-14T11:38:29.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.935+0000 7f3cc6840800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3cc6840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3cc6840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3cc6840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3cc6840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37, ofs0, ns] 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3b9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529771 cookie 93925676153424 notifier 7361 bl.length()=1007 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3b9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3b9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.943+0000 7f3b9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.944+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_sources= new_sources= 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.944+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential sources added=[] removed=[] 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.944+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_dests= new_dests= 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.944+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential dests added=[] removed=[] 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.951+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.0 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.951+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.0 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.951+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.1 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.1 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.2 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.2 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.3 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.3 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.4 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.4 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.5 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.5 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.6 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.6 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.7 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.7 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.8 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.8 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.9 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.9 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.10 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.10 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.11 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2.11 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.0 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.952+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.1 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.953+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.954+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.3 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.954+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.4 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.955+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.5 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.956+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.6 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.956+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.7 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.957+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.8 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.958+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.9 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.959+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.10 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.962+0000 7f3cc6840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.962+0000 7f3cc6840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.963+0000 7f3cc6840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.963+0000 7f3cc6840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.963+0000 7f3cc6840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.963+0000 7f3cc6840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37, ofs0, ns] 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3b9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529772 cookie 93925676153424 notifier 7361 bl.length()=1007 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3b9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3b9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3b9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_sources= new_sources= 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential sources added=[] removed=[] 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_dests= new_dests= 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.964+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential dests added=[] removed=[] 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.969+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.0 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.969+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.1 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.970+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.2 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.970+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.3 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.970+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.4 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.971+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.5 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.971+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.6 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.972+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.7 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.973+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.8 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.973+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.9 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.974+0000 7f3cc6840800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37.10 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.974+0000 7f3cc6840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.974+0000 7f3cc6840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37, ofs0, ns] 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3b9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529773 cookie 93925676153424 notifier 7361 bl.length()=975 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3b9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 info.flags=0x17 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3b9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 to cache LRU end 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3b9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_sources= new_sources= 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential sources added=[] removed=[] 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): orig_dests= new_dests= 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.976+0000 7f3cc6840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37]): potential dests added=[] removed=[] 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.979+0000 7f3cc6840800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.982+0000 7f3b7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.984+0000 7f3cc6840800 20 remove_watcher() i=0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.984+0000 7f3cc6840800 2 removed watcher, disabling cache 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.986+0000 7f3cc6840800 20 remove_watcher() i=1 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.987+0000 7f3cc6840800 20 remove_watcher() i=2 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.988+0000 7f3cc6840800 20 remove_watcher() i=3 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.989+0000 7f3cc6840800 20 remove_watcher() i=4 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.990+0000 7f3cc6840800 20 remove_watcher() i=5 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.991+0000 7f3cc6840800 20 remove_watcher() i=6 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:29.993+0000 7f3cc6840800 20 remove_watcher() i=7 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.077+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 20 realm 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.079+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.080+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.080+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.081+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.081+0000 7fecf7b46800 20 searching for the correct realm 2024-09-14T11:38:30.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.083+0000 7fecf5637640 0 -- 172.21.15.7:0/3589020058 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fecf008b300 msgr2=0x7fecf0089d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:30.288 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.290+0000 7fecf5637640 0 -- 172.21.15.7:0/3589020058 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fecf008b300 msgr2=0x7fecf0089d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.292 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.293 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.295+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 zone default found 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 4 Realm: () 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 zonegroup default 2024-09-14T11:38:30.294 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.296+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.297+0000 7fecf7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.297+0000 7fecf7b46800 20 started sync module instance, tier type = 2024-09-14T11:38:30.295 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.297+0000 7fecf7b46800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:30.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.307+0000 7fecf7b46800 20 add_watcher() i=0 2024-09-14T11:38:30.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.307+0000 7fecf7b46800 20 add_watcher() i=1 2024-09-14T11:38:30.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.307+0000 7fecf7b46800 20 add_watcher() i=2 2024-09-14T11:38:30.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.307+0000 7fecf7b46800 20 add_watcher() i=3 2024-09-14T11:38:30.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.307+0000 7fecf7b46800 20 add_watcher() i=4 2024-09-14T11:38:30.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.307+0000 7fecf7b46800 20 add_watcher() i=5 2024-09-14T11:38:30.305 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.307+0000 7fecf7b46800 20 add_watcher() i=6 2024-09-14T11:38:30.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.308+0000 7fecf7b46800 20 add_watcher() i=7 2024-09-14T11:38:30.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.308+0000 7fecf7b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.310+0000 7febab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7fecf7b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7fecf7b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7fecf7b46800 5 note: GC not initialized 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7febaa7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7fecf7b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7fecf7b46800 20 Filter name: none 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7feb1bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:30.309 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.311+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.312+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:38:30.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.312+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.312+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:38:30.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.312+0000 7fecf7b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.310 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.313+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.313+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:38:30.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.313+0000 7fecf7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.313+0000 7fecf7b46800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:38:30.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.313+0000 7fecf7b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.315+0000 7febab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.319+0000 7fecf7b46800 20 remove_watcher() i=0 2024-09-14T11:38:30.316 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.319+0000 7fecf7b46800 2 removed watcher, disabling cache 2024-09-14T11:38:30.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.320+0000 7fecf7b46800 20 remove_watcher() i=1 2024-09-14T11:38:30.319 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.321+0000 7fecf7b46800 20 remove_watcher() i=2 2024-09-14T11:38:30.320 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.322+0000 7fecf7b46800 20 remove_watcher() i=3 2024-09-14T11:38:30.321 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.323+0000 7fecf7b46800 20 remove_watcher() i=4 2024-09-14T11:38:30.322 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.324+0000 7fecf7b46800 20 remove_watcher() i=5 2024-09-14T11:38:30.323 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.326+0000 7fecf7b46800 20 remove_watcher() i=6 2024-09-14T11:38:30.324 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.327+0000 7fecf7b46800 20 remove_watcher() i=7 2024-09-14T11:38:30.336 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:30.336 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:30.336 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-logrecord-writes id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:30.336 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:30.339 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.339 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.342 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.342 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.386 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.386 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.416 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:38:30.416 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:30.417 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.417 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.430 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.430 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.473 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.473 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.480 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.480 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.487 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.487 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.493 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.493 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.500 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.500 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.506 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.506 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.512 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.512 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.518 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.518 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.524 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.524 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.530 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.530 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.537 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.537 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.544 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.544 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.562 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.562 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.569 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.569 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.575 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.575 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.581 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.582 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.588 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.588 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.594 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.594 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:30.601 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:30.631 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.631 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.672+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 20 realm 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.674+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.675+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.675+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.676+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.676+0000 7f5b2c7ad800 20 searching for the correct realm 2024-09-14T11:38:30.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.678+0000 7f5b2aa98640 0 -- 172.21.15.7:0/2525211380 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f5b200b9d70 msgr2=0x7f5b200b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:30.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:30.885+0000 7f5b29a96640 0 -- 172.21.15.7:0/2525211380 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f5b1c04c200 msgr2=0x7f5b1c05f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.093+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:31.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 zone default found 2024-09-14T11:38:31.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 4 Realm: () 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 zonegroup default 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.094+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.095+0000 7f5b2c7ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.095+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.095+0000 7f5b2c7ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.095+0000 7f5b2c7ad800 20 started sync module instance, tier type = 2024-09-14T11:38:31.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.095+0000 7f5b2c7ad800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.105+0000 7f5b2c7ad800 20 add_watcher() i=0 2024-09-14T11:38:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.105+0000 7f5b2c7ad800 20 add_watcher() i=1 2024-09-14T11:38:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.105+0000 7f5b2c7ad800 20 add_watcher() i=2 2024-09-14T11:38:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.105+0000 7f5b2c7ad800 20 add_watcher() i=3 2024-09-14T11:38:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.105+0000 7f5b2c7ad800 20 add_watcher() i=4 2024-09-14T11:38:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.105+0000 7f5b2c7ad800 20 add_watcher() i=5 2024-09-14T11:38:31.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.105+0000 7f5b2c7ad800 20 add_watcher() i=6 2024-09-14T11:38:31.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.107+0000 7f5b2c7ad800 20 add_watcher() i=7 2024-09-14T11:38:31.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.107+0000 7f5b2c7ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:31.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.108+0000 7f59e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.109+0000 7f5b2c7ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.109+0000 7f5b2c7ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.109+0000 7f5b2c7ad800 5 note: GC not initialized 2024-09-14T11:38:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.109+0000 7f595b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.109+0000 7f5b2c7ad800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.109+0000 7f5b2c7ad800 20 Filter name: none 2024-09-14T11:38:31.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.110+0000 7f59597fa640 20 reqs_thread_entry: start 2024-09-14T11:38:31.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.110+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.110+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:31.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.110+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.111+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.111+0000 7f5b2c7ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.111+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.111+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.111+0000 7f5b2c7ad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.112+0000 7f5b2c7ad800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:31.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.112+0000 7f5b2c7ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:31.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.114+0000 7f59e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.116+0000 7f5b2c7ad800 20 remove_watcher() i=0 2024-09-14T11:38:31.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.116+0000 7f5b2c7ad800 2 removed watcher, disabling cache 2024-09-14T11:38:31.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.117+0000 7f5b2c7ad800 20 remove_watcher() i=1 2024-09-14T11:38:31.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.119+0000 7f5b2c7ad800 20 remove_watcher() i=2 2024-09-14T11:38:31.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.120+0000 7f5b2c7ad800 20 remove_watcher() i=3 2024-09-14T11:38:31.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.121+0000 7f5b2c7ad800 20 remove_watcher() i=4 2024-09-14T11:38:31.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.122+0000 7f5b2c7ad800 20 remove_watcher() i=5 2024-09-14T11:38:31.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.123+0000 7f5b2c7ad800 20 remove_watcher() i=6 2024-09-14T11:38:31.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.124+0000 7f5b2c7ad800 20 remove_watcher() i=7 2024-09-14T11:38:31.134 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:31.134 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:31.134 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:31.134 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:31.136 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:38:31.172 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:31.172 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:31.213 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.215+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.217+0000 7f7bd1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.217+0000 7f7bd1c0e800 20 realm 2024-09-14T11:38:31.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.218+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.218+0000 7f7bd1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.218+0000 7f7bd1c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:31.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.218+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.218+0000 7f7bd1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.218+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.216 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.219+0000 7f7bd1c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.219+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.220+0000 7f7bd1c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:31.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.220+0000 7f7bd1c0e800 20 searching for the correct realm 2024-09-14T11:38:31.219 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.222+0000 7f7bcda5a640 0 -- 172.21.15.7:0/2966114462 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f7bc4067d50 msgr2=0x7f7bc4071f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.224 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.226+0000 7f7bcca58640 0 -- 172.21.15.7:0/2966114462 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f7bc009bc20 msgr2=0x7f7bc00438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.432+0000 7f7bd1c0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:31.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.432+0000 7f7bd1c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:31.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.432+0000 7f7bd1c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:31.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.432+0000 7f7bd1c0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:31.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.432+0000 7f7bd1c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:31.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.432+0000 7f7bd1c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:31.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.432+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:31.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 zone default found 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 4 Realm: () 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 zonegroup default 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.433+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.434+0000 7f7bd1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.434+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.434+0000 7f7bd1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.434+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.434+0000 7f7bd1c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.434+0000 7f7bd1c0e800 20 started sync module instance, tier type = 2024-09-14T11:38:31.433 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.434+0000 7f7bd1c0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:31.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.444+0000 7f7bd1c0e800 20 add_watcher() i=0 2024-09-14T11:38:31.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.444+0000 7f7bd1c0e800 20 add_watcher() i=1 2024-09-14T11:38:31.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.444+0000 7f7bd1c0e800 20 add_watcher() i=2 2024-09-14T11:38:31.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.444+0000 7f7bd1c0e800 20 add_watcher() i=3 2024-09-14T11:38:31.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.444+0000 7f7bd1c0e800 20 add_watcher() i=4 2024-09-14T11:38:31.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.444+0000 7f7bd1c0e800 20 add_watcher() i=5 2024-09-14T11:38:31.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.444+0000 7f7bd1c0e800 20 add_watcher() i=6 2024-09-14T11:38:31.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.445+0000 7f7bd1c0e800 20 add_watcher() i=7 2024-09-14T11:38:31.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.445+0000 7f7bd1c0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:31.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.447+0000 7f7a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.447+0000 7f7bd1c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.447+0000 7f7bd1c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.448+0000 7f7bd1c0e800 5 note: GC not initialized 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.448+0000 7f7a827e4640 20 reqs_thread_entry: start 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.448+0000 7f7bd1c0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.448+0000 7f7bd1c0e800 20 Filter name: none 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.448+0000 7f79f3fff640 20 reqs_thread_entry: start 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.448+0000 7f7bd1c0e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:38:31.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.448+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:31.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:31.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:38:31.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 : miss 2024-09-14T11:38:31.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:31.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:31.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:31.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:31.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:31.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.449+0000 7f7bd1c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 2024-09-14T11:38:31.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.455+0000 7f7bd1c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:31.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.455+0000 7f7bd1c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:31.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.455+0000 7f7bd1c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:31.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.455+0000 7f7bd1c0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38, ofs0, ns] 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7a9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529777 cookie 93990790387648 notifier 7797 bl.length()=1015 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7a9ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7a9ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7a9ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_sources= new_sources= 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential sources added=[] removed=[] 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_dests= new_dests= 2024-09-14T11:38:31.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.456+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential dests added=[] removed=[] 2024-09-14T11:38:31.461 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.0 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.0 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.1 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.1 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.2 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.2 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.3 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.3 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.4 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.4 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.5 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.5 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.6 2024-09-14T11:38:31.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.6 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.7 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.463+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.7 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.8 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.8 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.9 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.9 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.10 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.10 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.11 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.11 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.0 2024-09-14T11:38:31.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1 2024-09-14T11:38:31.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.464+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.2 2024-09-14T11:38:31.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.465+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.3 2024-09-14T11:38:31.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.465+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.4 2024-09-14T11:38:31.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.466+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.5 2024-09-14T11:38:31.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.466+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.6 2024-09-14T11:38:31.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.467+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.7 2024-09-14T11:38:31.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.467+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.8 2024-09-14T11:38:31.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.468+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.9 2024-09-14T11:38:31.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.469+0000 7f7bd1c0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.10 2024-09-14T11:38:31.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.472+0000 7f7bd1c0e800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:38:31.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.472+0000 7f7bd1c0e800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:38:31.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.483+0000 7f7bd1c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:31.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.483+0000 7f7bd1c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 2024-09-14T11:38:31.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38, ofs0, ns] 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7ab0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529778 cookie 93990790387648 notifier 7797 bl.length()=983 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7ab0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7ab0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7ab0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_sources= new_sources= 2024-09-14T11:38:31.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential sources added=[] removed=[] 2024-09-14T11:38:31.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_dests= new_dests= 2024-09-14T11:38:31.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential dests added=[] removed=[] 2024-09-14T11:38:31.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.485+0000 7f7bd1c0e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:38:31.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.487+0000 7f7a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.490+0000 7f7bd1c0e800 20 remove_watcher() i=0 2024-09-14T11:38:31.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.490+0000 7f7bd1c0e800 2 removed watcher, disabling cache 2024-09-14T11:38:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.491+0000 7f7bd1c0e800 20 remove_watcher() i=1 2024-09-14T11:38:31.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.492+0000 7f7bd1c0e800 20 remove_watcher() i=2 2024-09-14T11:38:31.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.493+0000 7f7bd1c0e800 20 remove_watcher() i=3 2024-09-14T11:38:31.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.494+0000 7f7bd1c0e800 20 remove_watcher() i=4 2024-09-14T11:38:31.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.495+0000 7f7bd1c0e800 20 remove_watcher() i=5 2024-09-14T11:38:31.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.496+0000 7f7bd1c0e800 20 remove_watcher() i=6 2024-09-14T11:38:31.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.497+0000 7f7bd1c0e800 20 remove_watcher() i=7 2024-09-14T11:38:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:31.537 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:31.537 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:31.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.579+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.580+0000 7fd4e3c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.580+0000 7fd4e3c14800 20 realm 2024-09-14T11:38:31.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.580+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.581+0000 7fd4e3c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.581+0000 7fd4e3c14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:31.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.581+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.581+0000 7fd4e3c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.581+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.582+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.582+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.582+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:31.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.582+0000 7fd4e3c14800 20 searching for the correct realm 2024-09-14T11:38:31.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.585+0000 7fd4df2cb640 0 -- 172.21.15.7:0/4177034050 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fd4d802f060 msgr2=0x7fd4d8065b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:31.790 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.792+0000 7fd4df2cb640 0 -- 172.21.15.7:0/4177034050 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fd4d802f060 msgr2=0x7fd4d8065b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.795 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.797+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:31.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 zone default found 2024-09-14T11:38:31.796 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 4 Realm: () 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 zonegroup default 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.798+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.799+0000 7fd4e3c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.799+0000 7fd4e3c14800 20 started sync module instance, tier type = 2024-09-14T11:38:31.797 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.799+0000 7fd4e3c14800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.808+0000 7fd4e3c14800 20 add_watcher() i=0 2024-09-14T11:38:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.808+0000 7fd4e3c14800 20 add_watcher() i=1 2024-09-14T11:38:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.808+0000 7fd4e3c14800 20 add_watcher() i=2 2024-09-14T11:38:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.808+0000 7fd4e3c14800 20 add_watcher() i=3 2024-09-14T11:38:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.808+0000 7fd4e3c14800 20 add_watcher() i=4 2024-09-14T11:38:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.808+0000 7fd4e3c14800 20 add_watcher() i=5 2024-09-14T11:38:31.806 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.808+0000 7fd4e3c14800 20 add_watcher() i=6 2024-09-14T11:38:31.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.809+0000 7fd4e3c14800 20 add_watcher() i=7 2024-09-14T11:38:31.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.809+0000 7fd4e3c14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:31.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.811+0000 7fd395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd4e3c14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd4e3c14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd4e3c14800 5 note: GC not initialized 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd394fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd4e3c14800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd4e3c14800 20 Filter name: none 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd30e7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:31.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.812+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.813+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:31.811 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.813+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.813+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.813+0000 7fd4e3c14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.813+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.813+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.813+0000 7fd4e3c14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.814+0000 7fd4e3c14800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:31.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.814+0000 7fd4e3c14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:31.813 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.816+0000 7fd395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.815 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.818+0000 7fd4e3c14800 20 remove_watcher() i=0 2024-09-14T11:38:31.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.818+0000 7fd4e3c14800 2 removed watcher, disabling cache 2024-09-14T11:38:31.816 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.819+0000 7fd4e3c14800 20 remove_watcher() i=1 2024-09-14T11:38:31.818 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.820+0000 7fd4e3c14800 20 remove_watcher() i=2 2024-09-14T11:38:31.819 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.821+0000 7fd4e3c14800 20 remove_watcher() i=3 2024-09-14T11:38:31.820 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.823+0000 7fd4e3c14800 20 remove_watcher() i=4 2024-09-14T11:38:31.821 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.824+0000 7fd4e3c14800 20 remove_watcher() i=5 2024-09-14T11:38:31.822 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.825+0000 7fd4e3c14800 20 remove_watcher() i=6 2024-09-14T11:38:31.823 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.826+0000 7fd4e3c14800 20 remove_watcher() i=7 2024-09-14T11:38:31.835 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:31.835 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:31.835 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:31.835 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:31.837 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:31.837 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:31.843 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:31.843 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:31.887 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:31.920 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:31.920 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:31.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.962+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 20 realm 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.964+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.965+0000 7f1669526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.963 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.965+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.966+0000 7f1669526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:31.964 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:31.966+0000 7f1669526800 20 searching for the correct realm 2024-09-14T11:38:32.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.171+0000 7f166590a640 0 -- 172.21.15.7:0/1843185733 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f1650074040 msgr2=0x7f1650076040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:32.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.377+0000 7f1664908640 0 -- 172.21.15.7:0/1843185733 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f165808ac40 msgr2=0x7f165806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:32.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:32.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:32.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:32.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:32.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:32.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:32.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.584+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 20 zone default found 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 4 Realm: () 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 20 zonegroup default 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.585+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.586+0000 7f1669526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.586+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.586+0000 7f1669526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.586+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.586+0000 7f1669526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.586+0000 7f1669526800 20 started sync module instance, tier type = 2024-09-14T11:38:32.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.587+0000 7f1669526800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:32.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.598+0000 7f1669526800 20 add_watcher() i=0 2024-09-14T11:38:32.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.598+0000 7f1669526800 20 add_watcher() i=1 2024-09-14T11:38:32.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.598+0000 7f1669526800 20 add_watcher() i=2 2024-09-14T11:38:32.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.598+0000 7f1669526800 20 add_watcher() i=3 2024-09-14T11:38:32.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.598+0000 7f1669526800 20 add_watcher() i=4 2024-09-14T11:38:32.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.598+0000 7f1669526800 20 add_watcher() i=5 2024-09-14T11:38:32.596 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.598+0000 7f1669526800 20 add_watcher() i=6 2024-09-14T11:38:32.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.599+0000 7f1669526800 20 add_watcher() i=7 2024-09-14T11:38:32.597 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.599+0000 7f1669526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:32.599 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.601+0000 7f151bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1669526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1669526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1669526800 5 note: GC not initialized 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f151afe5640 20 reqs_thread_entry: start 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1669526800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1669526800 20 Filter name: none 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1518fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1669526800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:38:32.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.602+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.603+0000 7f1669526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:32.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.603+0000 7f1669526800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.603+0000 7f1669526800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.603+0000 7f1669526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 : miss 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.603+0000 7f1669526800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.604+0000 7f1669526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.604+0000 7f1669526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.604+0000 7f1669526800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.604+0000 7f1669526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.604+0000 7f1669526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:32.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.604+0000 7f1669526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 2024-09-14T11:38:32.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1669526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:32.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1669526800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:32.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1669526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:32.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1669526800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38, ofs0, ns] 2024-09-14T11:38:32.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1548ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529779 cookie 94025328088640 notifier 7451 bl.length()=1015 2024-09-14T11:38:32.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1548ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:32.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1548ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:32.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.610+0000 7f1548ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:32.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.611+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_sources= new_sources= 2024-09-14T11:38:32.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.611+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential sources added=[] removed=[] 2024-09-14T11:38:32.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.611+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_dests= new_dests= 2024-09-14T11:38:32.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.611+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential dests added=[] removed=[] 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.0 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.0 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.1 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.1 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.2 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.2 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.3 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.3 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.4 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.4 2024-09-14T11:38:32.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.5 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.5 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.6 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.6 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.7 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.7 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.8 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.8 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.9 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.9 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.10 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.10 2024-09-14T11:38:32.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.11 2024-09-14T11:38:32.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1.11 2024-09-14T11:38:32.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.0 2024-09-14T11:38:32.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.618+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1 2024-09-14T11:38:32.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.619+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.2 2024-09-14T11:38:32.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.619+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.3 2024-09-14T11:38:32.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.620+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.4 2024-09-14T11:38:32.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.620+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.5 2024-09-14T11:38:32.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.621+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.6 2024-09-14T11:38:32.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.621+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.7 2024-09-14T11:38:32.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.621+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.8 2024-09-14T11:38:32.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.622+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.9 2024-09-14T11:38:32.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.623+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.10 2024-09-14T11:38:32.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.626+0000 7f1669526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:32.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.626+0000 7f1669526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 2024-09-14T11:38:32.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.627+0000 7f1669526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:32.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.627+0000 7f1669526800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:32.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.627+0000 7f1669526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:32.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.627+0000 7f1669526800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38, ofs0, ns] 2024-09-14T11:38:32.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1548ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529780 cookie 94025328088640 notifier 7451 bl.length()=1015 2024-09-14T11:38:32.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1548ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:32.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1548ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:32.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1548ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:32.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_sources= new_sources= 2024-09-14T11:38:32.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential sources added=[] removed=[] 2024-09-14T11:38:32.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_dests= new_dests= 2024-09-14T11:38:32.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.628+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential dests added=[] removed=[] 2024-09-14T11:38:32.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.632+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.0 2024-09-14T11:38:32.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.633+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.1 2024-09-14T11:38:32.630 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.633+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.2 2024-09-14T11:38:32.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.633+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.3 2024-09-14T11:38:32.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.634+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.4 2024-09-14T11:38:32.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.634+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.5 2024-09-14T11:38:32.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.634+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.6 2024-09-14T11:38:32.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.635+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.7 2024-09-14T11:38:32.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.635+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.8 2024-09-14T11:38:32.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.635+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.9 2024-09-14T11:38:32.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.636+0000 7f1669526800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38.10 2024-09-14T11:38:32.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.636+0000 7f1669526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:32.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.636+0000 7f1669526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 2024-09-14T11:38:32.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.637+0000 7f1669526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:32.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.637+0000 7f1669526800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:32.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.637+0000 7f1669526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.637+0000 7f1669526800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38, ofs0, ns] 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1548ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529781 cookie 94025328088640 notifier 7451 bl.length()=983 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1548ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 info.flags=0x17 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1548ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 to cache LRU end 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1548ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_sources= new_sources= 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential sources added=[] removed=[] 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): orig_dests= new_dests= 2024-09-14T11:38:32.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.638+0000 7f1669526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38]): potential dests added=[] removed=[] 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.641+0000 7f1669526800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:32.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.643+0000 7f151bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.646+0000 7f1669526800 20 remove_watcher() i=0 2024-09-14T11:38:32.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.646+0000 7f1669526800 2 removed watcher, disabling cache 2024-09-14T11:38:32.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.647+0000 7f1669526800 20 remove_watcher() i=1 2024-09-14T11:38:32.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.648+0000 7f1669526800 20 remove_watcher() i=2 2024-09-14T11:38:32.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.649+0000 7f1669526800 20 remove_watcher() i=3 2024-09-14T11:38:32.648 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.650+0000 7f1669526800 20 remove_watcher() i=4 2024-09-14T11:38:32.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.651+0000 7f1669526800 20 remove_watcher() i=5 2024-09-14T11:38:32.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.653+0000 7f1669526800 20 remove_watcher() i=6 2024-09-14T11:38:32.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.654+0000 7f1669526800 20 remove_watcher() i=7 2024-09-14T11:38:32.665 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:32.695 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:32.695 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:32.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.737+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 20 realm 2024-09-14T11:38:32.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:32.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.739+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.740+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.740+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.741+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:32.739 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.741+0000 7f9287ba2800 20 searching for the correct realm 2024-09-14T11:38:32.740 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.743+0000 7f9285e8d640 0 -- 172.21.15.7:0/2855180152 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f927c0ae000 msgr2=0x7f927c0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:32.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:32.949+0000 7f9284e8b640 0 -- 172.21.15.7:0/2855180152 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f927807b160 msgr2=0x7f927806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:33.154 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.156+0000 7f9287ba2800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.156+0000 7f9287ba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.156+0000 7f9287ba2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.156+0000 7f9287ba2800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.156+0000 7f9287ba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.156+0000 7f9287ba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.156+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:33.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 zone default found 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 4 Realm: () 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 zonegroup default 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.157+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.158+0000 7f9287ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.158+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.158+0000 7f9287ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.158+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.159+0000 7f9287ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.159+0000 7f9287ba2800 20 started sync module instance, tier type = 2024-09-14T11:38:33.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.159+0000 7f9287ba2800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.169+0000 7f9287ba2800 20 add_watcher() i=0 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.169+0000 7f9287ba2800 20 add_watcher() i=1 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.169+0000 7f9287ba2800 20 add_watcher() i=2 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.169+0000 7f9287ba2800 20 add_watcher() i=3 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.169+0000 7f9287ba2800 20 add_watcher() i=4 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.169+0000 7f9287ba2800 20 add_watcher() i=5 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.169+0000 7f9287ba2800 20 add_watcher() i=6 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.170+0000 7f9287ba2800 20 add_watcher() i=7 2024-09-14T11:38:33.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.170+0000 7f9287ba2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:33.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.172+0000 7f913bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.172+0000 7f9287ba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:33.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.172+0000 7f9287ba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:33.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.172+0000 7f9287ba2800 5 note: GC not initialized 2024-09-14T11:38:33.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.172+0000 7f913afe5640 20 reqs_thread_entry: start 2024-09-14T11:38:33.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.172+0000 7f9287ba2800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:33.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.172+0000 7f9287ba2800 20 Filter name: none 2024-09-14T11:38:33.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.173+0000 7f9138fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:33.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.173+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.173+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.173+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.174+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.174+0000 7f9287ba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.174+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.174+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.174+0000 7f9287ba2800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.174+0000 7f9287ba2800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:33.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.174+0000 7f9287ba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:33.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.176+0000 7f913bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.179+0000 7f9287ba2800 20 remove_watcher() i=0 2024-09-14T11:38:33.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.179+0000 7f9287ba2800 2 removed watcher, disabling cache 2024-09-14T11:38:33.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.180+0000 7f9287ba2800 20 remove_watcher() i=1 2024-09-14T11:38:33.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.181+0000 7f9287ba2800 20 remove_watcher() i=2 2024-09-14T11:38:33.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.183+0000 7f9287ba2800 20 remove_watcher() i=3 2024-09-14T11:38:33.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.184+0000 7f9287ba2800 20 remove_watcher() i=4 2024-09-14T11:38:33.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.185+0000 7f9287ba2800 20 remove_watcher() i=5 2024-09-14T11:38:33.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.186+0000 7f9287ba2800 20 remove_watcher() i=6 2024-09-14T11:38:33.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.187+0000 7f9287ba2800 20 remove_watcher() i=7 2024-09-14T11:38:33.196 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:33.196 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:33.196 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:33.198 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.199 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.202 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.202 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.245 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.245 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.274 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:38:33.275 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:33.276 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.276 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.288 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.288 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.330 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.331 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.337 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.337 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.343 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.343 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.349 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.349 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.356 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.356 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.363 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.363 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.368 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.368 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.374 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.374 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.380 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.380 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.385 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.385 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.391 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.391 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.397 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.397 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.402 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.402 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.408 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.408 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.419 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.419 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.431 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.431 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.436 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.437 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.443 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:33.443 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:33.450 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:33.479 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:33.479 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:33.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.521+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.522+0000 7f3c67c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.522+0000 7f3c67c87800 20 realm 2024-09-14T11:38:33.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.522+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.523+0000 7f3c67c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.523+0000 7f3c67c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:33.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.523+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.523+0000 7f3c67c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.523+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.524+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.524+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.524+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:33.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.525+0000 7f3c67c87800 20 searching for the correct realm 2024-09-14T11:38:33.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.525+0000 7f3c65771640 0 -- 172.21.15.7:0/2023011609 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x5596f80c3cc0 msgr2=0x5596f80c6180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:33.930+0000 7f3c65771640 0 -- 172.21.15.7:0/2023011609 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f3c60031070 msgr2=0x7f3c6004b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.343+0000 7f3c67c87800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:34.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.343+0000 7f3c67c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:34.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.343+0000 7f3c67c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:34.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.343+0000 7f3c67c87800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:34.341 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.343+0000 7f3c67c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:34.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.343+0000 7f3c67c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:34.342 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.343+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.344+0000 7f3c67c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.344+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.344+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.344+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 zone default found 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 4 Realm: () 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 zonegroup default 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.344 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.345+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.346+0000 7f3c67c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.345 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.346+0000 7f3c67c87800 20 started sync module instance, tier type = 2024-09-14T11:38:34.346 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.346+0000 7f3c67c87800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:34.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.356+0000 7f3c67c87800 20 add_watcher() i=0 2024-09-14T11:38:34.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.356+0000 7f3c67c87800 20 add_watcher() i=1 2024-09-14T11:38:34.354 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.356+0000 7f3c67c87800 20 add_watcher() i=2 2024-09-14T11:38:34.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.356+0000 7f3c67c87800 20 add_watcher() i=3 2024-09-14T11:38:34.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.356+0000 7f3c67c87800 20 add_watcher() i=4 2024-09-14T11:38:34.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.356+0000 7f3c67c87800 20 add_watcher() i=5 2024-09-14T11:38:34.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.357+0000 7f3c67c87800 20 add_watcher() i=6 2024-09-14T11:38:34.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.358+0000 7f3c67c87800 20 add_watcher() i=7 2024-09-14T11:38:34.355 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.358+0000 7f3c67c87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:34.357 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.359+0000 7f3b1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3c67c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:34.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3c67c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:34.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3c67c87800 5 note: GC not initialized 2024-09-14T11:38:34.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3b1a7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:34.358 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3c67c87800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:34.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3c67c87800 20 Filter name: none 2024-09-14T11:38:34.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3a8bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:34.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.360+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.362+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:34.359 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.362+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.362+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:34.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.362+0000 7f3c67c87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:34.360 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.362+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.363+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:34.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.363+0000 7f3c67c87800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.363+0000 7f3c67c87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:34.361 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.363+0000 7f3c67c87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:34.363 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.366+0000 7f3b1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.368+0000 7f3c67c87800 20 remove_watcher() i=0 2024-09-14T11:38:34.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.368+0000 7f3c67c87800 2 removed watcher, disabling cache 2024-09-14T11:38:34.367 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.369+0000 7f3c67c87800 20 remove_watcher() i=1 2024-09-14T11:38:34.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.371+0000 7f3c67c87800 20 remove_watcher() i=2 2024-09-14T11:38:34.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.372+0000 7f3c67c87800 20 remove_watcher() i=3 2024-09-14T11:38:34.371 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.373+0000 7f3c67c87800 20 remove_watcher() i=4 2024-09-14T11:38:34.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.375+0000 7f3c67c87800 20 remove_watcher() i=5 2024-09-14T11:38:34.374 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.377+0000 7f3c67c87800 20 remove_watcher() i=6 2024-09-14T11:38:34.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.378+0000 7f3c67c87800 20 remove_watcher() i=7 2024-09-14T11:38:34.389 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:34.389 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:34.389 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:34.389 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:34.391 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:38:34.429 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:34.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.474+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 20 realm 2024-09-14T11:38:34.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:34.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.475+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.476+0000 7f5c43898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.476+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.477+0000 7f5c43898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:34.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.477+0000 7f5c43898800 20 searching for the correct realm 2024-09-14T11:38:34.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.479+0000 7f5c41b83640 0 -- 172.21.15.7:0/2912260704 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f5c380a6040 msgr2=0x7f5c38094a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.683 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.686+0000 7f5c40b81640 0 -- 172.21.15.7:0/2912260704 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f5c34072f00 msgr2=0x7f5c34080990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.894+0000 7f5c43898800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:34.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.894+0000 7f5c43898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:34.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.894+0000 7f5c43898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:34.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.894+0000 7f5c43898800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:34.892 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.894+0000 7f5c43898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:34.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.894+0000 7f5c43898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:34.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.894+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.893 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 zone default found 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 4 Realm: () 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 zonegroup default 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.895+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.896+0000 7f5c43898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.896+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.894 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.896+0000 7f5c43898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.896+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.897+0000 7f5c43898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.897+0000 7f5c43898800 20 started sync module instance, tier type = 2024-09-14T11:38:34.895 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.897+0000 7f5c43898800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:34.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.908+0000 7f5c43898800 20 add_watcher() i=0 2024-09-14T11:38:34.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.908+0000 7f5c43898800 20 add_watcher() i=1 2024-09-14T11:38:34.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.908+0000 7f5c43898800 20 add_watcher() i=2 2024-09-14T11:38:34.905 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.908+0000 7f5c43898800 20 add_watcher() i=3 2024-09-14T11:38:34.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.908+0000 7f5c43898800 20 add_watcher() i=4 2024-09-14T11:38:34.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.908+0000 7f5c43898800 20 add_watcher() i=5 2024-09-14T11:38:34.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.908+0000 7f5c43898800 20 add_watcher() i=6 2024-09-14T11:38:34.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.909+0000 7f5c43898800 20 add_watcher() i=7 2024-09-14T11:38:34.906 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.909+0000 7f5c43898800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:34.908 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.911+0000 7f5af77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.911+0000 7f5c43898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:34.909 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.911+0000 7f5c43898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:34.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.911+0000 7f5c43898800 5 note: GC not initialized 2024-09-14T11:38:34.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.911+0000 7f5af67e4640 20 reqs_thread_entry: start 2024-09-14T11:38:34.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:34.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 20 Filter name: none 2024-09-14T11:38:34.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5a67fff640 20 reqs_thread_entry: start 2024-09-14T11:38:34.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:38:34.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 : miss 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.912+0000 7f5c43898800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.913+0000 7f5c43898800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.913+0000 7f5c43898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 info.flags=0x17 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.913+0000 7f5c43898800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 to cache LRU end 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.913+0000 7f5c43898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.913+0000 7f5c43898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:34.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.913+0000 7f5c43898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 2024-09-14T11:38:34.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5c43898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 info.flags=0x17 2024-09-14T11:38:34.916 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5c43898800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 to cache LRU end 2024-09-14T11:38:34.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5c43898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:34.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5c43898800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39, ofs0, ns] 2024-09-14T11:38:34.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5b13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529784 cookie 94376526738480 notifier 7884 bl.length()=1015 2024-09-14T11:38:34.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5b13fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 info.flags=0x17 2024-09-14T11:38:34.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5b13fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 to cache LRU end 2024-09-14T11:38:34.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.919+0000 7f5b13fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:34.917 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.920+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): orig_sources= new_sources= 2024-09-14T11:38:34.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.920+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): potential sources added=[] removed=[] 2024-09-14T11:38:34.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.920+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): orig_dests= new_dests= 2024-09-14T11:38:34.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.920+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): potential dests added=[] removed=[] 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.0 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.0 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.1 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.1 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.2 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.2 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.3 2024-09-14T11:38:34.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.3 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.4 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.4 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.5 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.5 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.6 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.6 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.7 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.7 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.8 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.8 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.9 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.9 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.10 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.10 2024-09-14T11:38:34.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.11 2024-09-14T11:38:34.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1.11 2024-09-14T11:38:34.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.0 2024-09-14T11:38:34.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.926+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1 2024-09-14T11:38:34.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.927+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.2 2024-09-14T11:38:34.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.927+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.3 2024-09-14T11:38:34.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.928+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.4 2024-09-14T11:38:34.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.929+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.5 2024-09-14T11:38:34.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.929+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.6 2024-09-14T11:38:34.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.930+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.7 2024-09-14T11:38:34.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.930+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.8 2024-09-14T11:38:34.928 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.931+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.9 2024-09-14T11:38:34.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.931+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.10 2024-09-14T11:38:34.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.935+0000 7f5c43898800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:38:34.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.935+0000 7f5c43898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:34.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.935+0000 7f5c43898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 2024-09-14T11:38:34.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.936+0000 7f5c43898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 info.flags=0x17 2024-09-14T11:38:34.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.936+0000 7f5c43898800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 to cache LRU end 2024-09-14T11:38:34.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.936+0000 7f5c43898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:34.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.936+0000 7f5c43898800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39, ofs0, ns] 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5b13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529785 cookie 94376526738480 notifier 7884 bl.length()=1015 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5b13fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 info.flags=0x17 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5b13fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 to cache LRU end 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5b13fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): orig_sources= new_sources= 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): potential sources added=[] removed=[] 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): orig_dests= new_dests= 2024-09-14T11:38:34.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.937+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): potential dests added=[] removed=[] 2024-09-14T11:38:34.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.940+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.0 2024-09-14T11:38:34.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.940+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.1 2024-09-14T11:38:34.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.940+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.2 2024-09-14T11:38:34.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.941+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.3 2024-09-14T11:38:34.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.941+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.4 2024-09-14T11:38:34.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.941+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.5 2024-09-14T11:38:34.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.942+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.6 2024-09-14T11:38:34.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.942+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.7 2024-09-14T11:38:34.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.943+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.8 2024-09-14T11:38:34.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.943+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.9 2024-09-14T11:38:34.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.943+0000 7f5c43898800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39.10 2024-09-14T11:38:34.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.944+0000 7f5c43898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:34.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.944+0000 7f5c43898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 2024-09-14T11:38:34.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5c43898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 info.flags=0x17 2024-09-14T11:38:34.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5c43898800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 to cache LRU end 2024-09-14T11:38:34.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5c43898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:34.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5c43898800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39, ofs0, ns] 2024-09-14T11:38:34.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5b24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529786 cookie 94376526738480 notifier 7884 bl.length()=983 2024-09-14T11:38:34.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5b24ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 info.flags=0x17 2024-09-14T11:38:34.943 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5b24ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 to cache LRU end 2024-09-14T11:38:34.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.945+0000 7f5b24ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:34.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.946+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): orig_sources= new_sources= 2024-09-14T11:38:34.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.946+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): potential sources added=[] removed=[] 2024-09-14T11:38:34.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.946+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): orig_dests= new_dests= 2024-09-14T11:38:34.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.946+0000 7f5c43898800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39]): potential dests added=[] removed=[] 2024-09-14T11:38:34.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.948+0000 7f5c43898800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:34.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.950+0000 7f5af77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.953+0000 7f5c43898800 20 remove_watcher() i=0 2024-09-14T11:38:34.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.953+0000 7f5c43898800 2 removed watcher, disabling cache 2024-09-14T11:38:34.952 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.954+0000 7f5c43898800 20 remove_watcher() i=1 2024-09-14T11:38:34.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.955+0000 7f5c43898800 20 remove_watcher() i=2 2024-09-14T11:38:34.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.956+0000 7f5c43898800 20 remove_watcher() i=3 2024-09-14T11:38:34.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.957+0000 7f5c43898800 20 remove_watcher() i=4 2024-09-14T11:38:34.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.958+0000 7f5c43898800 20 remove_watcher() i=5 2024-09-14T11:38:34.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.959+0000 7f5c43898800 20 remove_watcher() i=6 2024-09-14T11:38:34.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:34.961+0000 7f5c43898800 20 remove_watcher() i=7 2024-09-14T11:38:34.973 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:35.003 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.003 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.046+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 20 realm 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.046 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.048+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.049+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.049+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.050+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.050+0000 7f64e8a20800 20 searching for the correct realm 2024-09-14T11:38:35.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.051+0000 7f64e6d0b640 0 -- 172.21.15.7:0/2199946918 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f64dc032060 msgr2=0x7f64dc0672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.254 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.257+0000 7f64e5d09640 0 -- 172.21.15.7:0/2199946918 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f64d80c79f0 msgr2=0x7f64d80c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.464+0000 7f64e8a20800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.464+0000 7f64e8a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.464+0000 7f64e8a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.464+0000 7f64e8a20800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.464+0000 7f64e8a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.464+0000 7f64e8a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.464+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 20 zone default found 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 4 Realm: () 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.465+0000 7f64e8a20800 20 zonegroup default 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 started sync module instance, tier type = 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.466+0000 7f64e8a20800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:35.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.477+0000 7f64e8a20800 20 add_watcher() i=0 2024-09-14T11:38:35.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.477+0000 7f64e8a20800 20 add_watcher() i=1 2024-09-14T11:38:35.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.477+0000 7f64e8a20800 20 add_watcher() i=2 2024-09-14T11:38:35.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.477+0000 7f64e8a20800 20 add_watcher() i=3 2024-09-14T11:38:35.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.477+0000 7f64e8a20800 20 add_watcher() i=4 2024-09-14T11:38:35.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.477+0000 7f64e8a20800 20 add_watcher() i=5 2024-09-14T11:38:35.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.477+0000 7f64e8a20800 20 add_watcher() i=6 2024-09-14T11:38:35.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.478+0000 7f64e8a20800 20 add_watcher() i=7 2024-09-14T11:38:35.476 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.478+0000 7f64e8a20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.481+0000 7f639cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.481+0000 7f64e8a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.481+0000 7f64e8a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.481+0000 7f64e8a20800 5 note: GC not initialized 2024-09-14T11:38:35.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.481+0000 7f63177fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.481+0000 7f64e8a20800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.481+0000 7f64e8a20800 20 Filter name: none 2024-09-14T11:38:35.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.482+0000 7f63157fa640 20 reqs_thread_entry: start 2024-09-14T11:38:35.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.482+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.482+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.482+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.483+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.483+0000 7f64e8a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.483+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.483+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:35.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.483+0000 7f64e8a20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.484+0000 7f64e8a20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:35.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.484+0000 7f64e8a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.486+0000 7f639cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.488+0000 7f64e8a20800 20 remove_watcher() i=0 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.488+0000 7f64e8a20800 2 removed watcher, disabling cache 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.489+0000 7f64e8a20800 20 remove_watcher() i=1 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.490+0000 7f64e8a20800 20 remove_watcher() i=2 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.492+0000 7f64e8a20800 20 remove_watcher() i=3 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.493+0000 7f64e8a20800 20 remove_watcher() i=4 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.494+0000 7f64e8a20800 20 remove_watcher() i=5 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.495+0000 7f64e8a20800 20 remove_watcher() i=6 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.496+0000 7f64e8a20800 20 remove_watcher() i=7 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: error-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.597 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.597 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.640 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.640 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.647 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.647 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.653 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.653 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.659 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.659 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.666 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.666 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.672 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.672 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.678 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.678 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.684 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.684 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.691 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.691 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.697 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.697 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.703 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.703 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.710 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.710 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.717 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.717 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.723 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.723 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.729 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.729 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.735 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.735 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.741 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.741 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.748 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.748 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.755 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.755 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.761 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:35.761 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:35.768 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:38:35.797 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.797 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.838+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.840+0000 7fbd21c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.840+0000 7fbd21c20800 20 realm 2024-09-14T11:38:35.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.840+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.840+0000 7fbd21c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.840+0000 7fbd21c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.840+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.838 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.841+0000 7fbd21c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.841+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.842+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.842+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.842+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.842+0000 7fbd21c20800 20 searching for the correct realm 2024-09-14T11:38:35.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.845+0000 7fbd1ff12640 0 -- 172.21.15.7:0/1988040359 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fbd1400b040 msgr2=0x7fbd14044970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:35.849+0000 7fbd1ef10640 0 -- 172.21.15.7:0/1988040359 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fbd10002e40 msgr2=0x7fbd10071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.056+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 zone default found 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 4 Realm: () 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 zonegroup default 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.057+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.058+0000 7fbd21c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.058+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.058+0000 7fbd21c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.058+0000 7fbd21c20800 20 started sync module instance, tier type = 2024-09-14T11:38:36.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.058+0000 7fbd21c20800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.067+0000 7fbd21c20800 20 add_watcher() i=0 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.067+0000 7fbd21c20800 20 add_watcher() i=1 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.067+0000 7fbd21c20800 20 add_watcher() i=2 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.067+0000 7fbd21c20800 20 add_watcher() i=3 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.067+0000 7fbd21c20800 20 add_watcher() i=4 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.067+0000 7fbd21c20800 20 add_watcher() i=5 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.067+0000 7fbd21c20800 20 add_watcher() i=6 2024-09-14T11:38:36.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.068+0000 7fbd21c20800 20 add_watcher() i=7 2024-09-14T11:38:36.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.068+0000 7fbd21c20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:36.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.070+0000 7fbbd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.070+0000 7fbd21c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.070+0000 7fbd21c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.070+0000 7fbd21c20800 5 note: GC not initialized 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.070+0000 7fbbd4fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.071+0000 7fbd21c20800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.071+0000 7fbd21c20800 20 Filter name: none 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.071+0000 7fbb4e7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:36.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.071+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.071+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.071+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.072+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.072+0000 7fbd21c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.072+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.072+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.072+0000 7fbd21c20800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.073+0000 7fbd21c20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:36.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.073+0000 7fbd21c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:36.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.075+0000 7fbbd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.077+0000 7fbd21c20800 20 remove_watcher() i=0 2024-09-14T11:38:36.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.077+0000 7fbd21c20800 2 removed watcher, disabling cache 2024-09-14T11:38:36.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.078+0000 7fbd21c20800 20 remove_watcher() i=1 2024-09-14T11:38:36.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.079+0000 7fbd21c20800 20 remove_watcher() i=2 2024-09-14T11:38:36.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.080+0000 7fbd21c20800 20 remove_watcher() i=3 2024-09-14T11:38:36.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.081+0000 7fbd21c20800 20 remove_watcher() i=4 2024-09-14T11:38:36.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.082+0000 7fbd21c20800 20 remove_watcher() i=5 2024-09-14T11:38:36.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.083+0000 7fbd21c20800 20 remove_watcher() i=6 2024-09-14T11:38:36.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.084+0000 7fbd21c20800 20 remove_watcher() i=7 2024-09-14T11:38:36.093 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.093 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:36.093 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:36.093 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.095 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:38:36.130 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:36.130 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:36.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.172+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.173+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.173+0000 7efd0230c800 20 realm 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.173+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.174+0000 7efd0230c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:36.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.175+0000 7efd0230c800 20 searching for the correct realm 2024-09-14T11:38:36.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.178+0000 7efcffdfd640 0 -- 172.21.15.7:0/3132644376 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efcf806abd0 msgr2=0x7efcf8068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.385+0000 7efcffdfd640 0 -- 172.21.15.7:0/3132644376 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efcf806abd0 msgr2=0x7efcf8068570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:36.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:36.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:36.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:36.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:36.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:36.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:36.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 zone default found 2024-09-14T11:38:36.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 4 Realm: () 2024-09-14T11:38:36.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:36.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 zonegroup default 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.391+0000 7efd0230c800 20 started sync module instance, tier type = 2024-09-14T11:38:36.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.391+0000 7efd0230c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:36.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=0 2024-09-14T11:38:36.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=1 2024-09-14T11:38:36.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=2 2024-09-14T11:38:36.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=3 2024-09-14T11:38:36.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=4 2024-09-14T11:38:36.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=5 2024-09-14T11:38:36.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=6 2024-09-14T11:38:36.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.401+0000 7efd0230c800 20 add_watcher() i=7 2024-09-14T11:38:36.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.401+0000 7efd0230c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:36.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.402+0000 7efbb67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.403+0000 7efd0230c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:36.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.403+0000 7efd0230c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:36.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.403+0000 7efd0230c800 5 note: GC not initialized 2024-09-14T11:38:36.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.403+0000 7efbb57e2640 20 reqs_thread_entry: start 2024-09-14T11:38:36.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.403+0000 7efd0230c800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:36.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.403+0000 7efd0230c800 20 Filter name: none 2024-09-14T11:38:36.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.403+0000 7efbae7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:36.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:38:36.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:36.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:36.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 : miss 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.404+0000 7efd0230c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 2024-09-14T11:38:36.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efd0230c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efd0230c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efd0230c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40, ofs0, ns] 2024-09-14T11:38:36.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529790 cookie 94284580866592 notifier 7553 bl.length()=1015 2024-09-14T11:38:36.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_sources= new_sources= 2024-09-14T11:38:36.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential sources added=[] removed=[] 2024-09-14T11:38:36.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_dests= new_dests= 2024-09-14T11:38:36.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential dests added=[] removed=[] 2024-09-14T11:38:36.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.0 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.0 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.1 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.1 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.2 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.2 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.3 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.3 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.4 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.4 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.5 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.5 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.6 2024-09-14T11:38:36.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.6 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.7 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.7 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.8 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.8 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.9 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.9 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.10 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.10 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.11 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.11 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.0 2024-09-14T11:38:36.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.417+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1 2024-09-14T11:38:36.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2 2024-09-14T11:38:36.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.3 2024-09-14T11:38:36.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.4 2024-09-14T11:38:36.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.419+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.5 2024-09-14T11:38:36.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.419+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.6 2024-09-14T11:38:36.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.420+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.7 2024-09-14T11:38:36.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.420+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.8 2024-09-14T11:38:36.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.421+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.9 2024-09-14T11:38:36.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.422+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.10 2024-09-14T11:38:36.423 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd0230c800 time 2024-09-14T11:38:36.425911+0000 2024-09-14T11:38:36.423 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:36.423 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd0578c76a] 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.426+0000 7efd0230c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd0230c800 time 2024-09-14T11:38:36.425911+0000 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.424 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd0578c76a] 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:38:36.425 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7efd0230c800 thread_name:radosgw-admin 2024-09-14T11:38:36.444 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.444 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd0443e6f0] 2024-09-14T11:38:36.444 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd0448b99c] 2024-09-14T11:38:36.444 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd0578c7c4] 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.427+0000 7efd0230c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7efd0230c800 thread_name:radosgw-admin 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.445 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd0443e6f0] 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd0448b99c] 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd0578c7c4] 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:38:36.446 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command objecter_requests hook 0x55c056e2ed40 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:38:36.155+0000 7efd0230c800 1 librados: setting wanted keys 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:38:36.155+0000 7efd0230c800 1 librados: calling monclient init 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:38:36.155+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding auth protocol: cephx 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding auth protocol: cephx 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding auth protocol: cephx 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.447 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:38:36.155+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:38:36.156+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:38:36.156+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key hook 0x55c056e2b618 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:36.448 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056cb51d0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056cd8ea0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056d6e150 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.712188s 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056cb51d0 auth_method 0 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056cd8ea0 auth_method 0 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.449 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): get_auth_request con 0x55c056d6e150 auth_method 0 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_done global_id 7923 payload 824 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:38:36.156+0000 7efcffdfd640 1 monclient: found mon.noname-a 2024-09-14T11:38:36.450 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: dump: 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.451 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: dump: 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.452 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:38:36.156+0000 7efd0230c800 5 monclient: authenticate success, global_id 7923 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:38:36.156+0000 7efbede0b640 4 set_mon_vals no callback set 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:38:36.156+0000 7efd0230c800 1 librados: init done 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:38:36.158+0000 7efbe7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:38:36.158+0000 7efbe7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:38:36.158+0000 7efbe7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:38:36.159+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efbe8077230 auth_method 0 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:38:36.159+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056e54470 auth_method 0 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:38:36.160+0000 7efcffdfd640 10 monclient: get_auth_request con 0x55c056e7d530 auth_method 0 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:38:36.161+0000 7efcff5fc640 10 monclient: get_auth_request con 0x55c056e81720 auth_method 0 2024-09-14T11:38:36.453 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:38:36.162+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056e80de0 auth_method 0 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:38:36.162+0000 7efd0230c800 10 monclient: build_initial_monmap 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:38:36.162+0000 7efd0230c800 1 build_initial for_mkfs: 0 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:38:36.162+0000 7efd0230c800 10 monclient: monmap: 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding auth protocol: cephx 2024-09-14T11:38:36.454 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding auth protocol: cephx 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding auth protocol: cephx 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:38:36.163+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x55c056e8ce30 EEXIST 2024-09-14T11:38:36.455 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding auth protocol: cephx 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding auth protocol: cephx 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding auth protocol: cephx 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.456 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:38:36.163+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:38:36.163+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key cmddesc rotate-key hook 0x55c056e888c0 EEXIST 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056eb1150 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056eb1530 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056eafe60 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.719990s 2024-09-14T11:38:36.457 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056eb1150 auth_method 0 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): get_auth_request con 0x55c056eb1530 auth_method 0 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.458 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056eafe60 auth_method 0 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_done global_id 7926 payload 824 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:38:36.164+0000 7efd005fe640 1 monclient: found mon.noname-a 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: dump: 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.459 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: dump: 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.460 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:38:36.164+0000 7efd0230c800 5 monclient: authenticate success, global_id 7926 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:38:36.164+0000 7efd00dff640 4 set_mon_vals no callback set 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:38:36.166+0000 7efbe57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:38:36.166+0000 7efbe57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:38:36.166+0000 7efbe57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.461 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:38:36.166+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efbd8077140 auth_method 0 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:38:36.166+0000 7efd0230c800 10 monclient: get_monmap_and_config 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:38:36.166+0000 7efd0230c800 10 monclient: build_initial_monmap 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:38:36.166+0000 7efd0230c800 1 build_initial for_mkfs: 0 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:38:36.166+0000 7efd0230c800 10 monclient: monmap: 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:38:36.462 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding auth protocol: cephx 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding auth protocol: cephx 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding auth protocol: cephx 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.463 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:38:36.167+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding auth protocol: cephx 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding auth protocol: cephx 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding auth protocol: cephx 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.464 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:38:36.167+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:38:36.167+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key cmddesc rotate-key hook 0x7ffdb1c68538 EEXIST 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056f05410 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056eff470 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.465 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056f00fc0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.723904s 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056f05410 auth_method 0 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): get_auth_request con 0x55c056eff470 auth_method 0 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.466 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056f00fc0 auth_method 0 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_done global_id 7550 payload 274 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:38:36.168+0000 7efd005fe640 1 monclient: found mon.noname-c 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: dump: 2024-09-14T11:38:36.467 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:38:36.168+0000 7efd0230c800 5 monclient: authenticate success, global_id 7550 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:38:36.168+0000 7efd0230c800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:36.468 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:38:36.168+0000 7efd0230c800 4 set_mon_vals no callback set 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: dump: 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:38:36.168+0000 7efd0230c800 10 monclient: shutdown 2024-09-14T11:38:36.469 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:38:36.169+0000 7efd0230c800 10 monclient: build_initial_monmap 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 build_initial for_mkfs: 0 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:38:36.169+0000 7efd0230c800 10 monclient: monmap: 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding auth protocol: cephx 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding auth protocol: cephx 2024-09-14T11:38:36.470 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding auth protocol: cephx 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:38:36.169+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.471 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: starting msgr at 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: starting objecter 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x55c056f0a260 EEXIST 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: setting wanted keys 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: calling monclient init 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:38:36.169+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding auth protocol: cephx 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding auth protocol: cephx 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding auth protocol: cephx 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.472 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:38:36.169+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:38:36.170+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:38:36.170+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key cmddesc rotate-key hook 0x55c056ec5b58 EEXIST 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056eff470 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056f00fc0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056f05410 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.473 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.726130s 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056eff470 auth_method 0 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056f05410 auth_method 0 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.474 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_done global_id 7553 payload 824 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:38:36.170+0000 7efcffdfd640 1 monclient: found mon.noname-c 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: dump: 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.475 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: dump: 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.476 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:38:36.170+0000 7efbdeffd640 4 set_mon_vals no callback set 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:38:36.170+0000 7efd0230c800 5 monclient: authenticate success, global_id 7553 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:38:36.170+0000 7efd0230c800 1 librados: init done 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:38:36.170+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cr dump hook 0x55c056efbd78 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:38:36.172+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.477 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:38:36.172+0000 7efbdd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:38:36.172+0000 7efbdd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:38:36.172+0000 7efbdd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:38:36.173+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efbc8077230 auth_method 0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:38:36.173+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056f1faa0 auth_method 0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:38:36.173+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:38:36.173+0000 7efd0230c800 20 realm 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:38:36.173+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:38:36.174+0000 7efd0230c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:38:36.174+0000 7efcff5fc640 10 monclient: get_auth_request con 0x55c056f23cb0 auth_method 0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.478 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:38:36.175+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056f27540 auth_method 0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 searching for the correct realm 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:38:36.176+0000 7efcffdfd640 10 monclient: get_auth_request con 0x55c056f2c240 auth_method 0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:38:36.176+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efcf0018070 auth_method 0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:38:36.177+0000 7efd005fe640 10 monclient: get_auth_request con 0x7efcf4097400 auth_method 0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:38:36.178+0000 7efcffdfd640 0 -- 172.21.15.7:0/3132644376 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efcf806abd0 msgr2=0x7efcf8068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:38:36.380+0000 7efcffdfd640 10 monclient: get_auth_request con 0x7efcf806abd0 auth_method 0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:38:36.384+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efcf003d500 auth_method 0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:38:36.385+0000 7efcffdfd640 0 -- 172.21.15.7:0/3132644376 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efcf806abd0 msgr2=0x7efcf8068570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:38:36.385+0000 7efbdd7fa640 1 client.7553.objecter ms_handle_reset 0x7efcf806abd0 session 0x7efcf802f040 osd.4 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:38:36.385+0000 7efbdd7fa640 10 monclient: _renew_subs 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:38:36.385+0000 7efbdd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:38:36.385+0000 7efcffdfd640 10 monclient: get_auth_request con 0x7efbc8087050 auth_method 0 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:36.479 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 zone default found 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:38:36.390+0000 7efd0230c800 4 Realm: () 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:38:36.390+0000 7efd0230c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:38:36.390+0000 7efd0230c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:36.480 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:38:36.390+0000 7efd0230c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 zonegroup default 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 started sync module instance, tier type = 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=0 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=1 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=2 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=3 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=4 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=5 2024-09-14T11:38:36.481 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=6 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:38:36.401+0000 7efd0230c800 20 add_watcher() i=7 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:38:36.401+0000 7efd0230c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding auth protocol: cephx 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding auth protocol: cephx 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding auth protocol: cephx 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.482 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:38:36.402+0000 7efbb67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:38:36.403+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache list hook 0x55c056efdd30 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache inspect hook 0x55c056efdd30 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache erase hook 0x55c056efdd30 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache zap hook 0x55c056efdd30 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 note: GC not initialized 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:38:36.403+0000 7efbb57e2640 20 reqs_thread_entry: start 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace show hook 0x7efcf800e070 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace history hook 0x7efcf800e070 2024-09-14T11:38:36.483 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace active hook 0x7efcf800e070 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace active_short hook 0x7efcf800e070 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 Filter name: none 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:38:36.403+0000 7efbae7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 : miss 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.484 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40, ofs0, ns] 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529790 cookie 94284580866592 notifier 7553 bl.length()=1015 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_sources= new_sources= 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential sources added=[] removed=[] 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_dests= new_dests= 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential dests added=[] removed=[] 2024-09-14T11:38:36.485 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.0 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.0 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.1 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.1 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.2 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.2 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.3 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.3 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.4 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.4 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.5 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.5 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.6 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.6 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.7 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.7 2024-09-14T11:38:36.486 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.8 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.8 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.9 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.9 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.10 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.10 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.11 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.11 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.0 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:38:36.417+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.3 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.4 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:38:36.419+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.5 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:38:36.419+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.6 2024-09-14T11:38:36.487 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:38:36.420+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.7 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:38:36.420+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.8 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:38:36.421+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.9 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:38:36.422+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.10 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:38:36.426+0000 7efd0230c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd0230c800 time 2024-09-14T11:38:36.425911+0000 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd0578c76a] 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.488 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:38:36.427+0000 7efd0230c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7efd0230c800 thread_name:radosgw-admin 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd0443e6f0] 2024-09-14T11:38:36.489 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd0448b99c] 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd0578c7c4] 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:38:36.490 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:36.491 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:36.492 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:38:36.493 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:38:36.494 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:38:36.495 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:36.496 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:36.497 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbae7fc640 / http_manager 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbb57e2640 / http_manager 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbb67e4640 / rgw_dt_lg_renew 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbdd7fa640 / ms_dispatch 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbde7fc640 / io_context_pool 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbdeffd640 / io_context_pool 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbe57fa640 / ms_dispatch 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbe7fff640 / ms_dispatch 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbede0b640 / io_context_pool 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efcff5fc640 / msgr-worker-2 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efcffdfd640 / msgr-worker-1 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efd005fe640 / msgr-worker-0 2024-09-14T11:38:36.498 INFO:tasks.workunit.client.0.smithi007.stderr: 7efd00dff640 / io_context_pool 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: 7efd0230c800 / radosgw-admin 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.142184.log 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command objecter_requests hook 0x55c056e2ed40 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:38:36.155+0000 7efd0230c800 1 librados: setting wanted keys 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:38:36.155+0000 7efd0230c800 1 librados: calling monclient init 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:38:36.155+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding auth protocol: cephx 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding auth protocol: cephx 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding auth protocol: cephx 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.499 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: crc 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:38:36.155+0000 7efd0230c800 5 AuthRegistry(0x55c056e2b4d0) adding con mode: secure 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:38:36.155+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:38:36.156+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.500 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:38:36.156+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key hook 0x55c056e2b618 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056cb51d0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056cd8ea0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056d6e150 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.712188s 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056cb51d0 auth_method 0 2024-09-14T11:38:36.501 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056cd8ea0 auth_method 0 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:38:36.156+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): get_auth_request con 0x55c056d6e150 auth_method 0 2024-09-14T11:38:36.502 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:38:36.156+0000 7efd005fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient(hunting): handle_auth_done global_id 7923 payload 824 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:38:36.156+0000 7efcffdfd640 1 monclient: found mon.noname-a 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:38:36.156+0000 7efcffdfd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: dump: 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.503 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:38:36.156+0000 7efbe7fff640 10 monclient: dump: 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.504 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:38:36.156+0000 7efd0230c800 5 monclient: authenticate success, global_id 7923 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:38:36.156+0000 7efbede0b640 4 set_mon_vals no callback set 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:38:36.156+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.505 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:38:36.156+0000 7efd0230c800 1 librados: init done 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:38:36.158+0000 7efbe7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:38:36.158+0000 7efbe7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:38:36.158+0000 7efbe7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:38:36.159+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efbe8077230 auth_method 0 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:38:36.159+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056e54470 auth_method 0 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:38:36.160+0000 7efcffdfd640 10 monclient: get_auth_request con 0x55c056e7d530 auth_method 0 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:38:36.161+0000 7efcff5fc640 10 monclient: get_auth_request con 0x55c056e81720 auth_method 0 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:38:36.162+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056e80de0 auth_method 0 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:38:36.162+0000 7efd0230c800 10 monclient: build_initial_monmap 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:38:36.162+0000 7efd0230c800 1 build_initial for_mkfs: 0 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:38:36.162+0000 7efd0230c800 10 monclient: monmap: 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:38:36.506 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding auth protocol: cephx 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding auth protocol: cephx 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding auth protocol: cephx 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.507 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: crc 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:38:36.162+0000 7efd0230c800 5 AuthRegistry(0x55c056e89a30) adding con mode: secure 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:38:36.163+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x55c056e8ce30 EEXIST 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding auth protocol: cephx 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding auth protocol: cephx 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding auth protocol: cephx 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.508 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: crc 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 AuthRegistry(0x55c056e88778) adding con mode: secure 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:38:36.163+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:38:36.163+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.509 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:38:36.163+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key cmddesc rotate-key hook 0x55c056e888c0 EEXIST 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056eb1150 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056eb1530 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056eafe60 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:38:36.163+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.719990s 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056eb1150 auth_method 0 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.510 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): get_auth_request con 0x55c056eb1530 auth_method 0 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:38:36.164+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056eafe60 auth_method 0 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.511 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:38:36.164+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient(hunting): handle_auth_done global_id 7926 payload 824 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:38:36.164+0000 7efd005fe640 1 monclient: found mon.noname-a 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:38:36.164+0000 7efd005fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: dump: 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.512 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:38:36.164+0000 7efbe57fa640 10 monclient: dump: 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.513 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:38:36.164+0000 7efd0230c800 5 monclient: authenticate success, global_id 7926 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:38:36.164+0000 7efd00dff640 4 set_mon_vals no callback set 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:38:36.164+0000 7efd0230c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:38:36.166+0000 7efbe57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:38:36.166+0000 7efbe57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.514 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:38:36.166+0000 7efbe57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:38:36.166+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efbd8077140 auth_method 0 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:38:36.166+0000 7efd0230c800 10 monclient: get_monmap_and_config 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:38:36.166+0000 7efd0230c800 10 monclient: build_initial_monmap 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:38:36.166+0000 7efd0230c800 1 build_initial for_mkfs: 0 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:38:36.166+0000 7efd0230c800 10 monclient: monmap: 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:38:36.515 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding auth protocol: cephx 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding auth protocol: cephx 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding auth protocol: cephx 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.516 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: crc 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:38:36.166+0000 7efd0230c800 5 AuthRegistry(0x55c056ed0e70) adding con mode: secure 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:38:36.167+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding auth protocol: cephx 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding auth protocol: cephx 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding auth protocol: cephx 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.517 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: crc 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c683f0) adding con mode: secure 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:38:36.167+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:38:36.167+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:38:36.167+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key cmddesc rotate-key hook 0x7ffdb1c68538 EEXIST 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056f05410 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056eff470 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056f00fc0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.518 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:38:36.167+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.723904s 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056f05410 auth_method 0 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): get_auth_request con 0x55c056eff470 auth_method 0 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:38:36.168+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.519 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056f00fc0 auth_method 0 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:38:36.168+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient(hunting): handle_auth_done global_id 7550 payload 274 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:38:36.168+0000 7efd005fe640 1 monclient: found mon.noname-c 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:38:36.168+0000 7efd005fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: dump: 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.520 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:38:36.168+0000 7efd0230c800 5 monclient: authenticate success, global_id 7550 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.521 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:38:36.168+0000 7efd0230c800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:38:36.168+0000 7efd0230c800 4 set_mon_vals no callback set 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:38:36.168+0000 7efbdeffd640 10 monclient: dump: 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.522 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:38:36.168+0000 7efd0230c800 10 monclient: shutdown 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:38:36.169+0000 7efd0230c800 10 monclient: build_initial_monmap 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 build_initial for_mkfs: 0 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:38:36.169+0000 7efd0230c800 10 monclient: monmap: 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:38:36.523 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding auth protocol: cephx 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding auth protocol: cephx 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding auth protocol: cephx 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: crc 2024-09-14T11:38:36.524 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056f0a450) adding con mode: secure 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:38:36.169+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: starting msgr at 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: starting objecter 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command objecter_requests cmddesc objecter_requests hook 0x55c056f0a260 EEXIST 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: setting wanted keys 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:38:36.169+0000 7efd0230c800 1 librados: calling monclient init 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:38:36.169+0000 7efd0230c800 10 monclient: init 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding auth protocol: cephx 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding auth protocol: cephx 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding auth protocol: cephx 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.525 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: crc 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:38:36.169+0000 7efd0230c800 5 AuthRegistry(0x55c056ec5a10) adding con mode: secure 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:38:36.169+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:38:36.170+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:38:36.170+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command rotate-key cmddesc rotate-key hook 0x55c056ec5b58 EEXIST 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-a con 0x55c056eff470 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:38:36.526 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-b con 0x55c056f00fc0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): picked mon.noname-c con 0x55c056f05410 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient(hunting): authenticate will time out at 2216.726130s 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): get_auth_request con 0x55c056eff470 auth_method 0 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): get_auth_request con 0x55c056f05410 auth_method 0 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:36.527 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:38:36.170+0000 7efcff5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient(hunting): handle_auth_done global_id 7553 payload 824 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient: _finish_hunting 0 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:38:36.170+0000 7efcffdfd640 1 monclient: found mon.noname-c 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:38:36.170+0000 7efcffdfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: dump: 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.528 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:36.529 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:38:36.170+0000 7efbdd7fa640 10 monclient: dump: 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:38:36.170+0000 7efbdeffd640 4 set_mon_vals no callback set 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:38:36.170+0000 7efd0230c800 5 monclient: authenticate success, global_id 7553 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.530 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _renew_subs 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:38:36.170+0000 7efd0230c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:38:36.170+0000 7efd0230c800 1 librados: init done 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:38:36.170+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cr dump hook 0x55c056efbd78 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:38:36.172+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:38:36.172+0000 7efbdd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:38:36.172+0000 7efbdd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:38:36.172+0000 7efbdd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:38:36.173+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efbc8077230 auth_method 0 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:38:36.173+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056f1faa0 auth_method 0 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:38:36.173+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:38:36.173+0000 7efd0230c800 20 realm 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:38:36.173+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:38:36.174+0000 7efd0230c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:36.531 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:38:36.174+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:38:36.174+0000 7efcff5fc640 10 monclient: get_auth_request con 0x55c056f23cb0 auth_method 0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:38:36.175+0000 7efd005fe640 10 monclient: get_auth_request con 0x55c056f27540 auth_method 0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:38:36.175+0000 7efd0230c800 20 searching for the correct realm 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:38:36.176+0000 7efcffdfd640 10 monclient: get_auth_request con 0x55c056f2c240 auth_method 0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:38:36.176+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efcf0018070 auth_method 0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:38:36.177+0000 7efd005fe640 10 monclient: get_auth_request con 0x7efcf4097400 auth_method 0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:38:36.178+0000 7efcffdfd640 0 -- 172.21.15.7:0/3132644376 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efcf806abd0 msgr2=0x7efcf8068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:38:36.380+0000 7efcffdfd640 10 monclient: get_auth_request con 0x7efcf806abd0 auth_method 0 2024-09-14T11:38:36.532 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:38:36.384+0000 7efcff5fc640 10 monclient: get_auth_request con 0x7efcf003d500 auth_method 0 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:38:36.385+0000 7efcffdfd640 0 -- 172.21.15.7:0/3132644376 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efcf806abd0 msgr2=0x7efcf8068570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:38:36.385+0000 7efbdd7fa640 1 client.7553.objecter ms_handle_reset 0x7efcf806abd0 session 0x7efcf802f040 osd.4 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:38:36.385+0000 7efbdd7fa640 10 monclient: _renew_subs 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:38:36.385+0000 7efbdd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:38:36.385+0000 7efcffdfd640 10 monclient: get_auth_request con 0x7efbc8087050 auth_method 0 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:38:36.389+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.533 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 zone default found 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:38:36.390+0000 7efd0230c800 4 Realm: () 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:38:36.390+0000 7efd0230c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:38:36.390+0000 7efd0230c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:38:36.390+0000 7efd0230c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 zonegroup default 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:38:36.390+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.534 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 started sync module instance, tier type = 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:38:36.391+0000 7efd0230c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=0 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=1 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=2 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=3 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=4 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=5 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:38:36.400+0000 7efd0230c800 20 add_watcher() i=6 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:38:36.401+0000 7efd0230c800 20 add_watcher() i=7 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:38:36.401+0000 7efd0230c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding auth protocol: cephx 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding auth protocol: cephx 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding auth protocol: cephx 2024-09-14T11:38:36.535 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:38:36.402+0000 7efbb67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: crc 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:38:36.402+0000 7efd0230c800 5 AuthRegistry(0x7ffdb1c688d0) adding con mode: secure 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:38:36.403+0000 7efd0230c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:36.536 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache list hook 0x55c056efdd30 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache inspect hook 0x55c056efdd30 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache erase hook 0x55c056efdd30 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command cache zap hook 0x55c056efdd30 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 note: GC not initialized 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:38:36.403+0000 7efbb57e2640 20 reqs_thread_entry: start 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace show hook 0x7efcf800e070 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace history hook 0x7efcf800e070 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace active hook 0x7efcf800e070 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:38:36.403+0000 7efd0230c800 5 asok(0x55c056c0b270) register_command sync trace active_short hook 0x7efcf800e070 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:38:36.403+0000 7efd0230c800 20 Filter name: none 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:38:36.403+0000 7efbae7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:36.537 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 : miss 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:38:36.404+0000 7efd0230c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:38:36.404+0000 7efd0230c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.538 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:38:36.411+0000 7efd0230c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40, ofs0, ns] 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529790 cookie 94284580866592 notifier 7553 bl.length()=1015 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:38:36.411+0000 7efbde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_sources= new_sources= 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential sources added=[] removed=[] 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_dests= new_dests= 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:38:36.412+0000 7efd0230c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential dests added=[] removed=[] 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.0 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.0 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.1 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.1 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.2 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.2 2024-09-14T11:38:36.539 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.3 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.3 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.4 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.4 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.5 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.5 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.6 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.6 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.7 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.7 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.8 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.8 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.9 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.9 2024-09-14T11:38:36.540 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.10 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.10 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:38:36.416+0000 7efd0230c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.11 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1.11 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:38:36.416+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.0 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:38:36.417+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.3 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:38:36.418+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.4 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:38:36.419+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.5 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:38:36.419+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.6 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:38:36.420+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.7 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:38:36.420+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.8 2024-09-14T11:38:36.541 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:38:36.421+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.9 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:38:36.422+0000 7efd0230c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.10 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:38:36.426+0000 7efd0230c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd0230c800 time 2024-09-14T11:38:36.425911+0000 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd0578c76a] 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:38:36.542 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:38:36.427+0000 7efd0230c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7efd0230c800 thread_name:radosgw-admin 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd0443e6f0] 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd0448b99c] 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd0578c7c4] 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd0578c928] 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0544d90b1] 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55c0544e8124] 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c0544e8fc4] 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:38:36.543 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd04429590] 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:38:36.544 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:38:36.545 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:38:36.546 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:38:36.547 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:38:36.548 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:36.549 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:36.550 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbae7fc640 / http_manager 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbb57e2640 / http_manager 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbb67e4640 / rgw_dt_lg_renew 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbdd7fa640 / ms_dispatch 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbde7fc640 / io_context_pool 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbdeffd640 / io_context_pool 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbe57fa640 / ms_dispatch 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbe7fff640 / ms_dispatch 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efbede0b640 / io_context_pool 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efcff5fc640 / msgr-worker-2 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efcffdfd640 / msgr-worker-1 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efd005fe640 / msgr-worker-0 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efd00dff640 / io_context_pool 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: 7efd0230c800 / radosgw-admin 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:38:36.551 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:38:36.427559Z_75a69cee-16be-4f9e-b6a1-6e58341cff4f/log 2024-09-14T11:38:36.552 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:38:36.552 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.505+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 20 realm 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.507+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.508+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.508+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.509+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.509+0000 7fa81ab0c800 20 searching for the correct realm 2024-09-14T11:38:36.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:36.511+0000 7fa818df7640 0 -- 172.21.15.7:0/3783568934 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fa80c06b030 msgr2=0x7fa80c0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:37.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.120+0000 7fa8185f6640 0 -- 172.21.15.7:0/3783568934 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fa810069440 msgr2=0x7fa810067eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:37.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:37.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:37.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:37.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:37.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:37.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:37.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.126+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.127+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.127+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.127+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 20 zone default found 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 4 Realm: () 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 20 zonegroup default 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.128+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.129+0000 7fa81ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.129+0000 7fa81ab0c800 20 started sync module instance, tier type = 2024-09-14T11:38:37.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.129+0000 7fa81ab0c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:37.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.140+0000 7fa81ab0c800 20 add_watcher() i=0 2024-09-14T11:38:37.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.140+0000 7fa81ab0c800 20 add_watcher() i=1 2024-09-14T11:38:37.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.140+0000 7fa81ab0c800 20 add_watcher() i=2 2024-09-14T11:38:37.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.140+0000 7fa81ab0c800 20 add_watcher() i=3 2024-09-14T11:38:37.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.140+0000 7fa81ab0c800 20 add_watcher() i=4 2024-09-14T11:38:37.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.140+0000 7fa81ab0c800 20 add_watcher() i=5 2024-09-14T11:38:37.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.140+0000 7fa81ab0c800 20 add_watcher() i=6 2024-09-14T11:38:37.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.141+0000 7fa81ab0c800 20 add_watcher() i=7 2024-09-14T11:38:37.138 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.141+0000 7fa81ab0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:37.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.143+0000 7fa6cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.143+0000 7fa81ab0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.143+0000 7fa81ab0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.143+0000 7fa81ab0c800 5 note: GC not initialized 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.143+0000 7fa6cdfdb640 20 reqs_thread_entry: start 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.143+0000 7fa81ab0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.143+0000 7fa81ab0c800 20 Filter name: none 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.144+0000 7fa63f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.144+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.144+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:37.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.144+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.145+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:38:37.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.145+0000 7fa81ab0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:37.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.145+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.145+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:37.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.145+0000 7fa81ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.146+0000 7fa81ab0c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:38:37.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.146+0000 7fa81ab0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:37.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.148+0000 7fa6cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.150+0000 7fa81ab0c800 20 remove_watcher() i=0 2024-09-14T11:38:37.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.150+0000 7fa81ab0c800 2 removed watcher, disabling cache 2024-09-14T11:38:37.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.151+0000 7fa81ab0c800 20 remove_watcher() i=1 2024-09-14T11:38:37.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.152+0000 7fa81ab0c800 20 remove_watcher() i=2 2024-09-14T11:38:37.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.154+0000 7fa81ab0c800 20 remove_watcher() i=3 2024-09-14T11:38:37.152 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.155+0000 7fa81ab0c800 20 remove_watcher() i=4 2024-09-14T11:38:37.153 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.156+0000 7fa81ab0c800 20 remove_watcher() i=5 2024-09-14T11:38:37.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.157+0000 7fa81ab0c800 20 remove_watcher() i=6 2024-09-14T11:38:37.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.158+0000 7fa81ab0c800 20 remove_watcher() i=7 2024-09-14T11:38:37.168 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:37.168 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:38:37.168 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:37.168 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:38:37.170 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:37.171 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:37.178 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:37.178 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:38:37.222 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:37.255 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:37.256 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:37.298 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.300+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 20 realm 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.300 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.302+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.303+0000 7f592832a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:37.301 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.303+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.304+0000 7f592832a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:37.302 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.304+0000 7f592832a800 20 searching for the correct realm 2024-09-14T11:38:37.304 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.306+0000 7f59248ae640 0 -- 172.21.15.7:0/3740218738 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f591806d460 msgr2=0x7f591806d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:37.308 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.311+0000 7f59238ac640 0 -- 172.21.15.7:0/3740218738 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f591400d650 msgr2=0x7f591406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:37.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.518+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 zone default found 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 4 Realm: () 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 zonegroup default 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.519+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.520+0000 7f592832a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.520+0000 7f592832a800 20 started sync module instance, tier type = 2024-09-14T11:38:37.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.520+0000 7f592832a800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:38:37.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.530+0000 7f592832a800 20 add_watcher() i=0 2024-09-14T11:38:37.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.530+0000 7f592832a800 20 add_watcher() i=1 2024-09-14T11:38:37.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.530+0000 7f592832a800 20 add_watcher() i=2 2024-09-14T11:38:37.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.530+0000 7f592832a800 20 add_watcher() i=3 2024-09-14T11:38:37.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.530+0000 7f592832a800 20 add_watcher() i=4 2024-09-14T11:38:37.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.530+0000 7f592832a800 20 add_watcher() i=5 2024-09-14T11:38:37.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.530+0000 7f592832a800 20 add_watcher() i=6 2024-09-14T11:38:37.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.531+0000 7f592832a800 20 add_watcher() i=7 2024-09-14T11:38:37.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.531+0000 7f592832a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.533+0000 7f57dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f592832a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f592832a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f592832a800 5 note: GC not initialized 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f57d9fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f592832a800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f592832a800 20 Filter name: none 2024-09-14T11:38:37.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f574b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:37.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f592832a800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:38:37.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.534+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 : miss 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:38:37.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.535+0000 7f592832a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 2024-09-14T11:38:37.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.536+0000 7f592832a800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to be held by another RGW process; skipping for now 2024-09-14T11:38:37.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.537+0000 7f57dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.540+0000 7f592832a800 20 remove_watcher() i=0 2024-09-14T11:38:37.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.540+0000 7f592832a800 2 removed watcher, disabling cache 2024-09-14T11:38:37.538 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.541+0000 7f592832a800 20 remove_watcher() i=1 2024-09-14T11:38:37.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.542+0000 7f592832a800 20 remove_watcher() i=2 2024-09-14T11:38:37.541 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.543+0000 7f592832a800 20 remove_watcher() i=3 2024-09-14T11:38:37.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.545+0000 7f592832a800 20 remove_watcher() i=4 2024-09-14T11:38:37.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.546+0000 7f592832a800 20 remove_watcher() i=5 2024-09-14T11:38:37.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.546+0000 7f592832a800 20 remove_watcher() i=6 2024-09-14T11:38:37.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:38:37.548+0000 7f592832a800 20 remove_watcher() i=7 2024-09-14T11:38:37.557 INFO:tasks.workunit.client.0.smithi007.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:39:07.577 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:07.613 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:07.613 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:07.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.660+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 20 realm 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:07.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.662+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.664+0000 7fd5e4e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:07.662 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.664+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.664+0000 7fd5e4e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:07.663 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.665+0000 7fd5e4e98800 20 searching for the correct realm 2024-09-14T11:39:07.665 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.667+0000 7fd5e318a640 0 -- 172.21.15.7:0/901185033 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fd5d802b040 msgr2=0x7fd5d8043460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:07.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:07.874+0000 7fd5e2188640 0 -- 172.21.15.7:0/901185033 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fd5d406b700 msgr2=0x7fd5d40850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:08.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.082+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 20 zone default found 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 4 Realm: () 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 20 zonegroup default 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.083+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.084+0000 7fd5e4e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.084+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.084+0000 7fd5e4e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.084+0000 7fd5e4e98800 20 started sync module instance, tier type = 2024-09-14T11:39:08.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.084+0000 7fd5e4e98800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:08.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.095+0000 7fd5e4e98800 20 add_watcher() i=0 2024-09-14T11:39:08.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.095+0000 7fd5e4e98800 20 add_watcher() i=1 2024-09-14T11:39:08.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.095+0000 7fd5e4e98800 20 add_watcher() i=2 2024-09-14T11:39:08.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.095+0000 7fd5e4e98800 20 add_watcher() i=3 2024-09-14T11:39:08.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.095+0000 7fd5e4e98800 20 add_watcher() i=4 2024-09-14T11:39:08.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.095+0000 7fd5e4e98800 20 add_watcher() i=5 2024-09-14T11:39:08.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.095+0000 7fd5e4e98800 20 add_watcher() i=6 2024-09-14T11:39:08.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.097+0000 7fd5e4e98800 20 add_watcher() i=7 2024-09-14T11:39:08.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.097+0000 7fd5e4e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:08.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.099+0000 7fd4997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.099+0000 7fd5e4e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:08.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.099+0000 7fd5e4e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:08.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.099+0000 7fd5e4e98800 5 note: GC not initialized 2024-09-14T11:39:08.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.099+0000 7fd413fff640 20 reqs_thread_entry: start 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.099+0000 7fd5e4e98800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 20 Filter name: none 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd411ffb640 20 reqs_thread_entry: start 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:39:08.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 : miss 2024-09-14T11:39:08.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.100+0000 7fd5e4e98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.101+0000 7fd5e4e98800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:39:08.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.101+0000 7fd5e4e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:39:08.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.101+0000 7fd5e4e98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:39:08.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.101+0000 7fd5e4e98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:08.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.101+0000 7fd5e4e98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:39:08.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.101+0000 7fd5e4e98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 2024-09-14T11:39:08.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.103+0000 7fd5e4e98800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:39:08.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd5e4e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:39:08.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd5e4e98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:39:08.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd5e4e98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:39:08.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd5e4e98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40, ofs0, ns] 2024-09-14T11:39:08.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd4c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529791 cookie 94431059925104 notifier 7601 bl.length()=1015 2024-09-14T11:39:08.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd4c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:39:08.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd4c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:39:08.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.110+0000 7fd4c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:39:08.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.111+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_sources= new_sources= 2024-09-14T11:39:08.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.111+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential sources added=[] removed=[] 2024-09-14T11:39:08.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.111+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_dests= new_dests= 2024-09-14T11:39:08.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.111+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential dests added=[] removed=[] 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.0 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.0 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.1 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.1 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.2 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.2 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.3 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.3 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.4 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.4 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.5 2024-09-14T11:39:08.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.5 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.6 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.6 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.7 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.7 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.8 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.8 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.9 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.9 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.10 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.10 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.11 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2.11 2024-09-14T11:39:08.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.0 2024-09-14T11:39:08.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.117+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1 2024-09-14T11:39:08.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.118+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2 2024-09-14T11:39:08.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.118+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.3 2024-09-14T11:39:08.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.119+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.4 2024-09-14T11:39:08.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.119+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.5 2024-09-14T11:39:08.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.120+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.6 2024-09-14T11:39:08.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.121+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.7 2024-09-14T11:39:08.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.121+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.8 2024-09-14T11:39:08.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.122+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.9 2024-09-14T11:39:08.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.122+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.10 2024-09-14T11:39:08.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.126+0000 7fd5e4e98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:08.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.126+0000 7fd5e4e98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 2024-09-14T11:39:08.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:39:08.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:39:08.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:39:08.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40, ofs0, ns] 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd4c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529792 cookie 94431059925104 notifier 7601 bl.length()=1015 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd4c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd4c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd4c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_sources= new_sources= 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential sources added=[] removed=[] 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_dests= new_dests= 2024-09-14T11:39:08.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.128+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential dests added=[] removed=[] 2024-09-14T11:39:08.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.131+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.0 2024-09-14T11:39:08.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.131+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.1 2024-09-14T11:39:08.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.132+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.2 2024-09-14T11:39:08.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.132+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.3 2024-09-14T11:39:08.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.132+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.4 2024-09-14T11:39:08.131 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.133+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.5 2024-09-14T11:39:08.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.133+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.6 2024-09-14T11:39:08.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.134+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.7 2024-09-14T11:39:08.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.134+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.8 2024-09-14T11:39:08.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.135+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.9 2024-09-14T11:39:08.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.135+0000 7fd5e4e98800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40.10 2024-09-14T11:39:08.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.135+0000 7fd5e4e98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:08.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.135+0000 7fd5e4e98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 2024-09-14T11:39:08.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd5e4e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:39:08.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd5e4e98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:39:08.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd5e4e98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:39:08.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd5e4e98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40, ofs0, ns] 2024-09-14T11:39:08.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd4c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529793 cookie 94431059925104 notifier 7601 bl.length()=983 2024-09-14T11:39:08.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd4c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 info.flags=0x17 2024-09-14T11:39:08.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd4c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 to cache LRU end 2024-09-14T11:39:08.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.137+0000 7fd4c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:39:08.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.138+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_sources= new_sources= 2024-09-14T11:39:08.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.138+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential sources added=[] removed=[] 2024-09-14T11:39:08.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.138+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): orig_dests= new_dests= 2024-09-14T11:39:08.137 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.138+0000 7fd5e4e98800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40]): potential dests added=[] removed=[] 2024-09-14T11:39:08.139 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.140+0000 7fd5e4e98800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:08.141 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.142+0000 7fd4997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.145+0000 7fd5e4e98800 20 remove_watcher() i=0 2024-09-14T11:39:08.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.145+0000 7fd5e4e98800 2 removed watcher, disabling cache 2024-09-14T11:39:08.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.146+0000 7fd5e4e98800 20 remove_watcher() i=1 2024-09-14T11:39:08.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.147+0000 7fd5e4e98800 20 remove_watcher() i=2 2024-09-14T11:39:08.146 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.148+0000 7fd5e4e98800 20 remove_watcher() i=3 2024-09-14T11:39:08.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.149+0000 7fd5e4e98800 20 remove_watcher() i=4 2024-09-14T11:39:08.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.150+0000 7fd5e4e98800 20 remove_watcher() i=5 2024-09-14T11:39:08.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.151+0000 7fd5e4e98800 20 remove_watcher() i=6 2024-09-14T11:39:08.151 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.153+0000 7fd5e4e98800 20 remove_watcher() i=7 2024-09-14T11:39:08.165 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:39:08.196 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:08.196 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:08.237 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.238+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 20 realm 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.239 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.240+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.241+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.240 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.241+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.242+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:08.241 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.242+0000 7f1c56f75800 20 searching for the correct realm 2024-09-14T11:39:08.243 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.244+0000 7f1c55260640 0 -- 172.21.15.7:0/566502386 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f1c480a3040 msgr2=0x7f1c480643d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:08.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.450+0000 7f1c5425e640 0 -- 172.21.15.7:0/566502386 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f1c44056c20 msgr2=0x7f1c44064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:08.657 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.659+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 zone default found 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 4 Realm: () 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 zonegroup default 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.660+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.661+0000 7f1c56f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.661+0000 7f1c56f75800 20 started sync module instance, tier type = 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.661+0000 7f1c56f75800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.671+0000 7f1c56f75800 20 add_watcher() i=0 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.671+0000 7f1c56f75800 20 add_watcher() i=1 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.671+0000 7f1c56f75800 20 add_watcher() i=2 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.671+0000 7f1c56f75800 20 add_watcher() i=3 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.671+0000 7f1c56f75800 20 add_watcher() i=4 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.671+0000 7f1c56f75800 20 add_watcher() i=5 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.671+0000 7f1c56f75800 20 add_watcher() i=6 2024-09-14T11:39:08.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.672+0000 7f1c56f75800 20 add_watcher() i=7 2024-09-14T11:39:08.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.672+0000 7f1c56f75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:08.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.674+0000 7f1b0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.674+0000 7f1c56f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.674+0000 7f1c56f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.674+0000 7f1c56f75800 5 note: GC not initialized 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.675+0000 7f1b0a7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.675+0000 7f1c56f75800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.675+0000 7f1c56f75800 20 Filter name: none 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.675+0000 7f1b037fe640 20 reqs_thread_entry: start 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.675+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.675+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.675+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.676+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.676+0000 7f1c56f75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.676+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.677+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.677+0000 7f1c56f75800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.677+0000 7f1c56f75800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.677+0000 7f1c56f75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:08.679 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.680+0000 7f1b0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.683+0000 7f1c56f75800 20 remove_watcher() i=0 2024-09-14T11:39:08.681 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.683+0000 7f1c56f75800 2 removed watcher, disabling cache 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.684+0000 7f1c56f75800 20 remove_watcher() i=1 2024-09-14T11:39:08.684 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.685+0000 7f1c56f75800 20 remove_watcher() i=2 2024-09-14T11:39:08.685 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.686+0000 7f1c56f75800 20 remove_watcher() i=3 2024-09-14T11:39:08.686 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.687+0000 7f1c56f75800 20 remove_watcher() i=4 2024-09-14T11:39:08.687 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.688+0000 7f1c56f75800 20 remove_watcher() i=5 2024-09-14T11:39:08.688 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.689+0000 7f1c56f75800 20 remove_watcher() i=6 2024-09-14T11:39:08.689 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.690+0000 7f1c56f75800 20 remove_watcher() i=7 2024-09-14T11:39:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:08.701 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:39:08.701 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: abort-at-change-reshard-state id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:08.701 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:08.704 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:08.704 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:39:08.708 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:08.708 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:39:08.751 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:08.751 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:39:08.785 INFO:tasks.workunit.client.0.smithi007.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:39:08.786 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:08.817 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:08.817 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:08.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.857+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 20 realm 2024-09-14T11:39:08.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:08.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.859+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.860+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.860+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.861+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:08.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.861+0000 7f97aa773800 20 searching for the correct realm 2024-09-14T11:39:08.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.863+0000 7f97a8a5e640 0 -- 172.21.15.7:0/1923893198 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f979c018070 msgr2=0x7f979c044a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:08.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:08.867+0000 7f97a7a5c640 0 -- 172.21.15.7:0/1923893198 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f9798014430 msgr2=0x7f97980148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.073+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 zone default found 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 4 Realm: () 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 zonegroup default 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.074+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.075+0000 7f97aa773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.075+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.075+0000 7f97aa773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.075+0000 7f97aa773800 20 started sync module instance, tier type = 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.075+0000 7f97aa773800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.085+0000 7f97aa773800 20 add_watcher() i=0 2024-09-14T11:39:09.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.085+0000 7f97aa773800 20 add_watcher() i=1 2024-09-14T11:39:09.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.085+0000 7f97aa773800 20 add_watcher() i=2 2024-09-14T11:39:09.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.085+0000 7f97aa773800 20 add_watcher() i=3 2024-09-14T11:39:09.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.085+0000 7f97aa773800 20 add_watcher() i=4 2024-09-14T11:39:09.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.085+0000 7f97aa773800 20 add_watcher() i=5 2024-09-14T11:39:09.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.085+0000 7f97aa773800 20 add_watcher() i=6 2024-09-14T11:39:09.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.086+0000 7f97aa773800 20 add_watcher() i=7 2024-09-14T11:39:09.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.086+0000 7f97aa773800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.088+0000 7f965efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.088+0000 7f97aa773800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.088+0000 7f97aa773800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.088+0000 7f97aa773800 5 note: GC not initialized 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.088+0000 7f965dfdb640 20 reqs_thread_entry: start 2024-09-14T11:39:09.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.088+0000 7f97aa773800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:09.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.089+0000 7f97aa773800 20 Filter name: none 2024-09-14T11:39:09.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.089+0000 7f95cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:09.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.089+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.089+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.089+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.089+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.090+0000 7f97aa773800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.090+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.090+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.090+0000 7f97aa773800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.090+0000 7f97aa773800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:09.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.090+0000 7f97aa773800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:09.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.092+0000 7f965efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.095+0000 7f97aa773800 20 remove_watcher() i=0 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.095+0000 7f97aa773800 2 removed watcher, disabling cache 2024-09-14T11:39:09.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.096+0000 7f97aa773800 20 remove_watcher() i=1 2024-09-14T11:39:09.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.097+0000 7f97aa773800 20 remove_watcher() i=2 2024-09-14T11:39:09.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.098+0000 7f97aa773800 20 remove_watcher() i=3 2024-09-14T11:39:09.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.099+0000 7f97aa773800 20 remove_watcher() i=4 2024-09-14T11:39:09.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.100+0000 7f97aa773800 20 remove_watcher() i=5 2024-09-14T11:39:09.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.101+0000 7f97aa773800 20 remove_watcher() i=6 2024-09-14T11:39:09.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.102+0000 7f97aa773800 20 remove_watcher() i=7 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:09.112 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:39:09.112 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:39:09.112 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:09.113 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:09.142 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:09.142 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:09.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.184+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 20 realm 2024-09-14T11:39:09.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:09.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.185+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.187+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.187+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.188+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:09.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.188+0000 7f47cfb23800 20 searching for the correct realm 2024-09-14T11:39:09.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.189+0000 7f47cb00b640 0 -- 172.21.15.7:0/1803207478 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f47bc045060 msgr2=0x7f47bc0690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.395+0000 7f47cc00d640 0 -- 172.21.15.7:0/1803207478 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f47c0074070 msgr2=0x7f47c0019090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:09.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:09.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:09.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:09.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:09.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:09.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.402+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:09.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 zone default found 2024-09-14T11:39:09.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 4 Realm: () 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 zonegroup default 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.403+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.404+0000 7f47cfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.404+0000 7f47cfb23800 20 started sync module instance, tier type = 2024-09-14T11:39:09.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.404+0000 7f47cfb23800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:09.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.414+0000 7f47cfb23800 20 add_watcher() i=0 2024-09-14T11:39:09.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.414+0000 7f47cfb23800 20 add_watcher() i=1 2024-09-14T11:39:09.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.414+0000 7f47cfb23800 20 add_watcher() i=2 2024-09-14T11:39:09.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.414+0000 7f47cfb23800 20 add_watcher() i=3 2024-09-14T11:39:09.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.414+0000 7f47cfb23800 20 add_watcher() i=4 2024-09-14T11:39:09.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.414+0000 7f47cfb23800 20 add_watcher() i=5 2024-09-14T11:39:09.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.414+0000 7f47cfb23800 20 add_watcher() i=6 2024-09-14T11:39:09.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.415+0000 7f47cfb23800 20 add_watcher() i=7 2024-09-14T11:39:09.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.415+0000 7f47cfb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:09.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.417+0000 7f4681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.417+0000 7f47cfb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:09.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.417+0000 7f47cfb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:09.416 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.417+0000 7f47cfb23800 5 note: GC not initialized 2024-09-14T11:39:09.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.417+0000 7f4680fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:09.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.417+0000 7f47cfb23800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:09.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.418+0000 7f47cfb23800 20 Filter name: none 2024-09-14T11:39:09.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.418+0000 7f45fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:09.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.418+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.418+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.418+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.419+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.419+0000 7f47cfb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.419+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.419+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.419+0000 7f47cfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.419+0000 7f47cfb23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.419+0000 7f47cfb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.422+0000 7f4681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.424+0000 7f47cfb23800 20 remove_watcher() i=0 2024-09-14T11:39:09.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.424+0000 7f47cfb23800 2 removed watcher, disabling cache 2024-09-14T11:39:09.423 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.425+0000 7f47cfb23800 20 remove_watcher() i=1 2024-09-14T11:39:09.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.426+0000 7f47cfb23800 20 remove_watcher() i=2 2024-09-14T11:39:09.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.427+0000 7f47cfb23800 20 remove_watcher() i=3 2024-09-14T11:39:09.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.428+0000 7f47cfb23800 20 remove_watcher() i=4 2024-09-14T11:39:09.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.429+0000 7f47cfb23800 20 remove_watcher() i=5 2024-09-14T11:39:09.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.430+0000 7f47cfb23800 20 remove_watcher() i=6 2024-09-14T11:39:09.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.431+0000 7f47cfb23800 20 remove_watcher() i=7 2024-09-14T11:39:09.442 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:39:09.477 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:09.477 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:09.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.521+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 20 realm 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.524+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.524+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.525+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:09.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.525+0000 7fae02726800 20 searching for the correct realm 2024-09-14T11:39:09.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.527+0000 7fadfebda640 0 -- 172.21.15.7:0/762902694 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fadf406c040 msgr2=0x7fadf407c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.731 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.733+0000 7fadfdbd8640 0 -- 172.21.15.7:0/762902694 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fadf0073130 msgr2=0x7fadf0072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.939 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:09.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 20 zone default found 2024-09-14T11:39:09.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 4 Realm: () 2024-09-14T11:39:09.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:09.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 20 zonegroup default 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.941+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.942+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.942+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.942+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.942+0000 7fae02726800 20 started sync module instance, tier type = 2024-09-14T11:39:09.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.942+0000 7fae02726800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:09.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=0 2024-09-14T11:39:09.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=1 2024-09-14T11:39:09.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=2 2024-09-14T11:39:09.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=3 2024-09-14T11:39:09.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=4 2024-09-14T11:39:09.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=5 2024-09-14T11:39:09.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=6 2024-09-14T11:39:09.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.956+0000 7fae02726800 20 add_watcher() i=7 2024-09-14T11:39:09.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.956+0000 7fae02726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:09.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.957+0000 7facb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fae02726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fae02726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fae02726800 5 note: GC not initialized 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fac2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fae02726800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fae02726800 20 Filter name: none 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fac2d7fa640 20 reqs_thread_entry: start 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fae02726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:09.957 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.958+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.959+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:09.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.959+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:09.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.959+0000 7fae02726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:09.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.959+0000 7fae02726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:09.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.959+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.960+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:09.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.960+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:09.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.960+0000 7fae02726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:09.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.960+0000 7fae02726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:09.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.960+0000 7fae02726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:09.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.960+0000 7fae02726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:09.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.966+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:09.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.966+0000 7fae02726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:09.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.966+0000 7fae02726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:09.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.966+0000 7fae02726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529796 cookie 93985914124512 notifier 7664 bl.length()=911 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:39:09.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:39:09.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:39:09.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:39:09.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.1 2024-09-14T11:39:09.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.1 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.2 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.2 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.3 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.3 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.4 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.4 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.5 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.5 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.6 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.6 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.7 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.7 2024-09-14T11:39:09.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.8 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.8 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.9 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.9 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.10 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.10 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.11 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.11 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.12 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.12 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.13 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.13 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:09.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:09.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.974+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:09.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.974+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:09.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.974+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:09.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.974+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:09.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.975+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.975+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.976+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.976+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.976+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.976+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.977+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.977+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.977+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:09.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.977+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.978+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.978+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.979+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:09.977 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.979+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:09.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.979+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:09.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.979+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:09.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.980+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:09.978 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.980+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.980+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:09.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.980+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:09.981 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fae02726800 time 2024-09-14T11:39:09.984692+0000 2024-09-14T11:39:09.981 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:09.982 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:09.982 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fae03d8c76a] 2024-09-14T11:39:09.982 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:09.982 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:09.982 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.984+0000 7fae02726800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fae02726800 time 2024-09-14T11:39:09.984692+0000 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fae03d8c76a] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:09.983 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:39:09.984 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:09.984 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:39:09.984 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:39:09.984 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:09.984 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:39:09.984 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fae02726800 thread_name:radosgw-admin 2024-09-14T11:39:10.000 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:10.000 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae02a3e6f0] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fae02a8b99c] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fae03d8c7c4] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:39:10.001 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:09.984+0000 7fae02726800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fae02726800 thread_name:radosgw-admin 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae02a3e6f0] 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fae02a8b99c] 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fae03d8c7c4] 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:39:10.002 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.059540s 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557accf65b60 auth_method 0 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.003 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557accf65f80 auth_method 0 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557accded4e0 auth_method 0 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.004 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:39:09.502+0000 7fadfebda640 1 monclient: found mon.noname-a 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: dump: 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.005 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: dump: 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.006 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:39:09.503+0000 7fae02726800 5 monclient: authenticate success, global_id 8058 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:39:09.503+0000 7facec608640 4 set_mon_vals no callback set 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:39:09.503+0000 7fae02726800 1 librados: init done 2024-09-14T11:39:10.007 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:39:09.505+0000 7faceae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:39:09.505+0000 7faceae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:39:09.505+0000 7faceae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:39:09.505+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x7face4077230 auth_method 0 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:39:09.505+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x557accfab7f0 auth_method 0 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:39:09.506+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x557accfae9d0 auth_method 0 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:39:09.507+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x557accfb2e80 auth_method 0 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:39:09.508+0000 7fadfebda640 10 monclient: get_auth_request con 0x557accfb6f00 auth_method 0 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:39:09.509+0000 7fae02726800 10 monclient: build_initial_monmap 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:39:09.509+0000 7fae02726800 1 build_initial for_mkfs: 0 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:39:09.509+0000 7fae02726800 10 monclient: monmap: 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:10.008 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding auth protocol: cephx 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding auth protocol: cephx 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding auth protocol: cephx 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.009 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:39:09.509+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:39:09.509+0000 7fae02726800 5 asok(0x557accd42270) register_command objecter_requests cmddesc objecter_requests hook 0x557accfbe6b0 EEXIST 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:39:09.509+0000 7fae02726800 10 monclient: init 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding auth protocol: cephx 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding auth protocol: cephx 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding auth protocol: cephx 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.010 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:39:09.510+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:39:09.510+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:39:09.510+0000 7fae02726800 5 asok(0x557accd42270) register_command rotate-key cmddesc rotate-key hook 0x557accfba0a0 EEXIST 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:10.011 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): picked mon.noname-a con 0x557accfe29d0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): picked mon.noname-c con 0x557accfe2db0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): picked mon.noname-b con 0x557accfe16e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.067440s 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557accfe29d0 auth_method 0 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557accfe2db0 auth_method 0 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.012 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557accfe16e0 auth_method 0 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.013 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:39:09.510+0000 7fadfebda640 1 monclient: found mon.noname-c 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: dump: 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.014 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: dump: 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:39:09.513+0000 7fae02726800 5 monclient: authenticate success, global_id 7658 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:39:09.513+0000 7fadff3db640 4 set_mon_vals no callback set 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:39:09.515+0000 7face3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:39:09.515+0000 7face3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:39:09.515+0000 7face3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.016 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:39:09.515+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7facd8077140 auth_method 0 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: get_monmap_and_config 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: build_initial_monmap 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:39:09.515+0000 7fae02726800 1 build_initial for_mkfs: 0 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: monmap: 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:10.017 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding auth protocol: cephx 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding auth protocol: cephx 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding auth protocol: cephx 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.018 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:39:09.515+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: init 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding auth protocol: cephx 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding auth protocol: cephx 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding auth protocol: cephx 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.019 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:39:09.516+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:39:09.516+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:39:09.516+0000 7fae02726800 5 asok(0x557accd42270) register_command rotate-key cmddesc rotate-key hook 0x7ffcd26f2458 EEXIST 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): picked mon.noname-a con 0x557acd036cc0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): picked mon.noname-c con 0x557acd0370a0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): picked mon.noname-b con 0x557acd0068e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.020 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.073533s 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557acd0370a0 auth_method 0 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557acd036cc0 auth_method 0 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557acd0068e0 auth_method 0 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.021 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_done global_id 7661 payload 274 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:39:09.516+0000 7fadfebda640 1 monclient: found mon.noname-c 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: dump: 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.022 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: dump: 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:39:09.517+0000 7fae02726800 5 monclient: authenticate success, global_id 7661 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:39:09.517+0000 7fae02726800 4 set_mon_vals no callback set 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: shutdown 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: build_initial_monmap 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:39:09.517+0000 7fae02726800 1 build_initial for_mkfs: 0 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: monmap: 2024-09-14T11:39:10.024 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding auth protocol: cephx 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding auth protocol: cephx 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding auth protocol: cephx 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.025 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:39:09.518+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: starting msgr at 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: starting objecter 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:39:09.518+0000 7fae02726800 5 asok(0x557accd42270) register_command objecter_requests cmddesc objecter_requests hook 0x557acd032860 EEXIST 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: setting wanted keys 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: calling monclient init 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient: init 2024-09-14T11:39:10.026 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding auth protocol: cephx 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding auth protocol: cephx 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding auth protocol: cephx 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:39:09.518+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.027 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:39:09.518+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:39:09.518+0000 7fae02726800 5 asok(0x557accd42270) register_command rotate-key cmddesc rotate-key hook 0x557accff73d8 EEXIST 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): picked mon.noname-a con 0x557acd0068e0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): picked mon.noname-b con 0x557acd036cc0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): picked mon.noname-c con 0x557acd027480 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.075984s 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557acd0068e0 auth_method 0 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.028 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557acd027480 auth_method 0 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557acd036cc0 auth_method 0 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-14T11:39:10.029 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 1 monclient: found mon.noname-c 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: dump: 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.030 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: dump: 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.031 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:39:09.519+0000 7face1ffb640 4 set_mon_vals no callback set 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:39:09.520+0000 7fae02726800 5 monclient: authenticate success, global_id 7664 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:39:09.520+0000 7fae02726800 1 librados: init done 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:39:09.520+0000 7fae02726800 5 asok(0x557accd42270) register_command cr dump hook 0x7fadf8061d88 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:39:09.521+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:39:09.522+0000 7faccffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:39:09.522+0000 7faccffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:39:09.522+0000 7faccffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:39:09.522+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7facc8077230 auth_method 0 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:39:09.522+0000 7fadfebda640 10 monclient: get_auth_request con 0x557acd0517a0 auth_method 0 2024-09-14T11:39:10.032 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:39:09.523+0000 7fae02726800 20 realm 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:39:09.523+0000 7fae02726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:39:09.524+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x557acd055970 auth_method 0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:39:09.524+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:39:09.524+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:39:09.525+0000 7fadfebda640 10 monclient: get_auth_request con 0x557acd059200 auth_method 0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:39:09.525+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:39:09.525+0000 7fae02726800 20 searching for the correct realm 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:39:09.526+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x557acd05df00 auth_method 0 2024-09-14T11:39:10.033 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:39:09.526+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7fadf0069e90 auth_method 0 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:39:09.527+0000 7fadfebda640 0 -- 172.21.15.7:0/762902694 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fadf406c040 msgr2=0x7fadf407c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:39:09.527+0000 7fadfebda640 10 monclient: get_auth_request con 0x7fadf406c040 auth_method 0 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:39:09.728+0000 7fadfebda640 10 monclient: get_auth_request con 0x7fadf406c040 auth_method 0 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:39:09.728+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x7fadf805e050 auth_method 0 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:39:09.733+0000 7fadfdbd8640 0 -- 172.21.15.7:0/762902694 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fadf0073130 msgr2=0x7fadf0072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:39:09.934+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7fadf0073130 auth_method 0 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.034 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:39:09.941+0000 7fae02726800 20 zone default found 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:39:09.941+0000 7fae02726800 4 Realm: () 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:39:09.941+0000 7fae02726800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:39:09.941+0000 7fae02726800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:39:09.941+0000 7fae02726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:39:09.941+0000 7fae02726800 20 zonegroup default 2024-09-14T11:39:10.035 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:39:09.942+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:39:09.942+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:39:09.942+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:39:09.942+0000 7fae02726800 20 started sync module instance, tier type = 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:39:09.942+0000 7fae02726800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=0 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=1 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=2 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=3 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=4 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=5 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=6 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:39:09.956+0000 7fae02726800 20 add_watcher() i=7 2024-09-14T11:39:10.036 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:39:09.956+0000 7fae02726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding auth protocol: cephx 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding auth protocol: cephx 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding auth protocol: cephx 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.037 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:39:09.957+0000 7facb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:39:09.958+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:39:09.958+0000 7fae02726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:39:09.958+0000 7fae02726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache list hook 0x557acd02c080 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache inspect hook 0x557acd02c080 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache erase hook 0x557acd02c080 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache zap hook 0x557acd02c080 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:39:09.958+0000 7fae02726800 5 note: GC not initialized 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:39:09.958+0000 7fac2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace show hook 0x7fadf804c040 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace history hook 0x7fadf804c040 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace active hook 0x7fadf804c040 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace active_short hook 0x7fadf804c040 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:39:09.958+0000 7fae02726800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.038 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:39:09.958+0000 7fae02726800 20 Filter name: none 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:39:09.958+0000 7fac2d7fa640 20 reqs_thread_entry: start 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:39:09.958+0000 7fae02726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:39:09.958+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:39:09.959+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:39:09.959+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:39:09.959+0000 7fae02726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:39:09.959+0000 7fae02726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:39:09.959+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:39:09.959+0000 7faccffff640 1 client.7664.objecter ms_handle_reset 0x557acd05df00 session 0x557acd05d880 osd.3 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:39:09.959+0000 7faccffff640 10 monclient: _renew_subs 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:39:09.959+0000 7faccffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:39:09.959+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x7facc8087050 auth_method 0 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:39:09.960+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:39:09.960+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:39:09.960+0000 7fae02726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:10.039 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:39:09.960+0000 7fae02726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:39:09.960+0000 7fae02726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:39:09.960+0000 7fae02726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:39:09.966+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:39:09.966+0000 7fae02726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:39:09.966+0000 7fae02726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:39:09.966+0000 7fae02726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529796 cookie 93985914124512 notifier 7664 bl.length()=911 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:39:10.040 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.1 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.1 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.2 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.2 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.3 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.3 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.4 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.4 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.5 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.5 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.6 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.6 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.7 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.7 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.8 2024-09-14T11:39:10.041 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.8 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.9 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.9 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.10 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.10 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.11 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.11 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.12 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.12 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.13 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.13 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:39:09.974+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:39:09.974+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:10.042 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:39:09.974+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:39:09.974+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:39:09.975+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:39:09.975+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:39:09.976+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:39:09.976+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:39:09.976+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:39:09.976+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:39:09.977+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:39:09.977+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:39:09.977+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:39:09.977+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:39:09.978+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:39:09.978+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:39:09.979+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:39:09.979+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:10.043 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:39:09.979+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:39:09.979+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:39:09.980+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:39:09.980+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:39:09.980+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:39:09.980+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:39:09.984+0000 7fae02726800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fae02726800 time 2024-09-14T11:39:09.984692+0000 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fae03d8c76a] 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:39:10.044 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:39:09.984+0000 7fae02726800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fae02726800 thread_name:radosgw-admin 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae02a3e6f0] 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fae02a8b99c] 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fae03d8c7c4] 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:10.045 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:39:10.046 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:39:10.047 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:39:10.048 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:39:10.049 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:10.050 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:39:10.051 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7fac2d7fa640 / http_manager 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7fac2f7fe640 / http_manager 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7facb4fe1640 / rgw_dt_lg_renew 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7faccffff640 / ms_dispatch 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7face1ffb640 / io_context_pool 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7face3fff640 / ms_dispatch 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7faceae05640 / ms_dispatch 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7facec608640 / io_context_pool 2024-09-14T11:39:10.052 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadfdbd8640 / msgr-worker-2 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadfe3d9640 / msgr-worker-1 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadfebda640 / msgr-worker-0 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadff3db640 / io_context_pool 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: 7fae02726800 / radosgw-admin 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.146307.log 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:39:09.502+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.059540s 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557accf65b60 auth_method 0 2024-09-14T11:39:10.053 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557accf65f80 auth_method 0 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:39:09.502+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557accded4e0 auth_method 0 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.054 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:39:09.502+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:39:09.502+0000 7fadfebda640 1 monclient: found mon.noname-a 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:39:09.502+0000 7fadfebda640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: dump: 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.055 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:39:09.503+0000 7faceae05640 10 monclient: dump: 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.056 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:39:09.503+0000 7fae02726800 5 monclient: authenticate success, global_id 8058 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:39:09.503+0000 7facec608640 4 set_mon_vals no callback set 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:39:09.503+0000 7fae02726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:39:09.503+0000 7fae02726800 1 librados: init done 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:39:09.505+0000 7faceae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:39:09.505+0000 7faceae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:39:09.505+0000 7faceae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:39:09.505+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x7face4077230 auth_method 0 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:39:09.505+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x557accfab7f0 auth_method 0 2024-09-14T11:39:10.057 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:39:09.506+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x557accfae9d0 auth_method 0 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:39:09.507+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x557accfb2e80 auth_method 0 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:39:09.508+0000 7fadfebda640 10 monclient: get_auth_request con 0x557accfb6f00 auth_method 0 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:39:09.509+0000 7fae02726800 10 monclient: build_initial_monmap 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:39:09.509+0000 7fae02726800 1 build_initial for_mkfs: 0 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:39:09.509+0000 7fae02726800 10 monclient: monmap: 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:10.058 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding auth protocol: cephx 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding auth protocol: cephx 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding auth protocol: cephx 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: crc 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfbb1a0) adding con mode: secure 2024-09-14T11:39:10.059 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:39:09.509+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:39:09.509+0000 7fae02726800 5 asok(0x557accd42270) register_command objecter_requests cmddesc objecter_requests hook 0x557accfbe6b0 EEXIST 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:39:09.509+0000 7fae02726800 10 monclient: init 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding auth protocol: cephx 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding auth protocol: cephx 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding auth protocol: cephx 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.060 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: crc 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:39:09.509+0000 7fae02726800 5 AuthRegistry(0x557accfb9f58) adding con mode: secure 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:39:09.510+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:39:09.510+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:39:09.510+0000 7fae02726800 5 asok(0x557accd42270) register_command rotate-key cmddesc rotate-key hook 0x557accfba0a0 EEXIST 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): picked mon.noname-a con 0x557accfe29d0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): picked mon.noname-c con 0x557accfe2db0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): picked mon.noname-b con 0x557accfe16e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:39:09.510+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.067440s 2024-09-14T11:39:10.061 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557accfe29d0 auth_method 0 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557accfe2db0 auth_method 0 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557accfe16e0 auth_method 0 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.062 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:39:09.510+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:39:09.510+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:39:09.510+0000 7fadfebda640 1 monclient: found mon.noname-c 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:39:09.510+0000 7fadfebda640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: dump: 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.063 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:39:09.513+0000 7face3fff640 10 monclient: dump: 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.064 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:39:09.513+0000 7fae02726800 5 monclient: authenticate success, global_id 7658 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:39:09.513+0000 7fadff3db640 4 set_mon_vals no callback set 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:39:09.513+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:39:09.515+0000 7face3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:39:09.515+0000 7face3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:39:09.515+0000 7face3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.065 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:39:09.515+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7facd8077140 auth_method 0 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: get_monmap_and_config 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: build_initial_monmap 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:39:09.515+0000 7fae02726800 1 build_initial for_mkfs: 0 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: monmap: 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding auth protocol: cephx 2024-09-14T11:39:10.066 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding auth protocol: cephx 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding auth protocol: cephx 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: crc 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x557acd002850) adding con mode: secure 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:39:09.515+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:39:09.515+0000 7fae02726800 10 monclient: init 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding auth protocol: cephx 2024-09-14T11:39:10.067 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding auth protocol: cephx 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding auth protocol: cephx 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:39:09.515+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: crc 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:39:09.516+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f2310) adding con mode: secure 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:39:09.516+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:39:09.516+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.068 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:39:09.516+0000 7fae02726800 5 asok(0x557accd42270) register_command rotate-key cmddesc rotate-key hook 0x7ffcd26f2458 EEXIST 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): picked mon.noname-a con 0x557acd036cc0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): picked mon.noname-c con 0x557acd0370a0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): picked mon.noname-b con 0x557acd0068e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:39:09.516+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.073533s 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557acd0370a0 auth_method 0 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.069 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557acd036cc0 auth_method 0 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:39:09.516+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557acd0068e0 auth_method 0 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:39:09.516+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient(hunting): handle_auth_done global_id 7661 payload 274 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.070 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:39:09.516+0000 7fadfebda640 1 monclient: found mon.noname-c 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:39:09.516+0000 7fadfebda640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: dump: 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.071 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:39:09.517+0000 7face1ffb640 10 monclient: dump: 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:39:09.517+0000 7fae02726800 5 monclient: authenticate success, global_id 7661 2024-09-14T11:39:10.072 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:39:09.517+0000 7fae02726800 4 set_mon_vals no callback set 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: shutdown 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: build_initial_monmap 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:39:09.517+0000 7fae02726800 1 build_initial for_mkfs: 0 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:39:09.517+0000 7fae02726800 10 monclient: monmap: 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.073 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding auth protocol: cephx 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding auth protocol: cephx 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding auth protocol: cephx 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: crc 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:39:09.517+0000 7fae02726800 5 AuthRegistry(0x557acd002800) adding con mode: secure 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:39:09.518+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.074 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: starting msgr at 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: starting objecter 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:39:09.518+0000 7fae02726800 5 asok(0x557accd42270) register_command objecter_requests cmddesc objecter_requests hook 0x557acd032860 EEXIST 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: setting wanted keys 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:39:09.518+0000 7fae02726800 1 librados: calling monclient init 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient: init 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding auth protocol: cephx 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding auth protocol: cephx 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding auth protocol: cephx 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.075 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: crc 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:39:09.518+0000 7fae02726800 5 AuthRegistry(0x557accff7290) adding con mode: secure 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:39:09.518+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:39:09.518+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:39:09.518+0000 7fae02726800 5 asok(0x557accd42270) register_command rotate-key cmddesc rotate-key hook 0x557accff73d8 EEXIST 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): picked mon.noname-a con 0x557acd0068e0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): picked mon.noname-b con 0x557acd036cc0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): picked mon.noname-c con 0x557acd027480 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:10.076 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:39:09.518+0000 7fae02726800 10 monclient(hunting): authenticate will time out at 2250.075984s 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request con 0x557acd0068e0 auth_method 0 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request con 0x557acd027480 auth_method 0 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:39:09.519+0000 7fadfdbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:10.077 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): get_auth_request con 0x557acd036cc0 auth_method 0 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:39:09.519+0000 7fadfebda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 1 monclient: found mon.noname-c 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:39:09.519+0000 7fadfe3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: dump: 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.078 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: _finish_auth 0 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: _check_auth_tickets 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:39:09.519+0000 7faccffff640 10 monclient: dump: 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:10.079 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:39:09.519+0000 7face1ffb640 4 set_mon_vals no callback set 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:39:09.520+0000 7fae02726800 5 monclient: authenticate success, global_id 7664 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _renew_subs 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:39:09.520+0000 7fae02726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:39:09.520+0000 7fae02726800 1 librados: init done 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:39:09.520+0000 7fae02726800 5 asok(0x557accd42270) register_command cr dump hook 0x7fadf8061d88 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:39:09.521+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:39:09.522+0000 7faccffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:39:09.522+0000 7faccffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.080 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:39:09.522+0000 7faccffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:39:09.522+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7facc8077230 auth_method 0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:39:09.522+0000 7fadfebda640 10 monclient: get_auth_request con 0x557acd0517a0 auth_method 0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:39:09.523+0000 7fae02726800 20 realm 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:39:09.523+0000 7fae02726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:39:09.523+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:39:09.524+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x557acd055970 auth_method 0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:39:09.524+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:39:09.524+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:39:09.525+0000 7fadfebda640 10 monclient: get_auth_request con 0x557acd059200 auth_method 0 2024-09-14T11:39:10.081 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:39:09.525+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:39:09.525+0000 7fae02726800 20 searching for the correct realm 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:39:09.526+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x557acd05df00 auth_method 0 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:39:09.526+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7fadf0069e90 auth_method 0 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:39:09.527+0000 7fadfebda640 0 -- 172.21.15.7:0/762902694 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fadf406c040 msgr2=0x7fadf407c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:39:09.527+0000 7fadfebda640 10 monclient: get_auth_request con 0x7fadf406c040 auth_method 0 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:39:09.728+0000 7fadfebda640 10 monclient: get_auth_request con 0x7fadf406c040 auth_method 0 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:39:09.728+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x7fadf805e050 auth_method 0 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:39:09.733+0000 7fadfdbd8640 0 -- 172.21.15.7:0/762902694 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fadf0073130 msgr2=0x7fadf0072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:39:09.934+0000 7fadfdbd8640 10 monclient: get_auth_request con 0x7fadf0073130 auth_method 0 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.082 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:39:09.940+0000 7fae02726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:39:09.940+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:39:09.941+0000 7fae02726800 20 zone default found 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:39:09.941+0000 7fae02726800 4 Realm: () 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:39:09.941+0000 7fae02726800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:39:09.941+0000 7fae02726800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:39:09.941+0000 7fae02726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:39:09.941+0000 7fae02726800 20 zonegroup default 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:39:09.941+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.083 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:39:09.942+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:39:09.942+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:39:09.942+0000 7fae02726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:39:09.942+0000 7fae02726800 20 started sync module instance, tier type = 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:39:09.942+0000 7fae02726800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=0 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=1 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=2 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=3 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=4 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=5 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:39:09.955+0000 7fae02726800 20 add_watcher() i=6 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:39:09.956+0000 7fae02726800 20 add_watcher() i=7 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:39:09.956+0000 7fae02726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding auth protocol: cephx 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding auth protocol: cephx 2024-09-14T11:39:10.084 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding auth protocol: cephx 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: crc 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:39:09.957+0000 7fae02726800 5 AuthRegistry(0x7ffcd26f27f0) adding con mode: secure 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:39:09.957+0000 7facb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:39:09.958+0000 7fae02726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:10.085 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:39:09.958+0000 7fae02726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:39:09.958+0000 7fae02726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache list hook 0x557acd02c080 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache inspect hook 0x557acd02c080 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache erase hook 0x557acd02c080 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command cache zap hook 0x557acd02c080 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:39:09.958+0000 7fae02726800 5 note: GC not initialized 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:39:09.958+0000 7fac2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace show hook 0x7fadf804c040 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace history hook 0x7fadf804c040 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace active hook 0x7fadf804c040 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:39:09.958+0000 7fae02726800 5 asok(0x557accd42270) register_command sync trace active_short hook 0x7fadf804c040 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:39:09.958+0000 7fae02726800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:39:09.958+0000 7fae02726800 20 Filter name: none 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:39:09.958+0000 7fac2d7fa640 20 reqs_thread_entry: start 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:39:09.958+0000 7fae02726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:10.086 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:39:09.958+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:39:09.959+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:39:09.959+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:39:09.959+0000 7fae02726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:39:09.959+0000 7fae02726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:39:09.959+0000 7fae02726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:39:09.959+0000 7faccffff640 1 client.7664.objecter ms_handle_reset 0x557acd05df00 session 0x557acd05d880 osd.3 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:39:09.959+0000 7faccffff640 10 monclient: _renew_subs 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:39:09.959+0000 7faccffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:39:09.959+0000 7fadfe3d9640 10 monclient: get_auth_request con 0x7facc8087050 auth_method 0 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:39:09.960+0000 7fae02726800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:39:09.960+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:39:09.960+0000 7fae02726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:39:09.960+0000 7fae02726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:39:09.960+0000 7fae02726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:39:09.960+0000 7fae02726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:10.087 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:39:09.966+0000 7fae02726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:39:09.966+0000 7fae02726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:39:09.966+0000 7fae02726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:39:09.966+0000 7fae02726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529796 cookie 93985914124512 notifier 7664 bl.length()=911 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:39:09.967+0000 7face1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:39:09.967+0000 7fae02726800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.1 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.1 2024-09-14T11:39:10.088 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.2 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.2 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.3 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.3 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.4 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.4 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.5 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.5 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.6 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.6 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.7 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.7 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.8 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.8 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.9 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.9 2024-09-14T11:39:10.089 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.10 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.10 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.11 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.11 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.12 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.12 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.13 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.13 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:39:09.973+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:39:09.973+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:39:09.974+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:39:09.974+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:39:09.974+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:39:09.974+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:39:09.975+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:10.090 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:39:09.975+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:39:09.976+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:39:09.976+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:39:09.976+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:39:09.976+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:39:09.977+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:39:09.977+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:39:09.977+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:39:09.977+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:39:09.978+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:39:09.978+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:39:09.979+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:39:09.979+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:39:09.979+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:39:09.979+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:10.091 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:39:09.980+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:39:09.980+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:39:09.980+0000 7fae02726800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:39:09.980+0000 7fae02726800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:39:09.984+0000 7fae02726800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fae02726800 time 2024-09-14T11:39:09.984692+0000 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fae03d8c76a] 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:39:10.092 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:39:09.984+0000 7fae02726800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fae02726800 thread_name:radosgw-admin 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fae02a3e6f0] 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fae02a8b99c] 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fae03d8c7c4] 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fae03d8c928] 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557aca5ee0b1] 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557aca5fd124] 2024-09-14T11:39:10.093 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557aca5fdfc4] 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fae02a29590] 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:39:10.094 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:10.095 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:10.096 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:39:10.097 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:10.098 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:39:10.099 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7fac2d7fa640 / http_manager 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7fac2f7fe640 / http_manager 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7facb4fe1640 / rgw_dt_lg_renew 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7faccffff640 / ms_dispatch 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7face1ffb640 / io_context_pool 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7face3fff640 / ms_dispatch 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7faceae05640 / ms_dispatch 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7facec608640 / io_context_pool 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadfdbd8640 / msgr-worker-2 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadfe3d9640 / msgr-worker-1 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadfebda640 / msgr-worker-0 2024-09-14T11:39:10.100 INFO:tasks.workunit.client.0.smithi007.stderr: 7fadff3db640 / io_context_pool 2024-09-14T11:39:10.101 INFO:tasks.workunit.client.0.smithi007.stderr: 7fae02726800 / radosgw-admin 2024-09-14T11:39:10.101 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:39:10.101 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:39:10.101 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:39:09.986347Z_28ff4200-92b1-4abe-8ef0-ae6d580cfc97/log 2024-09-14T11:39:10.101 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:39:10.101 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:10.102 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:10.102 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:10.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.065+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 20 realm 2024-09-14T11:39:10.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.067+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.068+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.068+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.069+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.069+0000 7f3fdfc0f800 20 searching for the correct realm 2024-09-14T11:39:10.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.070+0000 7f3fddefa640 0 -- 172.21.15.7:0/920281493 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f3fd406b020 msgr2=0x7f3fd40a6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:10.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.277+0000 7f3fdcef8640 0 -- 172.21.15.7:0/920281493 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f3fd0046040 msgr2=0x7f3fd0046420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.483+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 zone default found 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 4 Realm: () 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 zonegroup default 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.484+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.485+0000 7f3fdfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.485+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.485+0000 7f3fdfc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.485+0000 7f3fdfc0f800 20 started sync module instance, tier type = 2024-09-14T11:39:10.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.485+0000 7f3fdfc0f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:10.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.498+0000 7f3fdfc0f800 20 add_watcher() i=0 2024-09-14T11:39:10.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.498+0000 7f3fdfc0f800 20 add_watcher() i=1 2024-09-14T11:39:10.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.498+0000 7f3fdfc0f800 20 add_watcher() i=2 2024-09-14T11:39:10.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.498+0000 7f3fdfc0f800 20 add_watcher() i=3 2024-09-14T11:39:10.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.498+0000 7f3fdfc0f800 20 add_watcher() i=4 2024-09-14T11:39:10.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.498+0000 7f3fdfc0f800 20 add_watcher() i=5 2024-09-14T11:39:10.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.498+0000 7f3fdfc0f800 20 add_watcher() i=6 2024-09-14T11:39:10.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.499+0000 7f3fdfc0f800 20 add_watcher() i=7 2024-09-14T11:39:10.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.499+0000 7f3fdfc0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.500+0000 7f3e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.501+0000 7f3fdfc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.501+0000 7f3fdfc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.501+0000 7f3fdfc0f800 5 note: GC not initialized 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.501+0000 7f3e927e4640 20 reqs_thread_entry: start 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.501+0000 7f3fdfc0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.501+0000 7f3fdfc0f800 20 Filter name: none 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.501+0000 7f3e03fff640 20 reqs_thread_entry: start 2024-09-14T11:39:10.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.502+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.502+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:10.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.502+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.503+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.503+0000 7f3fdfc0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.503+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.503+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.503+0000 7f3fdfc0f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.504+0000 7f3fdfc0f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:10.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.504+0000 7f3fdfc0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.506+0000 7f3e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.508+0000 7f3fdfc0f800 20 remove_watcher() i=0 2024-09-14T11:39:10.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.508+0000 7f3fdfc0f800 2 removed watcher, disabling cache 2024-09-14T11:39:10.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.510+0000 7f3fdfc0f800 20 remove_watcher() i=1 2024-09-14T11:39:10.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.511+0000 7f3fdfc0f800 20 remove_watcher() i=2 2024-09-14T11:39:10.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.512+0000 7f3fdfc0f800 20 remove_watcher() i=3 2024-09-14T11:39:10.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.513+0000 7f3fdfc0f800 20 remove_watcher() i=4 2024-09-14T11:39:10.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.515+0000 7f3fdfc0f800 20 remove_watcher() i=5 2024-09-14T11:39:10.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.516+0000 7f3fdfc0f800 20 remove_watcher() i=6 2024-09-14T11:39:10.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.517+0000 7f3fdfc0f800 20 remove_watcher() i=7 2024-09-14T11:39:10.529 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:10.576 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:39:10.577 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:39:10.577 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:10.577 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:10.607 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.608+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.609+0000 7f53ab4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.609+0000 7f53ab4bb800 20 realm 2024-09-14T11:39:10.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.609+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.608 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.610+0000 7f53ab4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.610+0000 7f53ab4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.610+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.610+0000 7f53ab4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.610+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.611+0000 7f53ab4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.609 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.611+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.612+0000 7f53ab4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.610 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.612+0000 7f53ab4bb800 20 searching for the correct realm 2024-09-14T11:39:10.613 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.614+0000 7f53a97a6640 0 -- 172.21.15.7:0/3060057824 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f539c0b2560 msgr2=0x7f539c0b13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.618+0000 7f53a87a4640 0 -- 172.21.15.7:0/3060057824 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f539804c950 msgr2=0x7f539802a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.824 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.825 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.826+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 zone default found 2024-09-14T11:39:10.826 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 4 Realm: () 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 zonegroup default 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.827+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.828+0000 7f53ab4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.828+0000 7f53ab4bb800 20 started sync module instance, tier type = 2024-09-14T11:39:10.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.828+0000 7f53ab4bb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.838+0000 7f53ab4bb800 20 add_watcher() i=0 2024-09-14T11:39:10.836 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.838+0000 7f53ab4bb800 20 add_watcher() i=1 2024-09-14T11:39:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.838+0000 7f53ab4bb800 20 add_watcher() i=2 2024-09-14T11:39:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.838+0000 7f53ab4bb800 20 add_watcher() i=3 2024-09-14T11:39:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.838+0000 7f53ab4bb800 20 add_watcher() i=4 2024-09-14T11:39:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.838+0000 7f53ab4bb800 20 add_watcher() i=5 2024-09-14T11:39:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.838+0000 7f53ab4bb800 20 add_watcher() i=6 2024-09-14T11:39:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.839+0000 7f53ab4bb800 20 add_watcher() i=7 2024-09-14T11:39:10.837 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.839+0000 7f53ab4bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.841+0000 7f525f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.841+0000 7f53ab4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.841+0000 7f53ab4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.841+0000 7f53ab4bb800 5 note: GC not initialized 2024-09-14T11:39:10.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.841+0000 7f525e7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:10.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.841+0000 7f53ab4bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.841+0000 7f53ab4bb800 20 Filter name: none 2024-09-14T11:39:10.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f52577fe640 20 reqs_thread_entry: start 2024-09-14T11:39:10.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f53ab4bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:10.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f53ab4bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f53ab4bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f53ab4bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f53ab4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.842+0000 7f53ab4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:10.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:10.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:10.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:10.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:10.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:10.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.843+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.844+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.844+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.844+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.844+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.844+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.844+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.845+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.845+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.845+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:10.844 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.845+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:10.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.845+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:10.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.845+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:10.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.846+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:10.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.846+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:10.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.846+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:10.845 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.846+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.847+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.847+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.847+0000 7f53ab4bb800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:10.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.847+0000 7f53ab4bb800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:10.847 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.848+0000 7f525f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.851+0000 7f53ab4bb800 20 remove_watcher() i=0 2024-09-14T11:39:10.849 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.851+0000 7f53ab4bb800 2 removed watcher, disabling cache 2024-09-14T11:39:10.850 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.852+0000 7f53ab4bb800 20 remove_watcher() i=1 2024-09-14T11:39:10.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.853+0000 7f53ab4bb800 20 remove_watcher() i=2 2024-09-14T11:39:10.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.854+0000 7f53ab4bb800 20 remove_watcher() i=3 2024-09-14T11:39:10.853 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.855+0000 7f53ab4bb800 20 remove_watcher() i=4 2024-09-14T11:39:10.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.856+0000 7f53ab4bb800 20 remove_watcher() i=5 2024-09-14T11:39:10.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.857+0000 7f53ab4bb800 20 remove_watcher() i=6 2024-09-14T11:39:10.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:10.858+0000 7f53ab4bb800 20 remove_watcher() i=7 2024-09-14T11:39:40.900 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:40.934 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:40.934 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:40.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.982+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 20 realm 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:40.982 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.984+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.985+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:40.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.985+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.986+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:40.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.986+0000 7f328a975800 20 searching for the correct realm 2024-09-14T11:39:40.985 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.988+0000 7f3287c5e640 0 -- 172.21.15.7:0/3449292648 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f327804e150 msgr2=0x7f3278061b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:40.989 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.992+0000 7f3287c5e640 0 -- 172.21.15.7:0/3449292648 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f3150087050 msgr2=0x7f3150089480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:40.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.998+0000 7f328a975800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:40.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.998+0000 7f328a975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:40.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.998+0000 7f328a975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:40.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.998+0000 7f328a975800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:40.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.998+0000 7f328a975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:40.996 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.998+0000 7f328a975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:40.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.998+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:40.997 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:40.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:40.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 zone default found 2024-09-14T11:39:40.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 4 Realm: () 2024-09-14T11:39:40.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:40.998 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 zonegroup default 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:40.999+0000 7f328a975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.000+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.000+0000 7f328a975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.000+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.000+0000 7f328a975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.000+0000 7f328a975800 20 started sync module instance, tier type = 2024-09-14T11:39:40.999 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.000+0000 7f328a975800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:41.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.010+0000 7f328a975800 20 add_watcher() i=0 2024-09-14T11:39:41.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.010+0000 7f328a975800 20 add_watcher() i=1 2024-09-14T11:39:41.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.010+0000 7f328a975800 20 add_watcher() i=2 2024-09-14T11:39:41.007 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.010+0000 7f328a975800 20 add_watcher() i=3 2024-09-14T11:39:41.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.010+0000 7f328a975800 20 add_watcher() i=4 2024-09-14T11:39:41.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.010+0000 7f328a975800 20 add_watcher() i=5 2024-09-14T11:39:41.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.010+0000 7f328a975800 20 add_watcher() i=6 2024-09-14T11:39:41.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.011+0000 7f328a975800 20 add_watcher() i=7 2024-09-14T11:39:41.008 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.011+0000 7f328a975800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.012+0000 7f313efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f328a975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f328a975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f328a975800 5 note: GC not initialized 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f313dfdb640 20 reqs_thread_entry: start 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f328a975800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f328a975800 20 Filter name: none 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f30af7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:41.011 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.013+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.014+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:41.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.014+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.015+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:41.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.015+0000 7f328a975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:41.012 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.015+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.015+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:41.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.015+0000 7f328a975800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.016+0000 7f328a975800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:41.013 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.016+0000 7f328a975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:41.015 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.018+0000 7f313efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:41.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.020+0000 7f328a975800 20 remove_watcher() i=0 2024-09-14T11:39:41.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.020+0000 7f328a975800 2 removed watcher, disabling cache 2024-09-14T11:39:41.019 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.021+0000 7f328a975800 20 remove_watcher() i=1 2024-09-14T11:39:41.020 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.022+0000 7f328a975800 20 remove_watcher() i=2 2024-09-14T11:39:41.021 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.023+0000 7f328a975800 20 remove_watcher() i=3 2024-09-14T11:39:41.022 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.024+0000 7f328a975800 20 remove_watcher() i=4 2024-09-14T11:39:41.023 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.026+0000 7f328a975800 20 remove_watcher() i=5 2024-09-14T11:39:41.024 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.027+0000 7f328a975800 20 remove_watcher() i=6 2024-09-14T11:39:41.025 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.027+0000 7f328a975800 20 remove_watcher() i=7 2024-09-14T11:39:41.039 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:41.039 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:39:41.061 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:39:41.090 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:41.090 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:41.130 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.132+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 20 realm 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.134+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.135+0000 7fc87de0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:41.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.135+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.136+0000 7fc87de0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:41.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.136+0000 7fc87de0e800 20 searching for the correct realm 2024-09-14T11:39:41.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.138+0000 7fc879ccc640 0 -- 172.21.15.7:0/3650760109 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc86406bc20 msgr2=0x7fc864069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:41.343 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.345+0000 7fc878cca640 0 -- 172.21.15.7:0/3650760109 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc86c03fb20 msgr2=0x7fc86c06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.552+0000 7fc87de0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.552+0000 7fc87de0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.552+0000 7fc87de0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.552+0000 7fc87de0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.552+0000 7fc87de0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.552+0000 7fc87de0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.553+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.553+0000 7fc87de0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.553+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.553+0000 7fc87de0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:41.552 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.553+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 zone default found 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 4 Realm: () 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 zonegroup default 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.553 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.554+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.555+0000 7fc87de0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.555+0000 7fc87de0e800 20 started sync module instance, tier type = 2024-09-14T11:39:41.554 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.555+0000 7fc87de0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:41.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.566+0000 7fc87de0e800 20 add_watcher() i=0 2024-09-14T11:39:41.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.566+0000 7fc87de0e800 20 add_watcher() i=1 2024-09-14T11:39:41.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.566+0000 7fc87de0e800 20 add_watcher() i=2 2024-09-14T11:39:41.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.566+0000 7fc87de0e800 20 add_watcher() i=3 2024-09-14T11:39:41.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.566+0000 7fc87de0e800 20 add_watcher() i=4 2024-09-14T11:39:41.563 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.566+0000 7fc87de0e800 20 add_watcher() i=5 2024-09-14T11:39:41.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.566+0000 7fc87de0e800 20 add_watcher() i=6 2024-09-14T11:39:41.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.567+0000 7fc87de0e800 20 add_watcher() i=7 2024-09-14T11:39:41.564 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.567+0000 7fc87de0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:41.566 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.569+0000 7fc72f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.569+0000 7fc87de0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.569+0000 7fc87de0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:41.567 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.569+0000 7fc87de0e800 5 note: GC not initialized 2024-09-14T11:39:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc72e7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 20 Filter name: none 2024-09-14T11:39:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc69ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:41.568 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.570+0000 7fc87de0e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:41.569 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:41.570 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.571+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.572+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.572+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.572+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.572+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.572+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.572+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.573+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.573+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.573+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:41.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.573+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:41.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.574+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:41.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.574+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:41.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.574+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:41.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.574+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:41.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.574+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:41.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.574+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:41.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.575+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:41.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.575+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:41.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.575+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:41.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.575+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:41.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.576+0000 7fc87de0e800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:41.573 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.576+0000 7fc87de0e800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:41.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.577+0000 7fc72f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.579+0000 7fc87de0e800 20 remove_watcher() i=0 2024-09-14T11:39:41.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.579+0000 7fc87de0e800 2 removed watcher, disabling cache 2024-09-14T11:39:41.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.581+0000 7fc87de0e800 20 remove_watcher() i=1 2024-09-14T11:39:41.579 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.582+0000 7fc87de0e800 20 remove_watcher() i=2 2024-09-14T11:39:41.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.583+0000 7fc87de0e800 20 remove_watcher() i=3 2024-09-14T11:39:41.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.584+0000 7fc87de0e800 20 remove_watcher() i=4 2024-09-14T11:39:41.582 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.585+0000 7fc87de0e800 20 remove_watcher() i=5 2024-09-14T11:39:41.583 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.586+0000 7fc87de0e800 20 remove_watcher() i=6 2024-09-14T11:39:41.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.587+0000 7fc87de0e800 20 remove_watcher() i=7 2024-09-14T11:39:41.598 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:41.627 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:41.627 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:41.667 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.670+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 20 realm 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.672+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.673+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:41.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.673+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:41.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.674+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:41.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.674+0000 7f7dd4213800 20 searching for the correct realm 2024-09-14T11:39:41.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.676+0000 7f7dd0149640 0 -- 172.21.15.7:0/36690159 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f7db80716c0 msgr2=0x7f7db8066f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:41.880 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:41.882+0000 7f7dcf147640 0 -- 172.21.15.7:0/36690159 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f7dc004a040 msgr2=0x7f7dc004b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:42.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.091+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 20 zone default found 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 4 Realm: () 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 20 zonegroup default 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.092+0000 7f7dd4213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.093+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.093+0000 7f7dd4213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.093+0000 7f7dd4213800 20 started sync module instance, tier type = 2024-09-14T11:39:42.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.093+0000 7f7dd4213800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:42.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.103+0000 7f7dd4213800 20 add_watcher() i=0 2024-09-14T11:39:42.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.103+0000 7f7dd4213800 20 add_watcher() i=1 2024-09-14T11:39:42.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.103+0000 7f7dd4213800 20 add_watcher() i=2 2024-09-14T11:39:42.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.103+0000 7f7dd4213800 20 add_watcher() i=3 2024-09-14T11:39:42.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.103+0000 7f7dd4213800 20 add_watcher() i=4 2024-09-14T11:39:42.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.103+0000 7f7dd4213800 20 add_watcher() i=5 2024-09-14T11:39:42.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.103+0000 7f7dd4213800 20 add_watcher() i=6 2024-09-14T11:39:42.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.104+0000 7f7dd4213800 20 add_watcher() i=7 2024-09-14T11:39:42.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.104+0000 7f7dd4213800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:42.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.106+0000 7f7c85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7dd4213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7dd4213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7dd4213800 5 note: GC not initialized 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7c84fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7dd4213800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7dd4213800 20 Filter name: none 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7bfe7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:42.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.107+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.108+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:42.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.108+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.108+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:42.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.108+0000 7f7dd4213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:42.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.108+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.109+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:42.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.109+0000 7f7dd4213800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.109+0000 7f7dd4213800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:42.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.109+0000 7f7dd4213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:42.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.111+0000 7f7c85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:42.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.114+0000 7f7dd4213800 20 remove_watcher() i=0 2024-09-14T11:39:42.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.114+0000 7f7dd4213800 2 removed watcher, disabling cache 2024-09-14T11:39:42.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.115+0000 7f7dd4213800 20 remove_watcher() i=1 2024-09-14T11:39:42.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.116+0000 7f7dd4213800 20 remove_watcher() i=2 2024-09-14T11:39:42.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.117+0000 7f7dd4213800 20 remove_watcher() i=3 2024-09-14T11:39:42.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.118+0000 7f7dd4213800 20 remove_watcher() i=4 2024-09-14T11:39:42.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.119+0000 7f7dd4213800 20 remove_watcher() i=5 2024-09-14T11:39:42.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.120+0000 7f7dd4213800 20 remove_watcher() i=6 2024-09-14T11:39:42.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.121+0000 7f7dd4213800 20 remove_watcher() i=7 2024-09-14T11:39:42.131 INFO:tasks.workunit.client.0.smithi007.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:39:42.133 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:42.163 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:42.163 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:42.205 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.207+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 20 realm 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.207 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.209+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.210+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:42.208 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.210+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.211+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:42.209 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.211+0000 7f10d0cbb800 20 searching for the correct realm 2024-09-14T11:39:42.210 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.213+0000 7f10cefa6640 0 -- 172.21.15.7:0/3178601985 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f10c401c8e0 msgr2=0x7f10c4003390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:42.417 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.420+0000 7f10cdfa4640 0 -- 172.21.15.7:0/3178601985 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f10c00cf6f0 msgr2=0x7f10c00b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:42.625 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.627+0000 7f10d0cbb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.627+0000 7f10d0cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.627+0000 7f10d0cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.627+0000 7f10d0cbb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.627+0000 7f10d0cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.627+0000 7f10d0cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.627+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.628+0000 7f10d0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.628+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.628+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.628+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 zone default found 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 4 Realm: () 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 zonegroup default 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.629+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.630+0000 7f10d0cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.630+0000 7f10d0cbb800 20 started sync module instance, tier type = 2024-09-14T11:39:42.629 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.630+0000 7f10d0cbb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:42.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.639+0000 7f10d0cbb800 20 add_watcher() i=0 2024-09-14T11:39:42.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.639+0000 7f10d0cbb800 20 add_watcher() i=1 2024-09-14T11:39:42.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.639+0000 7f10d0cbb800 20 add_watcher() i=2 2024-09-14T11:39:42.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.639+0000 7f10d0cbb800 20 add_watcher() i=3 2024-09-14T11:39:42.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.639+0000 7f10d0cbb800 20 add_watcher() i=4 2024-09-14T11:39:42.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.639+0000 7f10d0cbb800 20 add_watcher() i=5 2024-09-14T11:39:42.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.639+0000 7f10d0cbb800 20 add_watcher() i=6 2024-09-14T11:39:42.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.640+0000 7f10d0cbb800 20 add_watcher() i=7 2024-09-14T11:39:42.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.640+0000 7f10d0cbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:42.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.642+0000 7f0f84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.642+0000 7f10d0cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.642+0000 7f10d0cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.642+0000 7f10d0cbb800 5 note: GC not initialized 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.643+0000 7f0eff7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.643+0000 7f10d0cbb800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.643+0000 7f10d0cbb800 20 Filter name: none 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.643+0000 7f0efd7fa640 20 reqs_thread_entry: start 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.643+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.643+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:42.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.643+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.644+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:42.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.644+0000 7f10d0cbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:42.642 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.644+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.644+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:42.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.644+0000 7f10d0cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.645+0000 7f10d0cbb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:42.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.645+0000 7f10d0cbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:42.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.647+0000 7f0f84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:42.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.649+0000 7f10d0cbb800 20 remove_watcher() i=0 2024-09-14T11:39:42.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.649+0000 7f10d0cbb800 2 removed watcher, disabling cache 2024-09-14T11:39:42.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.650+0000 7f10d0cbb800 20 remove_watcher() i=1 2024-09-14T11:39:42.649 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.651+0000 7f10d0cbb800 20 remove_watcher() i=2 2024-09-14T11:39:42.650 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.652+0000 7f10d0cbb800 20 remove_watcher() i=3 2024-09-14T11:39:42.651 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.653+0000 7f10d0cbb800 20 remove_watcher() i=4 2024-09-14T11:39:42.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.654+0000 7f10d0cbb800 20 remove_watcher() i=5 2024-09-14T11:39:42.653 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.655+0000 7f10d0cbb800 20 remove_watcher() i=6 2024-09-14T11:39:42.654 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.656+0000 7f10d0cbb800 20 remove_watcher() i=7 2024-09-14T11:39:42.665 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:42.665 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:39:42.665 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:39:42.665 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:42.667 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:39:42.702 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:42.702 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:42.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.744+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 20 realm 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:42.744 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.747+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:42.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.747+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:42.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.748+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:42.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.748+0000 7f53c3542800 20 searching for the correct realm 2024-09-14T11:39:42.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.750+0000 7f53bfaee640 0 -- 172.21.15.7:0/2380725695 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f53a8044070 msgr2=0x7f53a8044960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:42.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:42.956+0000 7f53beaec640 0 -- 172.21.15.7:0/2380725695 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f53b008b040 msgr2=0x7f53b006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:43.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:43.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:43.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:43.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:43.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:43.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:43.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.164+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:43.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 zone default found 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 4 Realm: () 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 zonegroup default 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.167+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.167+0000 7f53c3542800 20 started sync module instance, tier type = 2024-09-14T11:39:43.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.167+0000 7f53c3542800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:43.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=0 2024-09-14T11:39:43.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=1 2024-09-14T11:39:43.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=2 2024-09-14T11:39:43.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=3 2024-09-14T11:39:43.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=4 2024-09-14T11:39:43.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=5 2024-09-14T11:39:43.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=6 2024-09-14T11:39:43.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=7 2024-09-14T11:39:43.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.177+0000 7f53c3542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:43.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.180+0000 7f5275fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:43.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.180+0000 7f53c3542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:43.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.180+0000 7f53c3542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:43.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.180+0000 7f53c3542800 5 note: GC not initialized 2024-09-14T11:39:43.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.180+0000 7f5274fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:43.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.180+0000 7f53c3542800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:43.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 20 Filter name: none 2024-09-14T11:39:43.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f51ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.182+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.182+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.182+0000 7f53c3542800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.182+0000 7f53c3542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.182+0000 7f53c3542800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.182+0000 7f53c3542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:43.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f53c3542800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f53c3542800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f53c3542800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:39:43.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529798 cookie 94540485752032 notifier 7781 bl.length()=911 2024-09-14T11:39:43.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:39:43.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:39:43.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:39:43.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:39:43.193 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f53c3542800 time 2024-09-14T11:39:43.196225+0000 2024-09-14T11:39:43.193 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:43.193 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f53c4d8c76a] 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.196+0000 7f53c3542800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f53c3542800 time 2024-09-14T11:39:43.196225+0000 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.194 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f53c4d8c76a] 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:39:43.195 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f53c3542800 thread_name:radosgw-admin 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53c3a3e6f0] 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f53c3a8b99c] 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f53c4d8c7c4] 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.213 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.197+0000 7f53c3542800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f53c3542800 thread_name:radosgw-admin 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53c3a3e6f0] 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f53c3a8b99c] 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f53c4d8c7c4] 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.214 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:39:42.726+0000 7f53c3542800 5 monclient: authenticate success, global_id 8187 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:39:42.726+0000 7f53c3542800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:39:42.726+0000 7f53c3542800 4 set_mon_vals no callback set 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.215 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: dump: 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: shutdown 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 asok(0x55fbebdfb270) unregister_commands rotate-key 2024-09-14T11:39:43.216 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding auth protocol: cephx 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding auth protocol: cephx 2024-09-14T11:39:43.217 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding auth protocol: cephx 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:39:42.727+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: starting msgr at 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: starting objecter 2024-09-14T11:39:43.218 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command objecter_requests hook 0x55fbec020910 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: setting wanted keys 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: calling monclient init 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding auth protocol: cephx 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding auth protocol: cephx 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding auth protocol: cephx 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.219 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:39:42.728+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:39:42.728+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:39:42.728+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key hook 0x55fbec01b578 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbebe93a60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbebec82a0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbebf5ded0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.220 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.284408s 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbebe93a60 auth_method 0 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbebec82a0 auth_method 0 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.221 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbebf5ded0 auth_method 0 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 1 monclient: found mon.noname-c 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: dump: 2024-09-14T11:39:43.222 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:39:42.729+0000 7f53c3542800 5 monclient: authenticate success, global_id 7772 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.223 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: dump: 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.224 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:39:42.729+0000 7f52ad60a640 4 set_mon_vals no callback set 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:39:42.729+0000 7f53c3542800 1 librados: init done 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:39:42.731+0000 7f52abe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:39:42.731+0000 7f52abe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:39:42.731+0000 7f52abe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:39:42.731+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f52a4077230 auth_method 0 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:39:42.731+0000 7f53bfaee640 10 monclient: get_auth_request con 0x55fbec05d5e0 auth_method 0 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:39:42.732+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x55fbec066db0 auth_method 0 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:39:42.733+0000 7f53beaec640 10 monclient: get_auth_request con 0x55fbec06b110 auth_method 0 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:39:42.734+0000 7f53bfaee640 10 monclient: get_auth_request con 0x55fbec06a630 auth_method 0 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:39:42.735+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.225 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:39:42.735+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:39:42.735+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding auth protocol: cephx 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding auth protocol: cephx 2024-09-14T11:39:43.226 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding auth protocol: cephx 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:39:42.735+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.227 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command objecter_requests cmddesc objecter_requests hook 0x55fbec0767c0 EEXIST 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:39:42.735+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding auth protocol: cephx 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding auth protocol: cephx 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding auth protocol: cephx 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.228 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:39:42.735+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:39:42.736+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:39:42.736+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key cmddesc rotate-key hook 0x55fbec072220 EEXIST 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbec09aae0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbec09aec0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbec0997f0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.229 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.292310s 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbec09aae0 auth_method 0 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbec09aec0 auth_method 0 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.230 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbec0997f0 auth_method 0 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:39:42.736+0000 7f53bfaee640 1 monclient: found mon.noname-c 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:43.231 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: dump: 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.232 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: dump: 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.233 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:39:42.737+0000 7f53c3542800 5 monclient: authenticate success, global_id 7775 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:39:42.737+0000 7f53c02ef640 4 set_mon_vals no callback set 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:39:42.738+0000 7f52a9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:39:42.738+0000 7f52a9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:39:42.738+0000 7f52a9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: get_monmap_and_config 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:39:42.739+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.234 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding auth protocol: cephx 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding auth protocol: cephx 2024-09-14T11:39:43.235 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding auth protocol: cephx 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.236 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:39:42.739+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f5298077140 auth_method 0 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:39:42.739+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding auth protocol: cephx 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding auth protocol: cephx 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding auth protocol: cephx 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.237 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:39:42.739+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:39:42.740+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:39:42.740+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key cmddesc rotate-key hook 0x7fff36efa648 EEXIST 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbec0eee70 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbec0bb810 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbec0ea710 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.238 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.296292s 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbec0eee70 auth_method 0 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbec0bb810 auth_method 0 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.239 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbec0ea710 auth_method 0 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_done global_id 8196 payload 274 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:39:42.740+0000 7f53beaec640 1 monclient: found mon.noname-a 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:39:42.740+0000 7f52a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.240 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: dump: 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.241 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 monclient: authenticate success, global_id 8196 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:39:42.741+0000 7f53c3542800 4 set_mon_vals no callback set 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: dump: 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.242 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: shutdown 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:39:42.741+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.243 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding auth protocol: cephx 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding auth protocol: cephx 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding auth protocol: cephx 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.244 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:39:42.741+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:39:42.741+0000 7f53c3542800 1 librados: starting msgr at 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:39:42.741+0000 7f53c3542800 1 librados: starting objecter 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command objecter_requests cmddesc objecter_requests hook 0x55fbec0bf0c0 EEXIST 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:39:42.742+0000 7f53c3542800 1 librados: setting wanted keys 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:39:42.742+0000 7f53c3542800 1 librados: calling monclient init 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.245 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding auth protocol: cephx 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding auth protocol: cephx 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding auth protocol: cephx 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.246 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:39:42.742+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:39:42.742+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key cmddesc rotate-key hook 0x55fbec0af4e8 EEXIST 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbec0bb810 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbec0ea710 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbec0eee70 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.247 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.298611s 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbec0ea710 auth_method 0 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbec0eee70 auth_method 0 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.248 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbec0bb810 auth_method 0 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:39:42.742+0000 7f53bfaee640 1 monclient: found mon.noname-c 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: dump: 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.249 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:39:42.743+0000 7f53c3542800 5 monclient: authenticate success, global_id 7781 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.250 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: dump: 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:39:42.743+0000 7f52a2ffd640 4 set_mon_vals no callback set 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.251 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:39:42.743+0000 7f53c3542800 1 librados: init done 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:39:42.743+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cr dump hook 0x55fbec0e0178 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:39:42.744+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:39:42.745+0000 7f52a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:39:42.745+0000 7f52a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:39:42.745+0000 7f52a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:39:42.745+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f5288077230 auth_method 0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:39:42.745+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x55fbec109480 auth_method 0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 realm 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:39:42.746+0000 7f53c3542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.252 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:39:42.747+0000 7f53beaec640 10 monclient: get_auth_request con 0x55fbec10d6e0 auth_method 0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:39:42.747+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:39:42.747+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:39:42.748+0000 7f53bfaee640 10 monclient: get_auth_request con 0x55fbec110f60 auth_method 0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:39:42.748+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:39:42.748+0000 7f53c3542800 20 searching for the correct realm 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:39:42.748+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x55fbec115d20 auth_method 0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:39:42.749+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f53b0062060 auth_method 0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:39:42.750+0000 7f53bfaee640 10 monclient: get_auth_request con 0x7f53a8044070 auth_method 0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:39:42.750+0000 7f53bfaee640 0 -- 172.21.15.7:0/2380725695 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f53a8044070 msgr2=0x7f53a8044960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:39:42.951+0000 7f53bfaee640 10 monclient: get_auth_request con 0x7f53a8044070 auth_method 0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:39:42.952+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x7f53b80ad050 auth_method 0 2024-09-14T11:39:43.253 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:39:42.956+0000 7f53beaec640 0 -- 172.21.15.7:0/2380725695 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f53b008b040 msgr2=0x7f53b006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:39:43.158+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f53b008b040 auth_method 0 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 zone default found 2024-09-14T11:39:43.254 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:39:43.165+0000 7f53c3542800 4 Realm: () 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:39:43.165+0000 7f53c3542800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:39:43.165+0000 7f53c3542800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:39:43.165+0000 7f53c3542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 zonegroup default 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:39:43.167+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:39:43.167+0000 7f53c3542800 20 started sync module instance, tier type = 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:39:43.167+0000 7f53c3542800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=0 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=1 2024-09-14T11:39:43.255 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=2 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=3 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=4 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=5 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=6 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=7 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:39:43.177+0000 7f53c3542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding auth protocol: cephx 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding auth protocol: cephx 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding auth protocol: cephx 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.256 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:39:43.180+0000 7f5275fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:39:43.180+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:39:43.180+0000 7f53c3542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:39:43.180+0000 7f53c3542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache list hook 0x55fbec0df020 2024-09-14T11:39:43.257 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache inspect hook 0x55fbec0df020 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache erase hook 0x55fbec0df020 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache zap hook 0x55fbec0df020 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 note: GC not initialized 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:39:43.180+0000 7f5274fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace show hook 0x7f53a8029870 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace history hook 0x7f53a8029870 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace active hook 0x7f53a8029870 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace active_short hook 0x7f53a8029870 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:39:43.180+0000 7f53c3542800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 Filter name: none 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:39:43.181+0000 7f51ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.258 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:39:43.182+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.259 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529798 cookie 94540485752032 notifier 7781 bl.length()=911 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:39:43.196+0000 7f53c3542800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f53c3542800 time 2024-09-14T11:39:43.196225+0000 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.260 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f53c4d8c76a] 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:39:43.197+0000 7f53c3542800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f53c3542800 thread_name:radosgw-admin 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.261 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53c3a3e6f0] 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f53c3a8b99c] 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f53c4d8c7c4] 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.262 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:39:43.263 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:39:43.264 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:43.265 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:39:43.266 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:43.267 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:43.268 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 7f51ee7fc640 / http_manager 2024-09-14T11:39:43.269 INFO:tasks.workunit.client.0.smithi007.stderr: 7f5274fe1640 / http_manager 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f5275fe3640 / rgw_dt_lg_renew 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a17fa640 / ms_dispatch 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a27fc640 / io_context_pool 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a2ffd640 / io_context_pool 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a9602640 / ms_dispatch 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52abe07640 / ms_dispatch 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52ad60a640 / io_context_pool 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53beaec640 / msgr-worker-2 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53bf2ed640 / msgr-worker-1 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53bfaee640 / msgr-worker-0 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53c02ef640 / io_context_pool 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53c3542800 / radosgw-admin 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:39:43.270 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.150431.log 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:39:42.726+0000 7f53c3542800 5 monclient: authenticate success, global_id 8187 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:39:42.726+0000 7f53c3542800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:39:42.726+0000 7f53c3542800 4 set_mon_vals no callback set 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:39:42.726+0000 7f52ad60a640 10 monclient: dump: 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.271 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: shutdown 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 asok(0x55fbebdfb270) unregister_commands rotate-key 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.272 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding auth protocol: cephx 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding auth protocol: cephx 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding auth protocol: cephx 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.273 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: crc 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01ea10) adding con mode: secure 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:39:42.727+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: starting msgr at 2024-09-14T11:39:43.274 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: starting objecter 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command objecter_requests hook 0x55fbec020910 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: setting wanted keys 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:39:42.727+0000 7f53c3542800 1 librados: calling monclient init 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:39:42.727+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding auth protocol: cephx 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding auth protocol: cephx 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding auth protocol: cephx 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.275 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: crc 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:39:42.727+0000 7f53c3542800 5 AuthRegistry(0x55fbec01b430) adding con mode: secure 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:39:42.728+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:39:42.728+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:39:42.728+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key hook 0x55fbec01b578 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbebe93a60 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbebec82a0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbebf5ded0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.276 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:39:42.728+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.284408s 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbebe93a60 auth_method 0 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbebec82a0 auth_method 0 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.277 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:39:42.728+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbebf5ded0 auth_method 0 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:39:42.728+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 1 monclient: found mon.noname-c 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:39:42.728+0000 7f53bf2ed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.278 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: dump: 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:39:42.729+0000 7f53c3542800 5 monclient: authenticate success, global_id 7772 2024-09-14T11:39:43.279 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:39:42.729+0000 7f52abe07640 10 monclient: dump: 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.280 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:39:42.729+0000 7f52ad60a640 4 set_mon_vals no callback set 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:39:42.729+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:39:42.729+0000 7f53c3542800 1 librados: init done 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:39:42.731+0000 7f52abe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:39:42.731+0000 7f52abe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:39:42.731+0000 7f52abe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:39:42.731+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f52a4077230 auth_method 0 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:39:42.731+0000 7f53bfaee640 10 monclient: get_auth_request con 0x55fbec05d5e0 auth_method 0 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:39:42.732+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x55fbec066db0 auth_method 0 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:39:42.733+0000 7f53beaec640 10 monclient: get_auth_request con 0x55fbec06b110 auth_method 0 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:39:42.734+0000 7f53bfaee640 10 monclient: get_auth_request con 0x55fbec06a630 auth_method 0 2024-09-14T11:39:43.281 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:39:42.735+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:39:42.735+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:39:42.735+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding auth protocol: cephx 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding auth protocol: cephx 2024-09-14T11:39:43.282 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding auth protocol: cephx 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: crc 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0732d0) adding con mode: secure 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:39:42.735+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.283 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command objecter_requests cmddesc objecter_requests hook 0x55fbec0767c0 EEXIST 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:39:42.735+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding auth protocol: cephx 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding auth protocol: cephx 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding auth protocol: cephx 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.284 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: crc 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:39:42.735+0000 7f53c3542800 5 AuthRegistry(0x55fbec0720d8) adding con mode: secure 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:39:42.735+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:39:42.736+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:39:42.736+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key cmddesc rotate-key hook 0x55fbec072220 EEXIST 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbec09aae0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbec09aec0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbec0997f0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.285 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:39:42.736+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.292310s 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbec09aae0 auth_method 0 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbec09aec0 auth_method 0 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:39:42.736+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.286 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbec0997f0 auth_method 0 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:39:42.736+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:39:42.736+0000 7f53bfaee640 1 monclient: found mon.noname-c 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:39:42.736+0000 7f53bfaee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.287 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: dump: 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.288 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:39:42.737+0000 7f52a9602640 10 monclient: dump: 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.289 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:39:42.737+0000 7f53c3542800 5 monclient: authenticate success, global_id 7775 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:39:42.737+0000 7f53c02ef640 4 set_mon_vals no callback set 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:39:42.737+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:39:42.738+0000 7f52a9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:39:42.738+0000 7f52a9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:39:42.738+0000 7f52a9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: get_monmap_and_config 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:39:42.739+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.290 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding auth protocol: cephx 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding auth protocol: cephx 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding auth protocol: cephx 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.291 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: crc 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x55fbec0ba830) adding con mode: secure 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:39:42.739+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f5298077140 auth_method 0 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:39:42.739+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:39:42.739+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.292 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding auth protocol: cephx 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding auth protocol: cephx 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding auth protocol: cephx 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: crc 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:39:42.739+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa500) adding con mode: secure 2024-09-14T11:39:43.293 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:39:42.739+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:39:42.740+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:39:42.740+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key cmddesc rotate-key hook 0x7fff36efa648 EEXIST 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbec0eee70 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbec0bb810 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbec0ea710 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:39:42.740+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.296292s 2024-09-14T11:39:43.294 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbec0eee70 auth_method 0 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbec0bb810 auth_method 0 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:39:42.740+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbec0ea710 auth_method 0 2024-09-14T11:39:43.295 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:39:42.740+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient(hunting): handle_auth_done global_id 8196 payload 274 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:39:42.740+0000 7f53beaec640 1 monclient: found mon.noname-a 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:39:42.740+0000 7f53beaec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:39:42.740+0000 7f52a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: dump: 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.296 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 monclient: authenticate success, global_id 8196 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:39:42.741+0000 7f53c3542800 4 set_mon_vals no callback set 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:43.297 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:39:42.741+0000 7f52a2ffd640 10 monclient: dump: 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: shutdown 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: build_initial_monmap 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:39:42.741+0000 7f53c3542800 1 build_initial for_mkfs: 0 2024-09-14T11:39:43.298 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:39:42.741+0000 7f53c3542800 10 monclient: monmap: 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding auth protocol: cephx 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding auth protocol: cephx 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding auth protocol: cephx 2024-09-14T11:39:43.299 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: crc 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 AuthRegistry(0x55fbec0df8f0) adding con mode: secure 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:39:42.741+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.300 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:39:42.741+0000 7f53c3542800 1 librados: starting msgr at 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:39:42.741+0000 7f53c3542800 1 librados: starting objecter 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:39:42.741+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command objecter_requests cmddesc objecter_requests hook 0x55fbec0bf0c0 EEXIST 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:39:42.742+0000 7f53c3542800 1 librados: setting wanted keys 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:39:42.742+0000 7f53c3542800 1 librados: calling monclient init 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient: init 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding auth protocol: cephx 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding auth protocol: cephx 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding auth protocol: cephx 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.301 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: crc 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 AuthRegistry(0x55fbec0af3a0) adding con mode: secure 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:39:42.742+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:39:42.742+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:39:42.742+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command rotate-key cmddesc rotate-key hook 0x55fbec0af4e8 EEXIST 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-b con 0x55fbec0bb810 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-c con 0x55fbec0ea710 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:39:43.302 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): picked mon.noname-a con 0x55fbec0eee70 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:39:42.742+0000 7f53c3542800 10 monclient(hunting): authenticate will time out at 2283.298611s 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): get_auth_request con 0x55fbec0ea710 auth_method 0 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request con 0x55fbec0eee70 auth_method 0 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.303 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:39:42.742+0000 7f53bf2ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): get_auth_request con 0x55fbec0bb810 auth_method 0 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:39:42.742+0000 7f53beaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient: _finish_hunting 0 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:39:42.742+0000 7f53bfaee640 1 monclient: found mon.noname-c 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:39:42.742+0000 7f53bfaee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.304 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: dump: 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: _finish_auth 0 2024-09-14T11:39:43.305 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:39:42.743+0000 7f53c3542800 5 monclient: authenticate success, global_id 7781 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:39:42.743+0000 7f52a17fa640 10 monclient: dump: 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:43.306 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:39:42.743+0000 7f52a2ffd640 4 set_mon_vals no callback set 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _renew_subs 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:39:42.743+0000 7f53c3542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:39:42.743+0000 7f53c3542800 1 librados: init done 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:39:42.743+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cr dump hook 0x55fbec0e0178 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:39:42.744+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:39:42.745+0000 7f52a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:39:42.745+0000 7f52a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:39:42.745+0000 7f52a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:39:43.307 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:39:42.745+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f5288077230 auth_method 0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:39:42.745+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x55fbec109480 auth_method 0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 realm 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:39:42.746+0000 7f53c3542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:39:42.746+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:39:42.747+0000 7f53beaec640 10 monclient: get_auth_request con 0x55fbec10d6e0 auth_method 0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:39:42.747+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:39:42.747+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:39:42.748+0000 7f53bfaee640 10 monclient: get_auth_request con 0x55fbec110f60 auth_method 0 2024-09-14T11:39:43.308 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:39:42.748+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:39:42.748+0000 7f53c3542800 20 searching for the correct realm 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:39:42.748+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x55fbec115d20 auth_method 0 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:39:42.749+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f53b0062060 auth_method 0 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:39:42.750+0000 7f53bfaee640 10 monclient: get_auth_request con 0x7f53a8044070 auth_method 0 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:39:42.750+0000 7f53bfaee640 0 -- 172.21.15.7:0/2380725695 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f53a8044070 msgr2=0x7f53a8044960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:39:42.951+0000 7f53bfaee640 10 monclient: get_auth_request con 0x7f53a8044070 auth_method 0 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:39:42.952+0000 7f53bf2ed640 10 monclient: get_auth_request con 0x7f53b80ad050 auth_method 0 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:39:42.956+0000 7f53beaec640 0 -- 172.21.15.7:0/2380725695 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f53b008b040 msgr2=0x7f53b006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:39:43.158+0000 7f53beaec640 10 monclient: get_auth_request con 0x7f53b008b040 auth_method 0 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:43.309 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:39:43.164+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 zone default found 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:39:43.165+0000 7f53c3542800 4 Realm: () 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:39:43.165+0000 7f53c3542800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:39:43.165+0000 7f53c3542800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:39:43.165+0000 7f53c3542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 zonegroup default 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:39:43.165+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.310 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:39:43.166+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:39:43.167+0000 7f53c3542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:39:43.167+0000 7f53c3542800 20 started sync module instance, tier type = 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:39:43.167+0000 7f53c3542800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=0 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=1 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=2 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=3 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=4 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=5 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=6 2024-09-14T11:39:43.311 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:39:43.177+0000 7f53c3542800 20 add_watcher() i=7 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:39:43.177+0000 7f53c3542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding auth protocol: cephx 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding auth protocol: cephx 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding auth protocol: cephx 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.312 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: crc 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 AuthRegistry(0x7fff36efa9e0) adding con mode: secure 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:39:43.180+0000 7f5275fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:39:43.180+0000 7f53c3542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:39:43.180+0000 7f53c3542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:39:43.180+0000 7f53c3542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache list hook 0x55fbec0df020 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache inspect hook 0x55fbec0df020 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache erase hook 0x55fbec0df020 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command cache zap hook 0x55fbec0df020 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 note: GC not initialized 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:39:43.180+0000 7f5274fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace show hook 0x7f53a8029870 2024-09-14T11:39:43.313 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace history hook 0x7f53a8029870 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace active hook 0x7f53a8029870 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:39:43.180+0000 7f53c3542800 5 asok(0x55fbebdfb270) register_command sync trace active_short hook 0x7f53a8029870 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:39:43.180+0000 7f53c3542800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 Filter name: none 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:39:43.181+0000 7f51ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:39:43.181+0000 7f53c3542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:39:43.181+0000 7f53c3542800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:39:43.182+0000 7f53c3542800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:43.314 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:39:43.182+0000 7f53c3542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:39:43.188+0000 7f53c3542800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529798 cookie 94540485752032 notifier 7781 bl.length()=911 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:39:43.188+0000 7f52a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:39:43.315 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:39:43.189+0000 7f53c3542800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:39:43.196+0000 7f53c3542800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f53c3542800 time 2024-09-14T11:39:43.196225+0000 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f53c4d8c76a] 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.316 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:39:43.197+0000 7f53c3542800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f53c3542800 thread_name:radosgw-admin 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f53c3a3e6f0] 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f53c3a8b99c] 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f53c4d8c7c4] 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f53c4d8c928] 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fbe9b7e0b1] 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55fbe9b8df6a] 2024-09-14T11:39:43.317 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f53c3a29590] 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:39:43.318 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:43.319 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:39:43.320 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:39:43.321 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:39:43.322 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:43.323 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 7f51ee7fc640 / http_manager 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 7f5274fe1640 / http_manager 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 7f5275fe3640 / rgw_dt_lg_renew 2024-09-14T11:39:43.324 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a17fa640 / ms_dispatch 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a27fc640 / io_context_pool 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a2ffd640 / io_context_pool 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52a9602640 / ms_dispatch 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52abe07640 / ms_dispatch 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f52ad60a640 / io_context_pool 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53beaec640 / msgr-worker-2 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53bf2ed640 / msgr-worker-1 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53bfaee640 / msgr-worker-0 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53c02ef640 / io_context_pool 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: 7f53c3542800 / radosgw-admin 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:39:43.197658Z_1d70c973-b71c-4e2e-81e1-3d92fba94a9a/log 2024-09-14T11:39:43.325 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:39:43.326 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.277+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.279+0000 7f000010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.279+0000 7f000010c800 20 realm 2024-09-14T11:39:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.279+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.327 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.279+0000 7f000010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.279+0000 7f000010c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.279+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.280+0000 7f000010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.280+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.281+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.281+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.281+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.281+0000 7f000010c800 20 searching for the correct realm 2024-09-14T11:39:43.328 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.284+0000 7efffdbf6640 0 -- 172.21.15.7:0/1426240101 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efff8074030 msgr2=0x7efff80693c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:43.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.491+0000 7efffdbf6640 0 -- 172.21.15.7:0/1426240101 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7efff8074030 msgr2=0x7efff80693c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.496+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 zone default found 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 4 Realm: () 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 zonegroup default 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.497+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.498+0000 7f000010c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.498+0000 7f000010c800 20 started sync module instance, tier type = 2024-09-14T11:39:43.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.498+0000 7f000010c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:43.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.507+0000 7f000010c800 20 add_watcher() i=0 2024-09-14T11:39:43.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.507+0000 7f000010c800 20 add_watcher() i=1 2024-09-14T11:39:43.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.507+0000 7f000010c800 20 add_watcher() i=2 2024-09-14T11:39:43.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.507+0000 7f000010c800 20 add_watcher() i=3 2024-09-14T11:39:43.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.507+0000 7f000010c800 20 add_watcher() i=4 2024-09-14T11:39:43.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.507+0000 7f000010c800 20 add_watcher() i=5 2024-09-14T11:39:43.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.507+0000 7f000010c800 20 add_watcher() i=6 2024-09-14T11:39:43.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.508+0000 7f000010c800 20 add_watcher() i=7 2024-09-14T11:39:43.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.508+0000 7f000010c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:43.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.510+0000 7efeaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7f000010c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7f000010c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7f000010c800 5 note: GC not initialized 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7efeae7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7f000010c800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7f000010c800 20 Filter name: none 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7efe1ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:43.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.511+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.512+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:43.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.512+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.512+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:43.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.512+0000 7f000010c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:43.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.512+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.513+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:43.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.513+0000 7f000010c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.513+0000 7f000010c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:43.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.513+0000 7f000010c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:43.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.515+0000 7efeaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:43.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.517+0000 7f000010c800 20 remove_watcher() i=0 2024-09-14T11:39:43.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.517+0000 7f000010c800 2 removed watcher, disabling cache 2024-09-14T11:39:43.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.518+0000 7f000010c800 20 remove_watcher() i=1 2024-09-14T11:39:43.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.520+0000 7f000010c800 20 remove_watcher() i=2 2024-09-14T11:39:43.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.521+0000 7f000010c800 20 remove_watcher() i=3 2024-09-14T11:39:43.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.522+0000 7f000010c800 20 remove_watcher() i=4 2024-09-14T11:39:43.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.523+0000 7f000010c800 20 remove_watcher() i=5 2024-09-14T11:39:43.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.524+0000 7f000010c800 20 remove_watcher() i=6 2024-09-14T11:39:43.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.525+0000 7f000010c800 20 remove_watcher() i=7 2024-09-14T11:39:43.536 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:43.536 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:39:43.544 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:39:43.574 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:43.574 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:43.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.616+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.617+0000 7f4438014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.617+0000 7f4438014800 20 realm 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.617+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.618+0000 7f4438014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.618+0000 7f4438014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.618+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.618+0000 7f4438014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:43.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.618+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.619+0000 7f4438014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:43.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.619+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:43.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.620+0000 7f4438014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:43.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.620+0000 7f4438014800 20 searching for the correct realm 2024-09-14T11:39:43.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.622+0000 7f4433ecc640 0 -- 172.21.15.7:0/56536444 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f441c085080 msgr2=0x7f441c020940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:43.827 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:43.829+0000 7f4432eca640 0 -- 172.21.15.7:0/56536444 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f44240155f0 msgr2=0x7f4424015a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:44.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.036+0000 7f4438014800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:39:44.034 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.036+0000 7f4438014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:44.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.036+0000 7f4438014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:44.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.036+0000 7f4438014800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:39:44.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.036+0000 7f4438014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:44.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.036+0000 7f4438014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:44.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.036+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.035 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:44.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:44.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 zone default found 2024-09-14T11:39:44.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 4 Realm: () 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 zonegroup default 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.037+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.038+0000 7f4438014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.038+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.038+0000 7f4438014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.038+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.038+0000 7f4438014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.038+0000 7f4438014800 20 started sync module instance, tier type = 2024-09-14T11:39:44.037 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.038+0000 7f4438014800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.049+0000 7f4438014800 20 add_watcher() i=0 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.049+0000 7f4438014800 20 add_watcher() i=1 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.049+0000 7f4438014800 20 add_watcher() i=2 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.049+0000 7f4438014800 20 add_watcher() i=3 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.049+0000 7f4438014800 20 add_watcher() i=4 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.049+0000 7f4438014800 20 add_watcher() i=5 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.049+0000 7f4438014800 20 add_watcher() i=6 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.050+0000 7f4438014800 20 add_watcher() i=7 2024-09-14T11:39:44.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.050+0000 7f4438014800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:44.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.052+0000 7f42ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.052+0000 7f4438014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.052+0000 7f4438014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.052+0000 7f4438014800 5 note: GC not initialized 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.053+0000 7f42e97e2640 20 reqs_thread_entry: start 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.053+0000 7f4438014800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.053+0000 7f4438014800 20 Filter name: none 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.053+0000 7f42e27fc640 20 reqs_thread_entry: start 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.053+0000 7f4438014800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:44.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.053+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:44.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:44.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:44.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:39:44.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:44.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.054+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.055+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.055+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.055+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.055+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.055+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.055+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.056+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.056+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:39:44.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.056+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:44.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.056+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:39:44.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.057+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:44.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.057+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:39:44.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.057+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:44.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.057+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:39:44.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.058+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:44.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.058+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:39:44.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.058+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:44.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.058+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:39:44.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.058+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:44.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.058+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:39:44.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.059+0000 7f4438014800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:44.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.059+0000 7f4438014800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:39:44.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.060+0000 7f42ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:44.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.063+0000 7f4438014800 20 remove_watcher() i=0 2024-09-14T11:39:44.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.063+0000 7f4438014800 2 removed watcher, disabling cache 2024-09-14T11:39:44.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.064+0000 7f4438014800 20 remove_watcher() i=1 2024-09-14T11:39:44.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.065+0000 7f4438014800 20 remove_watcher() i=2 2024-09-14T11:39:44.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.066+0000 7f4438014800 20 remove_watcher() i=3 2024-09-14T11:39:44.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.067+0000 7f4438014800 20 remove_watcher() i=4 2024-09-14T11:39:44.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.068+0000 7f4438014800 20 remove_watcher() i=5 2024-09-14T11:39:44.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.069+0000 7f4438014800 20 remove_watcher() i=6 2024-09-14T11:39:44.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:39:44.070+0000 7f4438014800 20 remove_watcher() i=7 2024-09-14T11:40:14.113 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:40:14.151 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:14.151 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:14.196 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.198+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.199+0000 7f26eb60e800 20 realm 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.199+0000 7f26eb60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.200+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.198 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.200+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.199 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.201+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:14.200 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.201+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.202+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:14.201 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.202+0000 7f26eb60e800 20 searching for the correct realm 2024-09-14T11:40:14.202 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.204+0000 7f26e74cc640 0 -- 172.21.15.7:0/305095572 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f26dc035030 msgr2=0x7f26dc084930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:14.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.411+0000 7f26e64ca640 0 -- 172.21.15.7:0/305095572 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f26d809a040 msgr2=0x7f26d8077930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:14.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:14.619 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 20 zone default found 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 4 Realm: () 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 20 zonegroup default 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.620 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.621+0000 7f26eb60e800 20 started sync module instance, tier type = 2024-09-14T11:40:14.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.621+0000 7f26eb60e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:14.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.632+0000 7f26eb60e800 20 add_watcher() i=0 2024-09-14T11:40:14.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=1 2024-09-14T11:40:14.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=2 2024-09-14T11:40:14.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=3 2024-09-14T11:40:14.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=4 2024-09-14T11:40:14.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=5 2024-09-14T11:40:14.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=6 2024-09-14T11:40:14.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.634+0000 7f26eb60e800 20 add_watcher() i=7 2024-09-14T11:40:14.632 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.634+0000 7f26eb60e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:14.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.636+0000 7f259dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:14.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.636+0000 7f26eb60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:14.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.636+0000 7f26eb60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:14.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.636+0000 7f26eb60e800 5 note: GC not initialized 2024-09-14T11:40:14.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.636+0000 7f259cfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:14.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.636+0000 7f26eb60e800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:14.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.636+0000 7f26eb60e800 20 Filter name: none 2024-09-14T11:40:14.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f2595ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:14.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:14.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:14.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:14.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f26eb60e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:14.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:14.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.638+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:14.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.638+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.638+0000 7f26eb60e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.638+0000 7f26eb60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:14.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.638+0000 7f26eb60e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.638+0000 7f26eb60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:14.638 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.639+0000 7f26eb60e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:14.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.647+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.647+0000 7f26eb60e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.647+0000 7f26eb60e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.647+0000 7f26eb60e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:40:14.646 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529799 cookie 93885431474592 notifier 7835 bl.length()=911 2024-09-14T11:40:14.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:40:14.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:40:14.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:40:14.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:40:14.650 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26eb60e800 time 2024-09-14T11:40:14.653590+0000 2024-09-14T11:40:14.650 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:14.651 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.651 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26ec78c76a] 2024-09-14T11:40:14.651 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.651 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.651 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.651 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.652+0000 7f26eb60e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26eb60e800 time 2024-09-14T11:40:14.653590+0000 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26ec78c76a] 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.652 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:40:14.653 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.653 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:40:14.653 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:40:14.653 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.653 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:40:14.653 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f26eb60e800 thread_name:radosgw-admin 2024-09-14T11:40:14.669 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.669 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26eb43e6f0] 2024-09-14T11:40:14.669 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26eb48b99c] 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26ec78c7c4] 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.653+0000 7f26eb60e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f26eb60e800 thread_name:radosgw-admin 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.670 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26eb43e6f0] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26eb48b99c] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26ec78c7c4] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.671 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:40:14.177+0000 7f25d4e09640 10 monclient: dump: 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 monclient: authenticate success, global_id 8235 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:40:14.178+0000 7f26eb60e800 4 set_mon_vals no callback set 2024-09-14T11:40:14.672 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: shutdown 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 asok(0x55636798a270) unregister_commands rotate-key 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:40:14.178+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.673 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding auth protocol: cephx 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding auth protocol: cephx 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding auth protocol: cephx 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.674 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:40:14.179+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: starting msgr at 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: starting objecter 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 asok(0x55636798a270) register_command objecter_requests hook 0x556367bac9d0 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: setting wanted keys 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: calling monclient init 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding auth protocol: cephx 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding auth protocol: cephx 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding auth protocol: cephx 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.675 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:40:14.179+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:40:14.179+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key hook 0x556367ba94c8 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367a35780 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367a56020 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367a56800 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.676 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.737043s 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367a35780 auth_method 0 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367a56800 auth_method 0 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.677 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367a56020 auth_method 0 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 1 monclient: found mon.noname-c 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.678 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: dump: 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.679 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: dump: 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:40:14.180+0000 7f26eb60e800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:40:14.180+0000 7f25d4e09640 4 set_mon_vals no callback set 2024-09-14T11:40:14.680 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:40:14.180+0000 7f26eb60e800 1 librados: init done 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:40:14.183+0000 7f25d3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:40:14.183+0000 7f25d3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:40:14.183+0000 7f25d3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:40:14.183+0000 7f26e64ca640 10 monclient: get_auth_request con 0x7f25cc077260 auth_method 0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:40:14.183+0000 7f26e74cc640 10 monclient: get_auth_request con 0x556367be7dc0 auth_method 0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:40:14.184+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x556367bf4d20 auth_method 0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:40:14.185+0000 7f26e64ca640 10 monclient: get_auth_request con 0x556367bf9190 auth_method 0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:40:14.186+0000 7f26e74cc640 10 monclient: get_auth_request con 0x556367bf8600 auth_method 0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:40:14.187+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:40:14.187+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:40:14.187+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.681 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding auth protocol: cephx 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding auth protocol: cephx 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding auth protocol: cephx 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.682 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:40:14.187+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 asok(0x55636798a270) register_command objecter_requests cmddesc objecter_requests hook 0x556367c04cd0 EEXIST 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding auth protocol: cephx 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding auth protocol: cephx 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding auth protocol: cephx 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.683 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:40:14.188+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:40:14.188+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key cmddesc rotate-key hook 0x556367c00400 EEXIST 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:14.684 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367c2e910 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367c27300 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367c29e10 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.745833s 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367c2e910 auth_method 0 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367c27300 auth_method 0 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.685 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367c29e10 auth_method 0 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_done global_id 8241 payload 824 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.686 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:40:14.189+0000 7f26e64ca640 1 monclient: found mon.noname-a 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: dump: 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.687 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: dump: 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.688 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:40:14.189+0000 7f26eb60e800 5 monclient: authenticate success, global_id 8241 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:40:14.189+0000 7f26e7ccd640 4 set_mon_vals no callback set 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:40:14.191+0000 7f25d0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:40:14.191+0000 7f25d0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:40:14.191+0000 7f25d0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:40:14.192+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f25c0077170 auth_method 0 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: get_monmap_and_config 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:40:14.192+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.689 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding auth protocol: cephx 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding auth protocol: cephx 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding auth protocol: cephx 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.690 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:40:14.192+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding auth protocol: cephx 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding auth protocol: cephx 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding auth protocol: cephx 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.691 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:40:14.192+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:40:14.193+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:40:14.193+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key cmddesc rotate-key hook 0x7ffc9b1f9648 EEXIST 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367c7deb0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.692 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367c4da10 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367c4a9b0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.750293s 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367c7deb0 auth_method 0 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367c4da10 auth_method 0 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.693 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367c4a9b0 auth_method 0 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_done global_id 8244 payload 274 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:40:14.193+0000 7f26e64ca640 1 monclient: found mon.noname-a 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.694 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: dump: 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.695 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: dump: 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 monclient: authenticate success, global_id 8244 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:40:14.194+0000 7f26eb60e800 4 set_mon_vals no callback set 2024-09-14T11:40:14.696 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: shutdown 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:40:14.194+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding auth protocol: cephx 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding auth protocol: cephx 2024-09-14T11:40:14.697 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding auth protocol: cephx 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:40:14.194+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:40:14.194+0000 7f26eb60e800 1 librados: starting msgr at 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:40:14.194+0000 7f26eb60e800 1 librados: starting objecter 2024-09-14T11:40:14.698 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 asok(0x55636798a270) register_command objecter_requests cmddesc objecter_requests hook 0x556367c4e880 EEXIST 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:40:14.195+0000 7f26eb60e800 1 librados: setting wanted keys 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:40:14.195+0000 7f26eb60e800 1 librados: calling monclient init 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding auth protocol: cephx 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding auth protocol: cephx 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding auth protocol: cephx 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.699 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:40:14.195+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:40:14.195+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key cmddesc rotate-key hook 0x556367a33ee8 EEXIST 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367c4a9b0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367c4da10 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367c7deb0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.752706s 2024-09-14T11:40:14.700 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367c4a9b0 auth_method 0 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367c4da10 auth_method 0 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367c7deb0 auth_method 0 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.701 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:40:14.196+0000 7f26e64ca640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:40:14.196+0000 7f26e64ca640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:40:14.196+0000 7f26e64ca640 1 monclient: found mon.noname-c 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:40:14.196+0000 7f26e64ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: dump: 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.702 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: dump: 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.703 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:40:14.196+0000 7f26eb60e800 5 monclient: authenticate success, global_id 7835 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:40:14.196+0000 7f25ca7fc640 4 set_mon_vals no callback set 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:40:14.196+0000 7f26eb60e800 1 librados: init done 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:40:14.196+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cr dump hook 0x556367c73d68 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:40:14.198+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:40:14.198+0000 7f25c8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:40:14.198+0000 7f25c8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:40:14.198+0000 7f25c8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:40:14.198+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f25b0077230 auth_method 0 2024-09-14T11:40:14.704 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:40:14.199+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x556367c98290 auth_method 0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 realm 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:40:14.199+0000 7f26eb60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:40:14.200+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:40:14.200+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:40:14.200+0000 7f26e64ca640 10 monclient: get_auth_request con 0x556367c9c4c0 auth_method 0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:40:14.201+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:40:14.201+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:40:14.201+0000 7f26e74cc640 10 monclient: get_auth_request con 0x556367c9fd00 auth_method 0 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:40:14.202+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:40:14.202+0000 7f26eb60e800 20 searching for the correct realm 2024-09-14T11:40:14.705 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:40:14.202+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x556367ca4ac0 auth_method 0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:40:14.203+0000 7f26e64ca640 10 monclient: get_auth_request con 0x7f26d804b040 auth_method 0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:40:14.204+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f26dc035030 auth_method 0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:40:14.204+0000 7f26e74cc640 0 -- 172.21.15.7:0/305095572 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f26dc035030 msgr2=0x7f26dc084930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:40:14.406+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f26dc035030 auth_method 0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:40:14.407+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x7f26e0099040 auth_method 0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:40:14.411+0000 7f26e64ca640 0 -- 172.21.15.7:0/305095572 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f26d809a040 msgr2=0x7f26d8077930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:40:14.612+0000 7f26e64ca640 10 monclient: get_auth_request con 0x7f26d809a040 auth_method 0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.706 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 zone default found 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:40:14.620+0000 7f26eb60e800 4 Realm: () 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:40:14.620+0000 7f26eb60e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:40:14.620+0000 7f26eb60e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:40:14.620+0000 7f26eb60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 zonegroup default 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.707 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 started sync module instance, tier type = 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:40:14.632+0000 7f26eb60e800 20 add_watcher() i=0 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=1 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=2 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=3 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=4 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=5 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=6 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:40:14.634+0000 7f26eb60e800 20 add_watcher() i=7 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:40:14.634+0000 7f26eb60e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding auth protocol: cephx 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding auth protocol: cephx 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding auth protocol: cephx 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.708 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:40:14.636+0000 7f259dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:40:14.636+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:14.709 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache list hook 0x556367c742b0 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache inspect hook 0x556367c742b0 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache erase hook 0x556367c742b0 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache zap hook 0x556367c742b0 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 note: GC not initialized 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:40:14.636+0000 7f259cfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace show hook 0x7f26d8065040 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace history hook 0x7f26d8065040 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace active hook 0x7f26d8065040 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace active_short hook 0x7f26d8065040 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 Filter name: none 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:40:14.637+0000 7f2595ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.710 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:40:14.638+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:40:14.639+0000 7f26eb60e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.711 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529799 cookie 93885431474592 notifier 7835 bl.length()=911 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:40:14.652+0000 7f26eb60e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26eb60e800 time 2024-09-14T11:40:14.653590+0000 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26ec78c76a] 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.712 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:40:14.653+0000 7f26eb60e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f26eb60e800 thread_name:radosgw-admin 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26eb43e6f0] 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26eb48b99c] 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:14.713 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26ec78c7c4] 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:40:14.714 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:14.715 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:40:14.716 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:40:14.717 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:40:14.718 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:14.719 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 7f2595ffb640 / http_manager 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 7f259cfe1640 / http_manager 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 7f259dfe3640 / rgw_dt_lg_renew 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25c8ff9640 / ms_dispatch 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25c9ffb640 / io_context_pool 2024-09-14T11:40:14.720 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25ca7fc640 / io_context_pool 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25d0e01640 / ms_dispatch 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25d3606640 / ms_dispatch 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25d4e09640 / io_context_pool 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e64ca640 / msgr-worker-2 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e6ccb640 / msgr-worker-1 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e74cc640 / msgr-worker-0 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e7ccd640 / io_context_pool 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26eb60e800 / radosgw-admin 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.152198.log 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:40:14.177+0000 7f25d4e09640 10 monclient: dump: 2024-09-14T11:40:14.721 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 monclient: authenticate success, global_id 8235 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:40:14.178+0000 7f26eb60e800 4 set_mon_vals no callback set 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: shutdown 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 asok(0x55636798a270) unregister_commands rotate-key 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.722 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:40:14.178+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:40:14.178+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding auth protocol: cephx 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding auth protocol: cephx 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding auth protocol: cephx 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.723 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: crc 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:40:14.178+0000 7f26eb60e800 5 AuthRegistry(0x556367bab680) adding con mode: secure 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:40:14.179+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: starting msgr at 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: starting objecter 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 asok(0x55636798a270) register_command objecter_requests hook 0x556367bac9d0 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: setting wanted keys 2024-09-14T11:40:14.724 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:40:14.179+0000 7f26eb60e800 1 librados: calling monclient init 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding auth protocol: cephx 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding auth protocol: cephx 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding auth protocol: cephx 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.725 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: crc 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 AuthRegistry(0x556367ba9380) adding con mode: secure 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:40:14.179+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:40:14.179+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:40:14.179+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key hook 0x556367ba94c8 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:40:14.179+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367a35780 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367a56020 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367a56800 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.737043s 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367a35780 auth_method 0 2024-09-14T11:40:14.726 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367a56800 auth_method 0 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:40:14.180+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367a56020 auth_method 0 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.727 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:40:14.180+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 1 monclient: found mon.noname-c 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:40:14.180+0000 7f26e6ccb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: dump: 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.728 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:40:14.180+0000 7f25d3606640 10 monclient: dump: 2024-09-14T11:40:14.729 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:40:14.180+0000 7f26eb60e800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:40:14.180+0000 7f25d4e09640 4 set_mon_vals no callback set 2024-09-14T11:40:14.730 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:40:14.180+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:40:14.180+0000 7f26eb60e800 1 librados: init done 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:40:14.183+0000 7f25d3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:40:14.183+0000 7f25d3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:40:14.183+0000 7f25d3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:40:14.183+0000 7f26e64ca640 10 monclient: get_auth_request con 0x7f25cc077260 auth_method 0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:40:14.183+0000 7f26e74cc640 10 monclient: get_auth_request con 0x556367be7dc0 auth_method 0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:40:14.184+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x556367bf4d20 auth_method 0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:40:14.185+0000 7f26e64ca640 10 monclient: get_auth_request con 0x556367bf9190 auth_method 0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:40:14.186+0000 7f26e74cc640 10 monclient: get_auth_request con 0x556367bf8600 auth_method 0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:40:14.187+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:40:14.187+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:40:14.187+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.731 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding auth protocol: cephx 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding auth protocol: cephx 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding auth protocol: cephx 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.732 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: crc 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:40:14.187+0000 7f26eb60e800 5 AuthRegistry(0x556367c013d0) adding con mode: secure 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:40:14.187+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 asok(0x55636798a270) register_command objecter_requests cmddesc objecter_requests hook 0x556367c04cd0 EEXIST 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding auth protocol: cephx 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding auth protocol: cephx 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding auth protocol: cephx 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.733 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: crc 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 AuthRegistry(0x556367c002b8) adding con mode: secure 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:40:14.188+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:40:14.188+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:40:14.188+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key cmddesc rotate-key hook 0x556367c00400 EEXIST 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367c2e910 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.734 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367c27300 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367c29e10 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:40:14.188+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.745833s 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367c2e910 auth_method 0 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:40:14.188+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367c27300 auth_method 0 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.735 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367c29e10 auth_method 0 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:40:14.189+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:40:14.189+0000 7f26e6ccb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient(hunting): handle_auth_done global_id 8241 payload 824 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:40:14.189+0000 7f26e64ca640 1 monclient: found mon.noname-a 2024-09-14T11:40:14.736 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:40:14.189+0000 7f26e64ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: dump: 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.737 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:40:14.189+0000 7f25d0e01640 10 monclient: dump: 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:40:14.189+0000 7f26eb60e800 5 monclient: authenticate success, global_id 8241 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.738 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:40:14.189+0000 7f26e7ccd640 4 set_mon_vals no callback set 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:40:14.189+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:40:14.191+0000 7f25d0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:40:14.191+0000 7f25d0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:40:14.191+0000 7f25d0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:40:14.192+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f25c0077170 auth_method 0 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: get_monmap_and_config 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:40:14.192+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.739 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding auth protocol: cephx 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding auth protocol: cephx 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding auth protocol: cephx 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.740 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: crc 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x556367c499d0) adding con mode: secure 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:40:14.192+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:40:14.192+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding auth protocol: cephx 2024-09-14T11:40:14.741 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding auth protocol: cephx 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding auth protocol: cephx 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: crc 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:40:14.192+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f9500) adding con mode: secure 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:40:14.192+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.742 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:40:14.193+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:40:14.193+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key cmddesc rotate-key hook 0x7ffc9b1f9648 EEXIST 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367c7deb0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367c4da10 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367c4a9b0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:40:14.193+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.750293s 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367c7deb0 auth_method 0 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.743 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367c4da10 auth_method 0 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367c4a9b0 auth_method 0 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:40:14.193+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:40:14.193+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.744 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient(hunting): handle_auth_done global_id 8244 payload 274 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:40:14.193+0000 7f26e64ca640 1 monclient: found mon.noname-a 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:40:14.193+0000 7f26e64ca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: dump: 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.745 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:40:14.193+0000 7f25ca7fc640 10 monclient: dump: 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.746 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 monclient: authenticate success, global_id 8244 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:40:14.194+0000 7f26eb60e800 4 set_mon_vals no callback set 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: shutdown 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: build_initial_monmap 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:40:14.194+0000 7f26eb60e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:40:14.194+0000 7f26eb60e800 10 monclient: monmap: 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:14.747 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding auth protocol: cephx 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding auth protocol: cephx 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding auth protocol: cephx 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.748 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: crc 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:40:14.194+0000 7f26eb60e800 5 AuthRegistry(0x556367c49980) adding con mode: secure 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:40:14.194+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:40:14.194+0000 7f26eb60e800 1 librados: starting msgr at 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:40:14.194+0000 7f26eb60e800 1 librados: starting objecter 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 asok(0x55636798a270) register_command objecter_requests cmddesc objecter_requests hook 0x556367c4e880 EEXIST 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:40:14.195+0000 7f26eb60e800 1 librados: setting wanted keys 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:40:14.195+0000 7f26eb60e800 1 librados: calling monclient init 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient: init 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding auth protocol: cephx 2024-09-14T11:40:14.749 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding auth protocol: cephx 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding auth protocol: cephx 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: crc 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 AuthRegistry(0x556367a33da0) adding con mode: secure 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:40:14.195+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:40:14.195+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.750 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:40:14.195+0000 7f26eb60e800 5 asok(0x55636798a270) register_command rotate-key cmddesc rotate-key hook 0x556367a33ee8 EEXIST 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-c con 0x556367c4a9b0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-a con 0x556367c4da10 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): picked mon.noname-b con 0x556367c7deb0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:40:14.195+0000 7f26eb60e800 10 monclient(hunting): authenticate will time out at 2314.752706s 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): get_auth_request con 0x556367c4a9b0 auth_method 0 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): get_auth_request con 0x556367c4da10 auth_method 0 2024-09-14T11:40:14.751 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:40:14.195+0000 7f26e64ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:40:14.195+0000 7f26e74cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request con 0x556367c7deb0 auth_method 0 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:40:14.195+0000 7f26e6ccb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:40:14.196+0000 7f26e64ca640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:40:14.196+0000 7f26e64ca640 10 monclient: _finish_hunting 0 2024-09-14T11:40:14.752 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:40:14.196+0000 7f26e64ca640 1 monclient: found mon.noname-c 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:40:14.196+0000 7f26e64ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: dump: 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.753 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:40:14.196+0000 7f25c8ff9640 10 monclient: dump: 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.754 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:40:14.196+0000 7f26eb60e800 5 monclient: authenticate success, global_id 7835 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:40:14.196+0000 7f25ca7fc640 4 set_mon_vals no callback set 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _renew_subs 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:40:14.196+0000 7f26eb60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:40:14.196+0000 7f26eb60e800 1 librados: init done 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:40:14.196+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cr dump hook 0x556367c73d68 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:40:14.198+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:40:14.198+0000 7f25c8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:40:14.198+0000 7f25c8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:40:14.198+0000 7f25c8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:40:14.198+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f25b0077230 auth_method 0 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:40:14.199+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x556367c98290 auth_method 0 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 realm 2024-09-14T11:40:14.755 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:40:14.199+0000 7f26eb60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:40:14.199+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:40:14.200+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:40:14.200+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:40:14.200+0000 7f26e64ca640 10 monclient: get_auth_request con 0x556367c9c4c0 auth_method 0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:40:14.201+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:40:14.201+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:40:14.201+0000 7f26e74cc640 10 monclient: get_auth_request con 0x556367c9fd00 auth_method 0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:40:14.202+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:40:14.202+0000 7f26eb60e800 20 searching for the correct realm 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:40:14.202+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x556367ca4ac0 auth_method 0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:40:14.203+0000 7f26e64ca640 10 monclient: get_auth_request con 0x7f26d804b040 auth_method 0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:40:14.204+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f26dc035030 auth_method 0 2024-09-14T11:40:14.756 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:40:14.204+0000 7f26e74cc640 0 -- 172.21.15.7:0/305095572 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f26dc035030 msgr2=0x7f26dc084930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:40:14.406+0000 7f26e74cc640 10 monclient: get_auth_request con 0x7f26dc035030 auth_method 0 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:40:14.407+0000 7f26e6ccb640 10 monclient: get_auth_request con 0x7f26e0099040 auth_method 0 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:40:14.411+0000 7f26e64ca640 0 -- 172.21.15.7:0/305095572 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f26d809a040 msgr2=0x7f26d8077930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:40:14.612+0000 7f26e64ca640 10 monclient: get_auth_request con 0x7f26d809a040 auth_method 0 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:40:14.619+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.757 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 zone default found 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:40:14.620+0000 7f26eb60e800 4 Realm: () 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:40:14.620+0000 7f26eb60e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:40:14.620+0000 7f26eb60e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:40:14.620+0000 7f26eb60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 zonegroup default 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:40:14.620+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 started sync module instance, tier type = 2024-09-14T11:40:14.758 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:40:14.621+0000 7f26eb60e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:40:14.632+0000 7f26eb60e800 20 add_watcher() i=0 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=1 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=2 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=3 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=4 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=5 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:40:14.633+0000 7f26eb60e800 20 add_watcher() i=6 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:40:14.634+0000 7f26eb60e800 20 add_watcher() i=7 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:40:14.634+0000 7f26eb60e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding auth protocol: cephx 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding auth protocol: cephx 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding auth protocol: cephx 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.759 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:40:14.636+0000 7f259dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: crc 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 AuthRegistry(0x7ffc9b1f99e0) adding con mode: secure 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:40:14.636+0000 7f26eb60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache list hook 0x556367c742b0 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache inspect hook 0x556367c742b0 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache erase hook 0x556367c742b0 2024-09-14T11:40:14.760 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command cache zap hook 0x556367c742b0 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 note: GC not initialized 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:40:14.636+0000 7f259cfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace show hook 0x7f26d8065040 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace history hook 0x7f26d8065040 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace active hook 0x7f26d8065040 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:40:14.636+0000 7f26eb60e800 5 asok(0x55636798a270) register_command sync trace active_short hook 0x7f26d8065040 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:40:14.636+0000 7f26eb60e800 20 Filter name: none 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:40:14.637+0000 7f2595ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:14.761 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:40:14.637+0000 7f26eb60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:40:14.637+0000 7f26eb60e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:40:14.638+0000 7f26eb60e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:40:14.638+0000 7f26eb60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:40:14.639+0000 7f26eb60e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:40:14.647+0000 7f26eb60e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529799 cookie 93885431474592 notifier 7835 bl.length()=911 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:14.762 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:40:14.648+0000 7f25c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:40:14.648+0000 7f26eb60e800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:40:14.652+0000 7f26eb60e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26eb60e800 time 2024-09-14T11:40:14.653590+0000 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26ec78c76a] 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 4: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 6: main() 2024-09-14T11:40:14.763 INFO:tasks.workunit.client.0.smithi007.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 8: __libc_start_main() 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 9: _start() 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:40:14.653+0000 7f26eb60e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7f26eb60e800 thread_name:radosgw-admin 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26eb43e6f0] 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26eb48b99c] 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26ec78c7c4] 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26ec78c928] 2024-09-14T11:40:14.764 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5563657c30b1] 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 8: radosgw-admin(+0xd8907c) [0x556365cd707c] 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5563657d2efd] 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 10: main() 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26eb429590] 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 12: __libc_start_main() 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 13: _start() 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:14.765 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:40:14.766 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:40:14.767 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:40:14.768 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:40:14.769 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:40:14.770 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f2595ffb640 / http_manager 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f259cfe1640 / http_manager 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f259dfe3640 / rgw_dt_lg_renew 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25c8ff9640 / ms_dispatch 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25c9ffb640 / io_context_pool 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25ca7fc640 / io_context_pool 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25d0e01640 / ms_dispatch 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25d3606640 / ms_dispatch 2024-09-14T11:40:14.771 INFO:tasks.workunit.client.0.smithi007.stderr: 7f25d4e09640 / io_context_pool 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e64ca640 / msgr-worker-2 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e6ccb640 / msgr-worker-1 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e74cc640 / msgr-worker-0 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26e7ccd640 / io_context_pool 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: 7f26eb60e800 / radosgw-admin 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:40:14.655303Z_b3da7a8a-4cfd-406a-bbc8-a8b8510d2dfc/log 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:40:14.772 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.738+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 20 realm 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.740+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.741+0000 7fbf27a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.741+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:14.774 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.742+0000 7fbf27a40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:14.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.742+0000 7fbf27a40800 20 searching for the correct realm 2024-09-14T11:40:14.775 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.743+0000 7fbf25d2b640 0 -- 172.21.15.7:0/3349450966 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fbf1002a070 msgr2=0x7fbf10044430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:14.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:14.949+0000 7fbf24d29640 0 -- 172.21.15.7:0/3349450966 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fbf20063530 msgr2=0x7fbf200aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:15.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.156+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 zone default found 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 4 Realm: () 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 zonegroup default 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.157+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.158+0000 7fbf27a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:15.157 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.158+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.158+0000 7fbf27a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:15.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.158+0000 7fbf27a40800 20 started sync module instance, tier type = 2024-09-14T11:40:15.158 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.158+0000 7fbf27a40800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:15.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.168+0000 7fbf27a40800 20 add_watcher() i=0 2024-09-14T11:40:15.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.168+0000 7fbf27a40800 20 add_watcher() i=1 2024-09-14T11:40:15.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.168+0000 7fbf27a40800 20 add_watcher() i=2 2024-09-14T11:40:15.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.168+0000 7fbf27a40800 20 add_watcher() i=3 2024-09-14T11:40:15.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.168+0000 7fbf27a40800 20 add_watcher() i=4 2024-09-14T11:40:15.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.168+0000 7fbf27a40800 20 add_watcher() i=5 2024-09-14T11:40:15.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.168+0000 7fbf27a40800 20 add_watcher() i=6 2024-09-14T11:40:15.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.169+0000 7fbf27a40800 20 add_watcher() i=7 2024-09-14T11:40:15.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.169+0000 7fbf27a40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:15.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.171+0000 7fbddb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.171+0000 7fbf27a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.171+0000 7fbf27a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.172+0000 7fbf27a40800 5 note: GC not initialized 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.172+0000 7fbdda7e4640 20 reqs_thread_entry: start 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.172+0000 7fbf27a40800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.172+0000 7fbf27a40800 20 Filter name: none 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.172+0000 7fbd4bfff640 20 reqs_thread_entry: start 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.172+0000 7fbf27a40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:15.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.172+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:15.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:15.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:15.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:15.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 20 rados->read ofs=0 len=0 2024-09-14T11:40:15.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.173+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.174+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:40:15.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.174+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.174+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.174+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.174+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.174+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.175+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.175+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.175+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:40:15.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.175+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:40:15.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.176+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:40:15.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.176+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:40:15.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.176+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:40:15.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.176+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:40:15.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.176+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:40:15.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.176+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:40:15.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.177+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:40:15.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.177+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:40:15.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.177+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:40:15.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.177+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:40:15.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.177+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:40:15.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.177+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:40:15.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.178+0000 7fbf27a40800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:40:15.177 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.178+0000 7fbf27a40800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:40:15.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.179+0000 7fbddb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:15.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.182+0000 7fbf27a40800 20 remove_watcher() i=0 2024-09-14T11:40:15.180 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.182+0000 7fbf27a40800 2 removed watcher, disabling cache 2024-09-14T11:40:15.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.183+0000 7fbf27a40800 20 remove_watcher() i=1 2024-09-14T11:40:15.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.184+0000 7fbf27a40800 20 remove_watcher() i=2 2024-09-14T11:40:15.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.185+0000 7fbf27a40800 20 remove_watcher() i=3 2024-09-14T11:40:15.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.186+0000 7fbf27a40800 20 remove_watcher() i=4 2024-09-14T11:40:15.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.187+0000 7fbf27a40800 20 remove_watcher() i=5 2024-09-14T11:40:15.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.188+0000 7fbf27a40800 20 remove_watcher() i=6 2024-09-14T11:40:15.188 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:15.190+0000 7fbf27a40800 20 remove_watcher() i=7 2024-09-14T11:40:15.199 INFO:tasks.workunit.client.0.smithi007.stderr: test: duplicated entries can be purged manually 2024-09-14T11:40:45.233 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:40:45.266 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:45.266 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:45.311 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.314+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.315+0000 7fe3a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.315+0000 7fe3a970c800 20 realm 2024-09-14T11:40:45.313 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.315+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.316+0000 7fe3a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.316+0000 7fe3a970c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.316+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.316+0000 7fe3a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.316+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.314 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.317+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.317+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.318+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.315 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.318+0000 7fe3a970c800 20 searching for the correct realm 2024-09-14T11:40:45.317 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.320+0000 7fe3a79fe640 0 -- 172.21.15.7:0/3431630107 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fe39c042030 msgr2=0x7fe39c027400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.527+0000 7fe3a69fc640 0 -- 172.21.15.7:0/3431630107 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fe398082410 msgr2=0x7fe398082890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:45.734 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.735 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.737+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 20 zone default found 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 4 Realm: () 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 20 zonegroup default 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.738+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.737 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.739+0000 7fe3a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.739+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.739+0000 7fe3a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.739+0000 7fe3a970c800 20 started sync module instance, tier type = 2024-09-14T11:40:45.738 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.739+0000 7fe3a970c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:45.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.750+0000 7fe3a970c800 20 add_watcher() i=0 2024-09-14T11:40:45.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.750+0000 7fe3a970c800 20 add_watcher() i=1 2024-09-14T11:40:45.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.750+0000 7fe3a970c800 20 add_watcher() i=2 2024-09-14T11:40:45.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.750+0000 7fe3a970c800 20 add_watcher() i=3 2024-09-14T11:40:45.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.750+0000 7fe3a970c800 20 add_watcher() i=4 2024-09-14T11:40:45.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.750+0000 7fe3a970c800 20 add_watcher() i=5 2024-09-14T11:40:45.748 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.750+0000 7fe3a970c800 20 add_watcher() i=6 2024-09-14T11:40:45.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.751+0000 7fe3a970c800 20 add_watcher() i=7 2024-09-14T11:40:45.749 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.751+0000 7fe3a970c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:45.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.753+0000 7fe25dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.754+0000 7fe3a970c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:45.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.754+0000 7fe3a970c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:45.751 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.754+0000 7fe3a970c800 5 note: GC not initialized 2024-09-14T11:40:45.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.754+0000 7fe25cfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:45.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.754+0000 7fe3a970c800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:45.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.754+0000 7fe3a970c800 20 Filter name: none 2024-09-14T11:40:45.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.755+0000 7fe1d67fc640 20 reqs_thread_entry: start 2024-09-14T11:40:45.752 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.755+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.755+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:45.753 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.755+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.756+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:45.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.756+0000 7fe3a970c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:45.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.756+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.756+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:45.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.756+0000 7fe3a970c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.754 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.757+0000 7fe3a970c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:45.755 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.757+0000 7fe3a970c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:45.757 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.759+0000 7fe25dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:45.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.762+0000 7fe3a970c800 20 remove_watcher() i=0 2024-09-14T11:40:45.759 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.762+0000 7fe3a970c800 2 removed watcher, disabling cache 2024-09-14T11:40:45.761 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.763+0000 7fe3a970c800 20 remove_watcher() i=1 2024-09-14T11:40:45.762 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.764+0000 7fe3a970c800 20 remove_watcher() i=2 2024-09-14T11:40:45.763 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.766+0000 7fe3a970c800 20 remove_watcher() i=3 2024-09-14T11:40:45.764 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.767+0000 7fe3a970c800 20 remove_watcher() i=4 2024-09-14T11:40:45.765 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.768+0000 7fe3a970c800 20 remove_watcher() i=5 2024-09-14T11:40:45.767 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.769+0000 7fe3a970c800 20 remove_watcher() i=6 2024-09-14T11:40:45.768 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.770+0000 7fe3a970c800 20 remove_watcher() i=7 2024-09-14T11:40:45.782 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:45.782 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:40:45.782 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:40:45.782 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:45.783 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:40:45.820 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:45.820 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:45.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.865+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 20 realm 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:45.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.868+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:45.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.868+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:45.866 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.869+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:45.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.869+0000 7fed27f44800 20 searching for the correct realm 2024-09-14T11:40:45.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.871+0000 7fed2622f640 0 -- 172.21.15.7:0/2292633289 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fed1c028070 msgr2=0x7fed1c06b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:45.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:45.875+0000 7fed2522d640 0 -- 172.21.15.7:0/2292633289 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fed180ab450 msgr2=0x7fed180c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 zone default found 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 4 Realm: () 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 zonegroup default 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.085+0000 7fed27f44800 20 started sync module instance, tier type = 2024-09-14T11:40:46.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.085+0000 7fed27f44800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=0 2024-09-14T11:40:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=1 2024-09-14T11:40:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=2 2024-09-14T11:40:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=3 2024-09-14T11:40:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=4 2024-09-14T11:40:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=5 2024-09-14T11:40:46.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=6 2024-09-14T11:40:46.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.096+0000 7fed27f44800 20 add_watcher() i=7 2024-09-14T11:40:46.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.096+0000 7fed27f44800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:46.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.098+0000 7febd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.098+0000 7fed27f44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.098+0000 7fed27f44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.098+0000 7fed27f44800 5 note: GC not initialized 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.099+0000 7febd67fc640 20 reqs_thread_entry: start 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.099+0000 7fed27f44800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.099+0000 7fed27f44800 20 Filter name: none 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.099+0000 7feb47fff640 20 reqs_thread_entry: start 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.099+0000 7fed27f44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:46.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.099+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.100+0000 7fed27f44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:46.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.101+0000 7fed27f44800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:46.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fed27f44800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fed27f44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fed27f44800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:40:46.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529800 cookie 94176711229168 notifier 7886 bl.length()=911 2024-09-14T11:40:46.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:40:46.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:40:46.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:40:46.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:40:46.113 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed27f44800 time 2024-09-14T11:40:46.116166+0000 2024-09-14T11:40:46.113 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:46.113 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed2b58c76a] 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.116+0000 7fed27f44800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed27f44800 time 2024-09-14T11:40:46.116166+0000 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.114 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed2b58c76a] 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:40:46.115 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fed27f44800 thread_name:radosgw-admin 2024-09-14T11:40:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed2a23e6f0] 2024-09-14T11:40:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed2a28b99c] 2024-09-14T11:40:46.134 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed2b58c7c4] 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.117+0000 7fed27f44800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fed27f44800 thread_name:radosgw-admin 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.135 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed2a23e6f0] 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed2a28b99c] 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed2b58c7c4] 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:46.136 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:40:45.845+0000 7fed27f44800 4 set_mon_vals no callback set 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:40:45.846+0000 7fed27f44800 10 monclient: shutdown 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 asok(0x55a739392270) unregister_commands rotate-key 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:40:45.846+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:40:45.846+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:40:45.846+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.137 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding auth protocol: cephx 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding auth protocol: cephx 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding auth protocol: cephx 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.138 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:40:45.846+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:40:45.846+0000 7fed27f44800 1 librados: starting msgr at 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:40:45.846+0000 7fed27f44800 1 librados: starting objecter 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 asok(0x55a739392270) register_command objecter_requests hook 0x55a7395e45c0 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:40:45.847+0000 7fed27f44800 1 librados: setting wanted keys 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:40:45.847+0000 7fed27f44800 1 librados: calling monclient init 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding auth protocol: cephx 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding auth protocol: cephx 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding auth protocol: cephx 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.139 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:40:45.847+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:40:45.847+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key hook 0x55a7395b2848 2024-09-14T11:40:46.140 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a73943d4e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a739467350 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a7395b97e0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.403692s 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): get_auth_request con 0x55a739467350 auth_method 0 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.141 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a7395b97e0 auth_method 0 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a73943d4e0 auth_method 0 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.142 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:40:45.848+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:40:45.848+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:40:45.848+0000 7fed2622f640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:40:45.848+0000 7fed2622f640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:40:45.848+0000 7fed2622f640 1 monclient: found mon.noname-c 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:40:45.848+0000 7fed2622f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: dump: 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.143 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: dump: 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.144 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:40:45.848+0000 7fed27f44800 5 monclient: authenticate success, global_id 7877 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:40:45.848+0000 7fec13e07640 4 set_mon_vals no callback set 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.145 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:40:45.848+0000 7fed27f44800 1 librados: init done 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:40:45.850+0000 7fec12604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:40:45.850+0000 7fec12604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:40:45.850+0000 7fec12604640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:40:45.850+0000 7fed25a2e640 10 monclient: get_auth_request con 0x7fec0c077230 auth_method 0 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:40:45.850+0000 7fed2522d640 10 monclient: get_auth_request con 0x55a7395db720 auth_method 0 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:40:45.851+0000 7fed25a2e640 10 monclient: get_auth_request con 0x55a7395fc0c0 auth_method 0 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:40:45.852+0000 7fed2522d640 10 monclient: get_auth_request con 0x55a739600420 auth_method 0 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:40:45.854+0000 7fed2622f640 10 monclient: get_auth_request con 0x55a7395ff970 auth_method 0 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:40:45.854+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:40:45.854+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:40:45.854+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.146 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding auth protocol: cephx 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding auth protocol: cephx 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding auth protocol: cephx 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.147 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:40:45.855+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 asok(0x55a739392270) register_command objecter_requests cmddesc objecter_requests hook 0x55a73960bc00 EEXIST 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding auth protocol: cephx 2024-09-14T11:40:46.148 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding auth protocol: cephx 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding auth protocol: cephx 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.149 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:40:45.855+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:40:45.855+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key cmddesc rotate-key hook 0x55a739607620 EEXIST 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a73962ff20 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a739630300 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a73962ec30 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.411900s 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): get_auth_request con 0x55a73962ff20 auth_method 0 2024-09-14T11:40:46.150 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a73962ec30 auth_method 0 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a739630300 auth_method 0 2024-09-14T11:40:46.151 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:40:45.856+0000 7fed25a2e640 1 monclient: found mon.noname-a 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: dump: 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.152 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:46.153 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: dump: 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:40:45.856+0000 7fed27f44800 5 monclient: authenticate success, global_id 8298 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:40:45.856+0000 7fed26a30640 4 set_mon_vals no callback set 2024-09-14T11:40:46.154 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:40:45.858+0000 7fec0b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:40:45.858+0000 7fec0b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:40:45.858+0000 7fec0b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:40:45.858+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fec00077140 auth_method 0 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: get_monmap_and_config 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:40:45.859+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.155 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding auth protocol: cephx 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding auth protocol: cephx 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding auth protocol: cephx 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.156 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:40:45.859+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding auth protocol: cephx 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding auth protocol: cephx 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding auth protocol: cephx 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.157 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:40:45.859+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:40:45.859+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:40:45.860+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key cmddesc rotate-key hook 0x7ffd130ac248 EEXIST 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a739653ed0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.158 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a73967e940 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a73967fcf0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.416081s 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a73967e940 auth_method 0 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a73967fcf0 auth_method 0 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.159 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_done global_id 8301 payload 274 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:40:45.860+0000 7fed25a2e640 1 monclient: found mon.noname-a 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: dump: 2024-09-14T11:40:46.160 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:40:45.860+0000 7fed27f44800 5 monclient: authenticate success, global_id 8301 2024-09-14T11:40:46.161 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:40:45.860+0000 7fed27f44800 4 set_mon_vals no callback set 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: dump: 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.162 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: shutdown 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.163 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding auth protocol: cephx 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding auth protocol: cephx 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding auth protocol: cephx 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.164 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:40:45.861+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: starting msgr at 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: starting objecter 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 asok(0x55a739392270) register_command objecter_requests cmddesc objecter_requests hook 0x55a7395e3e10 EEXIST 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: setting wanted keys 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: calling monclient init 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding auth protocol: cephx 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding auth protocol: cephx 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding auth protocol: cephx 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.165 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:40:45.862+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:40:45.862+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:40:45.862+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key cmddesc rotate-key hook 0x55a739644928 EEXIST 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.166 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a739653ed0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a73967fcf0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a7396883c0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.418489s 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): get_auth_request con 0x55a739653ed0 auth_method 0 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a73967fcf0 auth_method 0 2024-09-14T11:40:46.167 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a7396883c0 auth_method 0 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-14T11:40:46.168 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:40:45.862+0000 7fed2522d640 1 monclient: found mon.noname-c 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: dump: 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.169 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: dump: 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.170 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:40:45.863+0000 7fed27f44800 5 monclient: authenticate success, global_id 7886 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:40:45.863+0000 7fec097fa640 4 set_mon_vals no callback set 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:40:45.863+0000 7fed27f44800 1 librados: init done 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:40:45.863+0000 7fed27f44800 5 asok(0x55a739392270) register_command cr dump hook 0x55a739688018 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:40:45.865+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:40:45.866+0000 7febf77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:40:45.866+0000 7febf77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.171 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:40:45.866+0000 7febf77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:40:45.866+0000 7fed2622f640 10 monclient: get_auth_request con 0x7febf0077260 auth_method 0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:40:45.866+0000 7fed25a2e640 10 monclient: get_auth_request con 0x55a73969ef20 auth_method 0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 realm 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:40:45.867+0000 7fed27f44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:40:45.867+0000 7fed2522d640 10 monclient: get_auth_request con 0x55a7396a3210 auth_method 0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:40:45.868+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:40:45.868+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.172 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:40:45.868+0000 7fed2622f640 10 monclient: get_auth_request con 0x55a7396a6900 auth_method 0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:40:45.869+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:40:45.869+0000 7fed27f44800 20 searching for the correct realm 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:40:45.869+0000 7fed25a2e640 10 monclient: get_auth_request con 0x55a7396ab6c0 auth_method 0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:40:45.870+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fed180b5c80 auth_method 0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:40:45.871+0000 7fed2622f640 10 monclient: get_auth_request con 0x7fed1c028070 auth_method 0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:40:45.871+0000 7fed2622f640 0 -- 172.21.15.7:0/2292633289 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fed1c028070 msgr2=0x7fed1c06b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:40:45.871+0000 7febf77fe640 1 client.7886.objecter ms_handle_reset 0x7fed1c028070 session 0x7fed1c030050 osd.2 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:40:45.871+0000 7febf77fe640 10 monclient: _renew_subs 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:40:45.871+0000 7febf77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:40:45.871+0000 7fed2622f640 10 monclient: get_auth_request con 0x7febf0087080 auth_method 0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:40:45.872+0000 7fed25a2e640 10 monclient: get_auth_request con 0x7fed20062c10 auth_method 0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:40:45.875+0000 7fed2522d640 0 -- 172.21.15.7:0/2292633289 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fed180ab450 msgr2=0x7fed180c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:40:46.076+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fed180ab450 auth_method 0 2024-09-14T11:40:46.173 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:40:46.077+0000 7febf77fe640 1 client.7886.objecter ms_handle_reset 0x7fed180b5c80 session 0x7fed180cd040 osd.7 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:40:46.078+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fed1c028070 auth_method 0 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:40:46.080+0000 7febf77fe640 1 client.7886.objecter ms_handle_reset 0x7febf0087080 session 0x7fed1c030050 osd.2 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:40:46.080+0000 7fed2622f640 10 monclient: get_auth_request con 0x7fed180b5c80 auth_method 0 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.174 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 zone default found 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:40:46.084+0000 7fed27f44800 4 Realm: () 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:40:46.084+0000 7fed27f44800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:40:46.084+0000 7fed27f44800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:40:46.084+0000 7fed27f44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 zonegroup default 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 started sync module instance, tier type = 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:46.175 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=0 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=1 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=2 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=3 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=4 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=5 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=6 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:40:46.096+0000 7fed27f44800 20 add_watcher() i=7 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:40:46.096+0000 7fed27f44800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding auth protocol: cephx 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding auth protocol: cephx 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding auth protocol: cephx 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.176 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:40:46.098+0000 7febd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:40:46.098+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:40:46.098+0000 7fed27f44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:40:46.098+0000 7fed27f44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache list hook 0x55a739689fc0 2024-09-14T11:40:46.177 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache inspect hook 0x55a739689fc0 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache erase hook 0x55a739689fc0 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache zap hook 0x55a739689fc0 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 note: GC not initialized 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:40:46.099+0000 7febd67fc640 20 reqs_thread_entry: start 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace show hook 0x7fed18004040 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace history hook 0x7fed18004040 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace active hook 0x7fed18004040 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace active_short hook 0x7fed18004040 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:40:46.099+0000 7fed27f44800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:40:46.099+0000 7fed27f44800 20 Filter name: none 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:40:46.099+0000 7feb47fff640 20 reqs_thread_entry: start 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:40:46.099+0000 7fed27f44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:40:46.099+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:46.178 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:40:46.101+0000 7fed27f44800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:40:46.179 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529800 cookie 94176711229168 notifier 7886 bl.length()=911 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:40:46.116+0000 7fed27f44800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed27f44800 time 2024-09-14T11:40:46.116166+0000 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed2b58c76a] 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.180 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:40:46.117+0000 7fed27f44800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fed27f44800 thread_name:radosgw-admin 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed2a23e6f0] 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed2a28b99c] 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:46.181 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed2b58c7c4] 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:40:46.182 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:40:46.183 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:40:46.184 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:46.185 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:40:46.186 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:46.187 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:46.188 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7feb47fff640 / http_manager 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7febd67fc640 / http_manager 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7febd77fe640 / rgw_dt_lg_renew 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7febf77fe640 / ms_dispatch 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec097fa640 / io_context_pool 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec0b7fe640 / ms_dispatch 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec12604640 / ms_dispatch 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec13e07640 / io_context_pool 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed2522d640 / msgr-worker-2 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed25a2e640 / msgr-worker-1 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed2622f640 / msgr-worker-0 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed26a30640 / io_context_pool 2024-09-14T11:40:46.189 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed27f44800 / radosgw-admin 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/log/ceph/ceph-client.admin.153981.log 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr:--- begin dump of recent events --- 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -499> 2024-09-14T11:40:45.845+0000 7fed27f44800 4 set_mon_vals no callback set 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -498> 2024-09-14T11:40:45.846+0000 7fed27f44800 10 monclient: shutdown 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -497> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 asok(0x55a739392270) unregister_commands rotate-key 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -496> 2024-09-14T11:40:45.846+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -495> 2024-09-14T11:40:45.846+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr: -494> 2024-09-14T11:40:45.846+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.190 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -493> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding auth protocol: cephx 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -492> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding auth protocol: cephx 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -491> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding auth protocol: cephx 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -490> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -489> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.191 INFO:tasks.workunit.client.0.smithi007.stderr: -488> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -487> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -486> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -485> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -484> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -483> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -482> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -481> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -480> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: crc 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -479> 2024-09-14T11:40:45.846+0000 7fed27f44800 5 AuthRegistry(0x55a7395b5d20) adding con mode: secure 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -478> 2024-09-14T11:40:45.846+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -477> 2024-09-14T11:40:45.846+0000 7fed27f44800 1 librados: starting msgr at 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -476> 2024-09-14T11:40:45.846+0000 7fed27f44800 1 librados: starting objecter 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -475> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 asok(0x55a739392270) register_command objecter_requests hook 0x55a7395e45c0 2024-09-14T11:40:46.192 INFO:tasks.workunit.client.0.smithi007.stderr: -474> 2024-09-14T11:40:45.847+0000 7fed27f44800 1 librados: setting wanted keys 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -473> 2024-09-14T11:40:45.847+0000 7fed27f44800 1 librados: calling monclient init 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -472> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -471> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding auth protocol: cephx 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -470> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding auth protocol: cephx 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -469> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding auth protocol: cephx 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -468> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -467> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -466> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -465> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -464> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -463> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -462> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -461> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.193 INFO:tasks.workunit.client.0.smithi007.stderr: -460> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -459> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -458> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: crc 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -457> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 AuthRegistry(0x55a7395b2700) adding con mode: secure 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -456> 2024-09-14T11:40:45.847+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -455> 2024-09-14T11:40:45.847+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -454> 2024-09-14T11:40:45.847+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key hook 0x55a7395b2848 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -453> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -452> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -451> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a73943d4e0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -450> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a739467350 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -449> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a7395b97e0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -448> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -447> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.194 INFO:tasks.workunit.client.0.smithi007.stderr: -446> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -445> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -444> 2024-09-14T11:40:45.847+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.403692s 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -443> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): get_auth_request con 0x55a739467350 auth_method 0 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -442> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -441> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -440> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -439> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a7395b97e0 auth_method 0 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -438> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -437> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -436> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -435> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a73943d4e0 auth_method 0 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -434> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -433> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.195 INFO:tasks.workunit.client.0.smithi007.stderr: -432> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -431> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -430> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -429> 2024-09-14T11:40:45.847+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -428> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -427> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -426> 2024-09-14T11:40:45.847+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -425> 2024-09-14T11:40:45.847+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -424> 2024-09-14T11:40:45.848+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -423> 2024-09-14T11:40:45.848+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -422> 2024-09-14T11:40:45.848+0000 7fed2622f640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -421> 2024-09-14T11:40:45.848+0000 7fed2622f640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -420> 2024-09-14T11:40:45.848+0000 7fed2622f640 1 monclient: found mon.noname-c 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -419> 2024-09-14T11:40:45.848+0000 7fed2622f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.196 INFO:tasks.workunit.client.0.smithi007.stderr: -418> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -417> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -416> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: dump: 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -415> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -414> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.197 INFO:tasks.workunit.client.0.smithi007.stderr: -413> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -412> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -411> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -410> 2024-09-14T11:40:45.848+0000 7fec12604640 10 monclient: dump: 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.198 INFO:tasks.workunit.client.0.smithi007.stderr: -409> 2024-09-14T11:40:45.848+0000 7fed27f44800 5 monclient: authenticate success, global_id 7877 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -408> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -407> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -406> 2024-09-14T11:40:45.848+0000 7fec13e07640 4 set_mon_vals no callback set 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -405> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -404> 2024-09-14T11:40:45.848+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -403> 2024-09-14T11:40:45.848+0000 7fed27f44800 1 librados: init done 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -402> 2024-09-14T11:40:45.850+0000 7fec12604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -401> 2024-09-14T11:40:45.850+0000 7fec12604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -400> 2024-09-14T11:40:45.850+0000 7fec12604640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -399> 2024-09-14T11:40:45.850+0000 7fed25a2e640 10 monclient: get_auth_request con 0x7fec0c077230 auth_method 0 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -398> 2024-09-14T11:40:45.850+0000 7fed2522d640 10 monclient: get_auth_request con 0x55a7395db720 auth_method 0 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -397> 2024-09-14T11:40:45.851+0000 7fed25a2e640 10 monclient: get_auth_request con 0x55a7395fc0c0 auth_method 0 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -396> 2024-09-14T11:40:45.852+0000 7fed2522d640 10 monclient: get_auth_request con 0x55a739600420 auth_method 0 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -395> 2024-09-14T11:40:45.854+0000 7fed2622f640 10 monclient: get_auth_request con 0x55a7395ff970 auth_method 0 2024-09-14T11:40:46.199 INFO:tasks.workunit.client.0.smithi007.stderr: -394> 2024-09-14T11:40:45.854+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -393> 2024-09-14T11:40:45.854+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -392> 2024-09-14T11:40:45.854+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -391> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding auth protocol: cephx 2024-09-14T11:40:46.200 INFO:tasks.workunit.client.0.smithi007.stderr: -390> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding auth protocol: cephx 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -389> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding auth protocol: cephx 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -388> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -387> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -386> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -385> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -384> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -383> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -382> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -381> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -380> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -379> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -378> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: crc 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -377> 2024-09-14T11:40:45.854+0000 7fed27f44800 5 AuthRegistry(0x55a7396086d0) adding con mode: secure 2024-09-14T11:40:46.201 INFO:tasks.workunit.client.0.smithi007.stderr: -376> 2024-09-14T11:40:45.855+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -375> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 asok(0x55a739392270) register_command objecter_requests cmddesc objecter_requests hook 0x55a73960bc00 EEXIST 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -374> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -373> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding auth protocol: cephx 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -372> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding auth protocol: cephx 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -371> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding auth protocol: cephx 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -370> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -369> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -368> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -367> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -366> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -365> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -364> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -363> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -362> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.202 INFO:tasks.workunit.client.0.smithi007.stderr: -361> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -360> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: crc 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -359> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 AuthRegistry(0x55a7396074d8) adding con mode: secure 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -358> 2024-09-14T11:40:45.855+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -357> 2024-09-14T11:40:45.855+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -356> 2024-09-14T11:40:45.855+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key cmddesc rotate-key hook 0x55a739607620 EEXIST 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -355> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -354> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -353> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a73962ff20 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -352> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a739630300 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -351> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a73962ec30 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -350> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -349> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -348> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -347> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.203 INFO:tasks.workunit.client.0.smithi007.stderr: -346> 2024-09-14T11:40:45.855+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.411900s 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -345> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): get_auth_request con 0x55a73962ff20 auth_method 0 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -344> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -343> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -342> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -341> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a73962ec30 auth_method 0 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -340> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -339> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -338> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -337> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -336> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -335> 2024-09-14T11:40:45.856+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -334> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.204 INFO:tasks.workunit.client.0.smithi007.stderr: -333> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -332> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -331> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a739630300 auth_method 0 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -330> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -329> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -328> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -327> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -326> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -325> 2024-09-14T11:40:45.856+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -324> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -323> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -322> 2024-09-14T11:40:45.856+0000 7fed25a2e640 1 monclient: found mon.noname-a 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -321> 2024-09-14T11:40:45.856+0000 7fed25a2e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -320> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -319> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:46.205 INFO:tasks.workunit.client.0.smithi007.stderr: -318> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: dump: 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -317> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -316> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -315> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -314> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.206 INFO:tasks.workunit.client.0.smithi007.stderr: -313> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -312> 2024-09-14T11:40:45.856+0000 7fec0b7fe640 10 monclient: dump: 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -311> 2024-09-14T11:40:45.856+0000 7fed27f44800 5 monclient: authenticate success, global_id 8298 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -310> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -309> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.207 INFO:tasks.workunit.client.0.smithi007.stderr: -308> 2024-09-14T11:40:45.856+0000 7fed26a30640 4 set_mon_vals no callback set 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -307> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -306> 2024-09-14T11:40:45.856+0000 7fed27f44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -305> 2024-09-14T11:40:45.858+0000 7fec0b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -304> 2024-09-14T11:40:45.858+0000 7fec0b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -303> 2024-09-14T11:40:45.858+0000 7fec0b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -302> 2024-09-14T11:40:45.858+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fec00077140 auth_method 0 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -301> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: get_monmap_and_config 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -300> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -299> 2024-09-14T11:40:45.859+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr: -298> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.208 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -297> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding auth protocol: cephx 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -296> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding auth protocol: cephx 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -295> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding auth protocol: cephx 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -294> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -293> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -292> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -291> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -290> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -289> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.209 INFO:tasks.workunit.client.0.smithi007.stderr: -288> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -287> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -286> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -285> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -284> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: crc 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -283> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x55a73964fd80) adding con mode: secure 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -282> 2024-09-14T11:40:45.859+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -281> 2024-09-14T11:40:45.859+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -280> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding auth protocol: cephx 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -279> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding auth protocol: cephx 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -278> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding auth protocol: cephx 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -277> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -276> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -275> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.210 INFO:tasks.workunit.client.0.smithi007.stderr: -274> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -273> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -272> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -271> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -270> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -269> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -268> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -267> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: crc 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -266> 2024-09-14T11:40:45.859+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac100) adding con mode: secure 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -265> 2024-09-14T11:40:45.859+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -264> 2024-09-14T11:40:45.859+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -263> 2024-09-14T11:40:45.860+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key cmddesc rotate-key hook 0x7ffd130ac248 EEXIST 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -262> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -261> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:40:46.211 INFO:tasks.workunit.client.0.smithi007.stderr: -260> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a739653ed0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -259> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a73967e940 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -258> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a73967fcf0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -257> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -256> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -255> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -254> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -253> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.416081s 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -252> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a73967e940 auth_method 0 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -251> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -250> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -249> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -248> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a73967fcf0 auth_method 0 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -247> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -246> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.212 INFO:tasks.workunit.client.0.smithi007.stderr: -245> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -244> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -243> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -242> 2024-09-14T11:40:45.860+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -241> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -240> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -239> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -238> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient(hunting): handle_auth_done global_id 8301 payload 274 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -237> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -236> 2024-09-14T11:40:45.860+0000 7fed25a2e640 1 monclient: found mon.noname-a 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -235> 2024-09-14T11:40:45.860+0000 7fed25a2e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.7:3300/0 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -234> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -233> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr: -232> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: dump: 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.213 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: -231> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: -230> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: -229> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: -228> 2024-09-14T11:40:45.860+0000 7fed27f44800 5 monclient: authenticate success, global_id 8301 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: -227> 2024-09-14T11:40:45.860+0000 7fed27f44800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:46.214 INFO:tasks.workunit.client.0.smithi007.stderr: -226> 2024-09-14T11:40:45.860+0000 7fed27f44800 4 set_mon_vals no callback set 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: -225> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: -224> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: -223> 2024-09-14T11:40:45.860+0000 7fec097fa640 10 monclient: dump: 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: -222> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: shutdown 2024-09-14T11:40:46.215 INFO:tasks.workunit.client.0.smithi007.stderr: -221> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: build_initial_monmap 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: -220> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 build_initial for_mkfs: 0 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: -219> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: monmap: 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 0 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 0.000000 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:created 0.000000 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.noname-a 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.noname-b 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.noname-c 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: -218> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding auth protocol: cephx 2024-09-14T11:40:46.216 INFO:tasks.workunit.client.0.smithi007.stderr: -217> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding auth protocol: cephx 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -216> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding auth protocol: cephx 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -215> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -214> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -213> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -212> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -211> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -210> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -209> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -208> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -207> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -206> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -205> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: crc 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -204> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a739676640) adding con mode: secure 2024-09-14T11:40:46.217 INFO:tasks.workunit.client.0.smithi007.stderr: -203> 2024-09-14T11:40:45.861+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -202> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: starting msgr at 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -201> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: starting objecter 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -200> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 asok(0x55a739392270) register_command objecter_requests cmddesc objecter_requests hook 0x55a7395e3e10 EEXIST 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -199> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: setting wanted keys 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -198> 2024-09-14T11:40:45.861+0000 7fed27f44800 1 librados: calling monclient init 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -197> 2024-09-14T11:40:45.861+0000 7fed27f44800 10 monclient: init 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -196> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding auth protocol: cephx 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -195> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding auth protocol: cephx 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -194> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding auth protocol: cephx 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -193> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -192> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -191> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -190> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.218 INFO:tasks.workunit.client.0.smithi007.stderr: -189> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -188> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -187> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -186> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -185> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -184> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -183> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: crc 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -182> 2024-09-14T11:40:45.861+0000 7fed27f44800 5 AuthRegistry(0x55a7396447e0) adding con mode: secure 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -181> 2024-09-14T11:40:45.862+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -180> 2024-09-14T11:40:45.862+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -179> 2024-09-14T11:40:45.862+0000 7fed27f44800 5 asok(0x55a739392270) register_command rotate-key cmddesc rotate-key hook 0x55a739644928 EEXIST 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -178> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -177> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -176> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-c con 0x55a739653ed0 addr [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -175> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-a con 0x55a73967fcf0 addr [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] 2024-09-14T11:40:46.219 INFO:tasks.workunit.client.0.smithi007.stderr: -174> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): picked mon.noname-b con 0x55a7396883c0 addr [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -173> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -172> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -171> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -170> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -169> 2024-09-14T11:40:45.862+0000 7fed27f44800 10 monclient(hunting): authenticate will time out at 2346.418489s 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -168> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): get_auth_request con 0x55a739653ed0 auth_method 0 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -167> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -166> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -165> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -164> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): get_auth_request con 0x55a73967fcf0 auth_method 0 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -163> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -162> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.220 INFO:tasks.workunit.client.0.smithi007.stderr: -161> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -160> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -159> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -158> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -157> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -156> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -155> 2024-09-14T11:40:45.862+0000 7fed2622f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -154> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): get_auth_request con 0x55a7396883c0 auth_method 0 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -153> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -152> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -151> 2024-09-14T11:40:45.862+0000 7fed25a2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -150> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -149> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient: _finish_hunting 0 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -148> 2024-09-14T11:40:45.862+0000 7fed2522d640 1 monclient: found mon.noname-c 2024-09-14T11:40:46.221 INFO:tasks.workunit.client.0.smithi007.stderr: -147> 2024-09-14T11:40:45.862+0000 7fed2522d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: -146> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: -145> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: -144> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: dump: 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.222 INFO:tasks.workunit.client.0.smithi007.stderr: -143> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr: -142> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr: -141> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr: -140> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr: -139> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr: -138> 2024-09-14T11:40:45.863+0000 7febf77fe640 10 monclient: dump: 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:epoch 1 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:fsid 3191632e-7a9b-4e48-9872-c4da022399f4 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:last_changed 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:created 2024-09-14T11:14:22.491956+0000 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:election_strategy: 1 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.b 2024-09-14T11:40:46.223 INFO:tasks.workunit.client.0.smithi007.stderr:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -137> 2024-09-14T11:40:45.863+0000 7fed27f44800 5 monclient: authenticate success, global_id 7886 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -136> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -135> 2024-09-14T11:40:45.863+0000 7fec097fa640 4 set_mon_vals no callback set 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -134> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -133> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _renew_subs 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -132> 2024-09-14T11:40:45.863+0000 7fed27f44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -131> 2024-09-14T11:40:45.863+0000 7fed27f44800 1 librados: init done 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -130> 2024-09-14T11:40:45.863+0000 7fed27f44800 5 asok(0x55a739392270) register_command cr dump hook 0x55a739688018 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -129> 2024-09-14T11:40:45.865+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -128> 2024-09-14T11:40:45.866+0000 7febf77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -127> 2024-09-14T11:40:45.866+0000 7febf77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -126> 2024-09-14T11:40:45.866+0000 7febf77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.189:6832/898534802,v1:172.21.15.189:6833/898534802] 2024-09-14T11:40:46.224 INFO:tasks.workunit.client.0.smithi007.stderr: -125> 2024-09-14T11:40:45.866+0000 7fed2622f640 10 monclient: get_auth_request con 0x7febf0077260 auth_method 0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -124> 2024-09-14T11:40:45.866+0000 7fed25a2e640 10 monclient: get_auth_request con 0x55a73969ef20 auth_method 0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -123> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -122> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 realm 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -121> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -120> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -119> 2024-09-14T11:40:45.867+0000 7fed27f44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -118> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -117> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -116> 2024-09-14T11:40:45.867+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -115> 2024-09-14T11:40:45.867+0000 7fed2522d640 10 monclient: get_auth_request con 0x55a7396a3210 auth_method 0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -114> 2024-09-14T11:40:45.868+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -113> 2024-09-14T11:40:45.868+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -112> 2024-09-14T11:40:45.868+0000 7fed2622f640 10 monclient: get_auth_request con 0x55a7396a6900 auth_method 0 2024-09-14T11:40:46.225 INFO:tasks.workunit.client.0.smithi007.stderr: -111> 2024-09-14T11:40:45.869+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -110> 2024-09-14T11:40:45.869+0000 7fed27f44800 20 searching for the correct realm 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -109> 2024-09-14T11:40:45.869+0000 7fed25a2e640 10 monclient: get_auth_request con 0x55a7396ab6c0 auth_method 0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -108> 2024-09-14T11:40:45.870+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fed180b5c80 auth_method 0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -107> 2024-09-14T11:40:45.871+0000 7fed2622f640 10 monclient: get_auth_request con 0x7fed1c028070 auth_method 0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -106> 2024-09-14T11:40:45.871+0000 7fed2622f640 0 -- 172.21.15.7:0/2292633289 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fed1c028070 msgr2=0x7fed1c06b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -105> 2024-09-14T11:40:45.871+0000 7febf77fe640 1 client.7886.objecter ms_handle_reset 0x7fed1c028070 session 0x7fed1c030050 osd.2 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -104> 2024-09-14T11:40:45.871+0000 7febf77fe640 10 monclient: _renew_subs 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -103> 2024-09-14T11:40:45.871+0000 7febf77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.7:3301/0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -102> 2024-09-14T11:40:45.871+0000 7fed2622f640 10 monclient: get_auth_request con 0x7febf0087080 auth_method 0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -101> 2024-09-14T11:40:45.872+0000 7fed25a2e640 10 monclient: get_auth_request con 0x7fed20062c10 auth_method 0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -100> 2024-09-14T11:40:45.875+0000 7fed2522d640 0 -- 172.21.15.7:0/2292633289 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fed180ab450 msgr2=0x7fed180c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -99> 2024-09-14T11:40:46.076+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fed180ab450 auth_method 0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -98> 2024-09-14T11:40:46.077+0000 7febf77fe640 1 client.7886.objecter ms_handle_reset 0x7fed180b5c80 session 0x7fed180cd040 osd.7 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -97> 2024-09-14T11:40:46.078+0000 7fed2522d640 10 monclient: get_auth_request con 0x7fed1c028070 auth_method 0 2024-09-14T11:40:46.226 INFO:tasks.workunit.client.0.smithi007.stderr: -96> 2024-09-14T11:40:46.080+0000 7febf77fe640 1 client.7886.objecter ms_handle_reset 0x7febf0087080 session 0x7fed1c030050 osd.2 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -95> 2024-09-14T11:40:46.080+0000 7fed2622f640 10 monclient: get_auth_request con 0x7fed180b5c80 auth_method 0 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -94> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -93> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -92> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -91> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -90> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -89> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -88> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -87> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -86> 2024-09-14T11:40:46.083+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -85> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -84> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -83> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:46.227 INFO:tasks.workunit.client.0.smithi007.stderr: -82> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 zone default found 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -81> 2024-09-14T11:40:46.084+0000 7fed27f44800 4 Realm: () 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -80> 2024-09-14T11:40:46.084+0000 7fed27f44800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -79> 2024-09-14T11:40:46.084+0000 7fed27f44800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -78> 2024-09-14T11:40:46.084+0000 7fed27f44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -77> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 zonegroup default 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -76> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -75> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -74> 2024-09-14T11:40:46.084+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -73> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -72> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -71> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -70> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 started sync module instance, tier type = 2024-09-14T11:40:46.228 INFO:tasks.workunit.client.0.smithi007.stderr: -69> 2024-09-14T11:40:46.085+0000 7fed27f44800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -68> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=0 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -67> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=1 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -66> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=2 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -65> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=3 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -64> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=4 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -63> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=5 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -62> 2024-09-14T11:40:46.095+0000 7fed27f44800 20 add_watcher() i=6 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -61> 2024-09-14T11:40:46.096+0000 7fed27f44800 20 add_watcher() i=7 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -60> 2024-09-14T11:40:46.096+0000 7fed27f44800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -59> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding auth protocol: cephx 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -58> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding auth protocol: cephx 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -57> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding auth protocol: cephx 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -56> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.229 INFO:tasks.workunit.client.0.smithi007.stderr: -55> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -54> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -53> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -52> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -51> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -50> 2024-09-14T11:40:46.098+0000 7febd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -49> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -48> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -47> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -46> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -45> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: crc 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -44> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 AuthRegistry(0x7ffd130ac5e0) adding con mode: secure 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -43> 2024-09-14T11:40:46.098+0000 7fed27f44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -42> 2024-09-14T11:40:46.098+0000 7fed27f44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -41> 2024-09-14T11:40:46.098+0000 7fed27f44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:46.230 INFO:tasks.workunit.client.0.smithi007.stderr: -40> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache list hook 0x55a739689fc0 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -39> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache inspect hook 0x55a739689fc0 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -38> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache erase hook 0x55a739689fc0 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -37> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 asok(0x55a739392270) register_command cache zap hook 0x55a739689fc0 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -36> 2024-09-14T11:40:46.098+0000 7fed27f44800 5 note: GC not initialized 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -35> 2024-09-14T11:40:46.099+0000 7febd67fc640 20 reqs_thread_entry: start 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -34> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace show hook 0x7fed18004040 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -33> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace history hook 0x7fed18004040 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -32> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace active hook 0x7fed18004040 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -31> 2024-09-14T11:40:46.099+0000 7fed27f44800 5 asok(0x55a739392270) register_command sync trace active_short hook 0x7fed18004040 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -30> 2024-09-14T11:40:46.099+0000 7fed27f44800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -29> 2024-09-14T11:40:46.099+0000 7fed27f44800 20 Filter name: none 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -28> 2024-09-14T11:40:46.099+0000 7feb47fff640 20 reqs_thread_entry: start 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -27> 2024-09-14T11:40:46.099+0000 7fed27f44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -26> 2024-09-14T11:40:46.099+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.231 INFO:tasks.workunit.client.0.smithi007.stderr: -25> 2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -24> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -23> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -22> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -21> 2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -20> 2024-09-14T11:40:46.100+0000 7fed27f44800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -19> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -18> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -17> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -16> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -15> 2024-09-14T11:40:46.100+0000 7fed27f44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -14> 2024-09-14T11:40:46.101+0000 7fed27f44800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -13> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -12> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.232 INFO:tasks.workunit.client.0.smithi007.stderr: -11> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -10> 2024-09-14T11:40:46.109+0000 7fed27f44800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -9> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529800 cookie 94176711229168 notifier 7886 bl.length()=911 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -8> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -7> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -6> 2024-09-14T11:40:46.109+0000 7fec097fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -5> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -4> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -3> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -2> 2024-09-14T11:40:46.110+0000 7fed27f44800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: -1> 2024-09-14T11:40:46.116+0000 7fed27f44800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fed27f44800 time 2024-09-14T11:40:46.116166+0000 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.233 INFO:tasks.workunit.client.0.smithi007.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fed2b58c76a] 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 5: main() 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 7: __libc_start_main() 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 8: _start() 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 0> 2024-09-14T11:40:46.117+0000 7fed27f44800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: in thread 7fed27f44800 thread_name:radosgw-admin 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fed2a23e6f0] 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fed2a28b99c] 2024-09-14T11:40:46.234 INFO:tasks.workunit.client.0.smithi007.stderr: 3: raise() 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 4: abort() 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fed2b58c7c4] 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fed2b58c928] 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a7377820b1] 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a737791f6a] 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 9: main() 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fed2a229590] 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 11: __libc_start_main() 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 12: _start() 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr:--- logging levels --- 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 none 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 lockdep 2024-09-14T11:40:46.235 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 context 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 crush 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_locker 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 buffer 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 timer 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 filer 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 striper 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 1 objecter 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rados 2024-09-14T11:40:46.236 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 journaler 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objectcacher 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 client 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 osd 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 optracker 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 objclass 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 filestore 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 journal 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 ms 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mon 2024-09-14T11:40:46.237 INFO:tasks.workunit.client.0.smithi007.stderr: 0/10 monc 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 paxos 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 tp 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 auth 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 crypto 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 finisher 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 reserver 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 perfcounter 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_access 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:46.238 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 20/20 rgw_notification 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 javaclient 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 asok 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 1 throttle 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 0 refs 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 compressor 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluestore 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 bluefs 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 3 bdev 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 kstore 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 4/ 5 rocksdb 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 fuse 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 2/ 5 mgr 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mgrc 2024-09-14T11:40:46.239 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 dpdk 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 eventtrace 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 prioritycache 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 test 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_t 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:46.240 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_device 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 alienstore 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 mclock 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 cyanstore 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 memstore 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 1/ 5 trace 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:46.241 INFO:tasks.workunit.client.0.smithi007.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7feb47fff640 / http_manager 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7febd67fc640 / http_manager 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7febd77fe640 / rgw_dt_lg_renew 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7febf77fe640 / ms_dispatch 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec097fa640 / io_context_pool 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec0b7fe640 / ms_dispatch 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec12604640 / ms_dispatch 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fec13e07640 / io_context_pool 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed2522d640 / msgr-worker-2 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed25a2e640 / msgr-worker-1 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed2622f640 / msgr-worker-0 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed26a30640 / io_context_pool 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: 7fed27f44800 / radosgw-admin 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: max_recent 500 2024-09-14T11:40:46.242 INFO:tasks.workunit.client.0.smithi007.stderr: max_new 1000 2024-09-14T11:40:46.243 INFO:tasks.workunit.client.0.smithi007.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:40:46.117611Z_e85383e6-31de-44de-b14d-b31d8491ea32/log 2024-09-14T11:40:46.243 INFO:tasks.workunit.client.0.smithi007.stderr:--- end dump of recent events --- 2024-09-14T11:40:46.243 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:40:46.244 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:46.244 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:46.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.197+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.244 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.198+0000 7f62f7498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.198+0000 7f62f7498800 20 realm 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.199+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.199+0000 7f62f7498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.199+0000 7f62f7498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.199+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.199+0000 7f62f7498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.199+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.200+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.200+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.201+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.201+0000 7f62f7498800 20 searching for the correct realm 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.203+0000 7f62f5783640 0 -- 172.21.15.7:0/1942862679 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f62e001e070 msgr2=0x7f62e0043930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.245 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.207+0000 7f62effff640 0 -- 172.21.15.7:0/1942862679 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f62e80c8910 msgr2=0x7f62e80b9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:46.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.415+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:46.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 zone default found 2024-09-14T11:40:46.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 4 Realm: () 2024-09-14T11:40:46.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 zonegroup default 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.416+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.417+0000 7f62f7498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.417+0000 7f62f7498800 20 started sync module instance, tier type = 2024-09-14T11:40:46.415 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.417+0000 7f62f7498800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:46.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.426+0000 7f62f7498800 20 add_watcher() i=0 2024-09-14T11:40:46.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.426+0000 7f62f7498800 20 add_watcher() i=1 2024-09-14T11:40:46.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.426+0000 7f62f7498800 20 add_watcher() i=2 2024-09-14T11:40:46.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.426+0000 7f62f7498800 20 add_watcher() i=3 2024-09-14T11:40:46.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.426+0000 7f62f7498800 20 add_watcher() i=4 2024-09-14T11:40:46.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.426+0000 7f62f7498800 20 add_watcher() i=5 2024-09-14T11:40:46.424 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.426+0000 7f62f7498800 20 add_watcher() i=6 2024-09-14T11:40:46.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.427+0000 7f62f7498800 20 add_watcher() i=7 2024-09-14T11:40:46.425 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.427+0000 7f62f7498800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:46.427 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.429+0000 7f61aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f62f7498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f62f7498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f62f7498800 5 note: GC not initialized 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f61a9fe3640 20 reqs_thread_entry: start 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f62f7498800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f62f7498800 20 Filter name: none 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f611b7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:46.428 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.430+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.431+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:46.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.431+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.431+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:46.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.431+0000 7f62f7498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:46.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.431+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.432+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:46.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.432+0000 7f62f7498800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.432+0000 7f62f7498800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:46.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.432+0000 7f62f7498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:46.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.434+0000 7f61aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.436+0000 7f62f7498800 20 remove_watcher() i=0 2024-09-14T11:40:46.434 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.436+0000 7f62f7498800 2 removed watcher, disabling cache 2024-09-14T11:40:46.435 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.437+0000 7f62f7498800 20 remove_watcher() i=1 2024-09-14T11:40:46.436 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.439+0000 7f62f7498800 20 remove_watcher() i=2 2024-09-14T11:40:46.437 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.440+0000 7f62f7498800 20 remove_watcher() i=3 2024-09-14T11:40:46.438 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.441+0000 7f62f7498800 20 remove_watcher() i=4 2024-09-14T11:40:46.439 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.442+0000 7f62f7498800 20 remove_watcher() i=5 2024-09-14T11:40:46.440 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.443+0000 7f62f7498800 20 remove_watcher() i=6 2024-09-14T11:40:46.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.444+0000 7f62f7498800 20 remove_watcher() i=7 2024-09-14T11:40:46.455 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:40:46.455 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:40:46.463 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:40:46.493 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:46.493 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:46.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.535+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 20 realm 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.537+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.539+0000 7f9462d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.536 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.539+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.539+0000 7f9462d22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:46.537 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.539+0000 7f9462d22800 20 searching for the correct realm 2024-09-14T11:40:46.539 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.541+0000 7f945f269640 0 -- 172.21.15.7:0/3238514432 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f94540abd60 msgr2=0x7f94540aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.747+0000 7f945e267640 0 -- 172.21.15.7:0/3238514432 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f9450074420 msgr2=0x7f945006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.955+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 zone default found 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 4 Realm: () 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 zonegroup default 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.956+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.957+0000 7f9462d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.957+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.957+0000 7f9462d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:46.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.957+0000 7f9462d22800 20 started sync module instance, tier type = 2024-09-14T11:40:46.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.957+0000 7f9462d22800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:40:46.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=0 2024-09-14T11:40:46.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=1 2024-09-14T11:40:46.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=2 2024-09-14T11:40:46.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=3 2024-09-14T11:40:46.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=4 2024-09-14T11:40:46.965 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=5 2024-09-14T11:40:46.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=6 2024-09-14T11:40:46.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 20 add_watcher() i=7 2024-09-14T11:40:46.966 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.968+0000 7f9462d22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:46.968 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.970+0000 7f93157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f9462d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f9462d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f9462d22800 5 note: GC not initialized 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f928ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f9462d22800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f9462d22800 20 Filter name: none 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f928dffb640 20 reqs_thread_entry: start 2024-09-14T11:40:46.969 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f9462d22800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:46.970 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.971+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.972+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:40:46.971 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.973+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:40:46.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.973+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:40:46.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.973+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:40:46.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.973+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:40:46.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.973+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:40:46.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.973+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:40:46.972 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.974+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:40:46.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.974+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:40:46.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.974+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:40:46.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.974+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:40:46.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.975+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:40:46.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.975+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:40:46.973 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.975+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:40:46.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.975+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:40:46.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.976+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:40:46.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.976+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:40:46.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.976+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:40:46.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.976+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:40:46.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.976+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:40:46.974 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.976+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:40:46.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.977+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:40:46.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.977+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:40:46.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.977+0000 7f9462d22800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:40:46.975 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.977+0000 7f9462d22800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:40:46.976 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.979+0000 7f93157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:46.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.981+0000 7f9462d22800 20 remove_watcher() i=0 2024-09-14T11:40:46.979 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.981+0000 7f9462d22800 2 removed watcher, disabling cache 2024-09-14T11:40:46.980 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.983+0000 7f9462d22800 20 remove_watcher() i=1 2024-09-14T11:40:46.981 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.984+0000 7f9462d22800 20 remove_watcher() i=2 2024-09-14T11:40:46.983 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.985+0000 7f9462d22800 20 remove_watcher() i=3 2024-09-14T11:40:46.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.986+0000 7f9462d22800 20 remove_watcher() i=4 2024-09-14T11:40:46.984 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.987+0000 7f9462d22800 20 remove_watcher() i=5 2024-09-14T11:40:46.986 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.988+0000 7f9462d22800 20 remove_watcher() i=6 2024-09-14T11:40:46.987 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:40:46.989+0000 7f9462d22800 20 remove_watcher() i=7 2024-09-14T11:41:17.014 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:41:17.047 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:17.047 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:17.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.095+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.097+0000 7fb464813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.097+0000 7fb464813800 20 realm 2024-09-14T11:41:17.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.097+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.097+0000 7fb464813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.097+0000 7fb464813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:17.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.097+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.098+0000 7fb464813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.098+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.099+0000 7fb464813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.099+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.099+0000 7fb464813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:17.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.100+0000 7fb464813800 20 searching for the correct realm 2024-09-14T11:41:17.100 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.101+0000 7fb460749640 0 -- 172.21.15.7:0/60003331 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fb454036020 msgr2=0x7fb454068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:17.306 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.308+0000 7fb45f747640 0 -- 172.21.15.7:0/60003331 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fb450090040 msgr2=0x7fb450091940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:17.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:17.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:17.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:17.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:17.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:17.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:17.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.516+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 zone default found 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 4 Realm: () 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 zonegroup default 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.517+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.518+0000 7fb464813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.518+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.518+0000 7fb464813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.518+0000 7fb464813800 20 started sync module instance, tier type = 2024-09-14T11:41:17.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.518+0000 7fb464813800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:17.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.529+0000 7fb464813800 20 add_watcher() i=0 2024-09-14T11:41:17.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.529+0000 7fb464813800 20 add_watcher() i=1 2024-09-14T11:41:17.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.529+0000 7fb464813800 20 add_watcher() i=2 2024-09-14T11:41:17.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.529+0000 7fb464813800 20 add_watcher() i=3 2024-09-14T11:41:17.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.529+0000 7fb464813800 20 add_watcher() i=4 2024-09-14T11:41:17.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.529+0000 7fb464813800 20 add_watcher() i=5 2024-09-14T11:41:17.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.529+0000 7fb464813800 20 add_watcher() i=6 2024-09-14T11:41:17.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.531+0000 7fb464813800 20 add_watcher() i=7 2024-09-14T11:41:17.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.531+0000 7fb464813800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:17.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.533+0000 7fb315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.533+0000 7fb464813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:17.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.533+0000 7fb464813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:17.532 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.534+0000 7fb464813800 5 note: GC not initialized 2024-09-14T11:41:17.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.534+0000 7fb314fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:17.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.534+0000 7fb464813800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:17.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.534+0000 7fb464813800 20 Filter name: none 2024-09-14T11:41:17.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.534+0000 7fb28e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:17.533 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.534+0000 7fb464813800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:17.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.534+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.535+0000 7fb464813800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:17.534 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.535+0000 7fb464813800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.535+0000 7fb464813800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.535+0000 7fb464813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.535+0000 7fb464813800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.536+0000 7fb464813800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.536+0000 7fb464813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.536+0000 7fb464813800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.536+0000 7fb464813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.536+0000 7fb464813800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:17.535 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.536+0000 7fb464813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:41:17.540 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.541+0000 7fb315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.542 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.544+0000 7fb464813800 20 remove_watcher() i=0 2024-09-14T11:41:17.543 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.544+0000 7fb464813800 2 removed watcher, disabling cache 2024-09-14T11:41:17.544 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.545+0000 7fb464813800 20 remove_watcher() i=1 2024-09-14T11:41:17.545 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.546+0000 7fb464813800 20 remove_watcher() i=2 2024-09-14T11:41:17.546 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.548+0000 7fb464813800 20 remove_watcher() i=3 2024-09-14T11:41:17.548 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.549+0000 7fb464813800 20 remove_watcher() i=4 2024-09-14T11:41:17.549 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.550+0000 7fb464813800 20 remove_watcher() i=5 2024-09-14T11:41:17.550 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.551+0000 7fb464813800 20 remove_watcher() i=6 2024-09-14T11:41:17.551 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.552+0000 7fb464813800 20 remove_watcher() i=7 2024-09-14T11:41:17.567 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:41:17.598 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:17.598 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:17.641 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.643+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.643 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 20 realm 2024-09-14T11:41:17.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:17.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.644 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.645+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.646+0000 7fb1ffa13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.646+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.647+0000 7fb1ffa13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:17.645 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.647+0000 7fb1ffa13800 20 searching for the correct realm 2024-09-14T11:41:17.647 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.649+0000 7fb1fb949640 0 -- 172.21.15.7:0/1671794892 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fb1f006dbf0 msgr2=0x7fb1f00767b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:17.855+0000 7fb1fa947640 0 -- 172.21.15.7:0/1671794892 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fb1ec0aa190 msgr2=0x7fb1ec0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:18.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.062+0000 7fb1ffa13800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:18.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.062+0000 7fb1ffa13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:18.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.062+0000 7fb1ffa13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:18.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.062+0000 7fb1ffa13800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:18.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.062+0000 7fb1ffa13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:18.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.062+0000 7fb1ffa13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:18.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.063+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.063+0000 7fb1ffa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.063+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.063+0000 7fb1ffa13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.063+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:18.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 zone default found 2024-09-14T11:41:18.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 4 Realm: () 2024-09-14T11:41:18.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:18.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:18.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:18.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 zonegroup default 2024-09-14T11:41:18.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.064+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.065+0000 7fb1ffa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.065+0000 7fb1ffa13800 20 started sync module instance, tier type = 2024-09-14T11:41:18.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.065+0000 7fb1ffa13800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:18.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.075+0000 7fb1ffa13800 20 add_watcher() i=0 2024-09-14T11:41:18.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.075+0000 7fb1ffa13800 20 add_watcher() i=1 2024-09-14T11:41:18.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.075+0000 7fb1ffa13800 20 add_watcher() i=2 2024-09-14T11:41:18.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.075+0000 7fb1ffa13800 20 add_watcher() i=3 2024-09-14T11:41:18.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.075+0000 7fb1ffa13800 20 add_watcher() i=4 2024-09-14T11:41:18.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.075+0000 7fb1ffa13800 20 add_watcher() i=5 2024-09-14T11:41:18.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.075+0000 7fb1ffa13800 20 add_watcher() i=6 2024-09-14T11:41:18.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.076+0000 7fb1ffa13800 20 add_watcher() i=7 2024-09-14T11:41:18.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.076+0000 7fb1ffa13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:18.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.078+0000 7fb0b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb1ffa13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:18.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb1ffa13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:18.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb1ffa13800 5 note: GC not initialized 2024-09-14T11:41:18.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb0b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:18.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb1ffa13800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:18.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb1ffa13800 20 Filter name: none 2024-09-14T11:41:18.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb02a7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:18.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb1ffa13800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:18.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.079+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:18.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.080+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.081+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:18.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.081+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:18.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.081+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:18.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.081+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:18.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.082+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:18.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.082+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:18.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.082+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:18.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.082+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:18.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.082+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:18.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.082+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:18.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.083+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:18.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.083+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:18.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.083+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:18.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.083+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:18.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.084+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:18.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.084+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:18.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.084+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:18.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.084+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:18.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.085+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:18.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.085+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:18.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.085+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:18.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.085+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:18.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.085+0000 7fb1ffa13800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:18.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.085+0000 7fb1ffa13800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:18.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.087+0000 7fb0b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.089+0000 7fb1ffa13800 20 remove_watcher() i=0 2024-09-14T11:41:18.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.089+0000 7fb1ffa13800 2 removed watcher, disabling cache 2024-09-14T11:41:18.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.090+0000 7fb1ffa13800 20 remove_watcher() i=1 2024-09-14T11:41:18.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.091+0000 7fb1ffa13800 20 remove_watcher() i=2 2024-09-14T11:41:18.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.093+0000 7fb1ffa13800 20 remove_watcher() i=3 2024-09-14T11:41:18.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.094+0000 7fb1ffa13800 20 remove_watcher() i=4 2024-09-14T11:41:18.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.095+0000 7fb1ffa13800 20 remove_watcher() i=5 2024-09-14T11:41:18.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.096+0000 7fb1ffa13800 20 remove_watcher() i=6 2024-09-14T11:41:18.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.097+0000 7fb1ffa13800 20 remove_watcher() i=7 2024-09-14T11:41:18.107 INFO:tasks.workunit.client.0.smithi007.stderr:check reshard logrecord successfully 2024-09-14T11:41:18.107 INFO:tasks.workunit.client.0.smithi007.stderr: test: reshard versioned bucket 2024-09-14T11:41:18.109 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:41:18.139 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:18.139 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:18.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.181+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 20 realm 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.182 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.183+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.184+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.184+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.185+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:18.184 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.185+0000 7ff814b26800 20 searching for the correct realm 2024-09-14T11:41:18.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.187+0000 7ff810f0a640 0 -- 172.21.15.7:0/1288424077 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ff804017070 msgr2=0x7ff8040469d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:18.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.395+0000 7ff80ff08640 0 -- 172.21.15.7:0/1288424077 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ff80007fc20 msgr2=0x7ff800071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:18.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:18.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:18.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:18.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:18.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:18.600 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.601 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.601+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 zone default found 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 4 Realm: () 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 zonegroup default 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.602 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.602+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.603+0000 7ff814b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.603+0000 7ff814b26800 20 started sync module instance, tier type = 2024-09-14T11:41:18.603 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.603+0000 7ff814b26800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:18.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.612+0000 7ff814b26800 20 add_watcher() i=0 2024-09-14T11:41:18.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.612+0000 7ff814b26800 20 add_watcher() i=1 2024-09-14T11:41:18.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.612+0000 7ff814b26800 20 add_watcher() i=2 2024-09-14T11:41:18.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.612+0000 7ff814b26800 20 add_watcher() i=3 2024-09-14T11:41:18.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.612+0000 7ff814b26800 20 add_watcher() i=4 2024-09-14T11:41:18.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.612+0000 7ff814b26800 20 add_watcher() i=5 2024-09-14T11:41:18.611 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.612+0000 7ff814b26800 20 add_watcher() i=6 2024-09-14T11:41:18.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.613+0000 7ff814b26800 20 add_watcher() i=7 2024-09-14T11:41:18.612 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.613+0000 7ff814b26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:18.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.615+0000 7ff6c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.615+0000 7ff814b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:18.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.615+0000 7ff814b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:18.614 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.615+0000 7ff814b26800 5 note: GC not initialized 2024-09-14T11:41:18.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.615+0000 7ff6c5fdb640 20 reqs_thread_entry: start 2024-09-14T11:41:18.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.616+0000 7ff814b26800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:18.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.616+0000 7ff814b26800 20 Filter name: none 2024-09-14T11:41:18.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.616+0000 7ff6377fe640 20 reqs_thread_entry: start 2024-09-14T11:41:18.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.616+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.616+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:18.615 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.616+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.617+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:18.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.617+0000 7ff814b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:18.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.617+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.618+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:18.616 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.618+0000 7ff814b26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.618+0000 7ff814b26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:18.617 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.618+0000 7ff814b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:18.618 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.620+0000 7ff6c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.623+0000 7ff814b26800 20 remove_watcher() i=0 2024-09-14T11:41:18.621 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.623+0000 7ff814b26800 2 removed watcher, disabling cache 2024-09-14T11:41:18.622 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.624+0000 7ff814b26800 20 remove_watcher() i=1 2024-09-14T11:41:18.623 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.625+0000 7ff814b26800 20 remove_watcher() i=2 2024-09-14T11:41:18.624 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.626+0000 7ff814b26800 20 remove_watcher() i=3 2024-09-14T11:41:18.626 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.627+0000 7ff814b26800 20 remove_watcher() i=4 2024-09-14T11:41:18.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.628+0000 7ff814b26800 20 remove_watcher() i=5 2024-09-14T11:41:18.627 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.629+0000 7ff814b26800 20 remove_watcher() i=6 2024-09-14T11:41:18.628 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.630+0000 7ff814b26800 20 remove_watcher() i=7 2024-09-14T11:41:18.640 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:18.640 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:41:18.640 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: myver id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:41:18.640 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:18.641 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:41:18.673 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:18.673 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:18.713 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.715+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.716+0000 7f451ef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.716+0000 7f451ef33800 20 realm 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.716+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.716+0000 7f451ef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.716+0000 7f451ef33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.716+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.717+0000 7f451ef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.717+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.716 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.718+0000 7f451ef33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.718+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.718+0000 7f451ef33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:18.717 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.719+0000 7f451ef33800 20 searching for the correct realm 2024-09-14T11:41:18.719 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.720+0000 7f451b477640 0 -- 172.21.15.7:0/330539832 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4510065930 msgr2=0x7f451008c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:18.927+0000 7f451a475640 0 -- 172.21.15.7:0/330539832 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f450c07e1d0 msgr2=0x7f450c069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:19.132 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.133 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.134 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.134+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 zone default found 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 4 Realm: () 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 zonegroup default 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.135 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.135+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.136+0000 7f451ef33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.136+0000 7f451ef33800 20 started sync module instance, tier type = 2024-09-14T11:41:19.136 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.136+0000 7f451ef33800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:19.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.145+0000 7f451ef33800 20 add_watcher() i=0 2024-09-14T11:41:19.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.145+0000 7f451ef33800 20 add_watcher() i=1 2024-09-14T11:41:19.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.145+0000 7f451ef33800 20 add_watcher() i=2 2024-09-14T11:41:19.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.145+0000 7f451ef33800 20 add_watcher() i=3 2024-09-14T11:41:19.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.145+0000 7f451ef33800 20 add_watcher() i=4 2024-09-14T11:41:19.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.145+0000 7f451ef33800 20 add_watcher() i=5 2024-09-14T11:41:19.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.145+0000 7f451ef33800 20 add_watcher() i=6 2024-09-14T11:41:19.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.146+0000 7f451ef33800 20 add_watcher() i=7 2024-09-14T11:41:19.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.146+0000 7f451ef33800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:19.147 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.148+0000 7f43d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.148+0000 7f451ef33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:19.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.148+0000 7f451ef33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:19.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 5 note: GC not initialized 2024-09-14T11:41:19.148 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f434bfff640 20 reqs_thread_entry: start 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 20 Filter name: none 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f4349ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.149+0000 7f451ef33800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : miss 2024-09-14T11:41:19.149 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:19.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:19.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 10 adding default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:19.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:19.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:19.150 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.150+0000 7f451ef33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:19.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f451ef33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:19.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f451ef33800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:19.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f451ef33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:19.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f451ef33800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:19.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f43fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 93856467195616 notifier 8421 bl.length()=905 2024-09-14T11:41:19.155 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f43fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:19.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f43fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:19.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.156+0000 7f43fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:19.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.157+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:19.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.157+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:19.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.157+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:19.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.157+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.0 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.0 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.1 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.1 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.2 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.2 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.3 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.3 2024-09-14T11:41:19.162 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.4 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.4 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.5 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.5 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.6 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.6 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.7 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.7 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.8 2024-09-14T11:41:19.163 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.8 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.9 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.9 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.10 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.10 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.11 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.11 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.0 2024-09-14T11:41:19.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.163+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1 2024-09-14T11:41:19.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.164+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2 2024-09-14T11:41:19.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.164+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3 2024-09-14T11:41:19.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.165+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.4 2024-09-14T11:41:19.165 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.165+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.5 2024-09-14T11:41:19.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.165+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.6 2024-09-14T11:41:19.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.166+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.7 2024-09-14T11:41:19.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.167+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.8 2024-09-14T11:41:19.166 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.167+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.9 2024-09-14T11:41:19.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.168+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.10 2024-09-14T11:41:19.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.169+0000 7f451ef33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:19.167 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.169+0000 7f451ef33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.170+0000 7f451ef33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.170+0000 7f451ef33800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.170+0000 7f451ef33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.170+0000 7f451ef33800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f43fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529702 cookie 93856467195616 notifier 8421 bl.length()=905 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f43fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f43fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:19.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f43fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:19.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:19.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:19.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:19.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.171+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:19.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.174+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.0 2024-09-14T11:41:19.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.174+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1 2024-09-14T11:41:19.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.174+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2 2024-09-14T11:41:19.173 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.175+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3 2024-09-14T11:41:19.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.175+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.4 2024-09-14T11:41:19.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.175+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.5 2024-09-14T11:41:19.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.176+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.6 2024-09-14T11:41:19.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.176+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.7 2024-09-14T11:41:19.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.176+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.8 2024-09-14T11:41:19.175 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.177+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.9 2024-09-14T11:41:19.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.177+0000 7f451ef33800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.10 2024-09-14T11:41:19.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.178+0000 7f451ef33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:19.176 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.178+0000 7f451ef33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f451ef33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f451ef33800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f451ef33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f451ef33800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f43fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 93856467195616 notifier 8421 bl.length()=873 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f43fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f43fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:19.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.179+0000 7f43fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:19.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.180+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:19.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.180+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:19.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.180+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:19.179 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.180+0000 7f451ef33800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:19.181 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.182+0000 7f451ef33800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:41:19.183 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.184+0000 7f43d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.187+0000 7f451ef33800 20 remove_watcher() i=0 2024-09-14T11:41:19.185 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.187+0000 7f451ef33800 2 removed watcher, disabling cache 2024-09-14T11:41:19.186 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.188+0000 7f451ef33800 20 remove_watcher() i=1 2024-09-14T11:41:19.187 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.189+0000 7f451ef33800 20 remove_watcher() i=2 2024-09-14T11:41:19.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.190+0000 7f451ef33800 20 remove_watcher() i=3 2024-09-14T11:41:19.189 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.191+0000 7f451ef33800 20 remove_watcher() i=4 2024-09-14T11:41:19.190 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.192+0000 7f451ef33800 20 remove_watcher() i=5 2024-09-14T11:41:19.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.193+0000 7f451ef33800 20 remove_watcher() i=6 2024-09-14T11:41:19.192 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.194+0000 7f451ef33800 20 remove_watcher() i=7 2024-09-14T11:41:19.206 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:41:19.235 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:19.235 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:19.274 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.275+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.277+0000 7f0ce3e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.277+0000 7f0ce3e10800 20 realm 2024-09-14T11:41:19.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.277+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.277+0000 7f0ce3e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.277+0000 7f0ce3e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:19.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.277+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.278+0000 7f0ce3e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.278+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.279+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.279+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.279+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:19.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.279+0000 7f0ce3e10800 20 searching for the correct realm 2024-09-14T11:41:19.280 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.282+0000 7f0cdf5e0640 0 -- 172.21.15.7:0/4161758751 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f0cd8074070 msgr2=0x7f0cd80b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:19.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.489+0000 7f0cdf5e0640 0 -- 172.21.15.7:0/4161758751 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7f0cd8074070 msgr2=0x7f0cd80b5b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.494+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 zone default found 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 4 Realm: () 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 zonegroup default 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 started sync module instance, tier type = 2024-09-14T11:41:19.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.495+0000 7f0ce3e10800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:19.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.505+0000 7f0ce3e10800 20 add_watcher() i=0 2024-09-14T11:41:19.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.505+0000 7f0ce3e10800 20 add_watcher() i=1 2024-09-14T11:41:19.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.505+0000 7f0ce3e10800 20 add_watcher() i=2 2024-09-14T11:41:19.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.505+0000 7f0ce3e10800 20 add_watcher() i=3 2024-09-14T11:41:19.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.505+0000 7f0ce3e10800 20 add_watcher() i=4 2024-09-14T11:41:19.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.505+0000 7f0ce3e10800 20 add_watcher() i=5 2024-09-14T11:41:19.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.505+0000 7f0ce3e10800 20 add_watcher() i=6 2024-09-14T11:41:19.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.506+0000 7f0ce3e10800 20 add_watcher() i=7 2024-09-14T11:41:19.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.506+0000 7f0ce3e10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:19.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.508+0000 7f0b95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0ce3e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:19.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0ce3e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:19.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0ce3e10800 5 note: GC not initialized 2024-09-14T11:41:19.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0b94fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:19.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0ce3e10800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:19.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0ce3e10800 20 Filter name: none 2024-09-14T11:41:19.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0b0e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:19.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.509+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.510+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:19.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.510+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.510+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:19.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.510+0000 7f0ce3e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:19.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.510+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.511+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:19.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.511+0000 7f0ce3e10800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.511+0000 7f0ce3e10800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:19.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.511+0000 7f0ce3e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:19.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.513+0000 7f0b95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.516+0000 7f0ce3e10800 20 remove_watcher() i=0 2024-09-14T11:41:19.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.516+0000 7f0ce3e10800 2 removed watcher, disabling cache 2024-09-14T11:41:19.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.517+0000 7f0ce3e10800 20 remove_watcher() i=1 2024-09-14T11:41:19.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.518+0000 7f0ce3e10800 20 remove_watcher() i=2 2024-09-14T11:41:19.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.519+0000 7f0ce3e10800 20 remove_watcher() i=3 2024-09-14T11:41:19.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.520+0000 7f0ce3e10800 20 remove_watcher() i=4 2024-09-14T11:41:19.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.521+0000 7f0ce3e10800 20 remove_watcher() i=5 2024-09-14T11:41:19.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.522+0000 7f0ce3e10800 20 remove_watcher() i=6 2024-09-14T11:41:19.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.523+0000 7f0ce3e10800 20 remove_watcher() i=7 2024-09-14T11:41:19.532 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:19.533 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:41:19.533 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: myver id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:41:19.533 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:19.535 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:19.535 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:19.538 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:19.538 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:19.580 INFO:tasks.workunit.client.0.smithi007.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:41:19.582 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:19.582 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:19.629 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:19.629 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:19.673 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:41:19.703 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:19.703 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:19.742 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.744+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 20 realm 2024-09-14T11:41:19.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:19.745 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.746+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.747+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.746 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.747+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.748+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:19.747 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.748+0000 7ff0bb542800 20 searching for the correct realm 2024-09-14T11:41:19.950 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:19.951+0000 7ff0b7aee640 0 -- 172.21.15.7:0/449520138 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ff0ac090040 msgr2=0x7ff0ac092a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:20.156 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.157+0000 7ff0b6aec640 0 -- 172.21.15.7:0/449520138 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ff0a808b920 msgr2=0x7ff0a80973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:20.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:20.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:20.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:20.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:20.366 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:20.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:20.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.365+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:20.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.368 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 zone default found 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 4 Realm: () 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 zonegroup default 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.366+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.369 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.367+0000 7ff0bb542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.367+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.367+0000 7ff0bb542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.367+0000 7ff0bb542800 20 started sync module instance, tier type = 2024-09-14T11:41:20.370 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.367+0000 7ff0bb542800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:20.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.379+0000 7ff0bb542800 20 add_watcher() i=0 2024-09-14T11:41:20.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.379+0000 7ff0bb542800 20 add_watcher() i=1 2024-09-14T11:41:20.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.379+0000 7ff0bb542800 20 add_watcher() i=2 2024-09-14T11:41:20.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.379+0000 7ff0bb542800 20 add_watcher() i=3 2024-09-14T11:41:20.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.379+0000 7ff0bb542800 20 add_watcher() i=4 2024-09-14T11:41:20.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.379+0000 7ff0bb542800 20 add_watcher() i=5 2024-09-14T11:41:20.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.379+0000 7ff0bb542800 20 add_watcher() i=6 2024-09-14T11:41:20.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.381+0000 7ff0bb542800 20 add_watcher() i=7 2024-09-14T11:41:20.380 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.381+0000 7ff0bb542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:20.381 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.382+0000 7fef6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.383+0000 7ff0bb542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:20.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.383+0000 7ff0bb542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:20.382 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.383+0000 7ff0bb542800 5 note: GC not initialized 2024-09-14T11:41:20.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.383+0000 7fef6cfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:20.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.383+0000 7ff0bb542800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:20.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.383+0000 7ff0bb542800 20 Filter name: none 2024-09-14T11:41:20.383 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.383+0000 7feee67fc640 20 reqs_thread_entry: start 2024-09-14T11:41:20.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.384+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.384+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:20.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.384+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.385+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:41:20.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.385+0000 7ff0bb542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:20.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.385+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.385+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:20.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.385+0000 7ff0bb542800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.386+0000 7ff0bb542800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:41:20.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.386+0000 7ff0bb542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:20.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.388+0000 7fef6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.391+0000 7ff0bb542800 20 remove_watcher() i=0 2024-09-14T11:41:20.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.391+0000 7ff0bb542800 2 removed watcher, disabling cache 2024-09-14T11:41:20.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.392+0000 7ff0bb542800 20 remove_watcher() i=1 2024-09-14T11:41:20.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.393+0000 7ff0bb542800 20 remove_watcher() i=2 2024-09-14T11:41:20.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.394+0000 7ff0bb542800 20 remove_watcher() i=3 2024-09-14T11:41:20.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.396+0000 7ff0bb542800 20 remove_watcher() i=4 2024-09-14T11:41:20.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.397+0000 7ff0bb542800 20 remove_watcher() i=5 2024-09-14T11:41:20.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.398+0000 7ff0bb542800 20 remove_watcher() i=6 2024-09-14T11:41:20.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.399+0000 7ff0bb542800 20 remove_watcher() i=7 2024-09-14T11:41:20.411 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:20.411 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:41:20.411 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: a-bucket id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:41:20.411 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:20.413 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:41:20.444 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:20.444 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:20.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.488+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 20 realm 2024-09-14T11:41:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.490+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.491+0000 7f3808abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:20.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.491+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.492+0000 7f3808abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:20.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.492+0000 7f3808abb800 20 searching for the correct realm 2024-09-14T11:41:20.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.493+0000 7f3805da4640 0 -- 172.21.15.7:0/2147600068 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f37f8069050 msgr2=0x7f37f8060f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:20.697 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.699+0000 7f3806da6640 0 -- 172.21.15.7:0/2147600068 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f36d0087050 msgr2=0x7f36d0089480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:20.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:20.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:20.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:20.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:20.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:20.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:20.910 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.909+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 20 zone default found 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 4 Realm: () 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:20.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 20 zonegroup default 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.910+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.911+0000 7f3808abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.911+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.911+0000 7f3808abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.911+0000 7f3808abb800 20 started sync module instance, tier type = 2024-09-14T11:41:20.912 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.911+0000 7f3808abb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:20.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.922+0000 7f3808abb800 20 add_watcher() i=0 2024-09-14T11:41:20.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.922+0000 7f3808abb800 20 add_watcher() i=1 2024-09-14T11:41:20.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.922+0000 7f3808abb800 20 add_watcher() i=2 2024-09-14T11:41:20.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.922+0000 7f3808abb800 20 add_watcher() i=3 2024-09-14T11:41:20.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.922+0000 7f3808abb800 20 add_watcher() i=4 2024-09-14T11:41:20.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.922+0000 7f3808abb800 20 add_watcher() i=5 2024-09-14T11:41:20.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.922+0000 7f3808abb800 20 add_watcher() i=6 2024-09-14T11:41:20.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.923+0000 7f3808abb800 20 add_watcher() i=7 2024-09-14T11:41:20.922 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.923+0000 7f3808abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:20.924 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.924+0000 7f36bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.925+0000 7f3808abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:20.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.925+0000 7f3808abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:20.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.925+0000 7f3808abb800 5 note: GC not initialized 2024-09-14T11:41:20.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.925+0000 7f36377fe640 20 reqs_thread_entry: start 2024-09-14T11:41:20.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.925+0000 7f3808abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:20.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.925+0000 7f3808abb800 20 Filter name: none 2024-09-14T11:41:20.925 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.926+0000 7f36357fa640 20 reqs_thread_entry: start 2024-09-14T11:41:20.926 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.926+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.926+0000 7f3808abb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:20.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.927+0000 7f3808abb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:20.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.927+0000 7f3808abb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:41:20.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.927+0000 7f3808abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:20.927 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.928+0000 7f36bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:20.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.931+0000 7f3808abb800 20 remove_watcher() i=0 2024-09-14T11:41:20.929 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.931+0000 7f3808abb800 2 removed watcher, disabling cache 2024-09-14T11:41:20.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.932+0000 7f3808abb800 20 remove_watcher() i=1 2024-09-14T11:41:20.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.933+0000 7f3808abb800 20 remove_watcher() i=2 2024-09-14T11:41:20.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.934+0000 7f3808abb800 20 remove_watcher() i=3 2024-09-14T11:41:20.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.935+0000 7f3808abb800 20 remove_watcher() i=4 2024-09-14T11:41:20.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.936+0000 7f3808abb800 20 remove_watcher() i=5 2024-09-14T11:41:20.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.937+0000 7f3808abb800 20 remove_watcher() i=6 2024-09-14T11:41:20.937 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:20.938+0000 7f3808abb800 20 remove_watcher() i=7 2024-09-14T11:41:20.950 INFO:tasks.workunit.client.0.smithi007.stderr:rados -p default.rgw.buckets.index setomapval .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:41:20.978 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:20.978 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:20.995 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:41:21.025 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:21.025 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:21.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.065+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 20 realm 2024-09-14T11:41:21.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:21.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.067+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.068+0000 7f8bd8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.068+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.069+0000 7f8bd8f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:21.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.069+0000 7f8bd8f26800 20 searching for the correct realm 2024-09-14T11:41:21.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.071+0000 7f8bd530a640 0 -- 172.21.15.7:0/3405602964 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8bbc017020 msgr2=0x7f8bbc03cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:21.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.277+0000 7f8bcc308640 0 -- 172.21.15.7:0/3405602964 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8bc4008070 msgr2=0x7f8bc4048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:21.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.483+0000 7f8bd8f26800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.483+0000 7f8bd8f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.483+0000 7f8bd8f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.483+0000 7f8bd8f26800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.483+0000 7f8bd8f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.483+0000 7f8bd8f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.484+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.484+0000 7f8bd8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.484+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.484+0000 7f8bd8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.484 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.484+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 zone default found 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 4 Realm: () 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 zonegroup default 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.485+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.486+0000 7f8bd8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.486+0000 7f8bd8f26800 20 started sync module instance, tier type = 2024-09-14T11:41:21.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.486+0000 7f8bd8f26800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:21.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.496+0000 7f8bd8f26800 20 add_watcher() i=0 2024-09-14T11:41:21.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.496+0000 7f8bd8f26800 20 add_watcher() i=1 2024-09-14T11:41:21.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.496+0000 7f8bd8f26800 20 add_watcher() i=2 2024-09-14T11:41:21.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.496+0000 7f8bd8f26800 20 add_watcher() i=3 2024-09-14T11:41:21.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.496+0000 7f8bd8f26800 20 add_watcher() i=4 2024-09-14T11:41:21.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.496+0000 7f8bd8f26800 20 add_watcher() i=5 2024-09-14T11:41:21.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.496+0000 7f8bd8f26800 20 add_watcher() i=6 2024-09-14T11:41:21.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.497+0000 7f8bd8f26800 20 add_watcher() i=7 2024-09-14T11:41:21.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.497+0000 7f8bd8f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:21.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.499+0000 7f8a8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.499+0000 7f8bd8f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:21.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.499+0000 7f8bd8f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:21.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.499+0000 7f8bd8f26800 5 note: GC not initialized 2024-09-14T11:41:21.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.500+0000 7f8a8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:41:21.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.500+0000 7f8bd8f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:21.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.500+0000 7f8bd8f26800 20 Filter name: none 2024-09-14T11:41:21.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.500+0000 7f8a83fff640 20 reqs_thread_entry: start 2024-09-14T11:41:21.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.500+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 20 INFO: main: starting shard=0 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:21.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.501+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:21.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:41:21.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 INFO: main: starting shard=1 2024-09-14T11:41:21.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:21.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:21.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 INFO: main: starting shard=2 2024-09-14T11:41:21.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:21.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:21.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 INFO: main: starting shard=3 2024-09-14T11:41:21.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:21.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.502+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 20 INFO: main: starting shard=4 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 20 INFO: main: starting shard=5 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.503+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.504+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.504+0000 7f8bd8f26800 20 INFO: main: starting shard=6 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.504+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:21.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.504+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.505+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.505+0000 7f8bd8f26800 20 INFO: main: starting shard=7 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.505+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.505+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 20 INFO: main: starting shard=8 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:21.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:21.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 20 INFO: main: starting shard=9 2024-09-14T11:41:21.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:21.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.506+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:21.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 20 INFO: main: starting shard=10 2024-09-14T11:41:21.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:21.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:21.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 20 INFO: main: starting shard=11 2024-09-14T11:41:21.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:21.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.507+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:21.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.508+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.508+0000 7f8bd8f26800 20 INFO: main: starting shard=12 2024-09-14T11:41:21.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.508+0000 7f8bd8f26800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:21.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.508+0000 7f8bd8f26800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:21.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.509+0000 7f8bd8f26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:21.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.509+0000 7f8bd8f26800 20 INFO: main: done 2024-09-14T11:41:21.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.510+0000 7f8a8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:21.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.512+0000 7f8bd8f26800 20 remove_watcher() i=0 2024-09-14T11:41:21.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.512+0000 7f8bd8f26800 2 removed watcher, disabling cache 2024-09-14T11:41:21.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.513+0000 7f8bd8f26800 20 remove_watcher() i=1 2024-09-14T11:41:21.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.514+0000 7f8bd8f26800 20 remove_watcher() i=2 2024-09-14T11:41:21.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.516+0000 7f8bd8f26800 20 remove_watcher() i=3 2024-09-14T11:41:21.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.517+0000 7f8bd8f26800 20 remove_watcher() i=4 2024-09-14T11:41:21.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.518+0000 7f8bd8f26800 20 remove_watcher() i=5 2024-09-14T11:41:21.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.519+0000 7f8bd8f26800 20 remove_watcher() i=6 2024-09-14T11:41:21.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.520+0000 7f8bd8f26800 20 remove_watcher() i=7 2024-09-14T11:41:21.531 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:41:21.565 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:21.565 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:21.807 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.808+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.808 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 20 realm 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.810+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.811+0000 7f58e4d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:21.809 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.811+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:21.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.812+0000 7f58e4d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:21.810 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.812+0000 7f58e4d39800 20 searching for the correct realm 2024-09-14T11:41:21.812 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:21.813+0000 7f58e01c6640 0 -- 172.21.15.7:0/2539671185 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f58d0026020 msgr2=0x7f58d0061dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:22.018 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.020+0000 7f58e11c8640 0 -- 172.21.15.7:0/2539671185 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f58d4043040 msgr2=0x7f58d4043420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.026 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.027+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:22.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:22.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 20 zone default found 2024-09-14T11:41:22.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 4 Realm: () 2024-09-14T11:41:22.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:22.027 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:22.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:22.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 20 zonegroup default 2024-09-14T11:41:22.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.028+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.029+0000 7f58e4d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.029+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.029+0000 7f58e4d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.028 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.029+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.029+0000 7f58e4d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.029+0000 7f58e4d39800 20 started sync module instance, tier type = 2024-09-14T11:41:22.029 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.029+0000 7f58e4d39800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:22.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.040+0000 7f58e4d39800 20 add_watcher() i=0 2024-09-14T11:41:22.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.040+0000 7f58e4d39800 20 add_watcher() i=1 2024-09-14T11:41:22.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.040+0000 7f58e4d39800 20 add_watcher() i=2 2024-09-14T11:41:22.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.040+0000 7f58e4d39800 20 add_watcher() i=3 2024-09-14T11:41:22.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.040+0000 7f58e4d39800 20 add_watcher() i=4 2024-09-14T11:41:22.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.040+0000 7f58e4d39800 20 add_watcher() i=5 2024-09-14T11:41:22.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.040+0000 7f58e4d39800 20 add_watcher() i=6 2024-09-14T11:41:22.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.041+0000 7f58e4d39800 20 add_watcher() i=7 2024-09-14T11:41:22.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.041+0000 7f58e4d39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:22.041 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.042+0000 7f5796fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f58e4d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f58e4d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f58e4d39800 5 note: GC not initialized 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f5795fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f58e4d39800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f58e4d39800 20 Filter name: none 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f57077fe640 20 reqs_thread_entry: start 2024-09-14T11:41:22.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f58e4d39800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:22.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.043+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:22.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:22.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:22.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : miss 2024-09-14T11:41:22.043 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:41:22.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:22.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:22.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:22.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:22.044 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.044+0000 7f58e4d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:41:22.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.048+0000 7f58e4d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:22.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.048+0000 7f58e4d39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:22.047 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.048+0000 7f58e4d39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.048+0000 7f58e4d39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f57b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529802 cookie 94247279443008 notifier 8520 bl.length()=911 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f57b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f57b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f57b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:41:22.048 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.049+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:41:22.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.055+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:41:22.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.055+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:41:22.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.055+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:22.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.055+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:22.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.056+0000 7f58e4d39800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:41:22.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.056+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:22.054 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.056+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:22.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.056+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:22.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.056+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:22.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.056+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:22.055 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.056+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:22.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.057+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:22.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.057+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:22.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.057+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:22.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.057+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:22.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.058+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:22.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.058+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:22.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.059+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:22.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.059+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:22.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.060+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:22.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.060+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:22.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.060+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:22.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.060+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:22.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.061+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:22.059 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.061+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:22.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.061+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:22.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.061+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:22.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.062+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:22.060 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.062+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:22.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.062+0000 7f58e4d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:22.061 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.062+0000 7f58e4d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:41:22.062 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f58e4d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:22.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f58e4d39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:22.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f58e4d39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:22.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f58e4d39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:41:22.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f57b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529803 cookie 94247279443008 notifier 8520 bl.length()=911 2024-09-14T11:41:22.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f57b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:22.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f57b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:22.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.064+0000 7f57b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:22.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.065+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:41:22.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.065+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:41:22.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.065+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:41:22.064 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.065+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:41:22.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.068+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:22.066 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.068+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.0 2024-09-14T11:41:22.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.068+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:22.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.068+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.1 2024-09-14T11:41:22.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.068+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:22.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.068+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.2 2024-09-14T11:41:22.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.069+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:22.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.069+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.3 2024-09-14T11:41:22.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.069+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:22.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.069+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.4 2024-09-14T11:41:22.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.069+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:22.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.069+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.5 2024-09-14T11:41:22.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.070+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:22.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.070+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.6 2024-09-14T11:41:22.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.070+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:22.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.070+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.7 2024-09-14T11:41:22.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.070+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:22.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.070+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.8 2024-09-14T11:41:22.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.071+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:22.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.071+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.9 2024-09-14T11:41:22.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.071+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:22.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.071+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.10 2024-09-14T11:41:22.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.071+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:22.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.071+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.11 2024-09-14T11:41:22.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.072+0000 7f58e4d39800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:22.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.072+0000 7f58e4d39800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.2.12 2024-09-14T11:41:22.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.072+0000 7f58e4d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:22.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.072+0000 7f58e4d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 2024-09-14T11:41:22.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.073+0000 7f58e4d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:22.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.073+0000 7f58e4d39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.073+0000 7f58e4d39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f58e4d39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18, ofs0, ns] 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f57b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529804 cookie 94247279443008 notifier 8520 bl.length()=879 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f57b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 info.flags=0x17 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f57b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18 to cache LRU end 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f57b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_sources= new_sources= 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential sources added=[] removed=[] 2024-09-14T11:41:22.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): orig_dests= new_dests= 2024-09-14T11:41:22.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.074+0000 7f58e4d39800 20 handle_bi_update(): bucket=:a-bucket[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18]): potential dests added=[] removed=[] 2024-09-14T11:41:22.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.077+0000 7f58e4d39800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:41:22.078 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.079+0000 7f5796fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:22.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.082+0000 7f58e4d39800 20 remove_watcher() i=0 2024-09-14T11:41:22.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.082+0000 7f58e4d39800 2 removed watcher, disabling cache 2024-09-14T11:41:22.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.083+0000 7f58e4d39800 20 remove_watcher() i=1 2024-09-14T11:41:22.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.084+0000 7f58e4d39800 20 remove_watcher() i=2 2024-09-14T11:41:22.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.085+0000 7f58e4d39800 20 remove_watcher() i=3 2024-09-14T11:41:22.084 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.086+0000 7f58e4d39800 20 remove_watcher() i=4 2024-09-14T11:41:22.085 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.087+0000 7f58e4d39800 20 remove_watcher() i=5 2024-09-14T11:41:22.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.088+0000 7f58e4d39800 20 remove_watcher() i=6 2024-09-14T11:41:22.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.089+0000 7f58e4d39800 20 remove_watcher() i=7 2024-09-14T11:41:22.100 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:41:22.129 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:22.129 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:22.168 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.170+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.170 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 20 realm 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.172+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.171 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.173+0000 7ffa8771f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:22.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.173+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.174+0000 7ffa8771f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:22.172 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.174+0000 7ffa8771f800 20 searching for the correct realm 2024-09-14T11:41:22.174 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.176+0000 7ffa83ca3640 0 -- 172.21.15.7:0/2763108489 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ffa7803cb40 msgr2=0x7ffa78048900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:22.178 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.180+0000 7ffa82ca1640 0 -- 172.21.15.7:0/2763108489 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ffa7406cbc0 msgr2=0x7ffa74047830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.386 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:22.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.387+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 zone default found 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 4 Realm: () 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 zonegroup default 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.388+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.389+0000 7ffa8771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.389+0000 7ffa8771f800 20 started sync module instance, tier type = 2024-09-14T11:41:22.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.389+0000 7ffa8771f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:22.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=0 2024-09-14T11:41:22.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=1 2024-09-14T11:41:22.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=2 2024-09-14T11:41:22.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=3 2024-09-14T11:41:22.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=4 2024-09-14T11:41:22.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=5 2024-09-14T11:41:22.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=6 2024-09-14T11:41:22.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 20 add_watcher() i=7 2024-09-14T11:41:22.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.399+0000 7ffa8771f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:22.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.401+0000 7ff939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ffa8771f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ffa8771f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ffa8771f800 5 note: GC not initialized 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ff938fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ffa8771f800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ffa8771f800 20 Filter name: none 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ff8b27fc640 20 reqs_thread_entry: start 2024-09-14T11:41:22.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.402+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:41:22.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:41:22.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:22.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:41:22.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 20 INFO: main: starting shard=0 2024-09-14T11:41:22.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:41:22.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.403+0000 7ffa8771f800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18.3.0 2024-09-14T11:41:22.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.404+0000 7ffa8771f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:22.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.404+0000 7ffa8771f800 20 INFO: main: done 2024-09-14T11:41:22.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.405+0000 7ff939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:22.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.408+0000 7ffa8771f800 20 remove_watcher() i=0 2024-09-14T11:41:22.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.408+0000 7ffa8771f800 2 removed watcher, disabling cache 2024-09-14T11:41:22.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.409+0000 7ffa8771f800 20 remove_watcher() i=1 2024-09-14T11:41:22.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.410+0000 7ffa8771f800 20 remove_watcher() i=2 2024-09-14T11:41:22.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.411+0000 7ffa8771f800 20 remove_watcher() i=3 2024-09-14T11:41:22.410 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.412+0000 7ffa8771f800 20 remove_watcher() i=4 2024-09-14T11:41:22.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.413+0000 7ffa8771f800 20 remove_watcher() i=5 2024-09-14T11:41:22.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.414+0000 7ffa8771f800 20 remove_watcher() i=6 2024-09-14T11:41:22.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.415+0000 7ffa8771f800 20 remove_watcher() i=7 2024-09-14T11:41:22.425 INFO:tasks.workunit.client.0.smithi007.stderr: test: PUT succeeds during reshard 2024-09-14T11:41:22.427 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:41:22.456 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:22.456 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:22.700 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.702+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 20 realm 2024-09-14T11:41:22.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.702 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:22.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.704+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.705+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:22.703 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.705+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.706+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:22.704 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.706+0000 7f7813d2a800 20 searching for the correct realm 2024-09-14T11:41:22.705 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.707+0000 7f780f2ac640 0 -- 172.21.15.7:0/111452567 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f7800068040 msgr2=0x7f7800073920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:22.911 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.912+0000 7f78102ae640 0 -- 172.21.15.7:0/111452567 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f77f8078030 msgr2=0x7f77f806d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.919+0000 7f7813d2a800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.919+0000 7f7813d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.919+0000 7f7813d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.919+0000 7f7813d2a800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.919+0000 7f7813d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.919+0000 7f7813d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.919+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.918 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:22.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.919 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 zone default found 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 4 Realm: () 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 zonegroup default 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.920+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.921+0000 7f7813d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.920 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.921+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.921+0000 7f7813d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.921+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.921+0000 7f7813d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:22.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.921+0000 7f7813d2a800 20 started sync module instance, tier type = 2024-09-14T11:41:22.921 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.921+0000 7f7813d2a800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:22.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=0 2024-09-14T11:41:22.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=1 2024-09-14T11:41:22.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=2 2024-09-14T11:41:22.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=3 2024-09-14T11:41:22.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=4 2024-09-14T11:41:22.930 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=5 2024-09-14T11:41:22.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=6 2024-09-14T11:41:22.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 20 add_watcher() i=7 2024-09-14T11:41:22.931 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.932+0000 7f7813d2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:22.933 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.934+0000 7f76c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.934+0000 7f7813d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.934+0000 7f7813d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f7813d2a800 5 note: GC not initialized 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f76c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f7813d2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f7813d2a800 20 Filter name: none 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f763e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.934 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:22.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.935+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.936+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:22.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.936+0000 7f7813d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:22.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.936+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.935 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.937+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:22.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.937+0000 7f7813d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:22.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.937+0000 7f7813d2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:22.936 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.937+0000 7f7813d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:22.938 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.939+0000 7f76c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:22.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.942+0000 7f7813d2a800 20 remove_watcher() i=0 2024-09-14T11:41:22.940 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.942+0000 7f7813d2a800 2 removed watcher, disabling cache 2024-09-14T11:41:22.941 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.943+0000 7f7813d2a800 20 remove_watcher() i=1 2024-09-14T11:41:22.942 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.944+0000 7f7813d2a800 20 remove_watcher() i=2 2024-09-14T11:41:22.944 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.945+0000 7f7813d2a800 20 remove_watcher() i=3 2024-09-14T11:41:22.945 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.946+0000 7f7813d2a800 20 remove_watcher() i=4 2024-09-14T11:41:22.946 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.948+0000 7f7813d2a800 20 remove_watcher() i=5 2024-09-14T11:41:22.947 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.949+0000 7f7813d2a800 20 remove_watcher() i=6 2024-09-14T11:41:22.948 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:22.950+0000 7f7813d2a800 20 remove_watcher() i=7 2024-09-14T11:41:22.960 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:22.961 INFO:tasks.workunit.client.0.smithi007.stderr:BUCKET_STATS: 2024-09-14T11:41:22.961 INFO:tasks.workunit.client.0.smithi007.stderr:bucket: myver id: 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:41:22.961 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:22.962 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:41:22.996 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:22.996 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:23.036 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.037+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 20 realm 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:23.038 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.039+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.040+0000 7f150db44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:23.039 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.040+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.041+0000 7f150db44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:23.040 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.041+0000 7f150db44800 20 searching for the correct realm 2024-09-14T11:41:23.042 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.043+0000 7f150be2f640 0 -- 172.21.15.7:0/672830550 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f14f4097130 msgr2=0x7f14f405fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:23.248 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.250+0000 7f150ae2d640 0 -- 172.21.15.7:0/672830550 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f14fc06b900 msgr2=0x7f14fc06e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:23.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:23.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.457+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 zone default found 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 4 Realm: () 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:23.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 zonegroup default 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.458+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.459+0000 7f150db44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.459+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.459+0000 7f150db44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.459+0000 7f150db44800 20 started sync module instance, tier type = 2024-09-14T11:41:23.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.459+0000 7f150db44800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.469+0000 7f150db44800 20 add_watcher() i=0 2024-09-14T11:41:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.469+0000 7f150db44800 20 add_watcher() i=1 2024-09-14T11:41:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.469+0000 7f150db44800 20 add_watcher() i=2 2024-09-14T11:41:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.469+0000 7f150db44800 20 add_watcher() i=3 2024-09-14T11:41:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.469+0000 7f150db44800 20 add_watcher() i=4 2024-09-14T11:41:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.469+0000 7f150db44800 20 add_watcher() i=5 2024-09-14T11:41:23.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.469+0000 7f150db44800 20 add_watcher() i=6 2024-09-14T11:41:23.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.470+0000 7f150db44800 20 add_watcher() i=7 2024-09-14T11:41:23.469 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.470+0000 7f150db44800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:23.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.472+0000 7f13c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:23.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.472+0000 7f150db44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.472+0000 7f150db44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.472+0000 7f150db44800 5 note: GC not initialized 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f13c0fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 20 Filter name: none 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f133a7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:41:23.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : miss 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.473+0000 7f150db44800 20 rados->read ofs=0 len=0 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.474+0000 7f150db44800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.474+0000 7f150db44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:23.473 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.474+0000 7f150db44800 10 adding default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:23.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.474+0000 7f150db44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:23.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.474+0000 7f150db44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:23.474 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.474+0000 7f150db44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:23.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:23.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:23.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:23.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f13eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529704 cookie 93925426402640 notifier 8135 bl.length()=905 2024-09-14T11:41:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f13eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f13eeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f13eeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:23.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:23.481 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.481+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:23.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:23.488+0000 7f150db44800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:41:23.967 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:23.967 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:23.984 INFO:tasks.workunit.client.0.smithi007.stderr:put object successful 2024-09-14T11:41:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:28.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:28.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.0 2024-09-14T11:41:28.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.489+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.0 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.491+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.1 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.491+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.1 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.491+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.2 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.491+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.2 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.491+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.3 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.491+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.3 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.492+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.4 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.492+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.4 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.493+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.5 2024-09-14T11:41:28.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.493+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.5 2024-09-14T11:41:28.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.494+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.6 2024-09-14T11:41:28.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.494+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.6 2024-09-14T11:41:28.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.494+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.7 2024-09-14T11:41:28.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.494+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.7 2024-09-14T11:41:28.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.495+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.8 2024-09-14T11:41:28.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.495+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.8 2024-09-14T11:41:28.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.495+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.9 2024-09-14T11:41:28.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.495+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.9 2024-09-14T11:41:28.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.496+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.10 2024-09-14T11:41:28.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.496+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.10 2024-09-14T11:41:28.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.497+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.11 2024-09-14T11:41:28.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.497+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.11 2024-09-14T11:41:28.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.499+0000 7f150db44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:28.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.499+0000 7f150db44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:28.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f150db44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:28.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f150db44800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:28.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f150db44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:28.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f150db44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:28.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f13ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529705 cookie 93925426402640 notifier 8135 bl.length()=905 2024-09-14T11:41:28.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f13ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:28.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f13ee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:28.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.501+0000 7f13ee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:28.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.502+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:28.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.502+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:28.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.502+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:28.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.502+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:28.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.505+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.0 2024-09-14T11:41:28.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.505+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.0 2024-09-14T11:41:28.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.505+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.1 2024-09-14T11:41:28.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.505+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.1 2024-09-14T11:41:28.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.506+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.2 2024-09-14T11:41:28.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.506+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.2 2024-09-14T11:41:28.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.506+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.3 2024-09-14T11:41:28.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.506+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.3 2024-09-14T11:41:28.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.507+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.4 2024-09-14T11:41:28.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.507+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.4 2024-09-14T11:41:28.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.507+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.5 2024-09-14T11:41:28.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.507+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.5 2024-09-14T11:41:28.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.508+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.6 2024-09-14T11:41:28.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.508+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.6 2024-09-14T11:41:28.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.508+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.7 2024-09-14T11:41:28.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.508+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.7 2024-09-14T11:41:28.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.508+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.8 2024-09-14T11:41:28.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.508+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.8 2024-09-14T11:41:28.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.509+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.9 2024-09-14T11:41:28.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.509+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.9 2024-09-14T11:41:28.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.509+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.10 2024-09-14T11:41:28.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.509+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.10 2024-09-14T11:41:28.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.510+0000 7f150db44800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.11 2024-09-14T11:41:28.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.510+0000 7f150db44800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.1.11 2024-09-14T11:41:28.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.512+0000 7f150db44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:28.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.512+0000 7f150db44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:28.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f150db44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f150db44800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f150db44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f150db44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f13ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529706 cookie 93925426402640 notifier 8135 bl.length()=873 2024-09-14T11:41:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f13ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f13ee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:28.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.514+0000 7f13ee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:28.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.515+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:28.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.515+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:28.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.515+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:28.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.515+0000 7f150db44800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:28.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.518+0000 7f150db44800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:41:28.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.521+0000 7f13c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:28.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.523+0000 7f150db44800 20 remove_watcher() i=0 2024-09-14T11:41:28.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.523+0000 7f150db44800 2 removed watcher, disabling cache 2024-09-14T11:41:28.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.525+0000 7f150db44800 20 remove_watcher() i=1 2024-09-14T11:41:28.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.526+0000 7f150db44800 20 remove_watcher() i=2 2024-09-14T11:41:28.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.527+0000 7f150db44800 20 remove_watcher() i=3 2024-09-14T11:41:28.527 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.528+0000 7f150db44800 20 remove_watcher() i=4 2024-09-14T11:41:28.528 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.529+0000 7f150db44800 20 remove_watcher() i=5 2024-09-14T11:41:28.529 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.531+0000 7f150db44800 20 remove_watcher() i=6 2024-09-14T11:41:28.530 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:28.532+0000 7f150db44800 20 remove_watcher() i=7 2024-09-14T11:41:28.989 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:41:28.989 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:41:28.994 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:28.994 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.000 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:29.000 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.043 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:29.043 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.059 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:29.059 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.063 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:29.063 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.076 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:29.077 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.081 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:29.081 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.094 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:29.094 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:29.098 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:41:29.511 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:41:30.928 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:30.928 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:30.980 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:41:30.982 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:41:31.020 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:31.020 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:31.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.066+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.068+0000 7f6b50f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.069+0000 7f6b50f2c800 20 realm 2024-09-14T11:41:31.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.069+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.069+0000 7f6b50f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.069+0000 7f6b50f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:31.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.069+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.069+0000 7f6b50f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.069+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.070+0000 7f6b50f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:31.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.070+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.071+0000 7f6b50f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:31.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.071+0000 7f6b50f2c800 20 searching for the correct realm 2024-09-14T11:41:31.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.073+0000 7f6b4d4ae640 0 -- 172.21.15.7:0/706730298 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6b40088430 msgr2=0x7f6b40088850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:31.278 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.279+0000 7f6b4c4ac640 0 -- 172.21.15.7:0/706730298 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f6b3c072a00 msgr2=0x7f6b3c06d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:31.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.486+0000 7f6b50f2c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:31.485 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.486+0000 7f6b50f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:31.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.486+0000 7f6b50f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:31.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.486+0000 7f6b50f2c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:31.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.486+0000 7f6b50f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:31.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.486+0000 7f6b50f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:31.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.486+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:31.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 zone default found 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 4 Realm: () 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 zonegroup default 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.487+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.488+0000 7f6b50f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.488+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.488 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.488+0000 7f6b50f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.488+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.489+0000 7f6b50f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.489+0000 7f6b50f2c800 20 started sync module instance, tier type = 2024-09-14T11:41:31.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.489+0000 7f6b50f2c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:31.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.500+0000 7f6b50f2c800 20 add_watcher() i=0 2024-09-14T11:41:31.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.500+0000 7f6b50f2c800 20 add_watcher() i=1 2024-09-14T11:41:31.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.500+0000 7f6b50f2c800 20 add_watcher() i=2 2024-09-14T11:41:31.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.500+0000 7f6b50f2c800 20 add_watcher() i=3 2024-09-14T11:41:31.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.500+0000 7f6b50f2c800 20 add_watcher() i=4 2024-09-14T11:41:31.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.500+0000 7f6b50f2c800 20 add_watcher() i=5 2024-09-14T11:41:31.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.500+0000 7f6b50f2c800 20 add_watcher() i=6 2024-09-14T11:41:31.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.501+0000 7f6b50f2c800 20 add_watcher() i=7 2024-09-14T11:41:31.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.501+0000 7f6b50f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:31.501 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.503+0000 7f6a02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:31.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.503+0000 7f6b50f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:31.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.503+0000 7f6b50f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:31.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.503+0000 7f6b50f2c800 5 note: GC not initialized 2024-09-14T11:41:31.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.503+0000 7f6a01fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:31.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.504+0000 7f6b50f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:31.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.504+0000 7f6b50f2c800 20 Filter name: none 2024-09-14T11:41:31.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.504+0000 7f69737fe640 20 reqs_thread_entry: start 2024-09-14T11:41:31.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.504+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.504+0000 7f6b50f2c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:31.504 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.504+0000 7f6b50f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.505+0000 7f6b50f2c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.505+0000 7f6b50f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.505+0000 7f6b50f2c800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.505+0000 7f6b50f2c800 20 INFO: main: starting shard=0 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.505+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.505+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.506+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.506+0000 7f6b50f2c800 20 INFO: main: starting shard=1 2024-09-14T11:41:31.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.506+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:31.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.506+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:31.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 20 INFO: main: starting shard=2 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 20 INFO: main: starting shard=3 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.507+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 20 INFO: main: starting shard=4 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:31.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:31.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 20 INFO: main: starting shard=5 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.508+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.509+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.509+0000 7f6b50f2c800 20 INFO: main: starting shard=6 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.509+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.509+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 INFO: main: starting shard=7 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:31.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:31.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 INFO: main: starting shard=8 2024-09-14T11:41:31.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:31.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 INFO: main: starting shard=9 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.511+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 20 INFO: main: starting shard=10 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:31.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:31.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 20 INFO: main: starting shard=11 2024-09-14T11:41:31.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:31.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.512+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:31.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.513+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.513+0000 7f6b50f2c800 20 INFO: main: starting shard=12 2024-09-14T11:41:31.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.513+0000 7f6b50f2c800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:31.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.513+0000 7f6b50f2c800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:31.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.513+0000 7f6b50f2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:31.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.513+0000 7f6b50f2c800 20 INFO: main: done 2024-09-14T11:41:31.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.514+0000 7f6a02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:31.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.517+0000 7f6b50f2c800 20 remove_watcher() i=0 2024-09-14T11:41:31.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.517+0000 7f6b50f2c800 2 removed watcher, disabling cache 2024-09-14T11:41:31.517 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.519+0000 7f6b50f2c800 20 remove_watcher() i=1 2024-09-14T11:41:31.518 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.520+0000 7f6b50f2c800 20 remove_watcher() i=2 2024-09-14T11:41:31.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.521+0000 7f6b50f2c800 20 remove_watcher() i=3 2024-09-14T11:41:31.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.522+0000 7f6b50f2c800 20 remove_watcher() i=4 2024-09-14T11:41:31.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.523+0000 7f6b50f2c800 20 remove_watcher() i=5 2024-09-14T11:41:31.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.525+0000 7f6b50f2c800 20 remove_watcher() i=6 2024-09-14T11:41:31.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.526+0000 7f6b50f2c800 20 remove_watcher() i=7 2024-09-14T11:41:31.540 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:31.541 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:31.545 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:31.545 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:31.592 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:41:31.593 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:41:31.626 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:31.626 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:31.669 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.670+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 20 realm 2024-09-14T11:41:31.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.671 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:31.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:31.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.672+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.673+0000 7f8aeb814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:31.672 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.673+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:31.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.674+0000 7f8aeb814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:31.673 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.674+0000 7f8aeb814800 20 searching for the correct realm 2024-09-14T11:41:31.675 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.676+0000 7f8ae77e1640 0 -- 172.21.15.7:0/2547830600 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8ad001b040 msgr2=0x7f8ad0041930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:31.882 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:31.883+0000 7f8ae67df640 0 -- 172.21.15.7:0/2547830600 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8ad8091430 msgr2=0x7f8ad8091890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:32.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:32.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:32.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:32.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:32.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:32.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:32.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.090+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 20 zone default found 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 4 Realm: () 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:32.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 20 zonegroup default 2024-09-14T11:41:32.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.091+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.092+0000 7f8aeb814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.094 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.092+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.092+0000 7f8aeb814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.092+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.093+0000 7f8aeb814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.093+0000 7f8aeb814800 20 started sync module instance, tier type = 2024-09-14T11:41:32.095 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.093+0000 7f8aeb814800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:32.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.103+0000 7f8aeb814800 20 add_watcher() i=0 2024-09-14T11:41:32.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.103+0000 7f8aeb814800 20 add_watcher() i=1 2024-09-14T11:41:32.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.103+0000 7f8aeb814800 20 add_watcher() i=2 2024-09-14T11:41:32.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.103+0000 7f8aeb814800 20 add_watcher() i=3 2024-09-14T11:41:32.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.103+0000 7f8aeb814800 20 add_watcher() i=4 2024-09-14T11:41:32.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.103+0000 7f8aeb814800 20 add_watcher() i=5 2024-09-14T11:41:32.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.103+0000 7f8aeb814800 20 add_watcher() i=6 2024-09-14T11:41:32.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.104+0000 7f8aeb814800 20 add_watcher() i=7 2024-09-14T11:41:32.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.104+0000 7f8aeb814800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:32.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.106+0000 7f899d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:32.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8aeb814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:32.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8aeb814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:32.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8aeb814800 5 note: GC not initialized 2024-09-14T11:41:32.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8917fff640 20 reqs_thread_entry: start 2024-09-14T11:41:32.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8aeb814800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:32.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8aeb814800 20 Filter name: none 2024-09-14T11:41:32.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8915ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:32.107 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.107+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 20 INFO: main: starting shard=0 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:32.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.108+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.109+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.109+0000 7f8aeb814800 20 INFO: main: starting shard=1 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.109+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.109+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.110+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.110+0000 7f8aeb814800 20 INFO: main: starting shard=2 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.110+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:32.110 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.110+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:32.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 20 INFO: main: starting shard=3 2024-09-14T11:41:32.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:32.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 20 INFO: main: starting shard=4 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.111+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.112+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.112+0000 7f8aeb814800 20 INFO: main: starting shard=5 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.112+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:32.112 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.112+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:32.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.113+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.113+0000 7f8aeb814800 20 INFO: main: starting shard=6 2024-09-14T11:41:32.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.113+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.113+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 INFO: main: starting shard=7 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 INFO: main: starting shard=8 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:32.114 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:32.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 INFO: main: starting shard=9 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.115+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.116+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.116+0000 7f8aeb814800 20 INFO: main: starting shard=10 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.116+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.116+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 20 INFO: main: starting shard=11 2024-09-14T11:41:32.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:32.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:32.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 20 INFO: main: starting shard=12 2024-09-14T11:41:32.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:32.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.117+0000 7f8aeb814800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:32.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.118+0000 7f8aeb814800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.118+0000 7f8aeb814800 20 INFO: main: done 2024-09-14T11:41:32.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.119+0000 7f899d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:32.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.122+0000 7f8aeb814800 20 remove_watcher() i=0 2024-09-14T11:41:32.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.122+0000 7f8aeb814800 2 removed watcher, disabling cache 2024-09-14T11:41:32.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.123+0000 7f8aeb814800 20 remove_watcher() i=1 2024-09-14T11:41:32.123 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.124+0000 7f8aeb814800 20 remove_watcher() i=2 2024-09-14T11:41:32.124 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.126+0000 7f8aeb814800 20 remove_watcher() i=3 2024-09-14T11:41:32.125 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.127+0000 7f8aeb814800 20 remove_watcher() i=4 2024-09-14T11:41:32.126 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.128+0000 7f8aeb814800 20 remove_watcher() i=5 2024-09-14T11:41:32.127 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.129+0000 7f8aeb814800 20 remove_watcher() i=6 2024-09-14T11:41:32.129 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.130+0000 7f8aeb814800 20 remove_watcher() i=7 2024-09-14T11:41:32.144 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:32.144 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:32.148 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:32.149 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:32.197 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:41:32.198 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:41:32.231 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:32.231 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:32.273 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.274+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.276+0000 7fec2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.276+0000 7fec2213d800 20 realm 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.276+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.276+0000 7fec2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.276+0000 7fec2213d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.276+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.277+0000 7fec2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.275 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.277+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.278+0000 7fec2213d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:32.276 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.278+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.278+0000 7fec2213d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:32.277 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.279+0000 7fec2213d800 20 searching for the correct realm 2024-09-14T11:41:32.279 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.281+0000 7fec1de2a640 0 -- 172.21.15.7:0/3151384465 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fec180a4c20 msgr2=0x7fec18066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:32.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.488+0000 7fec1de2a640 0 -- 172.21.15.7:0/3151384465 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fec180a4c20 msgr2=0x7fec18066090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.491 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.493+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.492 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 zone default found 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 4 Realm: () 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 zonegroup default 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.494+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.495+0000 7fec2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.495+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.495+0000 7fec2213d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:32.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.495+0000 7fec2213d800 20 started sync module instance, tier type = 2024-09-14T11:41:32.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.495+0000 7fec2213d800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:32.502 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.505+0000 7fec2213d800 20 add_watcher() i=0 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.505+0000 7fec2213d800 20 add_watcher() i=1 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.505+0000 7fec2213d800 20 add_watcher() i=2 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.505+0000 7fec2213d800 20 add_watcher() i=3 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.505+0000 7fec2213d800 20 add_watcher() i=4 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.505+0000 7fec2213d800 20 add_watcher() i=5 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.505+0000 7fec2213d800 20 add_watcher() i=6 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.506+0000 7fec2213d800 20 add_watcher() i=7 2024-09-14T11:41:32.503 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.506+0000 7fec2213d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:32.505 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.508+0000 7feacf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:32.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.508+0000 7fec2213d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:32.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.508+0000 7fec2213d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:32.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.508+0000 7fec2213d800 5 note: GC not initialized 2024-09-14T11:41:32.506 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.508+0000 7feace7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:32.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.509+0000 7fec2213d800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:32.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.509+0000 7fec2213d800 20 Filter name: none 2024-09-14T11:41:32.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.509+0000 7fea3ffff640 20 reqs_thread_entry: start 2024-09-14T11:41:32.507 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.509+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.509+0000 7fec2213d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.509+0000 7fec2213d800 20 rados->read ofs=0 len=0 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.510+0000 7fec2213d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.510+0000 7fec2213d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.510+0000 7fec2213d800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.510+0000 7fec2213d800 20 INFO: main: starting shard=0 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.510+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:32.508 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.510+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.510+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.511+0000 7fec2213d800 20 INFO: main: starting shard=1 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.511+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.511+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.511+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.511+0000 7fec2213d800 20 INFO: main: starting shard=2 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.511+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:32.509 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.511+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:32.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.512+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.512+0000 7fec2213d800 20 INFO: main: starting shard=3 2024-09-14T11:41:32.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.512+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:32.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.512+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:32.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 20 INFO: main: starting shard=4 2024-09-14T11:41:32.510 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:32.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:32.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 20 INFO: main: starting shard=5 2024-09-14T11:41:32.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:32.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.513+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:32.511 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 20 INFO: main: starting shard=6 2024-09-14T11:41:32.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:32.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:32.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 20 INFO: main: starting shard=7 2024-09-14T11:41:32.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:32.512 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.514+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 20 INFO: main: starting shard=8 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 20 INFO: main: starting shard=9 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:32.513 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.515+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:32.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 20 INFO: main: starting shard=10 2024-09-14T11:41:32.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:32.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:32.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 20 INFO: main: starting shard=11 2024-09-14T11:41:32.514 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:32.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.516+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:32.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.517+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.517+0000 7fec2213d800 20 INFO: main: starting shard=12 2024-09-14T11:41:32.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.517+0000 7fec2213d800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:32.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.517+0000 7fec2213d800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:32.515 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.518+0000 7fec2213d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:32.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.518+0000 7fec2213d800 20 INFO: main: done 2024-09-14T11:41:32.516 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.518+0000 7feacf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:32.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.521+0000 7fec2213d800 20 remove_watcher() i=0 2024-09-14T11:41:32.519 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.521+0000 7fec2213d800 2 removed watcher, disabling cache 2024-09-14T11:41:32.520 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.522+0000 7fec2213d800 20 remove_watcher() i=1 2024-09-14T11:41:32.521 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.523+0000 7fec2213d800 20 remove_watcher() i=2 2024-09-14T11:41:32.522 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.525+0000 7fec2213d800 20 remove_watcher() i=3 2024-09-14T11:41:32.523 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.526+0000 7fec2213d800 20 remove_watcher() i=4 2024-09-14T11:41:32.524 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.527+0000 7fec2213d800 20 remove_watcher() i=5 2024-09-14T11:41:32.525 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.528+0000 7fec2213d800 20 remove_watcher() i=6 2024-09-14T11:41:32.526 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:32.529+0000 7fec2213d800 20 remove_watcher() i=7 2024-09-14T11:41:32.540 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:32.540 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:32.544 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:41:32.952 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:41:33.357 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:41:33.389 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:33.389 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:33.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.635+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:33.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 20 realm 2024-09-14T11:41:33.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:33.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:33.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:33.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.637+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.638+0000 7f0295e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:33.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.638+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.639+0000 7f0295e63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:33.637 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.639+0000 7f0295e63800 20 searching for the correct realm 2024-09-14T11:41:33.639 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.641+0000 7f0294155640 0 -- 172.21.15.7:0/584732027 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f027c08a030 msgr2=0x7f027c08a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:33.846 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:33.848+0000 7f028b153640 0 -- 172.21.15.7:0/584732027 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f0284061420 msgr2=0x7f0284069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:34.056 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.056+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 zone default found 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 4 Realm: () 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:34.057 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 zonegroup default 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.057+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.058+0000 7f0295e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.058+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.058+0000 7f0295e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.058+0000 7f0295e63800 20 started sync module instance, tier type = 2024-09-14T11:41:34.058 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.058+0000 7f0295e63800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:34.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.070+0000 7f0295e63800 20 add_watcher() i=0 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.070+0000 7f0295e63800 20 add_watcher() i=1 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.070+0000 7f0295e63800 20 add_watcher() i=2 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.070+0000 7f0295e63800 20 add_watcher() i=3 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.070+0000 7f0295e63800 20 add_watcher() i=4 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.070+0000 7f0295e63800 20 add_watcher() i=5 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.070+0000 7f0295e63800 20 add_watcher() i=6 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.071+0000 7f0295e63800 20 add_watcher() i=7 2024-09-14T11:41:34.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.071+0000 7f0295e63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:34.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.073+0000 7f0149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0295e63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0295e63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0295e63800 5 note: GC not initialized 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0148fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0295e63800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0295e63800 20 Filter name: none 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f00c27fc640 20 reqs_thread_entry: start 2024-09-14T11:41:34.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0295e63800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:41:34.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.074+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:34.073 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : miss 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 adding default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.074 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.075+0000 7f0295e63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:34.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.082+0000 7f0295e63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.082+0000 7f0295e63800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.082+0000 7f0295e63800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.082+0000 7f0295e63800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0172ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 94076826350592 notifier 8222 bl.length()=905 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0172ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0172ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0172ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:34.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.083+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:34.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.0 2024-09-14T11:41:34.086 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.0 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.1 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.1 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.2 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.2 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.3 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.3 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.4 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.4 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.5 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.5 2024-09-14T11:41:34.087 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.6 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.6 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.7 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.7 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.8 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.8 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.10 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.10 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.11 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.11 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.12 2024-09-14T11:41:34.088 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.12 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.13 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.13 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.14 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.14 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.15 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.15 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.16 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.088+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.16 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.089+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.089+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.089+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:34.089 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.089+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:34.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.089+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:34.090 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.089+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.090+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.090+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.091+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.091+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.091+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.091+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.092+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.092+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.092+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:34.091 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.092+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:34.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.093+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:34.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.093+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:34.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.094+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:34.092 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.094+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:34.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.095+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:34.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.095+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:34.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.095+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:34.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.095+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:34.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.096+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:34.093 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.096+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:34.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.098+0000 7f0295e63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:34.096 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.098+0000 7f0295e63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:34.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f0295e63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.097 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f0295e63800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f0295e63800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f0295e63800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:34.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f01727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529708 cookie 94076826350592 notifier 8222 bl.length()=905 2024-09-14T11:41:34.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f01727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f01727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.100+0000 7f01727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.098 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.101+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:34.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.101+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:34.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.101+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:34.099 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.101+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:34.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.103+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:34.101 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.103+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.0 2024-09-14T11:41:34.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.104+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:34.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.104+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.1 2024-09-14T11:41:34.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.104+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:34.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.104+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.2 2024-09-14T11:41:34.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.105+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:34.102 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.105+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.3 2024-09-14T11:41:34.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.105+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:34.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.105+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.4 2024-09-14T11:41:34.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.106+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:34.103 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.106+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.5 2024-09-14T11:41:34.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.106+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:34.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.106+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.6 2024-09-14T11:41:34.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.106+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:34.104 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.106+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.7 2024-09-14T11:41:34.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.107+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:34.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.107+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.8 2024-09-14T11:41:34.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.107+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:34.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.107+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.9 2024-09-14T11:41:34.105 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.107+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:34.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.107+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.10 2024-09-14T11:41:34.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.108+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:34.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.108+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.11 2024-09-14T11:41:34.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.108+0000 7f0295e63800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:34.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.108+0000 7f0295e63800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.2.12 2024-09-14T11:41:34.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.109+0000 7f0295e63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:34.106 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.109+0000 7f0295e63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f0295e63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f0295e63800 10 moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f0295e63800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f0295e63800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19, ofs0, ns] 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f01727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529709 cookie 94076826350592 notifier 8222 bl.length()=873 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f01727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f01727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.108 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.110+0000 7f01727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.111+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_sources= new_sources= 2024-09-14T11:41:34.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.111+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential sources added=[] removed=[] 2024-09-14T11:41:34.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.111+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): orig_dests= new_dests= 2024-09-14T11:41:34.109 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.111+0000 7f0295e63800 20 handle_bi_update(): bucket=:myver[00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19]): potential dests added=[] removed=[] 2024-09-14T11:41:34.111 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.113+0000 7f0295e63800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:41:34.113 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.115+0000 7f0149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.115 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.118+0000 7f0295e63800 20 remove_watcher() i=0 2024-09-14T11:41:34.116 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.118+0000 7f0295e63800 2 removed watcher, disabling cache 2024-09-14T11:41:34.117 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.119+0000 7f0295e63800 20 remove_watcher() i=1 2024-09-14T11:41:34.118 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.120+0000 7f0295e63800 20 remove_watcher() i=2 2024-09-14T11:41:34.119 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.121+0000 7f0295e63800 20 remove_watcher() i=3 2024-09-14T11:41:34.120 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.123+0000 7f0295e63800 20 remove_watcher() i=4 2024-09-14T11:41:34.121 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.124+0000 7f0295e63800 20 remove_watcher() i=5 2024-09-14T11:41:34.122 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.125+0000 7f0295e63800 20 remove_watcher() i=6 2024-09-14T11:41:34.123 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.126+0000 7f0295e63800 20 remove_watcher() i=7 2024-09-14T11:41:34.136 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:41:34.172 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:34.172 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:34.212 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.215+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 20 realm 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.216+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.217+0000 7fc89cb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.217+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.218+0000 7fc89cb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.218+0000 7fc89cb23800 20 searching for the correct realm 2024-09-14T11:41:34.217 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.220+0000 7fc89900d640 0 -- 172.21.15.7:0/1938206373 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc88c027020 msgr2=0x7fc88c04a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:34.221 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.224+0000 7fc89800b640 0 -- 172.21.15.7:0/1938206373 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc888095920 msgr2=0x7fc888085410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:34.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:34.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:34.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:34.429 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.431+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.430 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 zone default found 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 4 Realm: () 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 zonegroup default 2024-09-14T11:41:34.431 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.432+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.433+0000 7fc89cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.433+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.433+0000 7fc89cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.433+0000 7fc89cb23800 20 started sync module instance, tier type = 2024-09-14T11:41:34.432 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.433+0000 7fc89cb23800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.443+0000 7fc89cb23800 20 add_watcher() i=0 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.443+0000 7fc89cb23800 20 add_watcher() i=1 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.443+0000 7fc89cb23800 20 add_watcher() i=2 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.443+0000 7fc89cb23800 20 add_watcher() i=3 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.443+0000 7fc89cb23800 20 add_watcher() i=4 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.443+0000 7fc89cb23800 20 add_watcher() i=5 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.443+0000 7fc89cb23800 20 add_watcher() i=6 2024-09-14T11:41:34.441 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.444+0000 7fc89cb23800 20 add_watcher() i=7 2024-09-14T11:41:34.442 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.444+0000 7fc89cb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:34.443 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.446+0000 7fc74efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.446+0000 7fc89cb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:34.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.446+0000 7fc89cb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:34.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.446+0000 7fc89cb23800 5 note: GC not initialized 2024-09-14T11:41:34.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.446+0000 7fc74dfe3640 20 reqs_thread_entry: start 2024-09-14T11:41:34.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.446+0000 7fc89cb23800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:34.444 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 20 Filter name: none 2024-09-14T11:41:34.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc6bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:34.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:41:34.445 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 : miss 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.447+0000 7fc89cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 info.flags=0x17 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 10 adding default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 to cache LRU end 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19 2024-09-14T11:41:34.446 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.0 2024-09-14T11:41:34.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.448+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.0 2024-09-14T11:41:34.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.449+0000 7fc89cb23800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:41:34.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.449+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.1 2024-09-14T11:41:34.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.449+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.1 2024-09-14T11:41:34.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.449+0000 7fc89cb23800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:41:34.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.449+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.2 2024-09-14T11:41:34.447 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.449+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.2 2024-09-14T11:41:34.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.450+0000 7fc89cb23800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:41:34.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.450+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.3 2024-09-14T11:41:34.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.450+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.3 2024-09-14T11:41:34.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.450+0000 7fc89cb23800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:41:34.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.450+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.4 2024-09-14T11:41:34.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.450+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.4 2024-09-14T11:41:34.448 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.451+0000 7fc89cb23800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:41:34.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.451+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.5 2024-09-14T11:41:34.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.451+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.5 2024-09-14T11:41:34.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.451+0000 7fc89cb23800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:41:34.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.451+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.6 2024-09-14T11:41:34.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.451+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.6 2024-09-14T11:41:34.449 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.452+0000 7fc89cb23800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:41:34.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.452+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.7 2024-09-14T11:41:34.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.452+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.7 2024-09-14T11:41:34.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.453+0000 7fc89cb23800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:41:34.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.453+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.8 2024-09-14T11:41:34.450 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.453+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.8 2024-09-14T11:41:34.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.453+0000 7fc89cb23800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:41:34.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.453+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.453+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.454+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.10 2024-09-14T11:41:34.451 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.454+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.10 2024-09-14T11:41:34.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.455+0000 7fc89cb23800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:41:34.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.455+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.11 2024-09-14T11:41:34.452 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.455+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.11 2024-09-14T11:41:34.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.455+0000 7fc89cb23800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:41:34.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.455+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.12 2024-09-14T11:41:34.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.455+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.12 2024-09-14T11:41:34.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.456+0000 7fc89cb23800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:41:34.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.456+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.13 2024-09-14T11:41:34.453 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.456+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.13 2024-09-14T11:41:34.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.456+0000 7fc89cb23800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:41:34.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.456+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.14 2024-09-14T11:41:34.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.456+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.14 2024-09-14T11:41:34.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.457+0000 7fc89cb23800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:41:34.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.457+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.15 2024-09-14T11:41:34.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.457+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.15 2024-09-14T11:41:34.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.458+0000 7fc89cb23800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:41:34.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.458+0000 7fc89cb23800 10 bucket_obj is .dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.16 2024-09-14T11:41:34.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.458+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.16 2024-09-14T11:41:34.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.458+0000 7fc89cb23800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:41:34.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.458+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.459+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:x state=0x55e1939bf768 s->prefetch_data=0 2024-09-14T11:41:34.456 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.459+0000 7fc89cb23800 20 get_obj_state: setting s->obj_tag to hys1exwtcxtpvsbjjxubi09x9op0z7iw 2024-09-14T11:41:34.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.459+0000 7fc89cb23800 20 get_obj_state_impl: setting s->olh_tag to 8s6oo57dwlxgh113xw9hc1c7eoffw4io 2024-09-14T11:41:34.457 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.459+0000 7fc89cb23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8s6oo57dwlxgh113xw9hc1c7eoffw4io 2024-09-14T11:41:34.458 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.460+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.459 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:41:34.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 olh_log_entry: epoch=2 op=3 key=x[Q.DDz9vHvv.nL.2gLGj7ynOe82sPDJq] 2024-09-14T11:41:34.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:_:Q.DDz9vHvv.nL.2gLGj7ynOe82sPDJq_x state=0x55e1939fd248 s->prefetch_data=0 2024-09-14T11:41:34.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 10 manifest: total_size = 22 2024-09-14T11:41:34.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2605633534522033045 2024-09-14T11:41:34.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:_:Q.DDz9vHvv.nL.2gLGj7ynOe82sPDJq_x state=0x55e1939fd248 s->prefetch_data=0 2024-09-14T11:41:34.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 prepare_atomic_modification: state is not atomic. state=0x55e1939fd248 2024-09-14T11:41:34.460 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.462+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.466+0000 7fc76ffff640 20 handle_completion(): completion ok for obj=x[Q.DDz9vHvv.nL.2gLGj7ynOe82sPDJq] 2024-09-14T11:41:34.463 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.466+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:x state=0x55e1939bf768 s->prefetch_data=0 2024-09-14T11:41:34.464 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.466+0000 7fc89cb23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8s6oo57dwlxgh113xw9hc1c7eoffw4io 2024-09-14T11:41:34.466 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.469+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.470+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.467 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.470+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.470+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:y state=0x55e1939bf768 s->prefetch_data=0 2024-09-14T11:41:34.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.471+0000 7fc89cb23800 20 get_obj_state: setting s->obj_tag to rj48n2qs2gl4yxrmpvf390sjzuy6ib63 2024-09-14T11:41:34.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.471+0000 7fc89cb23800 20 get_obj_state_impl: setting s->olh_tag to gffaiaw2yjo088wxrqajwf0no23habe3 2024-09-14T11:41:34.468 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.471+0000 7fc89cb23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gffaiaw2yjo088wxrqajwf0no23habe3 2024-09-14T11:41:34.470 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.472+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.473+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:41:34.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 20 olh_log_entry: epoch=2 op=3 key=y[NbQUYecefd0GfUL.tEHk6MwO-bTk0MO] 2024-09-14T11:41:34.471 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:_:NbQUYecefd0GfUL.tEHk6MwO-bTk0MO_y state=0x55e1939fd378 s->prefetch_data=0 2024-09-14T11:41:34.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 10 manifest: total_size = 22 2024-09-14T11:41:34.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9877273823668423105 2024-09-14T11:41:34.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:_:NbQUYecefd0GfUL.tEHk6MwO-bTk0MO_y state=0x55e1939fd378 s->prefetch_data=0 2024-09-14T11:41:34.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 20 prepare_atomic_modification: state is not atomic. state=0x55e1939fd378 2024-09-14T11:41:34.472 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.474+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.477+0000 7fc76f7fe640 20 handle_completion(): completion ok for obj=y[NbQUYecefd0GfUL.tEHk6MwO-bTk0MO] 2024-09-14T11:41:34.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.477+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:y state=0x55e1939bf768 s->prefetch_data=0 2024-09-14T11:41:34.475 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.477+0000 7fc89cb23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gffaiaw2yjo088wxrqajwf0no23habe3 2024-09-14T11:41:34.477 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.479+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.481+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.478 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.481+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.481+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:z state=0x55e1939bf768 s->prefetch_data=0 2024-09-14T11:41:34.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.482+0000 7fc89cb23800 20 get_obj_state: setting s->obj_tag to ved285kgkv8hlztcxbq227rpn9sk5hc1 2024-09-14T11:41:34.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.482+0000 7fc89cb23800 20 get_obj_state_impl: setting s->olh_tag to pe3j4yg17okauaxmyb6ecmsz3w0o1dcv 2024-09-14T11:41:34.479 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.482+0000 7fc89cb23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pe3j4yg17okauaxmyb6ecmsz3w0o1dcv 2024-09-14T11:41:34.480 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.483+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.484+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.484+0000 7fc89cb23800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:41:34.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.484+0000 7fc89cb23800 20 olh_log_entry: epoch=2 op=3 key=z[uVrUN4EYWW2A8zkLf5G7vAVKLgIIrXL] 2024-09-14T11:41:34.482 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.484+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:_:uVrUN4EYWW2A8zkLf5G7vAVKLgIIrXL_z state=0x55e1939fd378 s->prefetch_data=0 2024-09-14T11:41:34.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.485+0000 7fc89cb23800 10 manifest: total_size = 22 2024-09-14T11:41:34.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.485+0000 7fc89cb23800 20 get_obj_state: setting s->obj_tag to 00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2463839907917983785 2024-09-14T11:41:34.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.485+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:_:uVrUN4EYWW2A8zkLf5G7vAVKLgIIrXL_z state=0x55e1939fd378 s->prefetch_data=0 2024-09-14T11:41:34.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.485+0000 7fc89cb23800 20 prepare_atomic_modification: state is not atomic. state=0x55e1939fd378 2024-09-14T11:41:34.483 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.485+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.489+0000 7fc89cb23800 20 get_obj_state: octx=0x55e19370bba0 obj=myver:z state=0x55e1939bf768 s->prefetch_data=0 2024-09-14T11:41:34.486 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.489+0000 7fc89cb23800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pe3j4yg17okauaxmyb6ecmsz3w0o1dcv 2024-09-14T11:41:34.487 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.489+0000 7fc76f7fe640 20 handle_completion(): completion ok for obj=z[uVrUN4EYWW2A8zkLf5G7vAVKLgIIrXL] 2024-09-14T11:41:34.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.491+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.492+0000 7fc89cb23800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.19.3.9 2024-09-14T11:41:34.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.492+0000 7fc89cb23800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:41:34.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.492+0000 7fc89cb23800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:41:34.490 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.493+0000 7fc74efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.496+0000 7fc89cb23800 20 remove_watcher() i=0 2024-09-14T11:41:34.493 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.496+0000 7fc89cb23800 2 removed watcher, disabling cache 2024-09-14T11:41:34.494 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.497+0000 7fc89cb23800 20 remove_watcher() i=1 2024-09-14T11:41:34.495 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.498+0000 7fc89cb23800 20 remove_watcher() i=2 2024-09-14T11:41:34.496 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.499+0000 7fc89cb23800 20 remove_watcher() i=3 2024-09-14T11:41:34.497 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.500+0000 7fc89cb23800 20 remove_watcher() i=4 2024-09-14T11:41:34.498 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.500+0000 7fc89cb23800 20 remove_watcher() i=5 2024-09-14T11:41:34.499 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.501+0000 7fc89cb23800 20 remove_watcher() i=6 2024-09-14T11:41:34.500 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.502+0000 7fc89cb23800 20 remove_watcher() i=7 2024-09-14T11:41:34.513 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:34.513 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:34.518 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:34.518 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:34.562 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:41:34.591 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:34.591 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:34.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.633+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 20 realm 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.633 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.635+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.636+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.634 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.636+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.637+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:34.635 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.637+0000 7f76b5d75800 20 searching for the correct realm 2024-09-14T11:41:34.636 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.639+0000 7f76b4060640 0 -- 172.21.15.7:0/3184321331 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f76a8041420 msgr2=0x7f76a8041840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:34.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:34.845+0000 7f76b305e640 0 -- 172.21.15.7:0/3184321331 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f76a403d420 msgr2=0x7f76a4046090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:35.049 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.052+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:35.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 zone default found 2024-09-14T11:41:35.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 4 Realm: () 2024-09-14T11:41:35.051 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 zonegroup default 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.053+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.054+0000 7f76b5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.054+0000 7f76b5d75800 20 started sync module instance, tier type = 2024-09-14T11:41:35.053 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.054+0000 7f76b5d75800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:35.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.065+0000 7f76b5d75800 20 add_watcher() i=0 2024-09-14T11:41:35.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.065+0000 7f76b5d75800 20 add_watcher() i=1 2024-09-14T11:41:35.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.065+0000 7f76b5d75800 20 add_watcher() i=2 2024-09-14T11:41:35.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.065+0000 7f76b5d75800 20 add_watcher() i=3 2024-09-14T11:41:35.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.065+0000 7f76b5d75800 20 add_watcher() i=4 2024-09-14T11:41:35.063 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.065+0000 7f76b5d75800 20 add_watcher() i=5 2024-09-14T11:41:35.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.067+0000 7f76b5d75800 20 add_watcher() i=6 2024-09-14T11:41:35.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.067+0000 7f76b5d75800 20 add_watcher() i=7 2024-09-14T11:41:35.065 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.067+0000 7f76b5d75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:35.067 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.069+0000 7f7569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f76b5d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:35.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f76b5d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:35.068 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f76b5d75800 5 note: GC not initialized 2024-09-14T11:41:35.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f7568fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:35.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f76b5d75800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:35.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f76b5d75800 20 Filter name: none 2024-09-14T11:41:35.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f74e27fc640 20 reqs_thread_entry: start 2024-09-14T11:41:35.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.070+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.071+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:35.069 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.071+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.071+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:35.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.071+0000 7f76b5d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:35.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.071+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.072+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:35.070 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.072+0000 7f76b5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.072+0000 7f76b5d75800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:35.071 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.072+0000 7f76b5d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:35.072 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.074+0000 7f7569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.077+0000 7f76b5d75800 20 remove_watcher() i=0 2024-09-14T11:41:35.075 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.077+0000 7f76b5d75800 2 removed watcher, disabling cache 2024-09-14T11:41:35.076 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.078+0000 7f76b5d75800 20 remove_watcher() i=1 2024-09-14T11:41:35.077 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.079+0000 7f76b5d75800 20 remove_watcher() i=2 2024-09-14T11:41:35.079 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.081+0000 7f76b5d75800 20 remove_watcher() i=3 2024-09-14T11:41:35.080 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.082+0000 7f76b5d75800 20 remove_watcher() i=4 2024-09-14T11:41:35.081 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.084+0000 7f76b5d75800 20 remove_watcher() i=5 2024-09-14T11:41:35.082 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.084+0000 7f76b5d75800 20 remove_watcher() i=6 2024-09-14T11:41:35.083 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:41:35.085+0000 7f76b5d75800 20 remove_watcher() i=7 2024-09-14T11:41:35.095 INFO:tasks.workunit.client.0.smithi007.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:41:35.095 INFO:tasks.workunit.client.0.smithi007.stderr:Deleting bucket a-bucket 2024-09-14T11:41:35.097 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:35.097 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:35.101 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:35.101 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:35.118 INFO:tasks.workunit.client.0.smithi007.stderr:Deleting bucket myver 2024-09-14T11:41:35.119 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:35.119 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:35.163 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:41:35.163 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:41:35.200 INFO:tasks.workunit.client.0.smithi007.stderr:Completed resharding tests 2024-09-14T11:41:35.200 INFO:tasks.workunit.client.0.smithi007.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:41:35.200 INFO:tasks.workunit.client.0.smithi007.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:41:35.201 INFO:tasks.workunit.client.0.smithi007.stdout:connected to https://localhost:443 2024-09-14T11:41:35.280 INFO:tasks.workunit.client.0.smithi007.stderr:+ deactivate 2024-09-14T11:41:35.280 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:41:35.280 INFO:tasks.workunit.client.0.smithi007.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ export PATH 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ hash -r 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset -f deactivate 2024-09-14T11:41:35.281 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo OK. 2024-09-14T11:41:35.282 INFO:tasks.workunit.client.0.smithi007.stdout:OK. 2024-09-14T11:41:35.283 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:41:35.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:41:35.363 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:41:35.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:41:35.801 DEBUG:teuthology.parallel:result is None 2024-09-14T11:41:35.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:41:35.841 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:41:35.841 DEBUG:teuthology.orchestra.run.smithi007:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:41:35.911 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:41:35.911 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:41:35.926 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:41:35.926 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:41:35.926 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:41:35.926 DEBUG:teuthology.orchestra.run.smithi007:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:41:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:41:40.706 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:41:40.706 DEBUG:teuthology.orchestra.run.smithi007:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:41:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:41:43.427 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:29:31 ago on Sat 14 Sep 2024 11:12:12 AM UTC. 2024-09-14T11:41:43.575 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-14T11:41:43.576 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-14T11:41:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-09-14T11:41:43.576 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-14T11:41:43.576 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-14T11:41:43.576 INFO:teuthology.orchestra.run.smithi007.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout:Install 5 Packages 2024-09-14T11:41:43.577 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:43.578 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 46 M 2024-09-14T11:41:43.578 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 166 M 2024-09-14T11:41:43.578 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-14T11:41:44.016 INFO:teuthology.orchestra.run.smithi007.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.8 MB/s | 426 kB 00:00 2024-09-14T11:41:44.191 INFO:teuthology.orchestra.run.smithi007.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-09-14T11:41:44.241 INFO:teuthology.orchestra.run.smithi007.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 518 kB/s | 26 kB 00:00 2024-09-14T11:41:44.400 INFO:teuthology.orchestra.run.smithi007.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 18 MB/s | 9.3 MB 00:00 2024-09-14T11:41:45.025 INFO:teuthology.orchestra.run.smithi007.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 32 MB/s | 32 MB 00:01 2024-09-14T11:41:45.026 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:41:45.026 INFO:teuthology.orchestra.run.smithi007.stdout:Total 31 MB/s | 46 MB 00:01 2024-09-14T11:41:45.465 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-14T11:41:45.489 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-14T11:41:45.489 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-14T11:41:45.991 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-14T11:41:45.991 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-14T11:41:46.527 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:41:46.683 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-14T11:41:46.874 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:41:47.505 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:41:47.545 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:41:47.798 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:41:47.829 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:41:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:41:48.342 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:41:48.350 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:41:48.361 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:41:48.444 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:41:50.883 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:41:50.883 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:41:50.883 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:41:50.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:41:50.884 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:41:51.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:41:51.283 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:51.283 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-14T11:41:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:41:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:41:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:41:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:41:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:41:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:51.284 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-14T11:41:51.745 INFO:teuthology.orchestra.run.smithi007.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:41:51.837 INFO:teuthology.orchestra.run.smithi007.stderr:--2024-09-14 11:41:51-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:41:51.965 INFO:teuthology.orchestra.run.smithi007.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-14T11:41:51.973 INFO:teuthology.orchestra.run.smithi007.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:41:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:41:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:41:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:--2024-09-14 11:41:52-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:41:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-14T11:41:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-14T11:41:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:41:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114152Z&X-Amz-Expires=300&X-Amz-Signature=2645e71f6072cd98b11a18293cd2fa483754dd597f0a1b85dd24e0fc9ec38f8b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:41:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:--2024-09-14 11:41:52-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114152Z&X-Amz-Expires=300&X-Amz-Signature=2645e71f6072cd98b11a18293cd2fa483754dd597f0a1b85dd24e0fc9ec38f8b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:41:52.241 INFO:teuthology.orchestra.run.smithi007.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.111.133, ... 2024-09-14T11:41:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-14T11:41:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:41:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:41:52.326 INFO:teuthology.orchestra.run.smithi007.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:41:52.327 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T11:41:52.350 INFO:teuthology.orchestra.run.smithi007.stderr: 0K .......... .......... .......... .......... .......... 0% 2.06M 44s 2024-09-14T11:41:52.354 INFO:teuthology.orchestra.run.smithi007.stderr: 50K .......... .......... .......... .......... .......... 0% 12.5M 26s 2024-09-14T11:41:52.361 INFO:teuthology.orchestra.run.smithi007.stderr: 100K .......... .......... .......... .......... .......... 0% 6.41M 22s 2024-09-14T11:41:52.364 INFO:teuthology.orchestra.run.smithi007.stderr: 150K .......... .......... .......... .......... .......... 0% 21.7M 17s 2024-09-14T11:41:52.366 INFO:teuthology.orchestra.run.smithi007.stderr: 200K .......... .......... .......... .......... .......... 0% 24.7M 15s 2024-09-14T11:41:52.368 INFO:teuthology.orchestra.run.smithi007.stderr: 250K .......... .......... .......... .......... .......... 0% 25.1M 13s 2024-09-14T11:41:52.373 INFO:teuthology.orchestra.run.smithi007.stderr: 300K .......... .......... .......... .......... .......... 0% 8.45M 12s 2024-09-14T11:41:52.375 INFO:teuthology.orchestra.run.smithi007.stderr: 350K .......... .......... .......... .......... .......... 0% 28.5M 11s 2024-09-14T11:41:52.377 INFO:teuthology.orchestra.run.smithi007.stderr: 400K .......... .......... .......... .......... .......... 0% 30.2M 10s 2024-09-14T11:41:52.378 INFO:teuthology.orchestra.run.smithi007.stderr: 450K .......... .......... .......... .......... .......... 0% 107M 9s 2024-09-14T11:41:52.380 INFO:teuthology.orchestra.run.smithi007.stderr: 500K .......... .......... .......... .......... .......... 0% 49.8M 9s 2024-09-14T11:41:52.380 INFO:teuthology.orchestra.run.smithi007.stderr: 550K .......... .......... .......... .......... .......... 0% 46.4M 8s 2024-09-14T11:41:52.385 INFO:teuthology.orchestra.run.smithi007.stderr: 600K .......... .......... .......... .......... .......... 0% 9.37M 8s 2024-09-14T11:41:52.385 INFO:teuthology.orchestra.run.smithi007.stderr: 650K .......... .......... .......... .......... .......... 0% 98.5M 8s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 700K .......... .......... .......... .......... .......... 0% 43.9M 7s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 750K .......... .......... .......... .......... .......... 0% 75.1M 7s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 800K .......... .......... .......... .......... .......... 0% 128M 7s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 850K .......... .......... .......... .......... .......... 0% 43.1M 6s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 900K .......... .......... .......... .......... .......... 1% 223M 6s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 950K .......... .......... .......... .......... .......... 1% 162M 6s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 1000K .......... .......... .......... .......... .......... 1% 48.0M 6s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 1050K .......... .......... .......... .......... .......... 1% 164M 5s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 1100K .......... .......... .......... .......... .......... 1% 155M 5s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 1150K .......... .......... .......... .......... .......... 1% 80.5M 5s 2024-09-14T11:41:52.394 INFO:teuthology.orchestra.run.smithi007.stderr: 1200K .......... .......... .......... .......... .......... 1% 111M 5s 2024-09-14T11:41:53.698 INFO:teuthology.orchestra.run.smithi007.stderr: 1250K .......... .......... .......... .......... .......... 1% 10.4M 5s 2024-09-14T11:41:53.698 INFO:teuthology.orchestra.run.smithi007.stderr: 1300K .......... .......... .......... .......... .......... 1% 216M 5s 2024-09-14T11:41:53.698 INFO:teuthology.orchestra.run.smithi007.stderr: 1350K .......... .......... .......... .......... .......... 1% 233M 5s 2024-09-14T11:41:53.698 INFO:teuthology.orchestra.run.smithi007.stderr: 1400K .......... .......... .......... .......... .......... 1% 62.1M 4s 2024-09-14T11:41:53.698 INFO:teuthology.orchestra.run.smithi007.stderr: 1450K .......... .......... .......... .......... .......... 1% 239M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1500K .......... .......... .......... .......... .......... 1% 94.0M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1550K .......... .......... .......... .......... .......... 1% 224M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1600K .......... .......... .......... .......... .......... 1% 187M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1650K .......... .......... .......... .......... .......... 1% 136M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1700K .......... .......... .......... .......... .......... 1% 147M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1750K .......... .......... .......... .......... .......... 1% 82.6M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1800K .......... .......... .......... .......... .......... 1% 195M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1850K .......... .......... .......... .......... .......... 2% 205M 4s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1900K .......... .......... .......... .......... .......... 2% 208M 3s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 1950K .......... .......... .......... .......... .......... 2% 168M 3s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 2000K .......... .......... .......... .......... .......... 2% 180M 3s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 2050K .......... .......... .......... .......... .......... 2% 190M 3s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 2100K .......... .......... .......... .......... .......... 2% 167M 3s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 2150K .......... .......... .......... .......... .......... 2% 176M 3s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 2200K .......... .......... .......... .......... .......... 2% 179M 3s 2024-09-14T11:41:53.699 INFO:teuthology.orchestra.run.smithi007.stderr: 2250K .......... .......... .......... .......... .......... 2% 204M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2300K .......... .......... .......... .......... .......... 2% 195M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2350K .......... .......... .......... .......... .......... 2% 145M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2400K .......... .......... .......... .......... .......... 2% 205M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2450K .......... .......... .......... .......... .......... 2% 196M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2500K .......... .......... .......... .......... .......... 2% 224M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2550K .......... .......... .......... .......... .......... 2% 12.8M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2600K .......... .......... .......... .......... .......... 2% 219M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2650K .......... .......... .......... .......... .......... 2% 206M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2700K .......... .......... .......... .......... .......... 2% 208M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2750K .......... .......... .......... .......... .......... 3% 141M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2800K .......... .......... .......... .......... .......... 3% 213M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2850K .......... .......... .......... .......... .......... 3% 225M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2900K .......... .......... .......... .......... .......... 3% 194M 3s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 2950K .......... .......... .......... .......... .......... 3% 219M 2s 2024-09-14T11:41:53.700 INFO:teuthology.orchestra.run.smithi007.stderr: 3000K .......... .......... .......... .......... .......... 3% 220M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3050K .......... .......... .......... .......... .......... 3% 178M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3100K .......... .......... .......... .......... .......... 3% 211M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3150K .......... .......... .......... .......... .......... 3% 217M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3200K .......... .......... .......... .......... .......... 3% 215M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3250K .......... .......... .......... .......... .......... 3% 195M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3300K .......... .......... .......... .......... .......... 3% 212M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3350K .......... .......... .......... .......... .......... 3% 184M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3400K .......... .......... .......... .......... .......... 3% 219M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3450K .......... .......... .......... .......... .......... 3% 220M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3500K .......... .......... .......... .......... .......... 3% 213M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3550K .......... .......... .......... .......... .......... 3% 195M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3600K .......... .......... .......... .......... .......... 3% 215M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3650K .......... .......... .......... .......... .......... 3% 218M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3700K .......... .......... .......... .......... .......... 4% 206M 2s 2024-09-14T11:41:53.701 INFO:teuthology.orchestra.run.smithi007.stderr: 3750K .......... .......... .......... .......... .......... 4% 182M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 3800K .......... .......... .......... .......... .......... 4% 206M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 3850K .......... .......... .......... .......... .......... 4% 220M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 3900K .......... .......... .......... .......... .......... 4% 232M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 3950K .......... .......... .......... .......... .......... 4% 198M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4000K .......... .......... .......... .......... .......... 4% 38.1M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4050K .......... .......... .......... .......... .......... 4% 216M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4100K .......... .......... .......... .......... .......... 4% 201M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4150K .......... .......... .......... .......... .......... 4% 175M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4200K .......... .......... .......... .......... .......... 4% 216M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4250K .......... .......... .......... .......... .......... 4% 213M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4300K .......... .......... .......... .......... .......... 4% 217M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4350K .......... .......... .......... .......... .......... 4% 201M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4400K .......... .......... .......... .......... .......... 4% 205M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4450K .......... .......... .......... .......... .......... 4% 222M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4500K .......... .......... .......... .......... .......... 4% 228M 2s 2024-09-14T11:41:53.702 INFO:teuthology.orchestra.run.smithi007.stderr: 4550K .......... .......... .......... .......... .......... 4% 184M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4600K .......... .......... .......... .......... .......... 5% 201M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4650K .......... .......... .......... .......... .......... 5% 226M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4700K .......... .......... .......... .......... .......... 5% 227M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4750K .......... .......... .......... .......... .......... 5% 207M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4800K .......... .......... .......... .......... .......... 5% 219M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4850K .......... .......... .......... .......... .......... 5% 183M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4900K .......... .......... .......... .......... .......... 5% 231M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 4950K .......... .......... .......... .......... .......... 5% 179M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5000K .......... .......... .......... .......... .......... 5% 217M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5050K .......... .......... .......... .......... .......... 5% 209M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5100K .......... .......... .......... .......... .......... 5% 220M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5150K .......... .......... .......... .......... .......... 5% 197M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5200K .......... .......... .......... .......... .......... 5% 216M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5250K .......... .......... .......... .......... .......... 5% 206M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5300K .......... .......... .......... .......... .......... 5% 227M 2s 2024-09-14T11:41:53.703 INFO:teuthology.orchestra.run.smithi007.stderr: 5350K .......... .......... .......... .......... .......... 5% 177M 2s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5400K .......... .......... .......... .......... .......... 5% 224M 2s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5450K .......... .......... .......... .......... .......... 5% 215M 2s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5500K .......... .......... .......... .......... .......... 5% 227M 2s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5550K .......... .......... .......... .......... .......... 6% 202M 2s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5600K .......... .......... .......... .......... .......... 6% 225M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5650K .......... .......... .......... .......... .......... 6% 213M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5700K .......... .......... .......... .......... .......... 6% 219M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5750K .......... .......... .......... .......... .......... 6% 187M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5800K .......... .......... .......... .......... .......... 6% 216M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5850K .......... .......... .......... .......... .......... 6% 222M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5900K .......... .......... .......... .......... .......... 6% 211M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 5950K .......... .......... .......... .......... .......... 6% 210M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 6000K .......... .......... .......... .......... .......... 6% 229M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 6050K .......... .......... .......... .......... .......... 6% 223M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 6100K .......... .......... .......... .......... .......... 6% 218M 1s 2024-09-14T11:41:53.704 INFO:teuthology.orchestra.run.smithi007.stderr: 6150K .......... .......... .......... .......... .......... 6% 185M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6200K .......... .......... .......... .......... .......... 6% 222M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6250K .......... .......... .......... .......... .......... 6% 226M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6300K .......... .......... .......... .......... .......... 6% 227M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6350K .......... .......... .......... .......... .......... 6% 200M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6400K .......... .......... .......... .......... .......... 6% 204M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6450K .......... .......... .......... .......... .......... 6% 223M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6500K .......... .......... .......... .......... .......... 7% 223M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6550K .......... .......... .......... .......... .......... 7% 179M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6600K .......... .......... .......... .......... .......... 7% 224M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6650K .......... .......... .......... .......... .......... 7% 226M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6700K .......... .......... .......... .......... .......... 7% 205M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6750K .......... .......... .......... .......... .......... 7% 202M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6800K .......... .......... .......... .......... .......... 7% 223M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6850K .......... .......... .......... .......... .......... 7% 204M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6900K .......... .......... .......... .......... .......... 7% 233M 1s 2024-09-14T11:41:53.705 INFO:teuthology.orchestra.run.smithi007.stderr: 6950K .......... .......... .......... .......... .......... 7% 175M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7000K .......... .......... .......... .......... .......... 7% 220M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7050K .......... .......... .......... .......... .......... 7% 215M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7100K .......... .......... .......... .......... .......... 7% 209M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7150K .......... .......... .......... .......... .......... 7% 203M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7200K .......... .......... .......... .......... .......... 7% 221M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7250K .......... .......... .......... .......... .......... 7% 213M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7300K .......... .......... .......... .......... .......... 7% 226M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7350K .......... .......... .......... .......... .......... 7% 184M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7400K .......... .......... .......... .......... .......... 8% 216M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7450K .......... .......... .......... .......... .......... 8% 226M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7500K .......... .......... .......... .......... .......... 8% 224M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7550K .......... .......... .......... .......... .......... 8% 209M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7600K .......... .......... .......... .......... .......... 8% 200M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7650K .......... .......... .......... .......... .......... 8% 221M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7700K .......... .......... .......... .......... .......... 8% 222M 1s 2024-09-14T11:41:53.706 INFO:teuthology.orchestra.run.smithi007.stderr: 7750K .......... .......... .......... .......... .......... 8% 186M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 7800K .......... .......... .......... .......... .......... 8% 199M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 7850K .......... .......... .......... .......... .......... 8% 221M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 7900K .......... .......... .......... .......... .......... 8% 232M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 7950K .......... .......... .......... .......... .......... 8% 203M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8000K .......... .......... .......... .......... .......... 8% 224M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8050K .......... .......... .......... .......... .......... 8% 186M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8100K .......... .......... .......... .......... .......... 8% 223M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8150K .......... .......... .......... .......... .......... 8% 221M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8200K .......... .......... .......... .......... .......... 8% 223M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8250K .......... .......... .......... .......... .......... 8% 199M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8300K .......... .......... .......... .......... .......... 8% 221M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8350K .......... .......... .......... .......... .......... 9% 223M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8400K .......... .......... .......... .......... .......... 9% 227M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8450K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8500K .......... .......... .......... .......... .......... 9% 218M 1s 2024-09-14T11:41:53.707 INFO:teuthology.orchestra.run.smithi007.stderr: 8550K .......... .......... .......... .......... .......... 9% 223M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8600K .......... .......... .......... .......... .......... 9% 228M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8650K .......... .......... .......... .......... .......... 9% 218M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8700K .......... .......... .......... .......... .......... 9% 219M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8750K .......... .......... .......... .......... .......... 9% 187M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8800K .......... .......... .......... .......... .......... 9% 228M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8850K .......... .......... .......... .......... .......... 9% 224M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8900K .......... .......... .......... .......... .......... 9% 219M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 8950K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9000K .......... .......... .......... .......... .......... 9% 217M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9050K .......... .......... .......... .......... .......... 9% 214M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9100K .......... .......... .......... .......... .......... 9% 218M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9150K .......... .......... .......... .......... .......... 9% 174M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9200K .......... .......... .......... .......... .......... 9% 221M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9250K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9300K .......... .......... .......... .......... .......... 10% 223M 1s 2024-09-14T11:41:53.708 INFO:teuthology.orchestra.run.smithi007.stderr: 9350K .......... .......... .......... .......... .......... 10% 182M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9400K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9450K .......... .......... .......... .......... .......... 10% 226M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9500K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9550K .......... .......... .......... .......... .......... 10% 175M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9600K .......... .......... .......... .......... .......... 10% 221M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9650K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9700K .......... .......... .......... .......... .......... 10% 223M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9750K .......... .......... .......... .......... .......... 10% 204M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9800K .......... .......... .......... .......... .......... 10% 214M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9850K .......... .......... .......... .......... .......... 10% 204M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9900K .......... .......... .......... .......... .......... 10% 223M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 9950K .......... .......... .......... .......... .......... 10% 191M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 10000K .......... .......... .......... .......... .......... 10% 209M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 10050K .......... .......... .......... .......... .......... 10% 222M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 10100K .......... .......... .......... .......... .......... 10% 216M 1s 2024-09-14T11:41:53.709 INFO:teuthology.orchestra.run.smithi007.stderr: 10150K .......... .......... .......... .......... .......... 10% 209M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10200K .......... .......... .......... .......... .......... 11% 205M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10250K .......... .......... .......... .......... .......... 11% 239M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10300K .......... .......... .......... .......... .......... 11% 182M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10350K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10400K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10450K .......... .......... .......... .......... .......... 11% 217M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10500K .......... .......... .......... .......... .......... 11% 192M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10550K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10600K .......... .......... .......... .......... .......... 11% 227M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10650K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10700K .......... .......... .......... .......... .......... 11% 189M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10750K .......... .......... .......... .......... .......... 11% 222M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10800K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10850K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10900K .......... .......... .......... .......... .......... 11% 196M 1s 2024-09-14T11:41:53.710 INFO:teuthology.orchestra.run.smithi007.stderr: 10950K .......... .......... .......... .......... .......... 11% 227M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11000K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11050K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11100K .......... .......... .......... .......... .......... 12% 178M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11150K .......... .......... .......... .......... .......... 12% 235M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11200K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11250K .......... .......... .......... .......... .......... 12% 229M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11300K .......... .......... .......... .......... .......... 12% 202M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11350K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11400K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11450K .......... .......... .......... .......... .......... 12% 223M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11500K .......... .......... .......... .......... .......... 12% 179M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11550K .......... .......... .......... .......... .......... 12% 211M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11600K .......... .......... .......... .......... .......... 12% 221M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11650K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-14T11:41:53.711 INFO:teuthology.orchestra.run.smithi007.stderr: 11700K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 11750K .......... .......... .......... .......... .......... 12% 216M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 11800K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 11850K .......... .......... .......... .......... .......... 12% 230M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 11900K .......... .......... .......... .......... .......... 12% 174M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 11950K .......... .......... .......... .......... .......... 12% 213M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12000K .......... .......... .......... .......... .......... 12% 224M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12050K .......... .......... .......... .......... .......... 13% 212M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12100K .......... .......... .......... .......... .......... 13% 180M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12150K .......... .......... .......... .......... .......... 13% 207M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12200K .......... .......... .......... .......... .......... 13% 224M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12250K .......... .......... .......... .......... .......... 13% 201M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12300K .......... .......... .......... .......... .......... 13% 222M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12350K .......... .......... .......... .......... .......... 13% 232M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12400K .......... .......... .......... .......... .......... 13% 178M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12450K .......... .......... .......... .......... .......... 13% 223M 1s 2024-09-14T11:41:53.712 INFO:teuthology.orchestra.run.smithi007.stderr: 12500K .......... .......... .......... .......... .......... 13% 221M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12550K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12600K .......... .......... .......... .......... .......... 13% 202M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12650K .......... .......... .......... .......... .......... 13% 227M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12700K .......... .......... .......... .......... .......... 13% 224M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12750K .......... .......... .......... .......... .......... 13% 225M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12800K .......... .......... .......... .......... .......... 13% 177M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12850K .......... .......... .......... .......... .......... 13% 228M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12900K .......... .......... .......... .......... .......... 13% 204M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 12950K .......... .......... .......... .......... .......... 13% 223M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 13000K .......... .......... .......... .......... .......... 14% 216M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 13050K .......... .......... .......... .......... .......... 14% 219M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 13100K .......... .......... .......... .......... .......... 14% 188M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 13150K .......... .......... .......... .......... .......... 14% 212M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 13200K .......... .......... .......... .......... .......... 14% 229M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 13250K .......... .......... .......... .......... .......... 14% 208M 1s 2024-09-14T11:41:53.713 INFO:teuthology.orchestra.run.smithi007.stderr: 13300K .......... .......... .......... .......... .......... 14% 199M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13350K .......... .......... .......... .......... .......... 14% 230M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13400K .......... .......... .......... .......... .......... 14% 186M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13450K .......... .......... .......... .......... .......... 14% 221M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13500K .......... .......... .......... .......... .......... 14% 224M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13550K .......... .......... .......... .......... .......... 14% 223M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13600K .......... .......... .......... .......... .......... 14% 204M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13650K .......... .......... .......... .......... .......... 14% 225M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13700K .......... .......... .......... .......... .......... 14% 216M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13750K .......... .......... .......... .......... .......... 14% 227M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13800K .......... .......... .......... .......... .......... 14% 190M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13850K .......... .......... .......... .......... .......... 14% 230M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13900K .......... .......... .......... .......... .......... 15% 195M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 13950K .......... .......... .......... .......... .......... 15% 220M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 14000K .......... .......... .......... .......... .......... 15% 197M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 14050K .......... .......... .......... .......... .......... 15% 217M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 14100K .......... .......... .......... .......... .......... 15% 213M 1s 2024-09-14T11:41:53.714 INFO:teuthology.orchestra.run.smithi007.stderr: 14150K .......... .......... .......... .......... .......... 15% 220M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14200K .......... .......... .......... .......... .......... 15% 190M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14250K .......... .......... .......... .......... .......... 15% 241M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14300K .......... .......... .......... .......... .......... 15% 179M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14350K .......... .......... .......... .......... .......... 15% 217M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14400K .......... .......... .......... .......... .......... 15% 232M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14450K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14500K .......... .......... .......... .......... .......... 15% 184M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14550K .......... .......... .......... .......... .......... 15% 214M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14600K .......... .......... .......... .......... .......... 15% 204M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14650K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14700K .......... .......... .......... .......... .......... 15% 206M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14750K .......... .......... .......... .......... .......... 15% 196M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14800K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14850K .......... .......... .......... .......... .......... 16% 225M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14900K .......... .......... .......... .......... .......... 16% 193M 1s 2024-09-14T11:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr: 14950K .......... .......... .......... .......... .......... 16% 226M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15000K .......... .......... .......... .......... .......... 16% 224M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15050K .......... .......... .......... .......... .......... 16% 219M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15100K .......... .......... .......... .......... .......... 16% 185M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15150K .......... .......... .......... .......... .......... 16% 218M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15200K .......... .......... .......... .......... .......... 16% 217M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15250K .......... .......... .......... .......... .......... 16% 214M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15300K .......... .......... .......... .......... .......... 16% 203M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15350K .......... .......... .......... .......... .......... 16% 239M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15400K .......... .......... .......... .......... .......... 16% 215M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15450K .......... .......... .......... .......... .......... 16% 226M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15500K .......... .......... .......... .......... .......... 16% 195M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15550K .......... .......... .......... .......... .......... 16% 224M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15600K .......... .......... .......... .......... .......... 16% 218M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15650K .......... .......... .......... .......... .......... 16% 207M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15700K .......... .......... .......... .......... .......... 16% 198M 1s 2024-09-14T11:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr: 15750K .......... .......... .......... .......... .......... 17% 217M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 15800K .......... .......... .......... .......... .......... 17% 222M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 15850K .......... .......... .......... .......... .......... 17% 222M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 15900K .......... .......... .......... .......... .......... 17% 183M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 15950K .......... .......... .......... .......... .......... 17% 218M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16000K .......... .......... .......... .......... .......... 17% 223M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16050K .......... .......... .......... .......... .......... 17% 224M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16100K .......... .......... .......... .......... .......... 17% 202M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16150K .......... .......... .......... .......... .......... 17% 228M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16200K .......... .......... .......... .......... .......... 17% 233M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16250K .......... .......... .......... .......... .......... 17% 234M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16300K .......... .......... .......... .......... .......... 17% 184M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16350K .......... .......... .......... .......... .......... 17% 227M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16400K .......... .......... .......... .......... .......... 17% 219M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16450K .......... .......... .......... .......... .......... 17% 213M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16500K .......... .......... .......... .......... .......... 17% 189M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16550K .......... .......... .......... .......... .......... 17% 218M 1s 2024-09-14T11:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr: 16600K .......... .......... .......... .......... .......... 17% 220M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 16650K .......... .......... .......... .......... .......... 17% 219M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 16700K .......... .......... .......... .......... .......... 18% 181M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 16750K .......... .......... .......... .......... .......... 18% 215M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 16800K .......... .......... .......... .......... .......... 18% 212M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 16850K .......... .......... .......... .......... .......... 18% 229M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 16900K .......... .......... .......... .......... .......... 18% 198M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 16950K .......... .......... .......... .......... .......... 18% 205M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17000K .......... .......... .......... .......... .......... 18% 222M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17050K .......... .......... .......... .......... .......... 18% 221M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17100K .......... .......... .......... .......... .......... 18% 185M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17150K .......... .......... .......... .......... .......... 18% 217M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17200K .......... .......... .......... .......... .......... 18% 228M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17250K .......... .......... .......... .......... .......... 18% 227M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17300K .......... .......... .......... .......... .......... 18% 201M 1s 2024-09-14T11:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr: 17350K .......... .......... .......... .......... .......... 18% 200M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17400K .......... .......... .......... .......... .......... 18% 216M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17450K .......... .......... .......... .......... .......... 18% 213M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17500K .......... .......... .......... .......... .......... 18% 185M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17550K .......... .......... .......... .......... .......... 18% 218M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17600K .......... .......... .......... .......... .......... 18% 211M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17650K .......... .......... .......... .......... .......... 19% 224M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17700K .......... .......... .......... .......... .......... 19% 202M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17750K .......... .......... .......... .......... .......... 19% 225M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17800K .......... .......... .......... .......... .......... 19% 256M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17850K .......... .......... .......... .......... .......... 19% 363M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17900K .......... .......... .......... .......... .......... 19% 314M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 17950K .......... .......... .......... .......... .......... 19% 356M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 18000K .......... .......... .......... .......... .......... 19% 357M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 18050K .......... .......... .......... .......... .......... 19% 378M 1s 2024-09-14T11:41:53.719 INFO:teuthology.orchestra.run.smithi007.stderr: 18100K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18150K .......... .......... .......... .......... .......... 19% 347M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18200K .......... .......... .......... .......... .......... 19% 356M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18250K .......... .......... .......... .......... .......... 19% 348M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18300K .......... .......... .......... .......... .......... 19% 309M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18350K .......... .......... .......... .......... .......... 19% 360M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18400K .......... .......... .......... .......... .......... 19% 361M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18450K .......... .......... .......... .......... .......... 19% 359M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18500K .......... .......... .......... .......... .......... 19% 250M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18550K .......... .......... .......... .......... .......... 20% 370M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18600K .......... .......... .......... .......... .......... 20% 336M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18650K .......... .......... .......... .......... .......... 20% 363M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18700K .......... .......... .......... .......... .......... 20% 266M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18750K .......... .......... .......... .......... .......... 20% 369M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18800K .......... .......... .......... .......... .......... 20% 358M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18850K .......... .......... .......... .......... .......... 20% 353M 1s 2024-09-14T11:41:53.720 INFO:teuthology.orchestra.run.smithi007.stderr: 18900K .......... .......... .......... .......... .......... 20% 346M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 18950K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19000K .......... .......... .......... .......... .......... 20% 377M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19050K .......... .......... .......... .......... .......... 20% 374M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19100K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19150K .......... .......... .......... .......... .......... 20% 378M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19200K .......... .......... .......... .......... .......... 20% 40.0M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19250K .......... .......... .......... .......... .......... 20% 346M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19300K .......... .......... .......... .......... .......... 20% 313M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19350K .......... .......... .......... .......... .......... 20% 365M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19400K .......... .......... .......... .......... .......... 20% 370M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19450K .......... .......... .......... .......... .......... 20% 368M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19500K .......... .......... .......... .......... .......... 21% 282M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19550K .......... .......... .......... .......... .......... 21% 359M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19600K .......... .......... .......... .......... .......... 21% 364M 1s 2024-09-14T11:41:53.721 INFO:teuthology.orchestra.run.smithi007.stderr: 19650K .......... .......... .......... .......... .......... 21% 362M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 19700K .......... .......... .......... .......... .......... 21% 337M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 19750K .......... .......... .......... .......... .......... 21% 383M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 19800K .......... .......... .......... .......... .......... 21% 388M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 19850K .......... .......... .......... .......... .......... 21% 373M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 19900K .......... .......... .......... .......... .......... 21% 291M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 19950K .......... .......... .......... .......... .......... 21% 379M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20000K .......... .......... .......... .......... .......... 21% 392M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20050K .......... .......... .......... .......... .......... 21% 351M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20100K .......... .......... .......... .......... .......... 21% 338M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20150K .......... .......... .......... .......... .......... 21% 371M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20200K .......... .......... .......... .......... .......... 21% 179M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20250K .......... .......... .......... .......... .......... 21% 361M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20300K .......... .......... .......... .......... .......... 21% 242M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20350K .......... .......... .......... .......... .......... 21% 349M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20400K .......... .......... .......... .......... .......... 22% 66.6M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20450K .......... .......... .......... .......... .......... 22% 333M 1s 2024-09-14T11:41:53.722 INFO:teuthology.orchestra.run.smithi007.stderr: 20500K .......... .......... .......... .......... .......... 22% 414M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20550K .......... .......... .......... .......... .......... 22% 406M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20600K .......... .......... .......... .......... .......... 22% 353M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20650K .......... .......... .......... .......... .......... 22% 218M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20700K .......... .......... .......... .......... .......... 22% 171M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20750K .......... .......... .......... .......... .......... 22% 327M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20800K .......... .......... .......... .......... .......... 22% 298M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20850K .......... .......... .......... .......... .......... 22% 113M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20900K .......... .......... .......... .......... .......... 22% 331M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 20950K .......... .......... .......... .......... .......... 22% 391M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 21000K .......... .......... .......... .......... .......... 22% 137M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 21050K .......... .......... .......... .......... .......... 22% 142M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 21100K .......... .......... .......... .......... .......... 22% 310M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 21150K .......... .......... .......... .......... .......... 22% 370M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 21200K .......... .......... .......... .......... .......... 22% 396M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 21250K .......... .......... .......... .......... .......... 22% 280M 1s 2024-09-14T11:41:53.723 INFO:teuthology.orchestra.run.smithi007.stderr: 21300K .......... .......... .......... .......... .......... 22% 337M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21350K .......... .......... .......... .......... .......... 23% 371M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21400K .......... .......... .......... .......... .......... 23% 345M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21450K .......... .......... .......... .......... .......... 23% 338M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21500K .......... .......... .......... .......... .......... 23% 305M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21550K .......... .......... .......... .......... .......... 23% 392M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21600K .......... .......... .......... .......... .......... 23% 374M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21650K .......... .......... .......... .......... .......... 23% 273M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21700K .......... .......... .......... .......... .......... 23% 284M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21750K .......... .......... .......... .......... .......... 23% 336M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21800K .......... .......... .......... .......... .......... 23% 189M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21850K .......... .......... .......... .......... .......... 23% 364M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21900K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 21950K .......... .......... .......... .......... .......... 23% 393M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 22000K .......... .......... .......... .......... .......... 23% 24.1M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 22050K .......... .......... .......... .......... .......... 23% 356M 1s 2024-09-14T11:41:53.724 INFO:teuthology.orchestra.run.smithi007.stderr: 22100K .......... .......... .......... .......... .......... 23% 314M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22150K .......... .......... .......... .......... .......... 23% 367M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22200K .......... .......... .......... .......... .......... 23% 268M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22250K .......... .......... .......... .......... .......... 24% 367M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22300K .......... .......... .......... .......... .......... 24% 308M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22350K .......... .......... .......... .......... .......... 24% 372M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22400K .......... .......... .......... .......... .......... 24% 374M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22450K .......... .......... .......... .......... .......... 24% 361M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22500K .......... .......... .......... .......... .......... 24% 346M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22550K .......... .......... .......... .......... .......... 24% 382M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22600K .......... .......... .......... .......... .......... 24% 374M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22650K .......... .......... .......... .......... .......... 24% 358M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22700K .......... .......... .......... .......... .......... 24% 318M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22750K .......... .......... .......... .......... .......... 24% 379M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22800K .......... .......... .......... .......... .......... 24% 355M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22850K .......... .......... .......... .......... .......... 24% 351M 1s 2024-09-14T11:41:53.725 INFO:teuthology.orchestra.run.smithi007.stderr: 22900K .......... .......... .......... .......... .......... 24% 343M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 22950K .......... .......... .......... .......... .......... 24% 375M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23000K .......... .......... .......... .......... .......... 24% 376M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23050K .......... .......... .......... .......... .......... 24% 379M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23100K .......... .......... .......... .......... .......... 24% 313M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23150K .......... .......... .......... .......... .......... 24% 394M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23200K .......... .......... .......... .......... .......... 25% 365M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23250K .......... .......... .......... .......... .......... 25% 356M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23300K .......... .......... .......... .......... .......... 25% 347M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23350K .......... .......... .......... .......... .......... 25% 387M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23400K .......... .......... .......... .......... .......... 25% 403M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23450K .......... .......... .......... .......... .......... 25% 350M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23500K .......... .......... .......... .......... .......... 25% 161M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23550K .......... .......... .......... .......... .......... 25% 235M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23600K .......... .......... .......... .......... .......... 25% 358M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23650K .......... .......... .......... .......... .......... 25% 350M 1s 2024-09-14T11:41:53.726 INFO:teuthology.orchestra.run.smithi007.stderr: 23700K .......... .......... .......... .......... .......... 25% 346M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 23750K .......... .......... .......... .......... .......... 25% 397M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 23800K .......... .......... .......... .......... .......... 25% 358M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 23850K .......... .......... .......... .......... .......... 25% 165M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 23900K .......... .......... .......... .......... .......... 25% 156M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 23950K .......... .......... .......... .......... .......... 25% 338M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24000K .......... .......... .......... .......... .......... 25% 320M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24050K .......... .......... .......... .......... .......... 25% 147M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24100K .......... .......... .......... .......... .......... 25% 112M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24150K .......... .......... .......... .......... .......... 26% 282M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24200K .......... .......... .......... .......... .......... 26% 366M 1s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24250K .......... .......... .......... .......... .......... 26% 340M 0s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24300K .......... .......... .......... .......... .......... 26% 225M 0s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24350K .......... .......... .......... .......... .......... 26% 382M 0s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24400K .......... .......... .......... .......... .......... 26% 379M 0s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24450K .......... .......... .......... .......... .......... 26% 358M 0s 2024-09-14T11:41:53.727 INFO:teuthology.orchestra.run.smithi007.stderr: 24500K .......... .......... .......... .......... .......... 26% 342M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24550K .......... .......... .......... .......... .......... 26% 243M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24600K .......... .......... .......... .......... .......... 26% 327M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24650K .......... .......... .......... .......... .......... 26% 361M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24700K .......... .......... .......... .......... .......... 26% 313M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24750K .......... .......... .......... .......... .......... 26% 352M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24800K .......... .......... .......... .......... .......... 26% 388M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24850K .......... .......... .......... .......... .......... 26% 379M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24900K .......... .......... .......... .......... .......... 26% 323M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 24950K .......... .......... .......... .......... .......... 26% 388M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25000K .......... .......... .......... .......... .......... 26% 231M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25050K .......... .......... .......... .......... .......... 27% 24.2M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25100K .......... .......... .......... .......... .......... 27% 124M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25150K .......... .......... .......... .......... .......... 27% 296M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25200K .......... .......... .......... .......... .......... 27% 360M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25250K .......... .......... .......... .......... .......... 27% 372M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25300K .......... .......... .......... .......... .......... 27% 345M 0s 2024-09-14T11:41:53.728 INFO:teuthology.orchestra.run.smithi007.stderr: 25350K .......... .......... .......... .......... .......... 27% 333M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25400K .......... .......... .......... .......... .......... 27% 274M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25450K .......... .......... .......... .......... .......... 27% 377M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25500K .......... .......... .......... .......... .......... 27% 297M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25550K .......... .......... .......... .......... .......... 27% 367M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25600K .......... .......... .......... .......... .......... 27% 353M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25650K .......... .......... .......... .......... .......... 27% 376M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25700K .......... .......... .......... .......... .......... 27% 326M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25750K .......... .......... .......... .......... .......... 27% 371M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25800K .......... .......... .......... .......... .......... 27% 379M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25850K .......... .......... .......... .......... .......... 27% 383M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25900K .......... .......... .......... .......... .......... 27% 288M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 25950K .......... .......... .......... .......... .......... 27% 370M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 26000K .......... .......... .......... .......... .......... 28% 367M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 26050K .......... .......... .......... .......... .......... 28% 381M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 26100K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-14T11:41:53.729 INFO:teuthology.orchestra.run.smithi007.stderr: 26150K .......... .......... .......... .......... .......... 28% 386M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26200K .......... .......... .......... .......... .......... 28% 368M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26250K .......... .......... .......... .......... .......... 28% 211M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26300K .......... .......... .......... .......... .......... 28% 297M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26350K .......... .......... .......... .......... .......... 28% 375M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26400K .......... .......... .......... .......... .......... 28% 368M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26450K .......... .......... .......... .......... .......... 28% 357M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26500K .......... .......... .......... .......... .......... 28% 280M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26550K .......... .......... .......... .......... .......... 28% 274M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26600K .......... .......... .......... .......... .......... 28% 289M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26650K .......... .......... .......... .......... .......... 28% 302M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26700K .......... .......... .......... .......... .......... 28% 288M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26750K .......... .......... .......... .......... .......... 28% 316M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26800K .......... .......... .......... .......... .......... 28% 324M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26850K .......... .......... .......... .......... .......... 28% 387M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26900K .......... .......... .......... .......... .......... 29% 303M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 26950K .......... .......... .......... .......... .......... 29% 376M 0s 2024-09-14T11:41:53.730 INFO:teuthology.orchestra.run.smithi007.stderr: 27000K .......... .......... .......... .......... .......... 29% 364M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27050K .......... .......... .......... .......... .......... 29% 381M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27100K .......... .......... .......... .......... .......... 29% 308M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27150K .......... .......... .......... .......... .......... 29% 124M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27200K .......... .......... .......... .......... .......... 29% 193M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27250K .......... .......... .......... .......... .......... 29% 227M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27300K .......... .......... .......... .......... .......... 29% 278M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27350K .......... .......... .......... .......... .......... 29% 307M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27400K .......... .......... .......... .......... .......... 29% 175M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27450K .......... .......... .......... .......... .......... 29% 262M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27500K .......... .......... .......... .......... .......... 29% 261M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27550K .......... .......... .......... .......... .......... 29% 379M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27600K .......... .......... .......... .......... .......... 29% 381M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27650K .......... .......... .......... .......... .......... 29% 337M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27700K .......... .......... .......... .......... .......... 29% 313M 0s 2024-09-14T11:41:53.731 INFO:teuthology.orchestra.run.smithi007.stderr: 27750K .......... .......... .......... .......... .......... 29% 391M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 27800K .......... .......... .......... .......... .......... 29% 384M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 27850K .......... .......... .......... .......... .......... 30% 213M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 27900K .......... .......... .......... .......... .......... 30% 309M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 27950K .......... .......... .......... .......... .......... 30% 356M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28000K .......... .......... .......... .......... .......... 30% 389M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28050K .......... .......... .......... .......... .......... 30% 365M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28100K .......... .......... .......... .......... .......... 30% 29.1M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28150K .......... .......... .......... .......... .......... 30% 61.6M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28200K .......... .......... .......... .......... .......... 30% 337M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28250K .......... .......... .......... .......... .......... 30% 333M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28300K .......... .......... .......... .......... .......... 30% 310M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28350K .......... .......... .......... .......... .......... 30% 357M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28400K .......... .......... .......... .......... .......... 30% 369M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28450K .......... .......... .......... .......... .......... 30% 388M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28500K .......... .......... .......... .......... .......... 30% 341M 0s 2024-09-14T11:41:53.732 INFO:teuthology.orchestra.run.smithi007.stderr: 28550K .......... .......... .......... .......... .......... 30% 378M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28600K .......... .......... .......... .......... .......... 30% 364M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28650K .......... .......... .......... .......... .......... 30% 354M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28700K .......... .......... .......... .......... .......... 30% 290M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28750K .......... .......... .......... .......... .......... 31% 376M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28800K .......... .......... .......... .......... .......... 31% 373M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28850K .......... .......... .......... .......... .......... 31% 359M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28900K .......... .......... .......... .......... .......... 31% 334M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 28950K .......... .......... .......... .......... .......... 31% 372M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29000K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29050K .......... .......... .......... .......... .......... 31% 355M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29100K .......... .......... .......... .......... .......... 31% 308M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29150K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29200K .......... .......... .......... .......... .......... 31% 389M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29250K .......... .......... .......... .......... .......... 31% 388M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29300K .......... .......... .......... .......... .......... 31% 316M 0s 2024-09-14T11:41:53.733 INFO:teuthology.orchestra.run.smithi007.stderr: 29350K .......... .......... .......... .......... .......... 31% 379M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29400K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29450K .......... .......... .......... .......... .......... 31% 358M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29500K .......... .......... .......... .......... .......... 31% 303M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29550K .......... .......... .......... .......... .......... 31% 387M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29600K .......... .......... .......... .......... .......... 31% 348M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29650K .......... .......... .......... .......... .......... 31% 392M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29700K .......... .......... .......... .......... .......... 32% 243M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29750K .......... .......... .......... .......... .......... 32% 350M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29800K .......... .......... .......... .......... .......... 32% 369M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29850K .......... .......... .......... .......... .......... 32% 379M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29900K .......... .......... .......... .......... .......... 32% 312M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 29950K .......... .......... .......... .......... .......... 32% 231M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 30000K .......... .......... .......... .......... .......... 32% 262M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 30050K .......... .......... .......... .......... .......... 32% 372M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 30100K .......... .......... .......... .......... .......... 32% 275M 0s 2024-09-14T11:41:53.734 INFO:teuthology.orchestra.run.smithi007.stderr: 30150K .......... .......... .......... .......... .......... 32% 358M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30200K .......... .......... .......... .......... .......... 32% 204M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30250K .......... .......... .......... .......... .......... 32% 230M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30300K .......... .......... .......... .......... .......... 32% 202M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30350K .......... .......... .......... .......... .......... 32% 352M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30400K .......... .......... .......... .......... .......... 32% 144M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30450K .......... .......... .......... .......... .......... 32% 368M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30500K .......... .......... .......... .......... .......... 32% 171M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30550K .......... .......... .......... .......... .......... 32% 333M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30600K .......... .......... .......... .......... .......... 32% 143M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30650K .......... .......... .......... .......... .......... 33% 197M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30700K .......... .......... .......... .......... .......... 33% 202M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30750K .......... .......... .......... .......... .......... 33% 164M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30800K .......... .......... .......... .......... .......... 33% 226M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30850K .......... .......... .......... .......... .......... 33% 214M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30900K .......... .......... .......... .......... .......... 33% 228M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 30950K .......... .......... .......... .......... .......... 33% 223M 0s 2024-09-14T11:41:53.735 INFO:teuthology.orchestra.run.smithi007.stderr: 31000K .......... .......... .......... .......... .......... 33% 202M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31050K .......... .......... .......... .......... .......... 33% 43.0M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31100K .......... .......... .......... .......... .......... 33% 226M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31150K .......... .......... .......... .......... .......... 33% 231M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31200K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31250K .......... .......... .......... .......... .......... 33% 205M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31300K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31350K .......... .......... .......... .......... .......... 33% 220M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31400K .......... .......... .......... .......... .......... 33% 223M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31450K .......... .......... .......... .......... .......... 33% 179M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31500K .......... .......... .......... .......... .......... 33% 230M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31550K .......... .......... .......... .......... .......... 34% 224M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31600K .......... .......... .......... .......... .......... 34% 218M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31650K .......... .......... .......... .......... .......... 34% 199M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31700K .......... .......... .......... .......... .......... 34% 221M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31750K .......... .......... .......... .......... .......... 34% 222M 0s 2024-09-14T11:41:53.736 INFO:teuthology.orchestra.run.smithi007.stderr: 31800K .......... .......... .......... .......... .......... 34% 223M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 31850K .......... .......... .......... .......... .......... 34% 177M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 31900K .......... .......... .......... .......... .......... 34% 219M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 31950K .......... .......... .......... .......... .......... 34% 213M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32000K .......... .......... .......... .......... .......... 34% 225M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32050K .......... .......... .......... .......... .......... 34% 212M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32100K .......... .......... .......... .......... .......... 34% 217M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32150K .......... .......... .......... .......... .......... 34% 215M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32200K .......... .......... .......... .......... .......... 34% 223M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32250K .......... .......... .......... .......... .......... 34% 185M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32300K .......... .......... .......... .......... .......... 34% 203M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32350K .......... .......... .......... .......... .......... 34% 210M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32400K .......... .......... .......... .......... .......... 34% 220M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32450K .......... .......... .......... .......... .......... 34% 201M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32500K .......... .......... .......... .......... .......... 35% 214M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32550K .......... .......... .......... .......... .......... 35% 219M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32600K .......... .......... .......... .......... .......... 35% 232M 0s 2024-09-14T11:41:53.737 INFO:teuthology.orchestra.run.smithi007.stderr: 32650K .......... .......... .......... .......... .......... 35% 188M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 32700K .......... .......... .......... .......... .......... 35% 227M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 32750K .......... .......... .......... .......... .......... 35% 220M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 32800K .......... .......... .......... .......... .......... 35% 220M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 32850K .......... .......... .......... .......... .......... 35% 206M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 32900K .......... .......... .......... .......... .......... 35% 222M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 32950K .......... .......... .......... .......... .......... 35% 218M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33000K .......... .......... .......... .......... .......... 35% 234M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33050K .......... .......... .......... .......... .......... 35% 183M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33100K .......... .......... .......... .......... .......... 35% 224M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33150K .......... .......... .......... .......... .......... 35% 230M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33200K .......... .......... .......... .......... .......... 35% 225M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33250K .......... .......... .......... .......... .......... 35% 212M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33300K .......... .......... .......... .......... .......... 35% 235M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33350K .......... .......... .......... .......... .......... 35% 234M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33400K .......... .......... .......... .......... .......... 36% 229M 0s 2024-09-14T11:41:53.738 INFO:teuthology.orchestra.run.smithi007.stderr: 33450K .......... .......... .......... .......... .......... 36% 176M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33500K .......... .......... .......... .......... .......... 36% 226M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33550K .......... .......... .......... .......... .......... 36% 217M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33600K .......... .......... .......... .......... .......... 36% 203M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33650K .......... .......... .......... .......... .......... 36% 201M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33700K .......... .......... .......... .......... .......... 36% 216M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33750K .......... .......... .......... .......... .......... 36% 226M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33800K .......... .......... .......... .......... .......... 36% 219M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33850K .......... .......... .......... .......... .......... 36% 176M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33900K .......... .......... .......... .......... .......... 36% 231M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 33950K .......... .......... .......... .......... .......... 36% 216M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 34000K .......... .......... .......... .......... .......... 36% 218M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 34050K .......... .......... .......... .......... .......... 36% 200M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 34100K .......... .......... .......... .......... .......... 36% 227M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 34150K .......... .......... .......... .......... .......... 36% 231M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 34200K .......... .......... .......... .......... .......... 36% 223M 0s 2024-09-14T11:41:53.739 INFO:teuthology.orchestra.run.smithi007.stderr: 34250K .......... .......... .......... .......... .......... 36% 175M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34300K .......... .......... .......... .......... .......... 36% 223M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34350K .......... .......... .......... .......... .......... 37% 222M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34400K .......... .......... .......... .......... .......... 37% 226M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34450K .......... .......... .......... .......... .......... 37% 202M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34500K .......... .......... .......... .......... .......... 37% 225M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34550K .......... .......... .......... .......... .......... 37% 211M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34600K .......... .......... .......... .......... .......... 37% 220M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34650K .......... .......... .......... .......... .......... 37% 187M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34700K .......... .......... .......... .......... .......... 37% 219M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34750K .......... .......... .......... .......... .......... 37% 221M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34800K .......... .......... .......... .......... .......... 37% 221M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34850K .......... .......... .......... .......... .......... 37% 207M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34900K .......... .......... .......... .......... .......... 37% 215M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 34950K .......... .......... .......... .......... .......... 37% 230M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 35000K .......... .......... .......... .......... .......... 37% 226M 0s 2024-09-14T11:41:53.740 INFO:teuthology.orchestra.run.smithi007.stderr: 35050K .......... .......... .......... .......... .......... 37% 175M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35100K .......... .......... .......... .......... .......... 37% 219M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35150K .......... .......... .......... .......... .......... 37% 219M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35200K .......... .......... .......... .......... .......... 37% 222M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35250K .......... .......... .......... .......... .......... 37% 202M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35300K .......... .......... .......... .......... .......... 38% 227M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35350K .......... .......... .......... .......... .......... 38% 214M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35400K .......... .......... .......... .......... .......... 38% 225M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35450K .......... .......... .......... .......... .......... 38% 184M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35500K .......... .......... .......... .......... .......... 38% 220M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35550K .......... .......... .......... .......... .......... 38% 217M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35600K .......... .......... .......... .......... .......... 38% 219M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35650K .......... .......... .......... .......... .......... 38% 206M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35700K .......... .......... .......... .......... .......... 38% 227M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35750K .......... .......... .......... .......... .......... 38% 226M 0s 2024-09-14T11:41:53.741 INFO:teuthology.orchestra.run.smithi007.stderr: 35800K .......... .......... .......... .......... .......... 38% 227M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 35850K .......... .......... .......... .......... .......... 38% 186M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 35900K .......... .......... .......... .......... .......... 38% 233M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 35950K .......... .......... .......... .......... .......... 38% 231M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36000K .......... .......... .......... .......... .......... 38% 226M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36050K .......... .......... .......... .......... .......... 38% 202M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36100K .......... .......... .......... .......... .......... 38% 224M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36150K .......... .......... .......... .......... .......... 38% 222M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36200K .......... .......... .......... .......... .......... 39% 230M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36250K .......... .......... .......... .......... .......... 39% 178M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36300K .......... .......... .......... .......... .......... 39% 224M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36350K .......... .......... .......... .......... .......... 39% 212M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36400K .......... .......... .......... .......... .......... 39% 226M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36450K .......... .......... .......... .......... .......... 39% 195M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36500K .......... .......... .......... .......... .......... 39% 209M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36550K .......... .......... .......... .......... .......... 39% 230M 0s 2024-09-14T11:41:53.742 INFO:teuthology.orchestra.run.smithi007.stderr: 36600K .......... .......... .......... .......... .......... 39% 221M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 36650K .......... .......... .......... .......... .......... 39% 191M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 36700K .......... .......... .......... .......... .......... 39% 214M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 36750K .......... .......... .......... .......... .......... 39% 222M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 36800K .......... .......... .......... .......... .......... 39% 219M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 36850K .......... .......... .......... .......... .......... 39% 188M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 36900K .......... .......... .......... .......... .......... 39% 216M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 36950K .......... .......... .......... .......... .......... 39% 230M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37000K .......... .......... .......... .......... .......... 39% 236M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37050K .......... .......... .......... .......... .......... 39% 188M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37100K .......... .......... .......... .......... .......... 39% 219M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37150K .......... .......... .......... .......... .......... 40% 219M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37200K .......... .......... .......... .......... .......... 40% 231M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37250K .......... .......... .......... .......... .......... 40% 202M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37300K .......... .......... .......... .......... .......... 40% 225M 0s 2024-09-14T11:41:53.743 INFO:teuthology.orchestra.run.smithi007.stderr: 37350K .......... .......... .......... .......... .......... 40% 220M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37400K .......... .......... .......... .......... .......... 40% 230M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37450K .......... .......... .......... .......... .......... 40% 189M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37500K .......... .......... .......... .......... .......... 40% 230M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37550K .......... .......... .......... .......... .......... 40% 227M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37600K .......... .......... .......... .......... .......... 40% 228M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37650K .......... .......... .......... .......... .......... 40% 206M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37700K .......... .......... .......... .......... .......... 40% 229M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37750K .......... .......... .......... .......... .......... 40% 234M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37800K .......... .......... .......... .......... .......... 40% 210M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37850K .......... .......... .......... .......... .......... 40% 190M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37900K .......... .......... .......... .......... .......... 40% 228M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 37950K .......... .......... .......... .......... .......... 40% 213M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 38000K .......... .......... .......... .......... .......... 40% 218M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 38050K .......... .......... .......... .......... .......... 41% 198M 0s 2024-09-14T11:41:53.744 INFO:teuthology.orchestra.run.smithi007.stderr: 38100K .......... .......... .......... .......... .......... 41% 223M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38150K .......... .......... .......... .......... .......... 41% 223M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38200K .......... .......... .......... .......... .......... 41% 217M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38250K .......... .......... .......... .......... .......... 41% 190M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38300K .......... .......... .......... .......... .......... 41% 231M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38350K .......... .......... .......... .......... .......... 41% 218M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38400K .......... .......... .......... .......... .......... 41% 224M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38450K .......... .......... .......... .......... .......... 41% 204M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38500K .......... .......... .......... .......... .......... 41% 230M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38550K .......... .......... .......... .......... .......... 41% 232M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38600K .......... .......... .......... .......... .......... 41% 233M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38650K .......... .......... .......... .......... .......... 41% 180M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38700K .......... .......... .......... .......... .......... 41% 212M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38750K .......... .......... .......... .......... .......... 41% 224M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38800K .......... .......... .......... .......... .......... 41% 214M 0s 2024-09-14T11:41:53.745 INFO:teuthology.orchestra.run.smithi007.stderr: 38850K .......... .......... .......... .......... .......... 41% 194M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 38900K .......... .......... .......... .......... .......... 41% 224M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 38950K .......... .......... .......... .......... .......... 41% 222M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39000K .......... .......... .......... .......... .......... 42% 233M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39050K .......... .......... .......... .......... .......... 42% 185M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39100K .......... .......... .......... .......... .......... 42% 215M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39150K .......... .......... .......... .......... .......... 42% 216M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39200K .......... .......... .......... .......... .......... 42% 221M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39250K .......... .......... .......... .......... .......... 42% 203M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39300K .......... .......... .......... .......... .......... 42% 222M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39350K .......... .......... .......... .......... .......... 42% 222M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39400K .......... .......... .......... .......... .......... 42% 225M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39450K .......... .......... .......... .......... .......... 42% 186M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39500K .......... .......... .......... .......... .......... 42% 227M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39550K .......... .......... .......... .......... .......... 42% 215M 0s 2024-09-14T11:41:53.746 INFO:teuthology.orchestra.run.smithi007.stderr: 39600K .......... .......... .......... .......... .......... 42% 215M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 39650K .......... .......... .......... .......... .......... 42% 205M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 39700K .......... .......... .......... .......... .......... 42% 226M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 39750K .......... .......... .......... .......... .......... 42% 209M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 39800K .......... .......... .......... .......... .......... 42% 225M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 39850K .......... .......... .......... .......... .......... 42% 175M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 39900K .......... .......... .......... .......... .......... 43% 222M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 39950K .......... .......... .......... .......... .......... 43% 210M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40000K .......... .......... .......... .......... .......... 43% 219M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40050K .......... .......... .......... .......... .......... 43% 206M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40100K .......... .......... .......... .......... .......... 43% 222M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40150K .......... .......... .......... .......... .......... 43% 216M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40200K .......... .......... .......... .......... .......... 43% 221M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40250K .......... .......... .......... .......... .......... 43% 183M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40300K .......... .......... .......... .......... .......... 43% 218M 0s 2024-09-14T11:41:53.747 INFO:teuthology.orchestra.run.smithi007.stderr: 40350K .......... .......... .......... .......... .......... 43% 226M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40400K .......... .......... .......... .......... .......... 43% 219M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40450K .......... .......... .......... .......... .......... 43% 205M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40500K .......... .......... .......... .......... .......... 43% 214M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40550K .......... .......... .......... .......... .......... 43% 224M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40600K .......... .......... .......... .......... .......... 43% 227M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40650K .......... .......... .......... .......... .......... 43% 184M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40700K .......... .......... .......... .......... .......... 43% 216M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40750K .......... .......... .......... .......... .......... 43% 223M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40800K .......... .......... .......... .......... .......... 43% 231M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40850K .......... .......... .......... .......... .......... 44% 200M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40900K .......... .......... .......... .......... .......... 44% 230M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 40950K .......... .......... .......... .......... .......... 44% 198M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 41000K .......... .......... .......... .......... .......... 44% 226M 0s 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi007.stderr: 41050K .......... .......... .......... .......... .......... 44% 225M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41100K .......... .......... .......... .......... .......... 44% 223M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41150K .......... .......... .......... .......... .......... 44% 186M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41200K .......... .......... .......... .......... .......... 44% 218M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41250K .......... .......... .......... .......... .......... 44% 214M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41300K .......... .......... .......... .......... .......... 44% 212M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41350K .......... .......... .......... .......... .......... 44% 196M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41400K .......... .......... .......... .......... .......... 44% 222M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41450K .......... .......... .......... .......... .......... 44% 215M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41500K .......... .......... .......... .......... .......... 44% 219M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41550K .......... .......... .......... .......... .......... 44% 184M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41600K .......... .......... .......... .......... .......... 44% 225M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41650K .......... .......... .......... .......... .......... 44% 222M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41700K .......... .......... .......... .......... .......... 44% 219M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41750K .......... .......... .......... .......... .......... 44% 196M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41800K .......... .......... .......... .......... .......... 45% 230M 0s 2024-09-14T11:41:53.749 INFO:teuthology.orchestra.run.smithi007.stderr: 41850K .......... .......... .......... .......... .......... 45% 214M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 41900K .......... .......... .......... .......... .......... 45% 205M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 41950K .......... .......... .......... .......... .......... 45% 184M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42000K .......... .......... .......... .......... .......... 45% 225M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42050K .......... .......... .......... .......... .......... 45% 227M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42100K .......... .......... .......... .......... .......... 45% 229M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42150K .......... .......... .......... .......... .......... 45% 200M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42200K .......... .......... .......... .......... .......... 45% 230M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42250K .......... .......... .......... .......... .......... 45% 219M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42300K .......... .......... .......... .......... .......... 45% 222M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42350K .......... .......... .......... .......... .......... 45% 176M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42400K .......... .......... .......... .......... .......... 45% 205M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42450K .......... .......... .......... .......... .......... 45% 226M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42500K .......... .......... .......... .......... .......... 45% 215M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42550K .......... .......... .......... .......... .......... 45% 202M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42600K .......... .......... .......... .......... .......... 45% 225M 0s 2024-09-14T11:41:53.750 INFO:teuthology.orchestra.run.smithi007.stderr: 42650K .......... .......... .......... .......... .......... 45% 218M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 42700K .......... .......... .......... .......... .......... 46% 228M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 42750K .......... .......... .......... .......... .......... 46% 188M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 42800K .......... .......... .......... .......... .......... 46% 211M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 42850K .......... .......... .......... .......... .......... 46% 226M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 42900K .......... .......... .......... .......... .......... 46% 220M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 42950K .......... .......... .......... .......... .......... 46% 195M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43000K .......... .......... .......... .......... .......... 46% 219M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43050K .......... .......... .......... .......... .......... 46% 224M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43100K .......... .......... .......... .......... .......... 46% 224M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43150K .......... .......... .......... .......... .......... 46% 187M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43200K .......... .......... .......... .......... .......... 46% 212M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43250K .......... .......... .......... .......... .......... 46% 212M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43300K .......... .......... .......... .......... .......... 46% 221M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43350K .......... .......... .......... .......... .......... 46% 209M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43400K .......... .......... .......... .......... .......... 46% 231M 0s 2024-09-14T11:41:53.751 INFO:teuthology.orchestra.run.smithi007.stderr: 43450K .......... .......... .......... .......... .......... 46% 224M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43500K .......... .......... .......... .......... .......... 46% 221M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43550K .......... .......... .......... .......... .......... 46% 193M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43600K .......... .......... .......... .......... .......... 46% 222M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43650K .......... .......... .......... .......... .......... 47% 196M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43700K .......... .......... .......... .......... .......... 47% 220M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43750K .......... .......... .......... .......... .......... 47% 201M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43800K .......... .......... .......... .......... .......... 47% 211M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43850K .......... .......... .......... .......... .......... 47% 233M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43900K .......... .......... .......... .......... .......... 47% 215M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 43950K .......... .......... .......... .......... .......... 47% 182M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 44000K .......... .......... .......... .......... .......... 47% 219M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 44050K .......... .......... .......... .......... .......... 47% 219M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 44100K .......... .......... .......... .......... .......... 47% 217M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 44150K .......... .......... .......... .......... .......... 47% 199M 0s 2024-09-14T11:41:53.752 INFO:teuthology.orchestra.run.smithi007.stderr: 44200K .......... .......... .......... .......... .......... 47% 220M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44250K .......... .......... .......... .......... .......... 47% 339M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44300K .......... .......... .......... .......... .......... 47% 274M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44350K .......... .......... .......... .......... .......... 47% 261M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44400K .......... .......... .......... .......... .......... 47% 381M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44450K .......... .......... .......... .......... .......... 47% 374M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44500K .......... .......... .......... .......... .......... 47% 378M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44550K .......... .......... .......... .......... .......... 48% 337M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44600K .......... .......... .......... .......... .......... 48% 325M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44650K .......... .......... .......... .......... .......... 48% 351M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44700K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44750K .......... .......... .......... .......... .......... 48% 294M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44800K .......... .......... .......... .......... .......... 48% 373M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44850K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44900K .......... .......... .......... .......... .......... 48% 224M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 44950K .......... .......... .......... .......... .......... 48% 198M 0s 2024-09-14T11:41:53.753 INFO:teuthology.orchestra.run.smithi007.stderr: 45000K .......... .......... .......... .......... .......... 48% 216M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45050K .......... .......... .......... .......... .......... 48% 205M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45100K .......... .......... .......... .......... .......... 48% 219M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45150K .......... .......... .......... .......... .......... 48% 193M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45200K .......... .......... .......... .......... .......... 48% 300M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45250K .......... .......... .......... .......... .......... 48% 379M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45300K .......... .......... .......... .......... .......... 48% 365M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45350K .......... .......... .......... .......... .......... 48% 342M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45400K .......... .......... .......... .......... .......... 48% 380M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45450K .......... .......... .......... .......... .......... 48% 390M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45500K .......... .......... .......... .......... .......... 49% 386M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45550K .......... .......... .......... .......... .......... 49% 304M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45600K .......... .......... .......... .......... .......... 49% 381M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45650K .......... .......... .......... .......... .......... 49% 376M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45700K .......... .......... .......... .......... .......... 49% 385M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45750K .......... .......... .......... .......... .......... 49% 344M 0s 2024-09-14T11:41:53.754 INFO:teuthology.orchestra.run.smithi007.stderr: 45800K .......... .......... .......... .......... .......... 49% 355M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 45850K .......... .......... .......... .......... .......... 49% 372M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 45900K .......... .......... .......... .......... .......... 49% 371M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 45950K .......... .......... .......... .......... .......... 49% 264M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46000K .......... .......... .......... .......... .......... 49% 368M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46050K .......... .......... .......... .......... .......... 49% 362M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46100K .......... .......... .......... .......... .......... 49% 385M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46150K .......... .......... .......... .......... .......... 49% 340M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46200K .......... .......... .......... .......... .......... 49% 374M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46250K .......... .......... .......... .......... .......... 49% 350M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46300K .......... .......... .......... .......... .......... 49% 335M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46350K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46400K .......... .......... .......... .......... .......... 49% 229M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46450K .......... .......... .......... .......... .......... 50% 355M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46500K .......... .......... .......... .......... .......... 50% 24.7M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46550K .......... .......... .......... .......... .......... 50% 299M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46600K .......... .......... .......... .......... .......... 50% 340M 0s 2024-09-14T11:41:53.755 INFO:teuthology.orchestra.run.smithi007.stderr: 46650K .......... .......... .......... .......... .......... 50% 347M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 46700K .......... .......... .......... .......... .......... 50% 343M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 46750K .......... .......... .......... .......... .......... 50% 291M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 46800K .......... .......... .......... .......... .......... 50% 377M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 46850K .......... .......... .......... .......... .......... 50% 382M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 46900K .......... .......... .......... .......... .......... 50% 368M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 46950K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47000K .......... .......... .......... .......... .......... 50% 367M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47050K .......... .......... .......... .......... .......... 50% 335M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47100K .......... .......... .......... .......... .......... 50% 286M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47150K .......... .......... .......... .......... .......... 50% 290M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47200K .......... .......... .......... .......... .......... 50% 378M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47250K .......... .......... .......... .......... .......... 50% 370M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47300K .......... .......... .......... .......... .......... 50% 375M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47350K .......... .......... .......... .......... .......... 51% 254M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47400K .......... .......... .......... .......... .......... 51% 381M 0s 2024-09-14T11:41:53.756 INFO:teuthology.orchestra.run.smithi007.stderr: 47450K .......... .......... .......... .......... .......... 51% 226M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47500K .......... .......... .......... .......... .......... 51% 326M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47550K .......... .......... .......... .......... .......... 51% 308M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47600K .......... .......... .......... .......... .......... 51% 385M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47650K .......... .......... .......... .......... .......... 51% 103M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47700K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47750K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47800K .......... .......... .......... .......... .......... 51% 334M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47850K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47900K .......... .......... .......... .......... .......... 51% 315M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 47950K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 48000K .......... .......... .......... .......... .......... 51% 393M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 48050K .......... .......... .......... .......... .......... 51% 383M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 48100K .......... .......... .......... .......... .......... 51% 294M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 48150K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 48200K .......... .......... .......... .......... .......... 51% 365M 0s 2024-09-14T11:41:53.757 INFO:teuthology.orchestra.run.smithi007.stderr: 48250K .......... .......... .......... .......... .......... 51% 372M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48300K .......... .......... .......... .......... .......... 52% 138M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48350K .......... .......... .......... .......... .......... 52% 181M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48400K .......... .......... .......... .......... .......... 52% 302M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48450K .......... .......... .......... .......... .......... 52% 184M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48500K .......... .......... .......... .......... .......... 52% 267M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48550K .......... .......... .......... .......... .......... 52% 330M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48600K .......... .......... .......... .......... .......... 52% 359M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48650K .......... .......... .......... .......... .......... 52% 384M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48700K .......... .......... .......... .......... .......... 52% 204M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48750K .......... .......... .......... .......... .......... 52% 210M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48800K .......... .......... .......... .......... .......... 52% 366M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48850K .......... .......... .......... .......... .......... 52% 380M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48900K .......... .......... .......... .......... .......... 52% 375M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 48950K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 49000K .......... .......... .......... .......... .......... 52% 386M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 49050K .......... .......... .......... .......... .......... 52% 346M 0s 2024-09-14T11:41:53.758 INFO:teuthology.orchestra.run.smithi007.stderr: 49100K .......... .......... .......... .......... .......... 52% 359M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49150K .......... .......... .......... .......... .......... 52% 312M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49200K .......... .......... .......... .......... .......... 53% 371M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49250K .......... .......... .......... .......... .......... 53% 378M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49300K .......... .......... .......... .......... .......... 53% 373M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49350K .......... .......... .......... .......... .......... 53% 341M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49400K .......... .......... .......... .......... .......... 53% 354M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49450K .......... .......... .......... .......... .......... 53% 352M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49500K .......... .......... .......... .......... .......... 53% 390M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49550K .......... .......... .......... .......... .......... 53% 26.0M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49600K .......... .......... .......... .......... .......... 53% 109M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49650K .......... .......... .......... .......... .......... 53% 153M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49700K .......... .......... .......... .......... .......... 53% 324M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49750K .......... .......... .......... .......... .......... 53% 321M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49800K .......... .......... .......... .......... .......... 53% 351M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49850K .......... .......... .......... .......... .......... 53% 349M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49900K .......... .......... .......... .......... .......... 53% 365M 0s 2024-09-14T11:41:53.759 INFO:teuthology.orchestra.run.smithi007.stderr: 49950K .......... .......... .......... .......... .......... 53% 295M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50000K .......... .......... .......... .......... .......... 53% 379M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50050K .......... .......... .......... .......... .......... 53% 312M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50100K .......... .......... .......... .......... .......... 53% 387M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50150K .......... .......... .......... .......... .......... 54% 344M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50200K .......... .......... .......... .......... .......... 54% 356M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50250K .......... .......... .......... .......... .......... 54% 358M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50300K .......... .......... .......... .......... .......... 54% 375M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50350K .......... .......... .......... .......... .......... 54% 300M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50400K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50450K .......... .......... .......... .......... .......... 54% 368M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50500K .......... .......... .......... .......... .......... 54% 379M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50550K .......... .......... .......... .......... .......... 54% 350M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50600K .......... .......... .......... .......... .......... 54% 392M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50650K .......... .......... .......... .......... .......... 54% 226M 0s 2024-09-14T11:41:53.760 INFO:teuthology.orchestra.run.smithi007.stderr: 50700K .......... .......... .......... .......... .......... 54% 377M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 50750K .......... .......... .......... .......... .......... 54% 129M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 50800K .......... .......... .......... .......... .......... 54% 357M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 50850K .......... .......... .......... .......... .......... 54% 373M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 50900K .......... .......... .......... .......... .......... 54% 382M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 50950K .......... .......... .......... .......... .......... 54% 343M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51000K .......... .......... .......... .......... .......... 54% 160M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51050K .......... .......... .......... .......... .......... 55% 258M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51100K .......... .......... .......... .......... .......... 55% 365M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51150K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51200K .......... .......... .......... .......... .......... 55% 349M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51250K .......... .......... .......... .......... .......... 55% 400M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51300K .......... .......... .......... .......... .......... 55% 403M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51350K .......... .......... .......... .......... .......... 55% 405M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51400K .......... .......... .......... .......... .......... 55% 351M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51450K .......... .......... .......... .......... .......... 55% 369M 0s 2024-09-14T11:41:53.761 INFO:teuthology.orchestra.run.smithi007.stderr: 51500K .......... .......... .......... .......... .......... 55% 123M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51550K .......... .......... .......... .......... .......... 55% 299M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51600K .......... .......... .......... .......... .......... 55% 314M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51650K .......... .......... .......... .......... .......... 55% 421M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51700K .......... .......... .......... .......... .......... 55% 127M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51750K .......... .......... .......... .......... .......... 55% 381M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51800K .......... .......... .......... .......... .......... 55% 357M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51850K .......... .......... .......... .......... .......... 55% 384M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51900K .......... .......... .......... .......... .......... 55% 387M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 51950K .......... .......... .......... .......... .......... 55% 400M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 52000K .......... .......... .......... .......... .......... 56% 175M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 52050K .......... .......... .......... .......... .......... 56% 369M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 52100K .......... .......... .......... .......... .......... 56% 411M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 52150K .......... .......... .......... .......... .......... 56% 414M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 52200K .......... .......... .......... .......... .......... 56% 352M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 52250K .......... .......... .......... .......... .......... 56% 401M 0s 2024-09-14T11:41:53.762 INFO:teuthology.orchestra.run.smithi007.stderr: 52300K .......... .......... .......... .......... .......... 56% 393M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52350K .......... .......... .......... .......... .......... 56% 401M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52400K .......... .......... .......... .......... .......... 56% 338M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52450K .......... .......... .......... .......... .......... 56% 373M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52500K .......... .......... .......... .......... .......... 56% 302M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52550K .......... .......... .......... .......... .......... 56% 25.8M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52600K .......... .......... .......... .......... .......... 56% 362M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52650K .......... .......... .......... .......... .......... 56% 403M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52700K .......... .......... .......... .......... .......... 56% 360M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52750K .......... .......... .......... .......... .......... 56% 131M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52800K .......... .......... .......... .......... .......... 56% 183M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52850K .......... .......... .......... .......... .......... 56% 386M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52900K .......... .......... .......... .......... .......... 56% 133M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 52950K .......... .......... .......... .......... .......... 57% 346M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 53000K .......... .......... .......... .......... .......... 57% 312M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 53050K .......... .......... .......... .......... .......... 57% 363M 0s 2024-09-14T11:41:53.763 INFO:teuthology.orchestra.run.smithi007.stderr: 53100K .......... .......... .......... .......... .......... 57% 321M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53150K .......... .......... .......... .......... .......... 57% 373M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53200K .......... .......... .......... .......... .......... 57% 351M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53250K .......... .......... .......... .......... .......... 57% 348M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53300K .......... .......... .......... .......... .......... 57% 328M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53350K .......... .......... .......... .......... .......... 57% 380M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53400K .......... .......... .......... .......... .......... 57% 380M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53450K .......... .......... .......... .......... .......... 57% 382M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53500K .......... .......... .......... .......... .......... 57% 320M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53550K .......... .......... .......... .......... .......... 57% 175M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53600K .......... .......... .......... .......... .......... 57% 345M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53650K .......... .......... .......... .......... .......... 57% 346M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53700K .......... .......... .......... .......... .......... 57% 347M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53750K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53800K .......... .......... .......... .......... .......... 57% 361M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53850K .......... .......... .......... .......... .......... 58% 345M 0s 2024-09-14T11:41:53.764 INFO:teuthology.orchestra.run.smithi007.stderr: 53900K .......... .......... .......... .......... .......... 58% 306M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 53950K .......... .......... .......... .......... .......... 58% 384M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54000K .......... .......... .......... .......... .......... 58% 127M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54050K .......... .......... .......... .......... .......... 58% 298M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54100K .......... .......... .......... .......... .......... 58% 128M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54150K .......... .......... .......... .......... .......... 58% 253M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54200K .......... .......... .......... .......... .......... 58% 372M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54250K .......... .......... .......... .......... .......... 58% 366M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54300K .......... .......... .......... .......... .......... 58% 278M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54350K .......... .......... .......... .......... .......... 58% 351M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54400K .......... .......... .......... .......... .......... 58% 377M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54450K .......... .......... .......... .......... .......... 58% 388M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54500K .......... .......... .......... .......... .......... 58% 335M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54550K .......... .......... .......... .......... .......... 58% 364M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54600K .......... .......... .......... .......... .......... 58% 389M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54650K .......... .......... .......... .......... .......... 58% 384M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54700K .......... .......... .......... .......... .......... 58% 267M 0s 2024-09-14T11:41:53.765 INFO:teuthology.orchestra.run.smithi007.stderr: 54750K .......... .......... .......... .......... .......... 58% 223M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 54800K .......... .......... .......... .......... .......... 59% 159M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 54850K .......... .......... .......... .......... .......... 59% 275M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 54900K .......... .......... .......... .......... .......... 59% 330M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 54950K .......... .......... .......... .......... .......... 59% 352M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55000K .......... .......... .......... .......... .......... 59% 352M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55050K .......... .......... .......... .......... .......... 59% 370M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55100K .......... .......... .......... .......... .......... 59% 264M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55150K .......... .......... .......... .......... .......... 59% 349M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55200K .......... .......... .......... .......... .......... 59% 370M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55250K .......... .......... .......... .......... .......... 59% 374M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55300K .......... .......... .......... .......... .......... 59% 309M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55350K .......... .......... .......... .......... .......... 59% 346M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55400K .......... .......... .......... .......... .......... 59% 360M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55450K .......... .......... .......... .......... .......... 59% 377M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55500K .......... .......... .......... .......... .......... 59% 293M 0s 2024-09-14T11:41:53.766 INFO:teuthology.orchestra.run.smithi007.stderr: 55550K .......... .......... .......... .......... .......... 59% 387M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55600K .......... .......... .......... .......... .......... 59% 34.1M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55650K .......... .......... .......... .......... .......... 59% 238M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55700K .......... .......... .......... .......... .......... 60% 201M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55750K .......... .......... .......... .......... .......... 60% 365M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55800K .......... .......... .......... .......... .......... 60% 259M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55850K .......... .......... .......... .......... .......... 60% 89.2M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55900K .......... .......... .......... .......... .......... 60% 254M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 55950K .......... .......... .......... .......... .......... 60% 355M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56000K .......... .......... .......... .......... .......... 60% 382M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56050K .......... .......... .......... .......... .......... 60% 152M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56100K .......... .......... .......... .......... .......... 60% 315M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56150K .......... .......... .......... .......... .......... 60% 364M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56200K .......... .......... .......... .......... .......... 60% 365M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56250K .......... .......... .......... .......... .......... 60% 335M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56300K .......... .......... .......... .......... .......... 60% 279M 0s 2024-09-14T11:41:53.767 INFO:teuthology.orchestra.run.smithi007.stderr: 56350K .......... .......... .......... .......... .......... 60% 359M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56400K .......... .......... .......... .......... .......... 60% 350M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56450K .......... .......... .......... .......... .......... 60% 383M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56500K .......... .......... .......... .......... .......... 60% 349M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56550K .......... .......... .......... .......... .......... 60% 206M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56600K .......... .......... .......... .......... .......... 60% 327M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56650K .......... .......... .......... .......... .......... 61% 333M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56700K .......... .......... .......... .......... .......... 61% 315M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56750K .......... .......... .......... .......... .......... 61% 361M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56800K .......... .......... .......... .......... .......... 61% 358M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56850K .......... .......... .......... .......... .......... 61% 360M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56900K .......... .......... .......... .......... .......... 61% 308M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 56950K .......... .......... .......... .......... .......... 61% 385M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 57000K .......... .......... .......... .......... .......... 61% 185M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 57050K .......... .......... .......... .......... .......... 61% 365M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 57100K .......... .......... .......... .......... .......... 61% 309M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 57150K .......... .......... .......... .......... .......... 61% 170M 0s 2024-09-14T11:41:53.768 INFO:teuthology.orchestra.run.smithi007.stderr: 57200K .......... .......... .......... .......... .......... 61% 356M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57250K .......... .......... .......... .......... .......... 61% 170M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57300K .......... .......... .......... .......... .......... 61% 270M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57350K .......... .......... .......... .......... .......... 61% 273M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57400K .......... .......... .......... .......... .......... 61% 358M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57450K .......... .......... .......... .......... .......... 61% 371M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57500K .......... .......... .......... .......... .......... 61% 287M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57550K .......... .......... .......... .......... .......... 62% 367M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57600K .......... .......... .......... .......... .......... 62% 382M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57650K .......... .......... .......... .......... .......... 62% 385M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57700K .......... .......... .......... .......... .......... 62% 287M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57750K .......... .......... .......... .......... .......... 62% 359M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57800K .......... .......... .......... .......... .......... 62% 373M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57850K .......... .......... .......... .......... .......... 62% 386M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57900K .......... .......... .......... .......... .......... 62% 208M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 57950K .......... .......... .......... .......... .......... 62% 123M 0s 2024-09-14T11:41:53.769 INFO:teuthology.orchestra.run.smithi007.stderr: 58000K .......... .......... .......... .......... .......... 62% 338M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58050K .......... .......... .......... .......... .......... 62% 365M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58100K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58150K .......... .......... .......... .......... .......... 62% 368M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58200K .......... .......... .......... .......... .......... 62% 379M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58250K .......... .......... .......... .......... .......... 62% 348M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58300K .......... .......... .......... .......... .......... 62% 203M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58350K .......... .......... .......... .......... .......... 62% 360M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58400K .......... .......... .......... .......... .......... 62% 256M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58450K .......... .......... .......... .......... .......... 62% 363M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58500K .......... .......... .......... .......... .......... 63% 34.5M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58550K .......... .......... .......... .......... .......... 63% 291M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58600K .......... .......... .......... .......... .......... 63% 356M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58650K .......... .......... .......... .......... .......... 63% 370M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58700K .......... .......... .......... .......... .......... 63% 310M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58750K .......... .......... .......... .......... .......... 63% 375M 0s 2024-09-14T11:41:53.770 INFO:teuthology.orchestra.run.smithi007.stderr: 58800K .......... .......... .......... .......... .......... 63% 366M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 58850K .......... .......... .......... .......... .......... 63% 388M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 58900K .......... .......... .......... .......... .......... 63% 71.7M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 58950K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59000K .......... .......... .......... .......... .......... 63% 231M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59050K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59100K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59150K .......... .......... .......... .......... .......... 63% 268M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59200K .......... .......... .......... .......... .......... 63% 285M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59250K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59300K .......... .......... .......... .......... .......... 63% 336M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59350K .......... .......... .......... .......... .......... 63% 323M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59400K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59450K .......... .......... .......... .......... .......... 64% 327M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59500K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59550K .......... .......... .......... .......... .......... 64% 364M 0s 2024-09-14T11:41:53.771 INFO:teuthology.orchestra.run.smithi007.stderr: 59600K .......... .......... .......... .......... .......... 64% 156M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 59650K .......... .......... .......... .......... .......... 64% 364M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 59700K .......... .......... .......... .......... .......... 64% 329M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 59750K .......... .......... .......... .......... .......... 64% 365M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 59800K .......... .......... .......... .......... .......... 64% 369M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 59850K .......... .......... .......... .......... .......... 64% 379M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 59900K .......... .......... .......... .......... .......... 64% 306M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 59950K .......... .......... .......... .......... .......... 64% 380M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60000K .......... .......... .......... .......... .......... 64% 383M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60050K .......... .......... .......... .......... .......... 64% 373M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60100K .......... .......... .......... .......... .......... 64% 342M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60150K .......... .......... .......... .......... .......... 64% 183M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60200K .......... .......... .......... .......... .......... 64% 305M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60250K .......... .......... .......... .......... .......... 64% 373M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60300K .......... .......... .......... .......... .......... 64% 186M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60350K .......... .......... .......... .......... .......... 65% 180M 0s 2024-09-14T11:41:53.772 INFO:teuthology.orchestra.run.smithi007.stderr: 60400K .......... .......... .......... .......... .......... 65% 362M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60450K .......... .......... .......... .......... .......... 65% 371M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60500K .......... .......... .......... .......... .......... 65% 118M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60550K .......... .......... .......... .......... .......... 65% 356M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60600K .......... .......... .......... .......... .......... 65% 338M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60650K .......... .......... .......... .......... .......... 65% 358M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60700K .......... .......... .......... .......... .......... 65% 311M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60750K .......... .......... .......... .......... .......... 65% 349M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60800K .......... .......... .......... .......... .......... 65% 350M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60850K .......... .......... .......... .......... .......... 65% 362M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60900K .......... .......... .......... .......... .......... 65% 344M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 60950K .......... .......... .......... .......... .......... 65% 325M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 61000K .......... .......... .......... .......... .......... 65% 358M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 61050K .......... .......... .......... .......... .......... 65% 130M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 61100K .......... .......... .......... .......... .......... 65% 292M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 61150K .......... .......... .......... .......... .......... 65% 364M 0s 2024-09-14T11:41:53.773 INFO:teuthology.orchestra.run.smithi007.stderr: 61200K .......... .......... .......... .......... .......... 65% 376M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61250K .......... .......... .......... .......... .......... 65% 359M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61300K .......... .......... .......... .......... .......... 66% 349M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61350K .......... .......... .......... .......... .......... 66% 368M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61400K .......... .......... .......... .......... .......... 66% 342M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61450K .......... .......... .......... .......... .......... 66% 419M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61500K .......... .......... .......... .......... .......... 66% 415M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61550K .......... .......... .......... .......... .......... 66% 425M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61600K .......... .......... .......... .......... .......... 66% 37.3M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61650K .......... .......... .......... .......... .......... 66% 281M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61700K .......... .......... .......... .......... .......... 66% 364M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61750K .......... .......... .......... .......... .......... 66% 331M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61800K .......... .......... .......... .......... .......... 66% 232M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61850K .......... .......... .......... .......... .......... 66% 351M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61900K .......... .......... .......... .......... .......... 66% 65.3M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 61950K .......... .......... .......... .......... .......... 66% 312M 0s 2024-09-14T11:41:53.774 INFO:teuthology.orchestra.run.smithi007.stderr: 62000K .......... .......... .......... .......... .......... 66% 355M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62050K .......... .......... .......... .......... .......... 66% 175M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62100K .......... .......... .......... .......... .......... 66% 328M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62150K .......... .......... .......... .......... .......... 66% 276M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62200K .......... .......... .......... .......... .......... 67% 354M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62250K .......... .......... .......... .......... .......... 67% 365M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62300K .......... .......... .......... .......... .......... 67% 350M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62350K .......... .......... .......... .......... .......... 67% 284M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62400K .......... .......... .......... .......... .......... 67% 389M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62450K .......... .......... .......... .......... .......... 67% 366M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62500K .......... .......... .......... .......... .......... 67% 284M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62550K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62600K .......... .......... .......... .......... .......... 67% 343M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62650K .......... .......... .......... .......... .......... 67% 275M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62700K .......... .......... .......... .......... .......... 67% 291M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62750K .......... .......... .......... .......... .......... 67% 225M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62800K .......... .......... .......... .......... .......... 67% 366M 0s 2024-09-14T11:41:53.775 INFO:teuthology.orchestra.run.smithi007.stderr: 62850K .......... .......... .......... .......... .......... 67% 337M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 62900K .......... .......... .......... .......... .......... 67% 357M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 62950K .......... .......... .......... .......... .......... 67% 355M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63000K .......... .......... .......... .......... .......... 67% 396M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63050K .......... .......... .......... .......... .......... 67% 274M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63100K .......... .......... .......... .......... .......... 67% 381M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63150K .......... .......... .......... .......... .......... 68% 122M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63200K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63250K .......... .......... .......... .......... .......... 68% 348M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63300K .......... .......... .......... .......... .......... 68% 377M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63350K .......... .......... .......... .......... .......... 68% 392M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63400K .......... .......... .......... .......... .......... 68% 383M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63450K .......... .......... .......... .......... .......... 68% 159M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63500K .......... .......... .......... .......... .......... 68% 360M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63550K .......... .......... .......... .......... .......... 68% 180M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63600K .......... .......... .......... .......... .......... 68% 109M 0s 2024-09-14T11:41:53.776 INFO:teuthology.orchestra.run.smithi007.stderr: 63650K .......... .......... .......... .......... .......... 68% 201M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 63700K .......... .......... .......... .......... .......... 68% 328M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 63750K .......... .......... .......... .......... .......... 68% 382M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 63800K .......... .......... .......... .......... .......... 68% 368M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 63850K .......... .......... .......... .......... .......... 68% 318M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 63900K .......... .......... .......... .......... .......... 68% 391M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 63950K .......... .......... .......... .......... .......... 68% 399M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64000K .......... .......... .......... .......... .......... 68% 390M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64050K .......... .......... .......... .......... .......... 68% 185M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64100K .......... .......... .......... .......... .......... 69% 367M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64150K .......... .......... .......... .......... .......... 69% 356M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64200K .......... .......... .......... .......... .......... 69% 378M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64250K .......... .......... .......... .......... .......... 69% 318M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64300K .......... .......... .......... .......... .......... 69% 363M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64350K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64400K .......... .......... .......... .......... .......... 69% 364M 0s 2024-09-14T11:41:53.777 INFO:teuthology.orchestra.run.smithi007.stderr: 64450K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64500K .......... .......... .......... .......... .......... 69% 377M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64550K .......... .......... .......... .......... .......... 69% 42.9M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64600K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64650K .......... .......... .......... .......... .......... 69% 265M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64700K .......... .......... .......... .......... .......... 69% 367M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64750K .......... .......... .......... .......... .......... 69% 160M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64800K .......... .......... .......... .......... .......... 69% 376M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64850K .......... .......... .......... .......... .......... 69% 339M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64900K .......... .......... .......... .......... .......... 69% 391M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 64950K .......... .......... .......... .......... .......... 69% 76.8M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 65000K .......... .......... .......... .......... .......... 70% 353M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 65050K .......... .......... .......... .......... .......... 70% 122M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 65100K .......... .......... .......... .......... .......... 70% 355M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 65150K .......... .......... .......... .......... .......... 70% 374M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 65200K .......... .......... .......... .......... .......... 70% 376M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 65250K .......... .......... .......... .......... .......... 70% 343M 0s 2024-09-14T11:41:53.778 INFO:teuthology.orchestra.run.smithi007.stderr: 65300K .......... .......... .......... .......... .......... 70% 364M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65350K .......... .......... .......... .......... .......... 70% 376M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65400K .......... .......... .......... .......... .......... 70% 371M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65450K .......... .......... .......... .......... .......... 70% 316M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65500K .......... .......... .......... .......... .......... 70% 109M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65550K .......... .......... .......... .......... .......... 70% 279M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65600K .......... .......... .......... .......... .......... 70% 375M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65650K .......... .......... .......... .......... .......... 70% 326M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65700K .......... .......... .......... .......... .......... 70% 374M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65750K .......... .......... .......... .......... .......... 70% 352M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65800K .......... .......... .......... .......... .......... 70% 370M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65850K .......... .......... .......... .......... .......... 70% 309M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65900K .......... .......... .......... .......... .......... 70% 367M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 65950K .......... .......... .......... .......... .......... 71% 373M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 66000K .......... .......... .......... .......... .......... 71% 383M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 66050K .......... .......... .......... .......... .......... 71% 334M 0s 2024-09-14T11:41:53.779 INFO:teuthology.orchestra.run.smithi007.stderr: 66100K .......... .......... .......... .......... .......... 71% 341M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66150K .......... .......... .......... .......... .......... 71% 392M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66200K .......... .......... .......... .......... .......... 71% 321M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66250K .......... .......... .......... .......... .......... 71% 162M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66300K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66350K .......... .......... .......... .......... .......... 71% 359M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66400K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66450K .......... .......... .......... .......... .......... 71% 319M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66500K .......... .......... .......... .......... .......... 71% 387M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66550K .......... .......... .......... .......... .......... 71% 204M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66600K .......... .......... .......... .......... .......... 71% 365M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66650K .......... .......... .......... .......... .......... 71% 93.7M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66700K .......... .......... .......... .......... .......... 71% 182M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66750K .......... .......... .......... .......... .......... 71% 264M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66800K .......... .......... .......... .......... .......... 71% 364M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66850K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-14T11:41:53.780 INFO:teuthology.orchestra.run.smithi007.stderr: 66900K .......... .......... .......... .......... .......... 72% 387M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 66950K .......... .......... .......... .......... .......... 72% 395M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67000K .......... .......... .......... .......... .......... 72% 108M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67050K .......... .......... .......... .......... .......... 72% 300M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67100K .......... .......... .......... .......... .......... 72% 352M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67150K .......... .......... .......... .......... .......... 72% 367M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67200K .......... .......... .......... .......... .......... 72% 374M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67250K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67300K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67350K .......... .......... .......... .......... .......... 72% 368M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67400K .......... .......... .......... .......... .......... 72% 386M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67450K .......... .......... .......... .......... .......... 72% 302M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67500K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67550K .......... .......... .......... .......... .......... 72% 373M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67600K .......... .......... .......... .......... .......... 72% 58.1M 0s 2024-09-14T11:41:53.781 INFO:teuthology.orchestra.run.smithi007.stderr: 67650K .......... .......... .......... .......... .......... 72% 300M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 67700K .......... .......... .......... .......... .......... 72% 323M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 67750K .......... .......... .......... .......... .......... 72% 100M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 67800K .......... .......... .......... .......... .......... 73% 275M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 67850K .......... .......... .......... .......... .......... 73% 323M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 67900K .......... .......... .......... .......... .......... 73% 149M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 67950K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68000K .......... .......... .......... .......... .......... 73% 376M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68050K .......... .......... .......... .......... .......... 73% 197M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68100K .......... .......... .......... .......... .......... 73% 166M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68150K .......... .......... .......... .......... .......... 73% 369M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68200K .......... .......... .......... .......... .......... 73% 336M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68250K .......... .......... .......... .......... .......... 73% 116M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68300K .......... .......... .......... .......... .......... 73% 359M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68350K .......... .......... .......... .......... .......... 73% 371M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68400K .......... .......... .......... .......... .......... 73% 374M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68450K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-14T11:41:53.782 INFO:teuthology.orchestra.run.smithi007.stderr: 68500K .......... .......... .......... .......... .......... 73% 391M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68550K .......... .......... .......... .......... .......... 73% 227M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68600K .......... .......... .......... .......... .......... 73% 243M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68650K .......... .......... .......... .......... .......... 73% 256M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68700K .......... .......... .......... .......... .......... 74% 243M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68750K .......... .......... .......... .......... .......... 74% 364M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68800K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68850K .......... .......... .......... .......... .......... 74% 339M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68900K .......... .......... .......... .......... .......... 74% 353M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 68950K .......... .......... .......... .......... .......... 74% 165M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 69000K .......... .......... .......... .......... .......... 74% 370M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 69050K .......... .......... .......... .......... .......... 74% 320M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 69100K .......... .......... .......... .......... .......... 74% 385M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 69150K .......... .......... .......... .......... .......... 74% 358M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 69200K .......... .......... .......... .......... .......... 74% 351M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 69250K .......... .......... .......... .......... .......... 74% 350M 0s 2024-09-14T11:41:53.783 INFO:teuthology.orchestra.run.smithi007.stderr: 69300K .......... .......... .......... .......... .......... 74% 403M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69350K .......... .......... .......... .......... .......... 74% 144M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69400K .......... .......... .......... .......... .......... 74% 366M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69450K .......... .......... .......... .......... .......... 74% 320M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69500K .......... .......... .......... .......... .......... 74% 346M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69550K .......... .......... .......... .......... .......... 74% 390M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69600K .......... .......... .......... .......... .......... 74% 395M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69650K .......... .......... .......... .......... .......... 75% 131M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69700K .......... .......... .......... .......... .......... 75% 321M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69750K .......... .......... .......... .......... .......... 75% 389M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69800K .......... .......... .......... .......... .......... 75% 323M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69850K .......... .......... .......... .......... .......... 75% 185M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69900K .......... .......... .......... .......... .......... 75% 379M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 69950K .......... .......... .......... .......... .......... 75% 82.1M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 70000K .......... .......... .......... .......... .......... 75% 344M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 70050K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-14T11:41:53.784 INFO:teuthology.orchestra.run.smithi007.stderr: 70100K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70150K .......... .......... .......... .......... .......... 75% 369M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70200K .......... .......... .......... .......... .......... 75% 387M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70250K .......... .......... .......... .......... .......... 75% 318M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70300K .......... .......... .......... .......... .......... 75% 364M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70350K .......... .......... .......... .......... .......... 75% 382M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70400K .......... .......... .......... .......... .......... 75% 380M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70450K .......... .......... .......... .......... .......... 75% 349M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70500K .......... .......... .......... .......... .......... 75% 379M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70550K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70600K .......... .......... .......... .......... .......... 76% 55.1M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70650K .......... .......... .......... .......... .......... 76% 275M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70700K .......... .......... .......... .......... .......... 76% 217M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70750K .......... .......... .......... .......... .......... 76% 383M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70800K .......... .......... .......... .......... .......... 76% 182M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70850K .......... .......... .......... .......... .......... 76% 176M 0s 2024-09-14T11:41:53.785 INFO:teuthology.orchestra.run.smithi007.stderr: 70900K .......... .......... .......... .......... .......... 76% 223M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 70950K .......... .......... .......... .......... .......... 76% 372M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71000K .......... .......... .......... .......... .......... 76% 314M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71050K .......... .......... .......... .......... .......... 76% 136M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71100K .......... .......... .......... .......... .......... 76% 223M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71150K .......... .......... .......... .......... .......... 76% 370M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71200K .......... .......... .......... .......... .......... 76% 366M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71250K .......... .......... .......... .......... .......... 76% 334M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71300K .......... .......... .......... .......... .......... 76% 127M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71350K .......... .......... .......... .......... .......... 76% 307M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71400K .......... .......... .......... .......... .......... 76% 378M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71450K .......... .......... .......... .......... .......... 76% 152M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71500K .......... .......... .......... .......... .......... 77% 383M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71550K .......... .......... .......... .......... .......... 77% 213M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71600K .......... .......... .......... .......... .......... 77% 293M 0s 2024-09-14T11:41:53.786 INFO:teuthology.orchestra.run.smithi007.stderr: 71650K .......... .......... .......... .......... .......... 77% 332M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 71700K .......... .......... .......... .......... .......... 77% 408M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 71750K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 71800K .......... .......... .......... .......... .......... 77% 384M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 71850K .......... .......... .......... .......... .......... 77% 378M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 71900K .......... .......... .......... .......... .......... 77% 351M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 71950K .......... .......... .......... .......... .......... 77% 262M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72000K .......... .......... .......... .......... .......... 77% 238M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72050K .......... .......... .......... .......... .......... 77% 185M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72100K .......... .......... .......... .......... .......... 77% 376M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72150K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72200K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72250K .......... .......... .......... .......... .......... 77% 368M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72300K .......... .......... .......... .......... .......... 77% 392M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72350K .......... .......... .......... .......... .......... 77% 138M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72400K .......... .......... .......... .......... .......... 77% 379M 0s 2024-09-14T11:41:53.787 INFO:teuthology.orchestra.run.smithi007.stderr: 72450K .......... .......... .......... .......... .......... 78% 374M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72500K .......... .......... .......... .......... .......... 78% 372M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72550K .......... .......... .......... .......... .......... 78% 338M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72600K .......... .......... .......... .......... .......... 78% 394M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72650K .......... .......... .......... .......... .......... 78% 107M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72700K .......... .......... .......... .......... .......... 78% 356M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72750K .......... .......... .......... .......... .......... 78% 296M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72800K .......... .......... .......... .......... .......... 78% 359M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72850K .......... .......... .......... .......... .......... 78% 391M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72900K .......... .......... .......... .......... .......... 78% 383M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 72950K .......... .......... .......... .......... .......... 78% 338M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 73000K .......... .......... .......... .......... .......... 78% 73.6M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 73050K .......... .......... .......... .......... .......... 78% 347M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 73100K .......... .......... .......... .......... .......... 78% 340M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 73150K .......... .......... .......... .......... .......... 78% 314M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 73200K .......... .......... .......... .......... .......... 78% 378M 0s 2024-09-14T11:41:53.788 INFO:teuthology.orchestra.run.smithi007.stderr: 73250K .......... .......... .......... .......... .......... 78% 243M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73300K .......... .......... .......... .......... .......... 78% 360M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73350K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73400K .......... .......... .......... .......... .......... 79% 358M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73450K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73500K .......... .......... .......... .......... .......... 79% 379M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73550K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73600K .......... .......... .......... .......... .......... 79% 55.9M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73650K .......... .......... .......... .......... .......... 79% 349M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73700K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73750K .......... .......... .......... .......... .......... 79% 310M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73800K .......... .......... .......... .......... .......... 79% 349M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73850K .......... .......... .......... .......... .......... 79% 352M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73900K .......... .......... .......... .......... .......... 79% 210M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 73950K .......... .......... .......... .......... .......... 79% 180M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 74000K .......... .......... .......... .......... .......... 79% 245M 0s 2024-09-14T11:41:53.789 INFO:teuthology.orchestra.run.smithi007.stderr: 74050K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74100K .......... .......... .......... .......... .......... 79% 372M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74150K .......... .......... .......... .......... .......... 79% 101M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74200K .......... .......... .......... .......... .......... 79% 233M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74250K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74300K .......... .......... .......... .......... .......... 80% 390M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74350K .......... .......... .......... .......... .......... 80% 299M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74400K .......... .......... .......... .......... .......... 80% 241M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74450K .......... .......... .......... .......... .......... 80% 318M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74500K .......... .......... .......... .......... .......... 80% 242M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74550K .......... .......... .......... .......... .......... 80% 124M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74600K .......... .......... .......... .......... .......... 80% 349M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74650K .......... .......... .......... .......... .......... 80% 384M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74700K .......... .......... .......... .......... .......... 80% 385M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74750K .......... .......... .......... .......... .......... 80% 313M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74800K .......... .......... .......... .......... .......... 80% 379M 0s 2024-09-14T11:41:53.790 INFO:teuthology.orchestra.run.smithi007.stderr: 74850K .......... .......... .......... .......... .......... 80% 261M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 74900K .......... .......... .......... .......... .......... 80% 354M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 74950K .......... .......... .......... .......... .......... 80% 337M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75000K .......... .......... .......... .......... .......... 80% 358M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75050K .......... .......... .......... .......... .......... 80% 371M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75100K .......... .......... .......... .......... .......... 80% 391M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75150K .......... .......... .......... .......... .......... 80% 133M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75200K .......... .......... .......... .......... .......... 81% 256M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75250K .......... .......... .......... .......... .......... 81% 210M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75300K .......... .......... .......... .......... .......... 81% 309M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75350K .......... .......... .......... .......... .......... 81% 326M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75400K .......... .......... .......... .......... .......... 81% 375M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75450K .......... .......... .......... .......... .......... 81% 359M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75500K .......... .......... .......... .......... .......... 81% 367M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75550K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-14T11:41:53.791 INFO:teuthology.orchestra.run.smithi007.stderr: 75600K .......... .......... .......... .......... .......... 81% 116M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 75650K .......... .......... .......... .......... .......... 81% 308M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 75700K .......... .......... .......... .......... .......... 81% 364M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 75750K .......... .......... .......... .......... .......... 81% 117M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 75800K .......... .......... .......... .......... .......... 81% 371M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 75850K .......... .......... .......... .......... .......... 81% 380M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 75900K .......... .......... .......... .......... .......... 81% 377M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 75950K .......... .......... .......... .......... .......... 81% 317M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76000K .......... .......... .......... .......... .......... 81% 333M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76050K .......... .......... .......... .......... .......... 81% 182M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76100K .......... .......... .......... .......... .......... 81% 370M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76150K .......... .......... .......... .......... .......... 82% 180M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76200K .......... .......... .......... .......... .......... 82% 141M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76250K .......... .......... .......... .......... .......... 82% 93.1M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76300K .......... .......... .......... .......... .......... 82% 247M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76350K .......... .......... .......... .......... .......... 82% 292M 0s 2024-09-14T11:41:53.792 INFO:teuthology.orchestra.run.smithi007.stderr: 76400K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76450K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76500K .......... .......... .......... .......... .......... 82% 393M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76550K .......... .......... .......... .......... .......... 82% 346M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76600K .......... .......... .......... .......... .......... 82% 76.1M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76650K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76700K .......... .......... .......... .......... .......... 82% 366M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76750K .......... .......... .......... .......... .......... 82% 288M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76800K .......... .......... .......... .......... .......... 82% 385M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76850K .......... .......... .......... .......... .......... 82% 385M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76900K .......... .......... .......... .......... .......... 82% 369M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 76950K .......... .......... .......... .......... .......... 82% 322M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 77000K .......... .......... .......... .......... .......... 82% 385M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 77050K .......... .......... .......... .......... .......... 82% 171M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 77100K .......... .......... .......... .......... .......... 83% 372M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 77150K .......... .......... .......... .......... .......... 83% 319M 0s 2024-09-14T11:41:53.793 INFO:teuthology.orchestra.run.smithi007.stderr: 77200K .......... .......... .......... .......... .......... 83% 176M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77250K .......... .......... .......... .......... .......... 83% 296M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77300K .......... .......... .......... .......... .......... 83% 154M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77350K .......... .......... .......... .......... .......... 83% 309M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77400K .......... .......... .......... .......... .......... 83% 375M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77450K .......... .......... .......... .......... .......... 83% 377M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77500K .......... .......... .......... .......... .......... 83% 374M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77550K .......... .......... .......... .......... .......... 83% 144M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77600K .......... .......... .......... .......... .......... 83% 354M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77650K .......... .......... .......... .......... .......... 83% 200M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77700K .......... .......... .......... .......... .......... 83% 260M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77750K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77800K .......... .......... .......... .......... .......... 83% 248M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77850K .......... .......... .......... .......... .......... 83% 374M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77900K .......... .......... .......... .......... .......... 83% 379M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 77950K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 78000K .......... .......... .......... .......... .......... 84% 388M 0s 2024-09-14T11:41:53.794 INFO:teuthology.orchestra.run.smithi007.stderr: 78050K .......... .......... .......... .......... .......... 84% 373M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78100K .......... .......... .......... .......... .......... 84% 136M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78150K .......... .......... .......... .......... .......... 84% 262M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78200K .......... .......... .......... .......... .......... 84% 392M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78250K .......... .......... .......... .......... .......... 84% 371M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78300K .......... .......... .......... .......... .......... 84% 226M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78350K .......... .......... .......... .......... .......... 84% 298M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78400K .......... .......... .......... .......... .......... 84% 266M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78450K .......... .......... .......... .......... .......... 84% 352M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78500K .......... .......... .......... .......... .......... 84% 371M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78550K .......... .......... .......... .......... .......... 84% 327M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78600K .......... .......... .......... .......... .......... 84% 377M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78650K .......... .......... .......... .......... .......... 84% 381M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78700K .......... .......... .......... .......... .......... 84% 126M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78750K .......... .......... .......... .......... .......... 84% 283M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78800K .......... .......... .......... .......... .......... 84% 105M 0s 2024-09-14T11:41:53.795 INFO:teuthology.orchestra.run.smithi007.stderr: 78850K .......... .......... .......... .......... .......... 84% 235M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 78900K .......... .......... .......... .......... .......... 84% 386M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 78950K .......... .......... .......... .......... .......... 85% 158M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79000K .......... .......... .......... .......... .......... 85% 380M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79050K .......... .......... .......... .......... .......... 85% 180M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79100K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79150K .......... .......... .......... .......... .......... 85% 317M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79200K .......... .......... .......... .......... .......... 85% 379M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79250K .......... .......... .......... .......... .......... 85% 384M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79300K .......... .......... .......... .......... .......... 85% 138M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79350K .......... .......... .......... .......... .......... 85% 234M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79400K .......... .......... .......... .......... .......... 85% 78.9M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79450K .......... .......... .......... .......... .......... 85% 317M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79500K .......... .......... .......... .......... .......... 85% 87.7M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79550K .......... .......... .......... .......... .......... 85% 248M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79600K .......... .......... .......... .......... .......... 85% 388M 0s 2024-09-14T11:41:53.796 INFO:teuthology.orchestra.run.smithi007.stderr: 79650K .......... .......... .......... .......... .......... 85% 372M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 79700K .......... .......... .......... .......... .......... 85% 226M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 79750K .......... .......... .......... .......... .......... 85% 333M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 79800K .......... .......... .......... .......... .......... 85% 318M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 79850K .......... .......... .......... .......... .......... 86% 374M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 79900K .......... .......... .......... .......... .......... 86% 390M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 79950K .......... .......... .......... .......... .......... 86% 311M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80000K .......... .......... .......... .......... .......... 86% 376M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80050K .......... .......... .......... .......... .......... 86% 359M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80100K .......... .......... .......... .......... .......... 86% 386M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80150K .......... .......... .......... .......... .......... 86% 349M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80200K .......... .......... .......... .......... .......... 86% 380M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80250K .......... .......... .......... .......... .......... 86% 374M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80300K .......... .......... .......... .......... .......... 86% 385M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80350K .......... .......... .......... .......... .......... 86% 200M 0s 2024-09-14T11:41:53.797 INFO:teuthology.orchestra.run.smithi007.stderr: 80400K .......... .......... .......... .......... .......... 86% 371M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80450K .......... .......... .......... .......... .......... 86% 95.5M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80500K .......... .......... .......... .......... .......... 86% 231M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80550K .......... .......... .......... .......... .......... 86% 329M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80600K .......... .......... .......... .......... .......... 86% 366M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80650K .......... .......... .......... .......... .......... 86% 385M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80700K .......... .......... .......... .......... .......... 86% 203M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80750K .......... .......... .......... .......... .......... 86% 233M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80800K .......... .......... .......... .......... .......... 87% 296M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80850K .......... .......... .......... .......... .......... 87% 366M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80900K .......... .......... .......... .......... .......... 87% 362M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 80950K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 81000K .......... .......... .......... .......... .......... 87% 394M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 81050K .......... .......... .......... .......... .......... 87% 390M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 81100K .......... .......... .......... .......... .......... 87% 264M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 81150K .......... .......... .......... .......... .......... 87% 237M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 81200K .......... .......... .......... .......... .......... 87% 383M 0s 2024-09-14T11:41:53.798 INFO:teuthology.orchestra.run.smithi007.stderr: 81250K .......... .......... .......... .......... .......... 87% 389M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81300K .......... .......... .......... .......... .......... 87% 178M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81350K .......... .......... .......... .......... .......... 87% 245M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81400K .......... .......... .......... .......... .......... 87% 371M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81450K .......... .......... .......... .......... .......... 87% 321M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81500K .......... .......... .......... .......... .......... 87% 373M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81550K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81600K .......... .......... .......... .......... .......... 87% 289M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81650K .......... .......... .......... .......... .......... 87% 122M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81700K .......... .......... .......... .......... .......... 87% 344M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81750K .......... .......... .......... .......... .......... 88% 340M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81800K .......... .......... .......... .......... .......... 88% 85.2M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81850K .......... .......... .......... .......... .......... 88% 358M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81900K .......... .......... .......... .......... .......... 88% 328M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 81950K .......... .......... .......... .......... .......... 88% 248M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 82000K .......... .......... .......... .......... .......... 88% 380M 0s 2024-09-14T11:41:53.799 INFO:teuthology.orchestra.run.smithi007.stderr: 82050K .......... .......... .......... .......... .......... 88% 165M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82100K .......... .......... .......... .......... .......... 88% 278M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82150K .......... .......... .......... .......... .......... 88% 316M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82200K .......... .......... .......... .......... .......... 88% 317M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82250K .......... .......... .......... .......... .......... 88% 388M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82300K .......... .......... .......... .......... .......... 88% 223M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82350K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82400K .......... .......... .......... .......... .......... 88% 388M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82450K .......... .......... .......... .......... .......... 88% 76.7M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82500K .......... .......... .......... .......... .......... 88% 363M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82550K .......... .......... .......... .......... .......... 88% 88.3M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82600K .......... .......... .......... .......... .......... 88% 374M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82650K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82700K .......... .......... .......... .......... .......... 89% 167M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82750K .......... .......... .......... .......... .......... 89% 303M 0s 2024-09-14T11:41:53.800 INFO:teuthology.orchestra.run.smithi007.stderr: 82800K .......... .......... .......... .......... .......... 89% 328M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 82850K .......... .......... .......... .......... .......... 89% 391M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 82900K .......... .......... .......... .......... .......... 89% 378M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 82950K .......... .......... .......... .......... .......... 89% 273M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83000K .......... .......... .......... .......... .......... 89% 266M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83050K .......... .......... .......... .......... .......... 89% 381M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83100K .......... .......... .......... .......... .......... 89% 393M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83150K .......... .......... .......... .......... .......... 89% 149M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83200K .......... .......... .......... .......... .......... 89% 361M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83250K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83300K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83350K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83400K .......... .......... .......... .......... .......... 89% 370M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83450K .......... .......... .......... .......... .......... 89% 348M 0s 2024-09-14T11:41:53.801 INFO:teuthology.orchestra.run.smithi007.stderr: 83500K .......... .......... .......... .......... .......... 89% 150M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83550K .......... .......... .......... .......... .......... 89% 175M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83600K .......... .......... .......... .......... .......... 90% 364M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83650K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83700K .......... .......... .......... .......... .......... 90% 211M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83750K .......... .......... .......... .......... .......... 90% 212M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83800K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83850K .......... .......... .......... .......... .......... 90% 311M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83900K .......... .......... .......... .......... .......... 90% 117M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 83950K .......... .......... .......... .......... .......... 90% 307M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 84000K .......... .......... .......... .......... .......... 90% 383M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 84050K .......... .......... .......... .......... .......... 90% 373M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 84100K .......... .......... .......... .......... .......... 90% 345M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 84150K .......... .......... .......... .......... .......... 90% 343M 0s 2024-09-14T11:41:53.802 INFO:teuthology.orchestra.run.smithi007.stderr: 84200K .......... .......... .......... .......... .......... 90% 386M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84250K .......... .......... .......... .......... .......... 90% 296M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84300K .......... .......... .......... .......... .......... 90% 370M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84350K .......... .......... .......... .......... .......... 90% 319M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84400K .......... .......... .......... .......... .......... 90% 380M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84450K .......... .......... .......... .......... .......... 90% 372M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84500K .......... .......... .......... .......... .......... 91% 382M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84550K .......... .......... .......... .......... .......... 91% 344M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84600K .......... .......... .......... .......... .......... 91% 260M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84650K .......... .......... .......... .......... .......... 91% 374M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84700K .......... .......... .......... .......... .......... 91% 382M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84750K .......... .......... .......... .......... .......... 91% 172M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84800K .......... .......... .......... .......... .......... 91% 57.6M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84850K .......... .......... .......... .......... .......... 91% 357M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84900K .......... .......... .......... .......... .......... 91% 384M 0s 2024-09-14T11:41:53.803 INFO:teuthology.orchestra.run.smithi007.stderr: 84950K .......... .......... .......... .......... .......... 91% 311M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85000K .......... .......... .......... .......... .......... 91% 338M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85050K .......... .......... .......... .......... .......... 91% 380M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85100K .......... .......... .......... .......... .......... 91% 374M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85150K .......... .......... .......... .......... .......... 91% 342M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85200K .......... .......... .......... .......... .......... 91% 335M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85250K .......... .......... .......... .......... .......... 91% 362M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85300K .......... .......... .......... .......... .......... 91% 279M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85350K .......... .......... .......... .......... .......... 91% 227M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85400K .......... .......... .......... .......... .......... 91% 381M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85450K .......... .......... .......... .......... .......... 92% 383M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85500K .......... .......... .......... .......... .......... 92% 111M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85550K .......... .......... .......... .......... .......... 92% 37.1M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85600K .......... .......... .......... .......... .......... 92% 328M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85650K .......... .......... .......... .......... .......... 92% 376M 0s 2024-09-14T11:41:53.804 INFO:teuthology.orchestra.run.smithi007.stderr: 85700K .......... .......... .......... .......... .......... 92% 380M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 85750K .......... .......... .......... .......... .......... 92% 309M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 85800K .......... .......... .......... .......... .......... 92% 353M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 85850K .......... .......... .......... .......... .......... 92% 379M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 85900K .......... .......... .......... .......... .......... 92% 354M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 85950K .......... .......... .......... .......... .......... 92% 351M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86000K .......... .......... .......... .......... .......... 92% 387M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86050K .......... .......... .......... .......... .......... 92% 375M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86100K .......... .......... .......... .......... .......... 92% 372M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86150K .......... .......... .......... .......... .......... 92% 312M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86200K .......... .......... .......... .......... .......... 92% 385M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86250K .......... .......... .......... .......... .......... 92% 378M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86300K .......... .......... .......... .......... .......... 92% 338M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86350K .......... .......... .......... .......... .......... 93% 325M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86400K .......... .......... .......... .......... .......... 93% 386M 0s 2024-09-14T11:41:53.805 INFO:teuthology.orchestra.run.smithi007.stderr: 86450K .......... .......... .......... .......... .......... 93% 383M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86500K .......... .......... .......... .......... .......... 93% 128M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86550K .......... .......... .......... .......... .......... 93% 251M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86600K .......... .......... .......... .......... .......... 93% 381M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86650K .......... .......... .......... .......... .......... 93% 392M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86700K .......... .......... .......... .......... .......... 93% 329M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86750K .......... .......... .......... .......... .......... 93% 329M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86800K .......... .......... .......... .......... .......... 93% 382M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86850K .......... .......... .......... .......... .......... 93% 180M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86900K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 86950K .......... .......... .......... .......... .......... 93% 94.4M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 87000K .......... .......... .......... .......... .......... 93% 363M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 87050K .......... .......... .......... .......... .......... 93% 362M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 87100K .......... .......... .......... .......... .......... 93% 386M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 87150K .......... .......... .......... .......... .......... 93% 341M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 87200K .......... .......... .......... .......... .......... 93% 381M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 87250K .......... .......... .......... .......... .......... 93% 395M 0s 2024-09-14T11:41:53.806 INFO:teuthology.orchestra.run.smithi007.stderr: 87300K .......... .......... .......... .......... .......... 94% 252M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87350K .......... .......... .......... .......... .......... 94% 305M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87400K .......... .......... .......... .......... .......... 94% 358M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87450K .......... .......... .......... .......... .......... 94% 385M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87500K .......... .......... .......... .......... .......... 94% 375M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87550K .......... .......... .......... .......... .......... 94% 338M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87600K .......... .......... .......... .......... .......... 94% 375M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87650K .......... .......... .......... .......... .......... 94% 380M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87700K .......... .......... .......... .......... .......... 94% 271M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87750K .......... .......... .......... .......... .......... 94% 290M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87800K .......... .......... .......... .......... .......... 94% 379M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87850K .......... .......... .......... .......... .......... 94% 62.9M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87900K .......... .......... .......... .......... .......... 94% 123M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 87950K .......... .......... .......... .......... .......... 94% 249M 0s 2024-09-14T11:41:53.807 INFO:teuthology.orchestra.run.smithi007.stderr: 88000K .......... .......... .......... .......... .......... 94% 364M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88050K .......... .......... .......... .......... .......... 94% 359M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88100K .......... .......... .......... .......... .......... 94% 388M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88150K .......... .......... .......... .......... .......... 94% 328M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88200K .......... .......... .......... .......... .......... 94% 385M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88250K .......... .......... .......... .......... .......... 95% 374M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88300K .......... .......... .......... .......... .......... 95% 387M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88350K .......... .......... .......... .......... .......... 95% 323M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88400K .......... .......... .......... .......... .......... 95% 384M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88450K .......... .......... .......... .......... .......... 95% 377M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88500K .......... .......... .......... .......... .......... 95% 280M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88550K .......... .......... .......... .......... .......... 95% 182M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88600K .......... .......... .......... .......... .......... 95% 39.6M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88650K .......... .......... .......... .......... .......... 95% 196M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88700K .......... .......... .......... .......... .......... 95% 291M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88750K .......... .......... .......... .......... .......... 95% 312M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88800K .......... .......... .......... .......... .......... 95% 373M 0s 2024-09-14T11:41:53.808 INFO:teuthology.orchestra.run.smithi007.stderr: 88850K .......... .......... .......... .......... .......... 95% 196M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 88900K .......... .......... .......... .......... .......... 95% 259M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 88950K .......... .......... .......... .......... .......... 95% 328M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89000K .......... .......... .......... .......... .......... 95% 368M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89050K .......... .......... .......... .......... .......... 95% 371M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89100K .......... .......... .......... .......... .......... 95% 386M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89150K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89200K .......... .......... .......... .......... .......... 96% 372M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89250K .......... .......... .......... .......... .......... 96% 398M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89300K .......... .......... .......... .......... .......... 96% 388M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89350K .......... .......... .......... .......... .......... 96% 338M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89400K .......... .......... .......... .......... .......... 96% 354M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89450K .......... .......... .......... .......... .......... 96% 380M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89500K .......... .......... .......... .......... .......... 96% 149M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89550K .......... .......... .......... .......... .......... 96% 271M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89600K .......... .......... .......... .......... .......... 96% 384M 0s 2024-09-14T11:41:53.809 INFO:teuthology.orchestra.run.smithi007.stderr: 89650K .......... .......... .......... .......... .......... 96% 370M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 89700K .......... .......... .......... .......... .......... 96% 352M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 89750K .......... .......... .......... .......... .......... 96% 342M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 89800K .......... .......... .......... .......... .......... 96% 371M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 89850K .......... .......... .......... .......... .......... 96% 395M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 89900K .......... .......... .......... .......... .......... 96% 403M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 89950K .......... .......... .......... .......... .......... 96% 207M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90000K .......... .......... .......... .......... .......... 96% 129M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90050K .......... .......... .......... .......... .......... 96% 167M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90100K .......... .......... .......... .......... .......... 97% 369M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90150K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90200K .......... .......... .......... .......... .......... 97% 395M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90250K .......... .......... .......... .......... .......... 97% 333M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90300K .......... .......... .......... .......... .......... 97% 321M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90350K .......... .......... .......... .......... .......... 97% 317M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90400K .......... .......... .......... .......... .......... 97% 237M 0s 2024-09-14T11:41:53.810 INFO:teuthology.orchestra.run.smithi007.stderr: 90450K .......... .......... .......... .......... .......... 97% 361M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90500K .......... .......... .......... .......... .......... 97% 381M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90550K .......... .......... .......... .......... .......... 97% 323M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90600K .......... .......... .......... .......... .......... 97% 350M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90650K .......... .......... .......... .......... .......... 97% 378M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90700K .......... .......... .......... .......... .......... 97% 384M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90750K .......... .......... .......... .......... .......... 97% 184M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90800K .......... .......... .......... .......... .......... 97% 386M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90850K .......... .......... .......... .......... .......... 97% 74.7M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90900K .......... .......... .......... .......... .......... 97% 286M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 90950K .......... .......... .......... .......... .......... 97% 128M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 91000K .......... .......... .......... .......... .......... 98% 375M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 91050K .......... .......... .......... .......... .......... 98% 295M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 91100K .......... .......... .......... .......... .......... 98% 374M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 91150K .......... .......... .......... .......... .......... 98% 230M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 91200K .......... .......... .......... .......... .......... 98% 377M 0s 2024-09-14T11:41:53.811 INFO:teuthology.orchestra.run.smithi007.stderr: 91250K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91300K .......... .......... .......... .......... .......... 98% 377M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91350K .......... .......... .......... .......... .......... 98% 337M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91400K .......... .......... .......... .......... .......... 98% 371M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91450K .......... .......... .......... .......... .......... 98% 395M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91500K .......... .......... .......... .......... .......... 98% 318M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91550K .......... .......... .......... .......... .......... 98% 302M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91600K .......... .......... .......... .......... .......... 98% 384M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91650K .......... .......... .......... .......... .......... 98% 41.9M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91700K .......... .......... .......... .......... .......... 98% 115M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91750K .......... .......... .......... .......... .......... 98% 242M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91800K .......... .......... .......... .......... .......... 98% 377M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91850K .......... .......... .......... .......... .......... 98% 375M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91900K .......... .......... .......... .......... .......... 98% 272M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 91950K .......... .......... .......... .......... .......... 99% 229M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 92000K .......... .......... .......... .......... .......... 99% 375M 0s 2024-09-14T11:41:53.812 INFO:teuthology.orchestra.run.smithi007.stderr: 92050K .......... .......... .......... .......... .......... 99% 374M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92100K .......... .......... .......... .......... .......... 99% 296M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92150K .......... .......... .......... .......... .......... 99% 328M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92200K .......... .......... .......... .......... .......... 99% 340M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92250K .......... .......... .......... .......... .......... 99% 393M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92300K .......... .......... .......... .......... .......... 99% 319M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92350K .......... .......... .......... .......... .......... 99% 213M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92400K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92450K .......... .......... .......... .......... .......... 99% 377M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92500K .......... .......... .......... .......... .......... 99% 387M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92550K .......... .......... .......... .......... .......... 99% 217M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92600K .......... .......... .......... .......... .......... 99% 385M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92650K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92700K .......... .......... .......... .......... .......... 99% 379M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92750K .......... .......... .......... .......... .......... 99% 317M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92800K .......... .......... .......... .......... .......... 99% 321M 0s 2024-09-14T11:41:53.813 INFO:teuthology.orchestra.run.smithi007.stderr: 92850K .......... .......... .......... .......... .......... 99% 379M 0s 2024-09-14T11:41:53.814 INFO:teuthology.orchestra.run.smithi007.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:41:53.814 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T11:41:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14 11:41:52 (201 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:41:53.814 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T11:41:53.842 INFO:teuthology.orchestra.run.smithi007.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:41:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:41:53.842 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:41:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:41:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:41:53.845 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:41:53.846 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:41:53.847 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:41:53.848 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:41:53.849 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:41:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:41:53.851 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:41:53.852 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:41:53.853 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:41:53.856 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:41:53.857 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:41:53.858 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:41:53.859 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:41:53.860 INFO:teuthology.orchestra.run.smithi007.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:41:53.860 INFO:teuthology.orchestra.run.smithi007.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:41:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.873 INFO:teuthology.orchestra.run.smithi007.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout:Here are the highlights of this release: 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Advanced control of transitive versions 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Support for optional features and dependencies 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Rules to tweak published metadata 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Support for Java 13 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - New Zinc compiler for Scala 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - VS2019 support 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.874 INFO:teuthology.orchestra.run.smithi007.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:41:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.875 INFO:teuthology.orchestra.run.smithi007.stdout:------------------------------------------------------------ 2024-09-14T11:41:53.876 INFO:teuthology.orchestra.run.smithi007.stdout:Gradle 6.0.1 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:------------------------------------------------------------ 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:Kotlin: 1.3.50 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:Groovy: 2.5.8 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:41:53.877 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:53.878 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:41:53.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:41:53.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T11:41:53.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:41:53.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T11:41:53.879 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:41:54.097 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:41:54.097 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:41:54.097 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'SHJHKKFXTORLDFCHWECX', 'access_secret': 'Si+kJvmZf1vZ4Ar0tWP9HoRhpBwr8Q5EwzDb+fmWR8DmZDt/+G1Fxg==', 'region': 'mexico', 'endpoint': 'smithi007.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi007.front.sepia.ceph.com'} 2024-09-14T11:41:54.097 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:41:54.098 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'SHJHKKFXTORLDFCHWECX', '--secret', 'Si+kJvmZf1vZ4Ar0tWP9HoRhpBwr8Q5EwzDb+fmWR8DmZDt/+G1Fxg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:41:54.098 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key SHJHKKFXTORLDFCHWECX --secret Si+kJvmZf1vZ4Ar0tWP9HoRhpBwr8Q5EwzDb+fmWR8DmZDt/+G1Fxg== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:41:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:54.164 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:54.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.203+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.204+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.204+0000 7fc00be0f800 20 realm 2024-09-14T11:41:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.204+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.205+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.205+0000 7fc00be0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.205+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.205+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.205+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.206+0000 7fc00be0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.206+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.207+0000 7fc00be0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:54.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.207+0000 7fc00be0f800 20 searching for the correct realm 2024-09-14T11:41:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.209+0000 7fc007592640 0 -- 172.21.15.7:0/4247800358 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fc00002b070 msgr2=0x7fc00002c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:54.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.415+0000 7fc007592640 0 -- 172.21.15.7:0/4247800358 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fc00002b070 msgr2=0x7fc00002c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.420+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 zone default found 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 4 Realm: () 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 zonegroup default 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.421+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.422+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.422+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.422+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.422+0000 7fc00be0f800 20 started sync module instance, tier type = 2024-09-14T11:41:54.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.422+0000 7fc00be0f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:54.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.434+0000 7fc00be0f800 20 add_watcher() i=0 2024-09-14T11:41:54.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.434+0000 7fc00be0f800 20 add_watcher() i=1 2024-09-14T11:41:54.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.434+0000 7fc00be0f800 20 add_watcher() i=2 2024-09-14T11:41:54.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.434+0000 7fc00be0f800 20 add_watcher() i=3 2024-09-14T11:41:54.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.434+0000 7fc00be0f800 20 add_watcher() i=4 2024-09-14T11:41:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.434+0000 7fc00be0f800 20 add_watcher() i=5 2024-09-14T11:41:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.434+0000 7fc00be0f800 20 add_watcher() i=6 2024-09-14T11:41:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.435+0000 7fc00be0f800 20 add_watcher() i=7 2024-09-14T11:41:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.435+0000 7fc00be0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:54.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.437+0000 7fbebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:54.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.437+0000 7fc00be0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:54.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.437+0000 7fc00be0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:54.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.437+0000 7fc00be0f800 5 note: GC not initialized 2024-09-14T11:41:54.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fbebcfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:54.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:54.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 20 Filter name: none 2024-09-14T11:41:54.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fbe367fc640 20 reqs_thread_entry: start 2024-09-14T11:41:54.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:41:54.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.438+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 10 cache get: name=default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX : miss 2024-09-14T11:41:54.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 10 cache put: name=default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX info.flags=0x0 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 10 adding default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX to cache LRU end 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 10 cache get: name=default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX : hit (negative entry) 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.439+0000 7fc00be0f800 10 cache get: name=default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX : hit (negative entry) 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.440+0000 7fc00be0f800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.440+0000 7fc00be0f800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:41:54.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.440+0000 7fc00be0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:41:54.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.441+0000 7fbeeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529806 cookie 94704736460400 notifier 8273 bl.length()=670 2024-09-14T11:41:54.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.441+0000 7fbeeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:41:54.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.441+0000 7fbeeaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:41:54.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.442+0000 7fc00be0f800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:41:54.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.442+0000 7fc00be0f800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:41:54.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.442+0000 7fc00be0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:41:54.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.442+0000 7fbeeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529714 cookie 94704736456688 notifier 8273 bl.length()=200 2024-09-14T11:41:54.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.443+0000 7fbeeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:41:54.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.443+0000 7fbeeaffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:41:54.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.445+0000 7fc00be0f800 10 cache put: name=default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX info.flags=0x7 2024-09-14T11:41:54.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.445+0000 7fc00be0f800 10 moving default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX to cache LRU end 2024-09-14T11:41:54.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.445+0000 7fc00be0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:SHJHKKFXTORLDFCHWECX, ofs0, ns] 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.445+0000 7fbeea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529711 cookie 94704736463728 notifier 8273 bl.length()=189 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.445+0000 7fbeea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX info.flags=0x7 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.445+0000 7fbeea7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SHJHKKFXTORLDFCHWECX to cache LRU end 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "tester.client.0", 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:41:54.443 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "tester.client.0", 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "SHJHKKFXTORLDFCHWECX", 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "Si+kJvmZf1vZ4Ar0tWP9HoRhpBwr8Q5EwzDb+fmWR8DmZDt/+G1Fxg==", 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:41:54.439934Z" 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:41:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:41:54.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:41:54.439917Z", 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:41:54.446 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:41:54.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.446+0000 7fbebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:54.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.449+0000 7fc00be0f800 20 remove_watcher() i=0 2024-09-14T11:41:54.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.449+0000 7fc00be0f800 2 removed watcher, disabling cache 2024-09-14T11:41:54.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.450+0000 7fc00be0f800 20 remove_watcher() i=1 2024-09-14T11:41:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.451+0000 7fc00be0f800 20 remove_watcher() i=2 2024-09-14T11:41:54.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.452+0000 7fc00be0f800 20 remove_watcher() i=3 2024-09-14T11:41:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.453+0000 7fc00be0f800 20 remove_watcher() i=4 2024-09-14T11:41:54.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.454+0000 7fc00be0f800 20 remove_watcher() i=5 2024-09-14T11:41:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.455+0000 7fc00be0f800 20 remove_watcher() i=6 2024-09-14T11:41:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.456+0000 7fc00be0f800 20 remove_watcher() i=7 2024-09-14T11:41:54.466 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:41:54.466 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:41:54.498 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:41:54.498 DEBUG:teuthology.orchestra.run.smithi007:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:41:54.565 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:41:54.658 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:54.658 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.701+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.702+0000 7f801870c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.702+0000 7f801870c800 20 realm 2024-09-14T11:41:54.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.702+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.702+0000 7f801870c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.702+0000 7f801870c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:54.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.702+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.703+0000 7f801870c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:54.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.703+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.704+0000 7f801870c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:54.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.704+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:54.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.705+0000 7f801870c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:54.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.705+0000 7f801870c800 20 searching for the correct realm 2024-09-14T11:41:54.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.706+0000 7f80169fe640 0 -- 172.21.15.7:0/417378328 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f800c067040 msgr2=0x7f800c08c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:54.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:54.913+0000 7f80159fc640 0 -- 172.21.15.7:0/417378328 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f800806b150 msgr2=0x7f8008073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.120+0000 7f801870c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.120+0000 7f801870c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:55.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.120+0000 7f801870c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.120+0000 7f801870c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.120+0000 7f801870c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.120+0000 7f801870c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.120+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 20 zone default found 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 4 Realm: () 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.121+0000 7f801870c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 20 zonegroup default 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.122+0000 7f801870c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.123+0000 7f801870c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.123+0000 7f801870c800 20 started sync module instance, tier type = 2024-09-14T11:41:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.123+0000 7f801870c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.133+0000 7f801870c800 20 add_watcher() i=0 2024-09-14T11:41:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.133+0000 7f801870c800 20 add_watcher() i=1 2024-09-14T11:41:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.133+0000 7f801870c800 20 add_watcher() i=2 2024-09-14T11:41:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.133+0000 7f801870c800 20 add_watcher() i=3 2024-09-14T11:41:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.133+0000 7f801870c800 20 add_watcher() i=4 2024-09-14T11:41:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.133+0000 7f801870c800 20 add_watcher() i=5 2024-09-14T11:41:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.133+0000 7f801870c800 20 add_watcher() i=6 2024-09-14T11:41:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.134+0000 7f801870c800 20 add_watcher() i=7 2024-09-14T11:41:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.134+0000 7f801870c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.136+0000 7f7eccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:55.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.136+0000 7f801870c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:55.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.136+0000 7f801870c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.177+0000 7f7e477fe640 20 reqs_thread_entry: start 2024-09-14T11:41:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.178+0000 7f801870c800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.178+0000 7f801870c800 20 Filter name: none 2024-09-14T11:41:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.178+0000 7f7e457fa640 20 reqs_thread_entry: start 2024-09-14T11:41:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.178+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:55.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.180+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.180+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_RXS_a05AQyMvyhrbH3XMLpxai_V8Dit', time=2024-09-14T13:32:41.986624+0000, chain.objs.size()=1 2024-09-14T11:41:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.317N7vIQJ-soF7pV3A0bMjW2cup7FMQ_0 2024-09-14T11:41:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7234002515447149230', time=2024-09-14T13:32:42.015271+0000, chain.objs.size()=2 2024-09-14T11:41:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_0 2024-09-14T11:41:55.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_1 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_ClrvFrWxkKywnALzyFxZUj_SkdFeJWB', time=2024-09-14T13:32:42.067405+0000, chain.objs.size()=3 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Eq3eyRiwvS6HRXFe11RPjWY78XPAjTj_0 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Eq3eyRiwvS6HRXFe11RPjWY78XPAjTj_1 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Eq3eyRiwvS6HRXFe11RPjWY78XPAjTj_2 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12742643101260751922', time=2024-09-14T13:32:42.094840+0000, chain.objs.size()=5 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1_1 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2_1 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.3 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2803167547595016578', time=2024-09-14T13:32:42.117608+0000, chain.objs.size()=3 2024-09-14T11:41:55.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.181+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-STANDARD.2~60N6nEjC_NJjYIlLC3ZzyNIBboLXkl6.1 2024-09-14T11:41:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.183+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-STANDARD.2~60N6nEjC_NJjYIlLC3ZzyNIBboLXkl6.2 2024-09-14T11:41:55.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.183+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-STANDARD.2~60N6nEjC_NJjYIlLC3ZzyNIBboLXkl6.3 2024-09-14T11:41:55.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.185+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.187+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.188+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.189+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.190+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.190+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15934185635502033396', time=2024-09-14T13:32:41.996149+0000, chain.objs.size()=2 2024-09-14T11:41:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.190+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__0 2024-09-14T11:41:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.190+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__1 2024-09-14T11:41:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.190+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_QUJTXWQSzSAxPz55XVEtGgIegtzI436', time=2024-09-14T13:32:42.004026+0000, chain.objs.size()=2 2024-09-14T11:41:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.190+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.uppjZzcd7LPPsimlYF2Fhj1oi894RS8_0 2024-09-14T11:41:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.190+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.uppjZzcd7LPPsimlYF2Fhj1oi894RS8_1 2024-09-14T11:41:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.192+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.195+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:55.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.196+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.197+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.198+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.198+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15631989479112375834', time=2024-09-14T13:32:42.070934+0000, chain.objs.size()=3 2024-09-14T11:41:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.198+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.1 2024-09-14T11:41:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.198+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.2 2024-09-14T11:41:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.198+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.3 2024-09-14T11:41:55.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.199+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.202+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:55.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.203+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.204+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.204+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.204+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_VN0ApYc7DuzmwHdX57SeqqyO79tguq_', time=2024-09-14T13:32:42.063839+0000, chain.objs.size()=3 2024-09-14T11:41:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.204+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Ad1qibR8rVgpyEBN-R6DrBkTmpavWkt_0 2024-09-14T11:41:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.204+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Ad1qibR8rVgpyEBN-R6DrBkTmpavWkt_1 2024-09-14T11:41:55.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.204+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.Ad1qibR8rVgpyEBN-R6DrBkTmpavWkt_2 2024-09-14T11:41:55.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.206+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.209+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:55.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.210+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.211+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.211+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.212+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:55.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.213+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.214+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.214+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.215+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:55.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.217+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.217+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9145915165871176205', time=2024-09-14T13:32:41.963712+0000, chain.objs.size()=7 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.1 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__shadow_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.1_1 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.2 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__shadow_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.2_1 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.3 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__shadow_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.3_1 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10__multipart_foo.2~A_8HsZZOaG8CiWWcUjqzU-VPe54Grep.4 2024-09-14T11:41:55.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6505664572589819216', time=2024-09-14T13:32:42.087344+0000, chain.objs.size()=5 2024-09-14T11:41:55.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1 2024-09-14T11:41:55.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1_1 2024-09-14T11:41:55.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2 2024-09-14T11:41:55.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2_1 2024-09-14T11:41:55.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.218+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.3 2024-09-14T11:41:55.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.224+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.226+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:55.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.228+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.228+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.228+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.229+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:55.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.231+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.232+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.232+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.233+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:55.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.235+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.235+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.235+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.236+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:55.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.238+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.238+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:55.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14013684162243217326', time=2024-09-14T13:32:42.059802+0000, chain.objs.size()=5 2024-09-14T11:41:55.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.1_1 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.2_1 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-FROZEN.2~J5bM7Bo6IFTGkv8gIpLgRI4g_yFy5qx.3 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16606933489004616442', time=2024-09-14T13:32:42.153559+0000, chain.objs.size()=3 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.5FLWuQZSOsHoEKTLI1zF_7Vqm2GiOLI_0 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.5FLWuQZSOsHoEKTLI1zF_7Vqm2GiOLI_1 2024-09-14T11:41:55.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.239+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.5FLWuQZSOsHoEKTLI1zF_7Vqm2GiOLI_2 2024-09-14T11:41:55.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.242+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.244+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:55.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.246+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.246+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.246+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.246+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_e6kjYPXaD7XR-Dq0AW9aKm8RioeSxm4', time=2024-09-14T13:32:41.992310+0000, chain.objs.size()=1 2024-09-14T11:41:55.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.246+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.XsLf2qXir0XwZ2Fbyztk0m3GBmFpCCs_1 2024-09-14T11:41:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.248+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.250+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.251+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10874185749575984377', time=2024-09-14T13:32:41.914886+0000, chain.objs.size()=7 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.1 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__shadow_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.1_1 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.2 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__shadow_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.2_1 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.3 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.252+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__shadow_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.3_1 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.253+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13__multipart_foo.2~kYDHHVWhBmJAo4xATChzG1meJkTCSfj.4 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.253+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_h5KjVVH4pkPtRzfORMv19jJnEVZikmZ', time=2024-09-14T13:32:42.025427+0000, chain.objs.size()=1 2024-09-14T11:41:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.253+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.8ZvuwRRNhbCtfbzLFqnwZV740j3R3eU_0 2024-09-14T11:41:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.255+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.257+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:55.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.258+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.259+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.259+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.259+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13976167385162033488', time=2024-09-14T13:32:42.146511+0000, chain.objs.size()=3 2024-09-14T11:41:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.259+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.WxcM6lMjl9XlMs0wRhN787NHDtQtpUz_0 2024-09-14T11:41:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.259+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.WxcM6lMjl9XlMs0wRhN787NHDtQtpUz_1 2024-09-14T11:41:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.259+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14__shadow_.WxcM6lMjl9XlMs0wRhN787NHDtQtpUz_2 2024-09-14T11:41:55.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.261+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.263+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:55.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.264+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.265+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.265+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.265+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_leOgRB-CexqFZhEKlLKyRc6iyOAjs-w', time=2024-09-14T13:32:42.000384+0000, chain.objs.size()=2 2024-09-14T11:41:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.265+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4E4-mnYgOYjymi3y2adsYv5XzzZb-nB_0 2024-09-14T11:41:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.265+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4E4-mnYgOYjymi3y2adsYv5XzzZb-nB_1 2024-09-14T11:41:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.265+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_Ykil0GybcWMxo2MQHO3i0r3lQzPsdhf', time=2024-09-14T13:32:42.050386+0000, chain.objs.size()=1 2024-09-14T11:41:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.265+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.9BkrnxqwePSk5eKbFx-DvAemjQOUyjV_0 2024-09-14T11:41:55.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.267+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.269+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.271+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.271+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.271+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.272+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.274+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.274+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.274+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.275+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.276+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.277+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.277+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.278+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.280+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.280+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.280+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.281+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:55.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.283+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.283+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8399970171743687933', time=2024-09-14T13:32:41.940612+0000, chain.objs.size()=4 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.1 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.2 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.3 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11__multipart_foo.2~MV4z4ruQt5b-WDN8AAReZp7mysvzcXP.4 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6245589511562896308', time=2024-09-14T13:32:42.083125+0000, chain.objs.size()=3 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.1 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.2 2024-09-14T11:41:55.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.284+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-STANDARD.2~kakF5RxKOTwXeXcpQjw_cIYqxZkDP-k.3 2024-09-14T11:41:55.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.286+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.288+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.289+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.290+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.290+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.291+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.292+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.802787930951598564', time=2024-09-14T13:32:42.113881+0000, chain.objs.size()=5 2024-09-14T11:41:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.1 2024-09-14T11:41:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.1_1 2024-09-14T11:41:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.2 2024-09-14T11:41:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.2_1 2024-09-14T11:41:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.293+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-FROZEN.2~HC_uvPvgJDcMHCjF4xyn2XFBKaoRhkM.3 2024-09-14T11:41:55.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.295+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.297+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:55.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.298+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18286927467947842341', time=2024-09-14T13:32:42.079171+0000, chain.objs.size()=5 2024-09-14T11:41:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1 2024-09-14T11:41:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.1_1 2024-09-14T11:41:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2 2024-09-14T11:41:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.2_1 2024-09-14T11:41:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.299+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__multipart_foo-LUKEWARM.2~cwr7zoOFVorhylWggkejnvak9J_iVrx.3 2024-09-14T11:41:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.302+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.304+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:55.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.305+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.305+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.306+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.306+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_zjyI_vXBkHS9KYf9weFs3IBey666-2i', time=2024-09-14T13:32:42.011287+0000, chain.objs.size()=1 2024-09-14T11:41:55.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.306+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.qbgugta73qIawQZhau_VjPDTAguxwlj_1 2024-09-14T11:41:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.307+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.309+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.310+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4317020435304289190', time=2024-09-14T13:32:42.121362+0000, chain.objs.size()=5 2024-09-14T11:41:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.1 2024-09-14T11:41:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.1_1 2024-09-14T11:41:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.2 2024-09-14T11:41:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__shadow_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.2_1 2024-09-14T11:41:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.311+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15__multipart_foo-LUKEWARM.2~n-en30qPOFfJazfiwJoSfVR5BtRZN6j.3 2024-09-14T11:41:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.313+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.315+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.316+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5869986532604102600', time=2024-09-14T13:32:41.893884+0000, chain.objs.size()=4 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.1 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.2 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.3 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12__multipart_foo.2~cSV4xjTN70aTIQ04hPur1llqTwaryUa.4 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5017961284645732713', time=2024-09-14T13:32:42.029310+0000, chain.objs.size()=2 2024-09-14T11:41:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__0 2024-09-14T11:41:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.4FJdyrltW4e1lEjeTOvhhIFpQJ01WP__1 2024-09-14T11:41:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_e-mId7770rL7Mn5MfzbNOM-jR-fvA5t', time=2024-09-14T13:32:42.091094+0000, chain.objs.size()=1 2024-09-14T11:41:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.317+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.OxcygNFPqSwnW5pSKi0_TTNNCWjdDXa_0 2024-09-14T11:41:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.319+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.321+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.323+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.323+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.323+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.324+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:55.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.326+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.326+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.326+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.327+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.329+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.329+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.330+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.330+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_xhxFueT5lpDgR02I_cLA1-hlnQWPA0F', time=2024-09-14T13:32:42.075365+0000, chain.objs.size()=2 2024-09-14T11:41:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.330+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.wGosO6RkJS0uGQfXzd_-KvIfG8XtZ-t_1 2024-09-14T11:41:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.330+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.wGosO6RkJS0uGQfXzd_-KvIfG8XtZ-t_2 2024-09-14T11:41:55.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.332+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.334+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:55.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.335+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.335+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.335+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.335+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='_daOEt9V2imvT3OK264AdQPYQOIY3_QN', time=2024-09-14T13:32:42.055158+0000, chain.objs.size()=2 2024-09-14T11:41:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.336+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.B1uN6OgBhAp28P56KQsZCrhfSYMVwW6_1 2024-09-14T11:41:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.336+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17__shadow_.B1uN6OgBhAp28P56KQsZCrhfSYMVwW6_2 2024-09-14T11:41:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.337+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.339+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.340+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.341+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.342+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.342+0000 7f801870c800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2693998878872487671', time=2024-09-14T13:32:42.021647+0000, chain.objs.size()=2 2024-09-14T11:41:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.342+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_0 2024-09-14T11:41:55.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.342+0000 7f801870c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16__shadow_.bJx9U4J637ozq7z_zGnfZoQxpu2gt1L_1 2024-09-14T11:41:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.344+0000 7f801870c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.346+0000 7f801870c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.347+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.348+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.348+0000 7f801870c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.350+0000 7f7eccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.352+0000 7f801870c800 20 remove_watcher() i=0 2024-09-14T11:41:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.352+0000 7f801870c800 2 removed watcher, disabling cache 2024-09-14T11:41:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.353+0000 7f801870c800 20 remove_watcher() i=1 2024-09-14T11:41:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.354+0000 7f801870c800 20 remove_watcher() i=2 2024-09-14T11:41:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.355+0000 7f801870c800 20 remove_watcher() i=3 2024-09-14T11:41:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.356+0000 7f801870c800 20 remove_watcher() i=4 2024-09-14T11:41:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.357+0000 7f801870c800 20 remove_watcher() i=5 2024-09-14T11:41:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.358+0000 7f801870c800 20 remove_watcher() i=6 2024-09-14T11:41:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.359+0000 7f801870c800 20 remove_watcher() i=7 2024-09-14T11:41:55.368 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:41:55.421 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:55.421 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:55.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.463+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.464+0000 7f2b0e125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.464+0000 7f2b0e125800 20 realm 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.464+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.464+0000 7f2b0e125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.464+0000 7f2b0e125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.464+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.465+0000 7f2b0e125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.465+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.465+0000 7f2b0e125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:55.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.465+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.466+0000 7f2b0e125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.466+0000 7f2b0e125800 20 searching for the correct realm 2024-09-14T11:41:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.468+0000 7f2b0a534640 0 -- 172.21.15.7:0/2009794960 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f2b000b5c50 msgr2=0x7f2b000ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.674+0000 7f2b09532640 0 -- 172.21.15.7:0/2009794960 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f2afc044d90 msgr2=0x7f2afc060190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:55.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.880+0000 7f2b0e125800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:41:55.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.880+0000 7f2b0e125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:55.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.880+0000 7f2b0e125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:55.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.880+0000 7f2b0e125800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:41:55.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.880+0000 7f2b0e125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:55.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.880+0000 7f2b0e125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:55.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.880+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:55.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:55.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 zone default found 2024-09-14T11:41:55.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 4 Realm: () 2024-09-14T11:41:55.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:41:55.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 zonegroup default 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.881+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.882+0000 7f2b0e125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.882+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.882+0000 7f2b0e125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.882+0000 7f2b0e125800 20 rados->read ofs=0 len=0 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.882+0000 7f2b0e125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.882+0000 7f2b0e125800 20 started sync module instance, tier type = 2024-09-14T11:41:55.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.882+0000 7f2b0e125800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.893+0000 7f2b0e125800 20 add_watcher() i=0 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.893+0000 7f2b0e125800 20 add_watcher() i=1 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.893+0000 7f2b0e125800 20 add_watcher() i=2 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.893+0000 7f2b0e125800 20 add_watcher() i=3 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.893+0000 7f2b0e125800 20 add_watcher() i=4 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.893+0000 7f2b0e125800 20 add_watcher() i=5 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.893+0000 7f2b0e125800 20 add_watcher() i=6 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.894+0000 7f2b0e125800 20 add_watcher() i=7 2024-09-14T11:41:55.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.894+0000 7f2b0e125800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:55.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.896+0000 7f29bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:55.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.896+0000 7f2b0e125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:55.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.896+0000 7f2b0e125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.933+0000 7f29ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.933+0000 7f2b0e125800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.933+0000 7f2b0e125800 20 Filter name: none 2024-09-14T11:41:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.933+0000 7f292bfff640 20 reqs_thread_entry: start 2024-09-14T11:41:55.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.933+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:55.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.935+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.936+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.936+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.937+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:55.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.938+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.939+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.939+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.940+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.941+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.942+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.942+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.944+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.945+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.945+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.945+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.947+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:55.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.948+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.948+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.949+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.950+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:55.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.951+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.952+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.952+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.953+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:55.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.954+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.955+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.955+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.956+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:55.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.957+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.958+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.958+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.959+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:55.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.961+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.961+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.962+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.963+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.964+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.965+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.965+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.966+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.968+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.968+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.968+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.969+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:55.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.971+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.971+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.972+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.973+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.974+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.975+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.975+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.976+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:55.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.978+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.978+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.978+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.979+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:55.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.981+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.982+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.982+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.983+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:55.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.985+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.985+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.985+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.986+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:55.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.987+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.988+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.988+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.989+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:55.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.991+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.991+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.991+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.992+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:55.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.993+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.994+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.994+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.995+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:55.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.997+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.997+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.997+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:55.998+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:55.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.000+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.000+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.000+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:55.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.001+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.002+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.003+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.003+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.004+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:56.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.006+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.006+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.007+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.008+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:56.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.009+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.010+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.010+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.011+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:56.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.012+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.013+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.013+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.014+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:56.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.015+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.016+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.016+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.017+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:56.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.018+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.018+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.019+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.020+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:56.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.021+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.021+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.022+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.023+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:56.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.024+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.024+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.025+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.026+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:56.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.027+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.027+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.028+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.029+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:56.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.030+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.030+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.030+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.031+0000 7f2b0e125800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:56.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.033+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.033+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:56.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.033+0000 7f2b0e125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.035+0000 7f29bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.038+0000 7f2b0e125800 20 remove_watcher() i=0 2024-09-14T11:41:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.038+0000 7f2b0e125800 2 removed watcher, disabling cache 2024-09-14T11:41:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.039+0000 7f2b0e125800 20 remove_watcher() i=1 2024-09-14T11:41:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.040+0000 7f2b0e125800 20 remove_watcher() i=2 2024-09-14T11:41:56.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.041+0000 7f2b0e125800 20 remove_watcher() i=3 2024-09-14T11:41:56.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.042+0000 7f2b0e125800 20 remove_watcher() i=4 2024-09-14T11:41:56.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.043+0000 7f2b0e125800 20 remove_watcher() i=5 2024-09-14T11:41:56.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.044+0000 7f2b0e125800 20 remove_watcher() i=6 2024-09-14T11:41:56.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:41:56.045+0000 7f2b0e125800 20 remove_watcher() i=7 2024-09-14T11:41:56.054 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:41:56.564 INFO:teuthology.orchestra.run.smithi007.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:42:00.264 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:42:18.564 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :compileJava 2024-09-14T11:42:18.564 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :processResources 2024-09-14T11:42:18.564 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :classes 2024-09-14T11:42:19.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:19.263 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :compileTestJava 2024-09-14T11:42:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:42:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:42:19.264 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:19.265 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:42:19.265 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :testClasses 2024-09-14T11:42:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :test 2024-09-14T11:42:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:42:26.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:26.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:42:26.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:26.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:42:26.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:26.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:42:26.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:26.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:42:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:27.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:42:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:27.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:42:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:27.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:42:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:27.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:42:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:27.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:42:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:27.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:42:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:27.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:42:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:28.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:42:28.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:28.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:42:28.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14 11:42:28,392 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:42:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:31.464 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:42:31.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:31.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:42:31.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:31.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:42:32.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:32.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:42:32.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:32.064 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:42:32.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:32.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:42:32.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:32.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:42:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:32.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:42:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:32.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:42:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:33.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:42:35.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:35.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:42:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:35.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:42:36.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:36.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:42:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:42:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:36.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:42:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:42:41.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:41.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:42:41.262 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:41.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:42:42.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:42.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:42:42.362 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:42.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:42:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:42.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:42:42.962 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:42.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:42:43.364 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:43.364 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:42:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:43.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:42:43.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:43.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:42:43.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:42:43.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:43.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:42:44.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:42:44.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:42:44.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:42:44.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:42:44.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:42:44.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:42:44.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:42:44.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:42:44.862 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:42:44.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:44.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:42:45.162 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:45.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:42:45.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:45.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:42:45.940 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:---------------------------------------------------------------------- 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:---------------------------------------------------------------------- 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:BUILD SUCCESSFUL in 49s 2024-09-14T11:42:45.941 INFO:teuthology.orchestra.run.smithi007.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:42:46.258 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:46.313 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:46.313 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:46.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.355+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 20 realm 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.357+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.358+0000 7ff9aa12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.358+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.359+0000 7ff9aa12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:46.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.359+0000 7ff9aa12e800 20 searching for the correct realm 2024-09-14T11:42:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.360+0000 7ff9a66de640 0 -- 172.21.15.7:0/2863037994 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ff99c0b5f10 msgr2=0x7ff99c0ab6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:46.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.365+0000 7ff9a56dc640 0 -- 172.21.15.7:0/2863037994 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ff9980635e0 msgr2=0x7ff998069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.572+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 zone default found 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 4 Realm: () 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 zonegroup default 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.573+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.574+0000 7ff9aa12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.574+0000 7ff9aa12e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.574+0000 7ff9aa12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.574+0000 7ff9aa12e800 20 started sync module instance, tier type = 2024-09-14T11:42:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.574+0000 7ff9aa12e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:46.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.584+0000 7ff9aa12e800 20 add_watcher() i=0 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.584+0000 7ff9aa12e800 20 add_watcher() i=1 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.584+0000 7ff9aa12e800 20 add_watcher() i=2 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.584+0000 7ff9aa12e800 20 add_watcher() i=3 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.584+0000 7ff9aa12e800 20 add_watcher() i=4 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.584+0000 7ff9aa12e800 20 add_watcher() i=5 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.584+0000 7ff9aa12e800 20 add_watcher() i=6 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.585+0000 7ff9aa12e800 20 add_watcher() i=7 2024-09-14T11:42:46.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.585+0000 7ff9aa12e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:46.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.586+0000 7ff8577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:46.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.587+0000 7ff9aa12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:46.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.587+0000 7ff9aa12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:46.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.622+0000 7ff8567fc640 20 reqs_thread_entry: start 2024-09-14T11:42:46.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.622+0000 7ff9aa12e800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:46.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.622+0000 7ff9aa12e800 20 Filter name: none 2024-09-14T11:42:46.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.622+0000 7ff7c7fff640 20 reqs_thread_entry: start 2024-09-14T11:42:46.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.622+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:46.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.623+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.624+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.624+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.624+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6435714551435072500', time=2024-09-14T13:42:30.950374+0000, chain.objs.size()=7 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.624+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~SoyPpYlPQ5-s43sfwrdRjpbnkkuA1Sl.1 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.624+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~SoyPpYlPQ5-s43sfwrdRjpbnkkuA1Sl.1_1 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.624+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~SoyPpYlPQ5-s43sfwrdRjpbnkkuA1Sl.1_2 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~SoyPpYlPQ5-s43sfwrdRjpbnkkuA1Sl.2 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~SoyPpYlPQ5-s43sfwrdRjpbnkkuA1Sl.2_1 2024-09-14T11:42:46.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~SoyPpYlPQ5-s43sfwrdRjpbnkkuA1Sl.2_2 2024-09-14T11:42:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~SoyPpYlPQ5-s43sfwrdRjpbnkkuA1Sl.3 2024-09-14T11:42:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2312287049257188676', time=2024-09-14T13:42:39.787025+0000, chain.objs.size()=19 2024-09-14T11:42:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.1 2024-09-14T11:42:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.1_1 2024-09-14T11:42:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.2 2024-09-14T11:42:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.2_1 2024-09-14T11:42:46.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.625+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.3 2024-09-14T11:42:46.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.627+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.3_1 2024-09-14T11:42:46.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.628+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.4 2024-09-14T11:42:46.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.628+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.4_1 2024-09-14T11:42:46.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.628+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.5 2024-09-14T11:42:46.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.628+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.5_1 2024-09-14T11:42:46.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.628+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.6 2024-09-14T11:42:46.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.628+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.6_1 2024-09-14T11:42:46.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.629+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.7 2024-09-14T11:42:46.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.630+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.7_1 2024-09-14T11:42:46.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.630+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.8 2024-09-14T11:42:46.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.630+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.8_1 2024-09-14T11:42:46.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.630+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.9 2024-09-14T11:42:46.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.633+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.9_1 2024-09-14T11:42:46.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.633+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~OGtaxa1rUtryseLBHxJh-0zoV-0y4UU.10 2024-09-14T11:42:46.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.635+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.638+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:46.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.639+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.639+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6757978373704088786', time=2024-09-14T13:42:38.523014+0000, chain.objs.size()=21 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.1 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.1_1 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.2 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.2_1 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.3 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.3_1 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.4 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.4_1 2024-09-14T11:42:46.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.5 2024-09-14T11:42:46.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.5_1 2024-09-14T11:42:46.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.6 2024-09-14T11:42:46.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.640+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.6_1 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.643+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.7 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.643+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.7_1 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.643+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.8 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.643+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.8_1 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.644+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.9 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.644+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.9_1 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.644+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.10 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.644+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.10_1 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.644+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~3a3Q9Aza7iM83fEaKjOfXxd7AqPkSvj.11 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.644+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5219818609123473847', time=2024-09-14T13:42:42.159788+0000, chain.objs.size()=9 2024-09-14T11:42:46.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.644+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__multipart_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.1 2024-09-14T11:42:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.645+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__shadow_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.1_1 2024-09-14T11:42:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.646+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__multipart_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.2 2024-09-14T11:42:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.647+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__shadow_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.2_1 2024-09-14T11:42:46.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.647+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__multipart_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.3 2024-09-14T11:42:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.647+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__shadow_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.3_1 2024-09-14T11:42:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.647+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__multipart_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.4 2024-09-14T11:42:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.647+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__shadow_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.4_1 2024-09-14T11:42:46.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.647+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.57__multipart_key1.2~KNnrnPDel7q5tpjiy0Hqty-hgBWry-H.5 2024-09-14T11:42:46.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.649+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.651+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:46.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.652+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.653+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.653+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.654+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.655+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:42:46.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13655919752283435705', time=2024-09-14T13:42:28.097504+0000, chain.objs.size()=9 2024-09-14T11:42:46.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.1 2024-09-14T11:42:46.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.1_1 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.2 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.2_1 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.3 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.3_1 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.4 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.4_1 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.5 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16417634059976664230', time=2024-09-14T13:42:30.152219+0000, chain.objs.size()=9 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.1 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.1_1 2024-09-14T11:42:46.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.656+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.2 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.2_1 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.3 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.3_1 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.4 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.4_1 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~2-kJjV2W3mKkUa0eTw2_J5TtQbERCTA.5 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.793288166342119146', time=2024-09-14T13:42:39.216545+0000, chain.objs.size()=21 2024-09-14T11:42:46.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.1 2024-09-14T11:42:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.1_1 2024-09-14T11:42:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.2 2024-09-14T11:42:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.2_1 2024-09-14T11:42:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.659+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.3 2024-09-14T11:42:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.3_1 2024-09-14T11:42:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.4 2024-09-14T11:42:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.4_1 2024-09-14T11:42:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.5 2024-09-14T11:42:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.5_1 2024-09-14T11:42:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.6 2024-09-14T11:42:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.6_1 2024-09-14T11:42:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.7 2024-09-14T11:42:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.662+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.7_1 2024-09-14T11:42:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.663+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.8 2024-09-14T11:42:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.663+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.8_1 2024-09-14T11:42:46.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.664+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.9 2024-09-14T11:42:46.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.664+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.9_1 2024-09-14T11:42:46.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.664+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.10 2024-09-14T11:42:46.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.664+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.10_1 2024-09-14T11:42:46.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.664+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~-1cGn9ObSqmuZbQb2bcItcgX2Iv4ZrL.11 2024-09-14T11:42:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.668+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.670+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:46.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.671+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.671+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.671+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.671+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11803776066033411813', time=2024-09-14T13:42:36.190045+0000, chain.objs.size()=9 2024-09-14T11:42:46.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.1 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.1_1 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.2 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.2_1 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.3 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.3_1 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.4 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.4_1 2024-09-14T11:42:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.672+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file.mpg.2~SYN6m0RbwZy5qW9a-uQ_AYwLPFQnmIA.5 2024-09-14T11:42:46.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.676+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.677+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.679+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.679+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.679+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.680+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.681+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.682+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.682+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.683+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.684+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2137727867916977959', time=2024-09-14T13:42:31.630231+0000, chain.objs.size()=5 2024-09-14T11:42:46.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.47__shadow_.0ZRhRCqkw0gHDB3BeYhQYCXWfcwe3VJ_1 2024-09-14T11:42:46.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.47__shadow_.0ZRhRCqkw0gHDB3BeYhQYCXWfcwe3VJ_2 2024-09-14T11:42:46.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.47__shadow_.0ZRhRCqkw0gHDB3BeYhQYCXWfcwe3VJ_3 2024-09-14T11:42:46.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.47__shadow_.0ZRhRCqkw0gHDB3BeYhQYCXWfcwe3VJ_4 2024-09-14T11:42:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.685+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.47__shadow_.0ZRhRCqkw0gHDB3BeYhQYCXWfcwe3VJ_5 2024-09-14T11:42:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.689+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.691+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:46.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.692+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.692+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.693+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.694+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.695+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.696+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.696+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.697+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:46.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.698+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11340263691430359433', time=2024-09-14T13:42:40.353071+0000, chain.objs.size()=16 2024-09-14T11:42:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.1 2024-09-14T11:42:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.1_1 2024-09-14T11:42:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.1_2 2024-09-14T11:42:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.2 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.2_1 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.2_2 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.3 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.3_1 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.3_2 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.699+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.4 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.701+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.4_1 2024-09-14T11:42:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.701+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.4_2 2024-09-14T11:42:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.703+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.5 2024-09-14T11:42:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.703+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.5_1 2024-09-14T11:42:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.703+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.5_2 2024-09-14T11:42:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.704+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~w15uQhOHSBF4DjsPapLDXJni_vkKn4Q.6 2024-09-14T11:42:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.706+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.709+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:46.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.710+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14451579057628364267', time=2024-09-14T13:42:42.817173+0000, chain.objs.size()=9 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__multipart_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.1 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__shadow_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.1_1 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__multipart_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.2 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__shadow_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.2_1 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__multipart_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.3 2024-09-14T11:42:46.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__shadow_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.3_1 2024-09-14T11:42:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__multipart_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.4 2024-09-14T11:42:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__shadow_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.4_1 2024-09-14T11:42:46.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.711+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.58__multipart_key1.2~LiwDV2Yt6KC_A7LDiAv3jfHU76jTi6A.5 2024-09-14T11:42:46.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.714+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.716+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:46.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.718+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.718+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.718+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.719+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:46.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.721+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.721+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.721+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.722+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:46.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.724+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.724+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.725+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.726+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:46.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.727+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.727+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.728+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.729+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:46.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.730+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.730+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11648683057170628632', time=2024-09-14T13:42:31.366665+0000, chain.objs.size()=7 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~hO-YDb0kbap5iakT1PK0TKC39VQ18Rb.1 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~hO-YDb0kbap5iakT1PK0TKC39VQ18Rb.1_1 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~hO-YDb0kbap5iakT1PK0TKC39VQ18Rb.1_2 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~hO-YDb0kbap5iakT1PK0TKC39VQ18Rb.2 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~hO-YDb0kbap5iakT1PK0TKC39VQ18Rb.2_1 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~hO-YDb0kbap5iakT1PK0TKC39VQ18Rb.2_2 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~hO-YDb0kbap5iakT1PK0TKC39VQ18Rb.3 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='2~pRAOdHCt-K_nK95SbdzH90lBHnuBU43', time=2024-09-14T13:42:36.721896+0000, chain.objs.size()=5 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.55__multipart_key1.2~pRAOdHCt-K_nK95SbdzH90lBHnuBU43.7 2024-09-14T11:42:46.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.55__shadow_key1.2~pRAOdHCt-K_nK95SbdzH90lBHnuBU43.7_1 2024-09-14T11:42:46.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.55__multipart_key1.2~pRAOdHCt-K_nK95SbdzH90lBHnuBU43.10 2024-09-14T11:42:46.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.55__shadow_key1.2~pRAOdHCt-K_nK95SbdzH90lBHnuBU43.10_1 2024-09-14T11:42:46.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.731+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.55__multipart_key1.2~pRAOdHCt-K_nK95SbdzH90lBHnuBU43.13 2024-09-14T11:42:46.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.735+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.737+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.739+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.739+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.739+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.741+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.742+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.742+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16380673543495336429', time=2024-09-14T13:42:41.058277+0000, chain.objs.size()=16 2024-09-14T11:42:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.1 2024-09-14T11:42:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.1_1 2024-09-14T11:42:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.1_2 2024-09-14T11:42:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.2 2024-09-14T11:42:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.2_1 2024-09-14T11:42:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.2_2 2024-09-14T11:42:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.3 2024-09-14T11:42:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.3_1 2024-09-14T11:42:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.3_2 2024-09-14T11:42:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.4 2024-09-14T11:42:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.4_1 2024-09-14T11:42:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.743+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.4_2 2024-09-14T11:42:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.746+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.5 2024-09-14T11:42:46.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.746+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.5_1 2024-09-14T11:42:46.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.746+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.5_2 2024-09-14T11:42:46.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.746+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~CZ5R1GPDvZ-VAboHAiDS9RQI-siOlOe.6 2024-09-14T11:42:46.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.749+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.751+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:46.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.752+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.752+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10788228640151181094', time=2024-09-14T13:42:27.973848+0000, chain.objs.size()=9 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.1 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.1_1 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.2 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.2_1 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.3 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.3_1 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.4 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__shadow_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.4_1 2024-09-14T11:42:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.753+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.45__multipart_key1.2~__FHm5-moLGjCX5-dL0m7u6JLLKR6ZI.5 2024-09-14T11:42:46.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.756+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.758+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:46.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.760+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.760+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6008199414805100729', time=2024-09-14T13:42:29.601802+0000, chain.objs.size()=9 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.1 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.1_1 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.2 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.2_1 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.3 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.3_1 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.4 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.4_1 2024-09-14T11:42:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~p3KN7A0I1MgS8JUU_50KhW5DJWr5MYp.5 2024-09-14T11:42:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17078819676549569492', time=2024-09-14T13:42:30.551691+0000, chain.objs.size()=9 2024-09-14T11:42:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.1 2024-09-14T11:42:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.1_1 2024-09-14T11:42:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.761+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.2 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.2_1 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.3 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.3_1 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.4 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.4_1 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~wnfaFdh-qgGnbF8O_8yVkeLXzoH10XP.5 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17665074537659291735', time=2024-09-14T13:42:31.507034+0000, chain.objs.size()=7 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~R5OCPgYFZnRSVlpZ09GWZQzuE2szd5f.1 2024-09-14T11:42:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.764+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~R5OCPgYFZnRSVlpZ09GWZQzuE2szd5f.1_1 2024-09-14T11:42:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.765+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~R5OCPgYFZnRSVlpZ09GWZQzuE2szd5f.1_2 2024-09-14T11:42:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.765+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~R5OCPgYFZnRSVlpZ09GWZQzuE2szd5f.2 2024-09-14T11:42:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.765+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~R5OCPgYFZnRSVlpZ09GWZQzuE2szd5f.2_1 2024-09-14T11:42:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.767+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__shadow_key1.2~R5OCPgYFZnRSVlpZ09GWZQzuE2szd5f.2_2 2024-09-14T11:42:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.767+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.48__multipart_key1.2~R5OCPgYFZnRSVlpZ09GWZQzuE2szd5f.3 2024-09-14T11:42:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.767+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5', time=2024-09-14T13:42:43.447803+0000, chain.objs.size()=92 2024-09-14T11:42:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.767+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.1 2024-09-14T11:42:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.767+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.2 2024-09-14T11:42:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.767+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.3 2024-09-14T11:42:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.768+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.4 2024-09-14T11:42:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.768+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.5 2024-09-14T11:42:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.768+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.6 2024-09-14T11:42:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.768+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.7 2024-09-14T11:42:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.768+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.8 2024-09-14T11:42:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.768+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.9 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.10 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.11 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.12 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.13 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.14 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.15 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.16 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.17 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.18 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.19 2024-09-14T11:42:46.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.770+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.20 2024-09-14T11:42:46.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.772+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.21 2024-09-14T11:42:46.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.772+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.22 2024-09-14T11:42:46.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.772+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.23 2024-09-14T11:42:46.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.772+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.24 2024-09-14T11:42:46.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.772+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.25 2024-09-14T11:42:46.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.773+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.26 2024-09-14T11:42:46.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.773+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.27 2024-09-14T11:42:46.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.773+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.28 2024-09-14T11:42:46.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.773+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.29 2024-09-14T11:42:46.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.773+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.30 2024-09-14T11:42:46.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.773+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.31 2024-09-14T11:42:46.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.773+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.32 2024-09-14T11:42:46.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.774+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.33 2024-09-14T11:42:46.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.774+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.34 2024-09-14T11:42:46.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.775+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.35 2024-09-14T11:42:46.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.775+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.36 2024-09-14T11:42:46.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.775+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.37 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.775+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.38 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.39 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.40 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.41 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.42 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.43 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.44 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.45 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.46 2024-09-14T11:42:46.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.776+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.47 2024-09-14T11:42:46.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.777+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.48 2024-09-14T11:42:46.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.777+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.49 2024-09-14T11:42:46.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.778+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.50 2024-09-14T11:42:46.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.778+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.51 2024-09-14T11:42:46.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.778+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.52 2024-09-14T11:42:46.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.778+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.53 2024-09-14T11:42:46.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.778+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.54 2024-09-14T11:42:46.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.778+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.55 2024-09-14T11:42:46.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.778+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.56 2024-09-14T11:42:46.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.779+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.57 2024-09-14T11:42:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.779+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.58 2024-09-14T11:42:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.779+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.59 2024-09-14T11:42:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.780+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.60 2024-09-14T11:42:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.780+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.61 2024-09-14T11:42:46.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.62 2024-09-14T11:42:46.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.63 2024-09-14T11:42:46.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.64 2024-09-14T11:42:46.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.65 2024-09-14T11:42:46.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.66 2024-09-14T11:42:46.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.67 2024-09-14T11:42:46.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.68 2024-09-14T11:42:46.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.69 2024-09-14T11:42:46.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.70 2024-09-14T11:42:46.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.71 2024-09-14T11:42:46.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.781+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.72 2024-09-14T11:42:46.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.782+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.73 2024-09-14T11:42:46.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.74 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.75 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.76 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.77 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.78 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.79 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.80 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.81 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.82 2024-09-14T11:42:46.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.783+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.83 2024-09-14T11:42:46.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.784+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.84 2024-09-14T11:42:46.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.785+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.85 2024-09-14T11:42:46.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.785+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.86 2024-09-14T11:42:46.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.785+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.87 2024-09-14T11:42:46.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.785+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.88 2024-09-14T11:42:46.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.785+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.89 2024-09-14T11:42:46.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.785+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.90 2024-09-14T11:42:46.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.786+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.91 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.59__multipart_key1.2~tEc9BWy07Zu5ylcq_QFTWQ2D55BX8H5.92 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1015749288777329072', time=2024-09-14T13:42:45.701603+0000, chain.objs.size()=21 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.1 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.1_1 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.2 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.2_1 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.3 2024-09-14T11:42:46.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.3_1 2024-09-14T11:42:46.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.4 2024-09-14T11:42:46.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.4_1 2024-09-14T11:42:46.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.5 2024-09-14T11:42:46.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.787+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.5_1 2024-09-14T11:42:46.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.789+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.6 2024-09-14T11:42:46.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.789+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.6_1 2024-09-14T11:42:46.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.790+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.7 2024-09-14T11:42:46.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.790+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.7_1 2024-09-14T11:42:46.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.790+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.8 2024-09-14T11:42:46.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.790+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.8_1 2024-09-14T11:42:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.791+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.9 2024-09-14T11:42:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.791+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.9_1 2024-09-14T11:42:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.791+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.10 2024-09-14T11:42:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.792+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__shadow_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.10_1 2024-09-14T11:42:46.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.792+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.67__multipart_key1.2~TqxgtFaXXlvTHUuOOeX6nv1chiMOcb1.11 2024-09-14T11:42:46.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.794+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.796+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:46.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.798+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.798+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7045388420386296973', time=2024-09-14T13:42:40.918596+0000, chain.objs.size()=16 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.1 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.1_1 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.1_2 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.2 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.2_1 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.2_2 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.3 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.3_1 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.3_2 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.4 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.4_1 2024-09-14T11:42:46.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.799+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.4_2 2024-09-14T11:42:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.802+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.5 2024-09-14T11:42:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.802+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.5_1 2024-09-14T11:42:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.802+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__shadow_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.5_2 2024-09-14T11:42:46.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.802+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.56__multipart_key1.2~L3dqOhHT7candNPdHmvgn22cwcoq6J1.6 2024-09-14T11:42:46.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.804+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.806+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.808+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.808+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='2~afKtS4aTak5L29okpsk9JBmwnCFVa7-', time=2024-09-14T13:42:25.998442+0000, chain.objs.size()=9 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__multipart_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.1 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__shadow_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.1_1 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__multipart_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.2 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__shadow_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.2_1 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__multipart_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.3 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__shadow_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.3_1 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__multipart_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.4 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__shadow_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.4_1 2024-09-14T11:42:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.809+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.41__multipart_key1.2~afKtS4aTak5L29okpsk9JBmwnCFVa7-.5 2024-09-14T11:42:46.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.812+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.814+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:46.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.815+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.816+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.816+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.817+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:46.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.819+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.819+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.819+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.820+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:46.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.822+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.822+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9441664330478000007', time=2024-09-14T13:42:36.200938+0000, chain.objs.size()=9 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.1 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.1_1 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.2 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.2_1 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.3 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.3_1 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.4 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__shadow_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.4_1 2024-09-14T11:42:46.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.823+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.54__multipart_file2.mpg.2~MGGXcmbzQKQM1KcMIPzy4_MjAld7DK8.5 2024-09-14T11:42:46.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.826+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.828+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.829+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.830+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.830+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.831+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:46.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.833+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.833+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.833+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.834+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.836+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.836+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4418268493138050800', time=2024-09-14T13:42:32.770140+0000, chain.objs.size()=9 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__multipart_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.1 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__shadow_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.1_1 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__multipart_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.2 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__shadow_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.2_1 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__multipart_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.3 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__shadow_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.3_1 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__multipart_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.4 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__shadow_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.4_1 2024-09-14T11:42:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.52__multipart_key1.2~O8urtU9J5Uyk70oBXx5vAk3Nn6BcKin.5 2024-09-14T11:42:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2116150998849179489', time=2024-09-14T13:42:35.420375+0000, chain.objs.size()=9 2024-09-14T11:42:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__multipart_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.1 2024-09-14T11:42:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__shadow_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.1_1 2024-09-14T11:42:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.837+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__multipart_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.2 2024-09-14T11:42:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.840+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__shadow_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.2_1 2024-09-14T11:42:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.840+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__multipart_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.3 2024-09-14T11:42:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.840+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__shadow_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.3_1 2024-09-14T11:42:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.840+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__multipart_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.4 2024-09-14T11:42:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.840+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__shadow_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.4_1 2024-09-14T11:42:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.840+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.53__multipart_key1.2~EjTJmKg0bo0uYm2tlHgB5t8ueL5dH_x.5 2024-09-14T11:42:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.843+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.845+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.846+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.846+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.847+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.848+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.849+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.849+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.850+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.850+0000 7ff9aa12e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16614530389970099425', time=2024-09-14T13:42:27.079224+0000, chain.objs.size()=9 2024-09-14T11:42:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__multipart_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.1 2024-09-14T11:42:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__shadow_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.1_1 2024-09-14T11:42:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__multipart_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.2 2024-09-14T11:42:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__shadow_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.2_1 2024-09-14T11:42:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__multipart_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.3 2024-09-14T11:42:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__shadow_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.3_1 2024-09-14T11:42:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.852+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__multipart_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.4 2024-09-14T11:42:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.853+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__shadow_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.4_1 2024-09-14T11:42:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.853+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.43__multipart_key1.2~bfZ7jsXf9XlghsBhhOzhnNOH95fd52s.5 2024-09-14T11:42:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.856+0000 7ff9aa12e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.860+0000 7ff8577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.862+0000 7ff9aa12e800 20 remove_watcher() i=0 2024-09-14T11:42:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.862+0000 7ff9aa12e800 2 removed watcher, disabling cache 2024-09-14T11:42:46.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.863+0000 7ff9aa12e800 20 remove_watcher() i=1 2024-09-14T11:42:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.864+0000 7ff9aa12e800 20 remove_watcher() i=2 2024-09-14T11:42:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.865+0000 7ff9aa12e800 20 remove_watcher() i=3 2024-09-14T11:42:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.866+0000 7ff9aa12e800 20 remove_watcher() i=4 2024-09-14T11:42:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.867+0000 7ff9aa12e800 20 remove_watcher() i=5 2024-09-14T11:42:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.868+0000 7ff9aa12e800 20 remove_watcher() i=6 2024-09-14T11:42:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.869+0000 7ff9aa12e800 20 remove_watcher() i=7 2024-09-14T11:42:46.878 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:46.930 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.973+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 20 realm 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:46.975+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.179+0000 7f0704d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.179+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.180+0000 7f0704d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.180+0000 7f0704d28800 20 searching for the correct realm 2024-09-14T11:42:47.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.181+0000 7f070024a640 0 -- 172.21.15.7:0/3427576760 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f06f006b020 msgr2=0x7f06f00a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.387+0000 7f070124c640 0 -- 172.21.15.7:0/3427576760 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f06f4046430 msgr2=0x7f06f4046850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.393+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 20 zone default found 2024-09-14T11:42:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 4 Realm: () 2024-09-14T11:42:47.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 20 zonegroup default 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.394+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.395+0000 7f0704d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.395+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.395+0000 7f0704d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.395+0000 7f0704d28800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.395+0000 7f0704d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.395+0000 7f0704d28800 20 started sync module instance, tier type = 2024-09-14T11:42:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.395+0000 7f0704d28800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.405+0000 7f0704d28800 20 add_watcher() i=0 2024-09-14T11:42:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.405+0000 7f0704d28800 20 add_watcher() i=1 2024-09-14T11:42:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.405+0000 7f0704d28800 20 add_watcher() i=2 2024-09-14T11:42:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.405+0000 7f0704d28800 20 add_watcher() i=3 2024-09-14T11:42:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.405+0000 7f0704d28800 20 add_watcher() i=4 2024-09-14T11:42:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.405+0000 7f0704d28800 20 add_watcher() i=5 2024-09-14T11:42:47.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.405+0000 7f0704d28800 20 add_watcher() i=6 2024-09-14T11:42:47.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.406+0000 7f0704d28800 20 add_watcher() i=7 2024-09-14T11:42:47.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.406+0000 7f0704d28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.407+0000 7f05b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.408+0000 7f0704d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.408+0000 7f0704d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.443+0000 7f05b5fe3640 20 reqs_thread_entry: start 2024-09-14T11:42:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.443+0000 7f0704d28800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.443+0000 7f0704d28800 20 Filter name: none 2024-09-14T11:42:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.443+0000 7f05277fe640 20 reqs_thread_entry: start 2024-09-14T11:42:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.444+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:47.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.445+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.445+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.446+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.447+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:47.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.448+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.449+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.449+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.450+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:47.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.451+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.452+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.452+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.453+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:47.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.454+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.455+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.455+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.456+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.457+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.458+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.458+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.459+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:47.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.460+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.461+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.461+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.463+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:47.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.464+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.465+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.465+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.466+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:47.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.468+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.468+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.469+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.470+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.471+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.471+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.472+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.473+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.474+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.475+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.475+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.476+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.477+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.478+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.478+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.479+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.480+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.481+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.481+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.482+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.483+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.484+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.484+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.485+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.486+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.486+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.487+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.488+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.489+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.490+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.490+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.491+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.492+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.493+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.493+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.494+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.496+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.496+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.496+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.497+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:47.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.499+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.499+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.500+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.501+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.502+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.503+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.503+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.505+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:47.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.506+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.507+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.507+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.508+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:47.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.509+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.509+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.510+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.511+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:47.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.512+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.512+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.513+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.514+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.515+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.516+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.516+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.518+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.519+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.519+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.519+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.520+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:47.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.522+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.522+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.522+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.524+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:47.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.525+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.526+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.526+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.527+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:47.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.529+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.529+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.530+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.531+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.532+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.533+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.533+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.534+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.535+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.536+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.536+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.537+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.538+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.539+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.539+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.540+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.541+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.542+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.542+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.543+0000 7f0704d28800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.544+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.545+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.545+0000 7f0704d28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.547+0000 7f05b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.549+0000 7f0704d28800 20 remove_watcher() i=0 2024-09-14T11:42:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.549+0000 7f0704d28800 2 removed watcher, disabling cache 2024-09-14T11:42:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.550+0000 7f0704d28800 20 remove_watcher() i=1 2024-09-14T11:42:47.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.551+0000 7f0704d28800 20 remove_watcher() i=2 2024-09-14T11:42:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.552+0000 7f0704d28800 20 remove_watcher() i=3 2024-09-14T11:42:47.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.553+0000 7f0704d28800 20 remove_watcher() i=4 2024-09-14T11:42:47.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.554+0000 7f0704d28800 20 remove_watcher() i=5 2024-09-14T11:42:47.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.555+0000 7f0704d28800 20 remove_watcher() i=6 2024-09-14T11:42:47.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.556+0000 7f0704d28800 20 remove_watcher() i=7 2024-09-14T11:42:47.565 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:47.618 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:47.618 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.660+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 20 realm 2024-09-14T11:42:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:47.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.662+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.663+0000 7f67c4a2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:47.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.663+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:47.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.664+0000 7f67c4a2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:47.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.664+0000 7f67c4a2d800 20 searching for the correct realm 2024-09-14T11:42:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.666+0000 7f67c2d18640 0 -- 172.21.15.7:0/3880951340 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f67ac07fc20 msgr2=0x7f67ac068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:47.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:47.872+0000 7f67b9d16640 0 -- 172.21.15.7:0/3880951340 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f67b404d880 msgr2=0x7f67b40569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.080+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 zone default found 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 4 Realm: () 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 zonegroup default 2024-09-14T11:42:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.081+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.082+0000 7f67c4a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.082+0000 7f67c4a2d800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.083+0000 7f67c4a2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.083+0000 7f67c4a2d800 20 started sync module instance, tier type = 2024-09-14T11:42:48.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.083+0000 7f67c4a2d800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.092+0000 7f67c4a2d800 20 add_watcher() i=0 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.092+0000 7f67c4a2d800 20 add_watcher() i=1 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.092+0000 7f67c4a2d800 20 add_watcher() i=2 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.092+0000 7f67c4a2d800 20 add_watcher() i=3 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.092+0000 7f67c4a2d800 20 add_watcher() i=4 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.092+0000 7f67c4a2d800 20 add_watcher() i=5 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.092+0000 7f67c4a2d800 20 add_watcher() i=6 2024-09-14T11:42:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.093+0000 7f67c4a2d800 20 add_watcher() i=7 2024-09-14T11:42:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.093+0000 7f67c4a2d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:48.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.095+0000 7f6678fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:48.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.096+0000 7f67c4a2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:48.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.096+0000 7f67c4a2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.133+0000 7f65f37fe640 20 reqs_thread_entry: start 2024-09-14T11:42:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.133+0000 7f67c4a2d800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:48.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.134+0000 7f67c4a2d800 20 Filter name: none 2024-09-14T11:42:48.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.134+0000 7f65f17fa640 20 reqs_thread_entry: start 2024-09-14T11:42:48.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.134+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.135+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.136+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.136+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.137+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:48.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.138+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.139+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.139+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.140+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:48.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.141+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.142+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.142+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.143+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:48.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.145+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.145+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.145+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.147+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:48.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.148+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.148+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.148+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.149+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:48.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.151+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.151+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.152+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.153+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:48.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.154+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.154+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.155+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.156+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:48.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.157+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.157+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.158+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.159+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:48.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.160+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.161+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.161+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.162+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:48.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.163+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.163+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.164+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.165+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:48.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.166+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.167+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.167+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.168+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:48.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.169+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.170+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.170+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.171+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:48.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.172+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.173+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.173+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.174+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:48.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.176+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.176+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.176+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.177+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:48.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.179+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.179+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.179+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.181+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.183+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.183+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.184+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.185+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:48.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.186+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.186+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.187+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.188+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:48.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.189+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.189+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.189+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.190+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:48.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.192+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.192+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.192+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.193+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.195+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.196+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.196+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.197+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.199+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.200+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.200+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.201+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:48.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.203+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.204+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.204+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.205+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:48.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.207+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.207+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.207+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.208+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:48.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.210+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.211+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.211+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.212+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:48.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.214+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.214+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.215+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.216+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:48.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.217+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.218+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.218+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.219+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:48.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.220+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.221+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.221+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.222+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:48.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.223+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.224+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.224+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.225+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:48.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.226+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.227+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.227+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.228+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:48.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.229+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.230+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.230+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.231+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:48.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.232+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.233+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.233+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.234+0000 7f67c4a2d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:48.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.235+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.236+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.236+0000 7f67c4a2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.238+0000 7f6678fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.240+0000 7f67c4a2d800 20 remove_watcher() i=0 2024-09-14T11:42:48.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.240+0000 7f67c4a2d800 2 removed watcher, disabling cache 2024-09-14T11:42:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.241+0000 7f67c4a2d800 20 remove_watcher() i=1 2024-09-14T11:42:48.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.242+0000 7f67c4a2d800 20 remove_watcher() i=2 2024-09-14T11:42:48.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.243+0000 7f67c4a2d800 20 remove_watcher() i=3 2024-09-14T11:42:48.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.244+0000 7f67c4a2d800 20 remove_watcher() i=4 2024-09-14T11:42:48.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.245+0000 7f67c4a2d800 20 remove_watcher() i=5 2024-09-14T11:42:48.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.246+0000 7f67c4a2d800 20 remove_watcher() i=6 2024-09-14T11:42:48.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.247+0000 7f67c4a2d800 20 remove_watcher() i=7 2024-09-14T11:42:48.256 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:48.309 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:48.309 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:48.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.353+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 20 realm 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.354+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.355+0000 7fb615b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:48.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.355+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.356+0000 7fb615b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:48.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.356+0000 7fb615b23800 20 searching for the correct realm 2024-09-14T11:42:48.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.356+0000 7fb61180c640 0 -- 172.21.15.7:0/4263643390 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55aa6c3e52e0 msgr2=0x55aa6c3e77a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:48.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.561+0000 7fb61180c640 0 -- 172.21.15.7:0/4263643390 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55aa6c3e52e0 msgr2=0x55aa6c3e77a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:48.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.569+0000 7fb615b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:48.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 zone default found 2024-09-14T11:42:48.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 4 Realm: () 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 zonegroup default 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 started sync module instance, tier type = 2024-09-14T11:42:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.570+0000 7fb615b23800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:48.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.579+0000 7fb615b23800 20 add_watcher() i=0 2024-09-14T11:42:48.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.579+0000 7fb615b23800 20 add_watcher() i=1 2024-09-14T11:42:48.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.579+0000 7fb615b23800 20 add_watcher() i=2 2024-09-14T11:42:48.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.579+0000 7fb615b23800 20 add_watcher() i=3 2024-09-14T11:42:48.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.579+0000 7fb615b23800 20 add_watcher() i=4 2024-09-14T11:42:48.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.579+0000 7fb615b23800 20 add_watcher() i=5 2024-09-14T11:42:48.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.579+0000 7fb615b23800 20 add_watcher() i=6 2024-09-14T11:42:48.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.580+0000 7fb615b23800 20 add_watcher() i=7 2024-09-14T11:42:48.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.580+0000 7fb615b23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:48.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.582+0000 7fb4c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:48.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.582+0000 7fb615b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:48.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.582+0000 7fb615b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:48.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.617+0000 7fb4c27fc640 20 reqs_thread_entry: start 2024-09-14T11:42:48.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.617+0000 7fb615b23800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:48.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.617+0000 7fb615b23800 20 Filter name: none 2024-09-14T11:42:48.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.617+0000 7fb433fff640 20 reqs_thread_entry: start 2024-09-14T11:42:48.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.617+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:48.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.619+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.619+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.619+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.620+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.622+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.622+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.622+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.624+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:48.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.625+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.625+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.626+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.627+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:48.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.628+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.628+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.629+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.630+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:48.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.631+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.631+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.632+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.633+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:48.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.634+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.634+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.635+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.636+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:48.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.637+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.637+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.637+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.638+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.640+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.640+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.640+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.642+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.643+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.643+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.643+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.644+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:48.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.646+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.646+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.646+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.647+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:48.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.648+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.649+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.649+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.650+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:48.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.651+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.652+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.652+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.653+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.655+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.655+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.656+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.656+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:48.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.658+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.658+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.658+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.659+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:48.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.661+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.661+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.662+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.663+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.664+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.664+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.665+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.666+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.667+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.668+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.668+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.669+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.670+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.671+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.671+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.672+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.674+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.674+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.675+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.676+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.677+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.677+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.677+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.678+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:48.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.680+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.680+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.681+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.682+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:48.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.683+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.684+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.684+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.685+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:48.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.686+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.687+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.687+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.688+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.689+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.690+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.690+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.691+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.692+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.693+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.693+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.694+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.696+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.696+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.697+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.697+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.699+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.699+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.700+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.700+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.702+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.702+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.703+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.704+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.705+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.705+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.706+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.707+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:48.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.708+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.708+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.709+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.710+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:48.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.711+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.711+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.712+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.713+0000 7fb615b23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:48.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.714+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.714+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:48.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.715+0000 7fb615b23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:48.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.716+0000 7fb4c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:48.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.719+0000 7fb615b23800 20 remove_watcher() i=0 2024-09-14T11:42:48.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.719+0000 7fb615b23800 2 removed watcher, disabling cache 2024-09-14T11:42:48.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.720+0000 7fb615b23800 20 remove_watcher() i=1 2024-09-14T11:42:48.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.720+0000 7fb615b23800 20 remove_watcher() i=2 2024-09-14T11:42:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.721+0000 7fb615b23800 20 remove_watcher() i=3 2024-09-14T11:42:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.722+0000 7fb615b23800 20 remove_watcher() i=4 2024-09-14T11:42:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.723+0000 7fb615b23800 20 remove_watcher() i=5 2024-09-14T11:42:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.724+0000 7fb615b23800 20 remove_watcher() i=6 2024-09-14T11:42:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:48.725+0000 7fb615b23800 20 remove_watcher() i=7 2024-09-14T11:42:48.734 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:42:49.255 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :clean 2024-09-14T11:42:50.051 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :compileJava 2024-09-14T11:42:50.051 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :processResources 2024-09-14T11:42:50.051 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :classes 2024-09-14T11:42:50.650 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :compileTestJava 2024-09-14T11:42:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:42:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:42:50.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:42:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :testClasses 2024-09-14T11:42:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.652 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :test 2024-09-14T11:42:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.652 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:42:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14 11:42:51,873 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:42:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.653 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:42:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.851 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:42:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.851 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:42:52.950 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:52.950 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:42:53.050 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:53.050 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:42:53.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:53.250 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:42:53.350 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:53.350 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:42:53.350 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:53.350 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:42:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:53.450 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:42:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:53.850 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:42:53.850 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:53.850 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:42:54.050 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:54.050 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:42:54.150 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:54.150 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------- 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------- 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:54.192 INFO:teuthology.orchestra.run.smithi007.stdout:BUILD SUCCESSFUL in 5s 2024-09-14T11:42:54.193 INFO:teuthology.orchestra.run.smithi007.stdout:5 actionable tasks: 5 executed 2024-09-14T11:42:54.198 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:54.252 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:54.252 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:54.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.296+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.298+0000 7fc20dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.298+0000 7fc20dd23800 20 realm 2024-09-14T11:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.298+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.298+0000 7fc20dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.298+0000 7fc20dd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.298+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.299+0000 7fc20dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.299+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.299+0000 7fc20dd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.300+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.300+0000 7fc20dd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:54.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.300+0000 7fc20dd23800 20 searching for the correct realm 2024-09-14T11:42:54.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.302+0000 7fc20a20d640 0 -- 172.21.15.7:0/2691108332 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc20003c070 msgr2=0x7fc20004a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:54.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.508+0000 7fc20920b640 0 -- 172.21.15.7:0/2691108332 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc1fc0a72b0 msgr2=0x7fc1fc0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.715+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 20 zone default found 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 4 Realm: () 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 20 zonegroup default 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.716+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.717+0000 7fc20dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.717+0000 7fc20dd23800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.717+0000 7fc20dd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.717+0000 7fc20dd23800 20 started sync module instance, tier type = 2024-09-14T11:42:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.717+0000 7fc20dd23800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.727+0000 7fc20dd23800 20 add_watcher() i=0 2024-09-14T11:42:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.727+0000 7fc20dd23800 20 add_watcher() i=1 2024-09-14T11:42:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.727+0000 7fc20dd23800 20 add_watcher() i=2 2024-09-14T11:42:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.727+0000 7fc20dd23800 20 add_watcher() i=3 2024-09-14T11:42:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.727+0000 7fc20dd23800 20 add_watcher() i=4 2024-09-14T11:42:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.727+0000 7fc20dd23800 20 add_watcher() i=5 2024-09-14T11:42:54.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.727+0000 7fc20dd23800 20 add_watcher() i=6 2024-09-14T11:42:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.728+0000 7fc20dd23800 20 add_watcher() i=7 2024-09-14T11:42:54.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.728+0000 7fc20dd23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.730+0000 7fc0bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.731+0000 7fc20dd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:54.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.731+0000 7fc20dd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.771+0000 7fc0baffd640 20 reqs_thread_entry: start 2024-09-14T11:42:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.771+0000 7fc20dd23800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.771+0000 7fc20dd23800 20 Filter name: none 2024-09-14T11:42:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.771+0000 7fc0b8ff9640 20 reqs_thread_entry: start 2024-09-14T11:42:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.771+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:54.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.773+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.774+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.774+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.775+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:54.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.777+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.777+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.778+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.779+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:54.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.780+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.781+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.781+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.782+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:54.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.784+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.785+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.785+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.786+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:54.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.788+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.788+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.788+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.789+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:54.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.791+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.791+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.792+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.793+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:54.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.794+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.795+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.795+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.796+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:54.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.798+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.798+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.798+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.800+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:54.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.801+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.802+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.802+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.803+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.804+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.805+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.805+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.807+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:54.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.808+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.809+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.809+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.810+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:54.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.811+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.812+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.812+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.814+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:54.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.815+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.816+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.816+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.817+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:54.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.819+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.819+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.820+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.821+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:54.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.822+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.822+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.823+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.824+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:54.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.825+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.826+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.826+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.827+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.829+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.829+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.829+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.830+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.832+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.832+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.832+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.833+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:54.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.835+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.835+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.836+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.837+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.838+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.839+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.839+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.841+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:54.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.842+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.843+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.843+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.844+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:54.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.846+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.846+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.847+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.848+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.850+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.850+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.851+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.852+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:54.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.853+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.854+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.854+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.855+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:54.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.856+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.857+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.857+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.858+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.859+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.860+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.860+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.861+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.862+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.863+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.863+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.864+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.865+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.866+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.866+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.867+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.868+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.869+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.869+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.870+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.872+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.873+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.873+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.874+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:54.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.875+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.876+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.876+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.877+0000 7fc20dd23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:54.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.879+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.879+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:54.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.880+0000 7fc20dd23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:54.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.882+0000 7fc0bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:54.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.884+0000 7fc20dd23800 20 remove_watcher() i=0 2024-09-14T11:42:54.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.884+0000 7fc20dd23800 2 removed watcher, disabling cache 2024-09-14T11:42:54.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.885+0000 7fc20dd23800 20 remove_watcher() i=1 2024-09-14T11:42:54.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.886+0000 7fc20dd23800 20 remove_watcher() i=2 2024-09-14T11:42:54.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.887+0000 7fc20dd23800 20 remove_watcher() i=3 2024-09-14T11:42:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.888+0000 7fc20dd23800 20 remove_watcher() i=4 2024-09-14T11:42:54.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.889+0000 7fc20dd23800 20 remove_watcher() i=5 2024-09-14T11:42:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.890+0000 7fc20dd23800 20 remove_watcher() i=6 2024-09-14T11:42:54.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.891+0000 7fc20dd23800 20 remove_watcher() i=7 2024-09-14T11:42:54.901 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:54.953 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:54.954 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:54.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.995+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 20 realm 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.997+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.998+0000 7f65638bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.998+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.999+0000 7f65638bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:54.999+0000 7f65638bb800 20 searching for the correct realm 2024-09-14T11:42:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.001+0000 7f6561ba6640 0 -- 172.21.15.7:0/2431236943 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f6558049030 msgr2=0x7f6558049410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:55.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.207+0000 7f6560ba4640 0 -- 172.21.15.7:0/2431236943 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f65540a7440 msgr2=0x7f65540e7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.414+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 zone default found 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 4 Realm: () 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 zonegroup default 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.415+0000 7f65638bb800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.416+0000 7f65638bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.416+0000 7f65638bb800 20 started sync module instance, tier type = 2024-09-14T11:42:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.416+0000 7f65638bb800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.425+0000 7f65638bb800 20 add_watcher() i=0 2024-09-14T11:42:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.425+0000 7f65638bb800 20 add_watcher() i=1 2024-09-14T11:42:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.425+0000 7f65638bb800 20 add_watcher() i=2 2024-09-14T11:42:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.425+0000 7f65638bb800 20 add_watcher() i=3 2024-09-14T11:42:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.425+0000 7f65638bb800 20 add_watcher() i=4 2024-09-14T11:42:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.425+0000 7f65638bb800 20 add_watcher() i=5 2024-09-14T11:42:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.425+0000 7f65638bb800 20 add_watcher() i=6 2024-09-14T11:42:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.426+0000 7f65638bb800 20 add_watcher() i=7 2024-09-14T11:42:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.426+0000 7f65638bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:55.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.429+0000 7f64177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:55.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.429+0000 7f65638bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:55.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.429+0000 7f65638bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.469+0000 7f64167e4640 20 reqs_thread_entry: start 2024-09-14T11:42:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.469+0000 7f65638bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.469+0000 7f65638bb800 20 Filter name: none 2024-09-14T11:42:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.469+0000 7f6387fff640 20 reqs_thread_entry: start 2024-09-14T11:42:55.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.469+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.470+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.471+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.471+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.472+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.473+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.474+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.474+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.475+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.477+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.477+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.478+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.479+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.480+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.480+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.481+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.481+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.483+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.484+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.484+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.485+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.487+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.487+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.487+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.489+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:55.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.491+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.491+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.492+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.493+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:55.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.494+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.494+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.495+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.496+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.497+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.497+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.498+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.499+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:55.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.500+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.501+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.501+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.502+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:55.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.504+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.504+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.504+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.505+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:55.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.507+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.507+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.507+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.508+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:55.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.510+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.510+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.511+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.512+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:55.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.513+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.513+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.514+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.515+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.516+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.517+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.517+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.518+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.519+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.520+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.520+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.521+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.522+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.523+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.523+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.524+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.526+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.526+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.526+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.527+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:55.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.529+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.529+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.530+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.531+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.532+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.533+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.533+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.534+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.535+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.536+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.536+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.537+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:55.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.539+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.539+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.539+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.540+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.542+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.542+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.542+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.543+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:55.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.545+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.545+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.546+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.547+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.548+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.548+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.548+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.549+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:55.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.551+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.552+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.552+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.553+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.554+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.554+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.555+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.556+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.557+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.557+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.557+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.558+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:55.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.560+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.560+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.560+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.561+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.563+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.563+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.564+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.565+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:55.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.567+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.567+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.568+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.568+0000 7f65638bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.570+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.570+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.571+0000 7f65638bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.573+0000 7f64177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:55.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.575+0000 7f65638bb800 20 remove_watcher() i=0 2024-09-14T11:42:55.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.575+0000 7f65638bb800 2 removed watcher, disabling cache 2024-09-14T11:42:55.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.576+0000 7f65638bb800 20 remove_watcher() i=1 2024-09-14T11:42:55.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.576+0000 7f65638bb800 20 remove_watcher() i=2 2024-09-14T11:42:55.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.577+0000 7f65638bb800 20 remove_watcher() i=3 2024-09-14T11:42:55.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.578+0000 7f65638bb800 20 remove_watcher() i=4 2024-09-14T11:42:55.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.579+0000 7f65638bb800 20 remove_watcher() i=5 2024-09-14T11:42:55.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.580+0000 7f65638bb800 20 remove_watcher() i=6 2024-09-14T11:42:55.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.581+0000 7f65638bb800 20 remove_watcher() i=7 2024-09-14T11:42:55.590 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:55.643 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:55.643 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:55.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.686+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 20 realm 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.687+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.688+0000 7ff3c9325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:55.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.688+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.689+0000 7ff3c9325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:55.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.689+0000 7ff3c9325800 20 searching for the correct realm 2024-09-14T11:42:55.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.690+0000 7ff3c48a1640 0 -- 172.21.15.7:0/1490699926 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7ff3b803c040 msgr2=0x7ff3b803e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:55.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.895+0000 7ff3c58a3640 0 -- 172.21.15.7:0/1490699926 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ff3bc018070 msgr2=0x7ff3bc0023d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.902+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 zone default found 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 4 Realm: () 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 zonegroup default 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 rados->read ofs=0 len=0 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 started sync module instance, tier type = 2024-09-14T11:42:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.903+0000 7ff3c9325800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=0 2024-09-14T11:42:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=1 2024-09-14T11:42:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=2 2024-09-14T11:42:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=3 2024-09-14T11:42:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=4 2024-09-14T11:42:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=5 2024-09-14T11:42:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=6 2024-09-14T11:42:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.913+0000 7ff3c9325800 20 add_watcher() i=7 2024-09-14T11:42:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.914+0000 7ff3c9325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:55.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.915+0000 7ff27bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:55.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.915+0000 7ff3c9325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:55.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.915+0000 7ff3c9325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:55.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.951+0000 7ff27afe5640 20 reqs_thread_entry: start 2024-09-14T11:42:55.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.951+0000 7ff3c9325800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:55.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.951+0000 7ff3c9325800 20 Filter name: none 2024-09-14T11:42:55.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.951+0000 7ff278fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:55.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.951+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:55.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.953+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.953+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.953+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.954+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:55.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.956+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.956+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.956+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.957+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:55.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.959+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.960+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.960+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.961+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.962+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.963+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.963+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.964+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:55.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.965+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.966+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.966+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.967+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:55.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.969+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.969+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.969+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.970+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:55.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.972+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.972+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.973+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.974+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.975+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.976+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.976+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.977+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:55.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.978+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.978+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.979+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.980+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:55.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.981+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.982+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.982+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.984+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:55.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.985+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.985+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.986+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.986+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:55.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.988+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.988+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.989+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.990+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:55.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.991+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.991+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.992+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.993+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:55.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.994+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.994+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.995+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.996+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:55.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.997+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.997+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.998+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:55.999+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:55.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.000+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.000+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:55.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.000+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:55.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.001+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:56.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.003+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.003+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.003+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.005+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:56.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.006+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.006+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.007+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.008+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:56.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.010+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.010+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.010+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.011+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:56.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.013+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.013+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.014+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.016+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:56.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.017+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.017+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.018+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.019+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:56.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.020+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.020+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.021+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.022+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:56.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.023+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.023+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.023+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.024+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:56.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.026+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.026+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.026+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.027+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:56.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.029+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.029+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.030+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.031+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:56.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.032+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.032+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.032+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.033+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:56.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.035+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.035+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.035+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.037+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.038+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.038+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.039+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.039+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:56.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.041+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.041+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.041+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.042+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:56.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.044+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.044+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.044+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.046+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:56.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.047+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.047+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.048+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.049+0000 7ff3c9325800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:56.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.050+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.050+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.051+0000 7ff3c9325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.052+0000 7ff27bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:56.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.055+0000 7ff3c9325800 20 remove_watcher() i=0 2024-09-14T11:42:56.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.055+0000 7ff3c9325800 2 removed watcher, disabling cache 2024-09-14T11:42:56.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.056+0000 7ff3c9325800 20 remove_watcher() i=1 2024-09-14T11:42:56.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.057+0000 7ff3c9325800 20 remove_watcher() i=2 2024-09-14T11:42:56.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.058+0000 7ff3c9325800 20 remove_watcher() i=3 2024-09-14T11:42:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.059+0000 7ff3c9325800 20 remove_watcher() i=4 2024-09-14T11:42:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.060+0000 7ff3c9325800 20 remove_watcher() i=5 2024-09-14T11:42:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.061+0000 7ff3c9325800 20 remove_watcher() i=6 2024-09-14T11:42:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.062+0000 7ff3c9325800 20 remove_watcher() i=7 2024-09-14T11:42:56.071 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:42:56.125 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:56.125 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:56.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.168+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.169+0000 7f0ef3125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:56.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.169+0000 7f0ef3125800 20 realm 2024-09-14T11:42:56.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.169+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.170+0000 7f0ef3125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:56.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.170+0000 7f0ef3125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:56.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.170+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.170+0000 7f0ef3125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:56.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.170+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.171+0000 7f0ef3125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:56.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.171+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.171+0000 7f0ef3125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:56.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.171+0000 7f0ef3125800 20 searching for the correct realm 2024-09-14T11:42:56.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.172+0000 7f0ee7fff640 0 -- 172.21.15.7:0/3643903829 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f0ee00695c0 msgr2=0x7f0ee0068030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.378+0000 7f0eef534640 0 -- 172.21.15.7:0/3643903829 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0ed8084070 msgr2=0x7f0ed8069ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.385+0000 7f0ef3125800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:42:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.385+0000 7f0ef3125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:56.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.385+0000 7f0ef3125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.385+0000 7f0ef3125800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.385+0000 7f0ef3125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.385+0000 7f0ef3125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.385+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:56.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 zone default found 2024-09-14T11:42:56.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 4 Realm: () 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 zonegroup default 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.386+0000 7f0ef3125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.387+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.387+0000 7f0ef3125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.387+0000 7f0ef3125800 20 rados->read ofs=0 len=0 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.387+0000 7f0ef3125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.387+0000 7f0ef3125800 20 started sync module instance, tier type = 2024-09-14T11:42:56.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.387+0000 7f0ef3125800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.396+0000 7f0ef3125800 20 add_watcher() i=0 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.396+0000 7f0ef3125800 20 add_watcher() i=1 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.396+0000 7f0ef3125800 20 add_watcher() i=2 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.396+0000 7f0ef3125800 20 add_watcher() i=3 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.396+0000 7f0ef3125800 20 add_watcher() i=4 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.396+0000 7f0ef3125800 20 add_watcher() i=5 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.396+0000 7f0ef3125800 20 add_watcher() i=6 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.397+0000 7f0ef3125800 20 add_watcher() i=7 2024-09-14T11:42:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.397+0000 7f0ef3125800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:56.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.398+0000 7f0da57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:56.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.399+0000 7f0ef3125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:56.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.399+0000 7f0ef3125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:56.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.433+0000 7f0d1ffff640 20 reqs_thread_entry: start 2024-09-14T11:42:56.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.433+0000 7f0ef3125800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:56.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.433+0000 7f0ef3125800 20 Filter name: none 2024-09-14T11:42:56.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.433+0000 7f0d1dffb640 20 reqs_thread_entry: start 2024-09-14T11:42:56.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.433+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:56.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.434+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.435+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.435+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.436+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:56.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.437+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.438+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.438+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.439+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.441+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.441+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.441+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.442+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:56.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.443+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.444+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.444+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.446+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:56.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.447+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.447+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.448+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.449+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:56.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.450+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.450+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.451+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.451+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:56.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.453+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.453+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.453+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.454+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:56.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.456+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.456+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.456+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.457+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.459+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.459+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.459+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.461+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:56.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.462+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.462+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.462+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.463+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:56.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.465+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.465+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.466+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.467+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:56.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.468+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.468+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.469+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.470+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:56.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.471+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.471+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.472+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.473+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:56.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.474+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.474+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.474+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.476+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:56.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.477+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.477+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.478+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.479+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.480+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.481+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.481+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.482+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.484+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.484+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.484+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.485+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:56.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.487+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.487+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.488+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.489+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:56.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.490+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.490+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.491+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.492+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:56.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.493+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.494+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.494+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.495+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:56.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.496+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.497+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.497+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.498+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.500+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.500+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.500+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.501+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:56.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.503+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.503+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.504+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.505+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:56.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.506+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.507+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.507+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.509+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:56.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.510+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.511+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.511+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.512+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:56.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.513+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.514+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.514+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.515+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:56.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.516+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.517+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.517+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.518+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:56.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.519+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.519+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.520+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.521+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:56.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.522+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.523+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.523+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.524+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:56.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.525+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.525+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.526+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.526+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:56.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.528+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.528+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.528+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.529+0000 7f0ef3125800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.530+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.531+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:56.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.531+0000 7f0ef3125800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:56.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.533+0000 7f0da57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:56.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.535+0000 7f0ef3125800 20 remove_watcher() i=0 2024-09-14T11:42:56.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.535+0000 7f0ef3125800 2 removed watcher, disabling cache 2024-09-14T11:42:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.536+0000 7f0ef3125800 20 remove_watcher() i=1 2024-09-14T11:42:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.537+0000 7f0ef3125800 20 remove_watcher() i=2 2024-09-14T11:42:56.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.538+0000 7f0ef3125800 20 remove_watcher() i=3 2024-09-14T11:42:56.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.539+0000 7f0ef3125800 20 remove_watcher() i=4 2024-09-14T11:42:56.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.540+0000 7f0ef3125800 20 remove_watcher() i=5 2024-09-14T11:42:56.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.541+0000 7f0ef3125800 20 remove_watcher() i=6 2024-09-14T11:42:56.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:42:56.542+0000 7f0ef3125800 20 remove_watcher() i=7 2024-09-14T11:42:56.551 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:42:57.068 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :clean 2024-09-14T11:42:57.764 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :compileJava 2024-09-14T11:42:57.764 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :processResources 2024-09-14T11:42:57.764 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :classes 2024-09-14T11:42:58.164 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:58.164 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :compileTestJava 2024-09-14T11:42:58.164 INFO:teuthology.orchestra.run.smithi007.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:42:58.165 INFO:teuthology.orchestra.run.smithi007.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:42:58.165 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:42:58.166 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:42:58.166 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :testClasses 2024-09-14T11:43:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.166 INFO:teuthology.orchestra.run.smithi007.stdout:> Task :test 2024-09-14T11:43:00.166 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14 11:42:59,453 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.167 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:43:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.464 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:43:00.464 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.464 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:43:00.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:00.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:43:01.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:01.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:43:01.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:01.464 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:43:01.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:01.564 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:43:01.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:01.764 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:43:01.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:01.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:43:02.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.064 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:43:02.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.064 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:43:02.164 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.164 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:43:02.164 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.164 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:43:02.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.364 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:43:02.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:43:02.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:43:02.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:02.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:43:03.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:43:03.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:43:03.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:43:03.364 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.364 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:43:03.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.664 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:43:03.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.664 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:43:03.864 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.864 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:43:03.964 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:03.964 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:43:04.164 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:04.164 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:43:04.164 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:04.164 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:43:04.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:04.364 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:43:04.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:43:04.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:04.664 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:43:05.264 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:05.264 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:43:05.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:05.564 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:43:09.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:09.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:43:09.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:09.664 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:43:09.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:09.664 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:43:09.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:09.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:43:09.864 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:09.864 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:43:10.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:10.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:43:10.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:43:10.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:10.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:43:10.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:10.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:43:10.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:10.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:43:11.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:11.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:43:11.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:11.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:43:12.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:12.364 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:43:12.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:12.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:43:13.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:43:13.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:13.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:43:16.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:16.464 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:43:16.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:16.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:43:17.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:17.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:43:17.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:17.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:43:18.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:18.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:43:18.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:18.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:43:18.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:18.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:43:19.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:19.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:43:19.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:19.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:43:19.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:19.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:43:19.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:19.564 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:43:19.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:19.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:43:19.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:19.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:43:20.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:43:20.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:43:20.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:43:20.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:43:20.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:43:20.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:43:20.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:43:20.864 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:20.864 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:43:21.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:43:21.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:43:21.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:43:21.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:43:21.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:43:21.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:43:21.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:43:21.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:21.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:43:22.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:22.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:43:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:22.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:43:22.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:22.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:43:22.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:22.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:43:22.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:22.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:43:22.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:22.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:43:23.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:43:23.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:43:23.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:43:23.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.664 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:43:23.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:43:23.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:23.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:43:24.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:24.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:43:24.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:24.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:43:24.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:24.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:43:24.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:24.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:43:24.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:24.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:43:24.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:24.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:43:25.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.064 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:43:25.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.064 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:43:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:43:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:43:25.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:43:25.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:43:25.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:43:25.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:25.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:43:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:26.163 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:43:26.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:26.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:43:26.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:26.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:43:26.564 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:26.564 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:43:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:26.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:43:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:26.764 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:43:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:26.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:43:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:27.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:43:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:27.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:43:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:27.363 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:43:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:27.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:43:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:27.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:43:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:27.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:43:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.064 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:43:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.264 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:43:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.264 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:43:28.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:43:28.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.663 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:43:28.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.863 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:43:28.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.864 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:43:28.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:28.963 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:43:29.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:29.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:43:29.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:29.263 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:43:29.264 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:29.264 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:43:29.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:29.463 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:43:29.563 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:29.563 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:43:29.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:29.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:43:29.863 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:29.864 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:43:30.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:30.063 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:43:30.564 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:30.564 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:43:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:30.763 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:43:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:31.064 INFO:teuthology.orchestra.run.smithi007.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:43:31.321 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout:---------------------------------------------------------------------- 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout:---------------------------------------------------------------------- 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:43:31.322 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:31.323 INFO:teuthology.orchestra.run.smithi007.stdout:BUILD SUCCESSFUL in 34s 2024-09-14T11:43:31.323 INFO:teuthology.orchestra.run.smithi007.stdout:5 actionable tasks: 5 executed 2024-09-14T11:43:31.336 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:43:31.390 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:31.390 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:31.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.435+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.437+0000 7f14b71a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.437+0000 7f14b71a7800 20 realm 2024-09-14T11:43:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.437+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.438+0000 7f14b71a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.438+0000 7f14b71a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.438+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.438+0000 7f14b71a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.438+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.439+0000 7f14b71a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.439+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.440+0000 7f14b71a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:31.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.440+0000 7f14b71a7800 20 searching for the correct realm 2024-09-14T11:43:31.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.442+0000 7f14b5492640 0 -- 172.21.15.7:0/846963180 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f14a80a70e0 msgr2=0x7f14a80b0650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.648+0000 7f14b4490640 0 -- 172.21.15.7:0/846963180 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f14a404e940 msgr2=0x7f14a4044430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:31.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.854+0000 7f14b71a7800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.854+0000 7f14b71a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.854+0000 7f14b71a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.854+0000 7f14b71a7800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.854+0000 7f14b71a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.854+0000 7f14b71a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.854+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:31.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 zone default found 2024-09-14T11:43:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 4 Realm: () 2024-09-14T11:43:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:31.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 zonegroup default 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.855+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.856+0000 7f14b71a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.856+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.856+0000 7f14b71a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.856+0000 7f14b71a7800 20 rados->read ofs=0 len=0 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.856+0000 7f14b71a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.856+0000 7f14b71a7800 20 started sync module instance, tier type = 2024-09-14T11:43:31.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.856+0000 7f14b71a7800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.865+0000 7f14b71a7800 20 add_watcher() i=0 2024-09-14T11:43:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.865+0000 7f14b71a7800 20 add_watcher() i=1 2024-09-14T11:43:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.865+0000 7f14b71a7800 20 add_watcher() i=2 2024-09-14T11:43:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.865+0000 7f14b71a7800 20 add_watcher() i=3 2024-09-14T11:43:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.865+0000 7f14b71a7800 20 add_watcher() i=4 2024-09-14T11:43:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.865+0000 7f14b71a7800 20 add_watcher() i=5 2024-09-14T11:43:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.865+0000 7f14b71a7800 20 add_watcher() i=6 2024-09-14T11:43:31.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.866+0000 7f14b71a7800 20 add_watcher() i=7 2024-09-14T11:43:31.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.866+0000 7f14b71a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:31.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.868+0000 7f136b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:31.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.869+0000 7f14b71a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:31.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.869+0000 7f14b71a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.904+0000 7f136a7e4640 20 reqs_thread_entry: start 2024-09-14T11:43:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.904+0000 7f14b71a7800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.904+0000 7f14b71a7800 20 Filter name: none 2024-09-14T11:43:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.904+0000 7f13637fe640 20 reqs_thread_entry: start 2024-09-14T11:43:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.904+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:43:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.906+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.906+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.906+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.907+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:43:31.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1001742992319442999', time=2024-09-14T13:43:17.658894+0000, chain.objs.size()=9 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__multipart_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.1 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__shadow_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.1_1 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__multipart_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.2 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__shadow_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.2_1 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__multipart_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.3 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.909+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__shadow_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.3_1 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.910+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__multipart_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.4 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.910+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__shadow_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.4_1 2024-09-14T11:43:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.910+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.104__multipart_key1.2~UzGzyAPMcKPS9EXM_jrvUt2gYqX3jKP.5 2024-09-14T11:43:31.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.913+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.915+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:43:31.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.916+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5804642165476171660', time=2024-09-14T13:43:10.630399+0000, chain.objs.size()=9 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__multipart_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.1 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__shadow_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.1_1 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__multipart_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.2 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__shadow_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.2_1 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__multipart_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.3 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__shadow_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.3_1 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__multipart_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.4 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__shadow_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.4_1 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.99__multipart_key1.2~Ax9UhdnNj0zFpKlXjUG1uXu-s2rTZ6G.5 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3418095291437344842', time=2024-09-14T13:43:11.814171+0000, chain.objs.size()=9 2024-09-14T11:43:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__multipart_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.1 2024-09-14T11:43:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__shadow_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.1_1 2024-09-14T11:43:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.917+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__multipart_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.2 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.920+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__shadow_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.2_1 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.920+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__multipart_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.3 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.920+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__shadow_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.3_1 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.920+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__multipart_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.4 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.920+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__shadow_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.4_1 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.920+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.100__multipart_key1.2~vsUfpf6p7B6XAjEe6E52S1-LjFOyQgI.5 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.921+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3155884798909833346', time=2024-09-14T13:43:18.315150+0000, chain.objs.size()=9 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.921+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__multipart_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.1 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.921+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__shadow_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.1_1 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.921+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__multipart_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.2 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.921+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__shadow_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.2_1 2024-09-14T11:43:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.921+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__multipart_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.3 2024-09-14T11:43:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.923+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__shadow_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.3_1 2024-09-14T11:43:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.923+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__multipart_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.4 2024-09-14T11:43:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.924+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__shadow_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.4_1 2024-09-14T11:43:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.924+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.105__multipart_key1.2~ZtwlZQhVuwFj2skB2LcbgLkDqz8Fj90.5 2024-09-14T11:43:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.924+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9030000942672800241', time=2024-09-14T13:43:30.584804+0000, chain.objs.size()=9 2024-09-14T11:43:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.924+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__multipart_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.1 2024-09-14T11:43:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.924+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__shadow_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.1_1 2024-09-14T11:43:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.924+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__multipart_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.2 2024-09-14T11:43:31.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.925+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__shadow_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.2_1 2024-09-14T11:43:31.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.925+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__multipart_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.3 2024-09-14T11:43:31.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.925+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__shadow_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.3_1 2024-09-14T11:43:31.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.925+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__multipart_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.4 2024-09-14T11:43:31.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.926+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__shadow_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.4_1 2024-09-14T11:43:31.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.926+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.144__multipart_key1.2~BsXNzFUJDmIegohadmyMUhphZJiaDIj.5 2024-09-14T11:43:31.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14727414895065886001', time=2024-09-14T13:43:31.145031+0000, chain.objs.size()=9 2024-09-14T11:43:31.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__multipart_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.1 2024-09-14T11:43:31.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__shadow_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.1_1 2024-09-14T11:43:31.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__multipart_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.2 2024-09-14T11:43:31.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__shadow_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.2_1 2024-09-14T11:43:31.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__multipart_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.3 2024-09-14T11:43:31.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__shadow_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.3_1 2024-09-14T11:43:31.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.927+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__multipart_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.4 2024-09-14T11:43:31.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.928+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__shadow_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.4_1 2024-09-14T11:43:31.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.928+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.145__multipart_key1/data/file.mpg.2~u-ORXNSuUGygH999o8yGqiKB_Iiucs7.5 2024-09-14T11:43:31.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.931+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:31.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.933+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:43:31.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.935+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.935+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:31.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1259232134233233344', time=2024-09-14T13:43:08.399951+0000, chain.objs.size()=9 2024-09-14T11:43:31.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.1 2024-09-14T11:43:31.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.1_1 2024-09-14T11:43:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.2 2024-09-14T11:43:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.2_1 2024-09-14T11:43:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.3 2024-09-14T11:43:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.3_1 2024-09-14T11:43:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.4 2024-09-14T11:43:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.4_1 2024-09-14T11:43:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.936+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~ou3QvKbqJEfFSMrgTq7EsuuhEOAXEIA.5 2024-09-14T11:43:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.938+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:31.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.940+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:43:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.942+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.943+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.943+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.944+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:43:31.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.945+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.945+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.946+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.946+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:43:31.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.948+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.948+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.452115110805674509', time=2024-09-14T13:43:05.316010+0000, chain.objs.size()=9 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.1 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.1_1 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.2 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.2_1 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.3 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.3_1 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.4 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.4_1 2024-09-14T11:43:31.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.5 2024-09-14T11:43:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0', time=2024-09-14T13:43:13.686143+0000, chain.objs.size()=9 2024-09-14T11:43:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__multipart_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.7 2024-09-14T11:43:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__shadow_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.7_1 2024-09-14T11:43:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.949+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__multipart_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.8 2024-09-14T11:43:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.950+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__shadow_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.8_1 2024-09-14T11:43:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__multipart_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.9 2024-09-14T11:43:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__shadow_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.9_1 2024-09-14T11:43:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__multipart_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.10 2024-09-14T11:43:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__shadow_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.10_1 2024-09-14T11:43:31.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.102__multipart_key1.2~BEoL2ijraTYf1rW6lXWDChAvxGjbeH0.11 2024-09-14T11:43:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14193869848458152294', time=2024-09-14T13:43:15.077926+0000, chain.objs.size()=9 2024-09-14T11:43:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.1 2024-09-14T11:43:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.1_1 2024-09-14T11:43:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.2 2024-09-14T11:43:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.2_1 2024-09-14T11:43:31.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.951+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.3 2024-09-14T11:43:31.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.954+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.3_1 2024-09-14T11:43:31.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.954+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.4 2024-09-14T11:43:31.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.954+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.4_1 2024-09-14T11:43:31.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.954+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~kJSoJXqi-AMRMrTpc0dhZtB4LWfBrbl.5 2024-09-14T11:43:31.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.957+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.959+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:43:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.960+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.961+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.961+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.962+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:43:31.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.963+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.964+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.964+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.965+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:43:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.966+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2484638679589114512', time=2024-09-14T13:43:12.426276+0000, chain.objs.size()=9 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.1 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.1_1 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.2 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.2_1 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.3 2024-09-14T11:43:31.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.3_1 2024-09-14T11:43:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.4 2024-09-14T11:43:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.4_1 2024-09-14T11:43:31.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.967+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file.mpg.2~O8Cp8i2DgNa4pZAneYTO_CBv6u74CHF.5 2024-09-14T11:43:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.970+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:31.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.973+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:43:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.975+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.975+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15967017011127079303', time=2024-09-14T13:43:08.001877+0000, chain.objs.size()=9 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.1 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.1_1 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.2 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.2_1 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.3 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.3_1 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.4 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.4_1 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~Xp_CxjVJBF7Eh0_jb9s3-g1gELGCEgF.5 2024-09-14T11:43:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5486847310977638153', time=2024-09-14T13:43:15.452329+0000, chain.objs.size()=9 2024-09-14T11:43:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.1 2024-09-14T11:43:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.1_1 2024-09-14T11:43:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.976+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.2 2024-09-14T11:43:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.979+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.2_1 2024-09-14T11:43:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.979+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.3 2024-09-14T11:43:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.979+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.3_1 2024-09-14T11:43:31.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.979+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.4 2024-09-14T11:43:31.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.979+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.4_1 2024-09-14T11:43:31.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.979+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~wCiJDbUiVUaOua-exucWfEip_BKMkyJ.5 2024-09-14T11:43:31.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.981+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:31.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.984+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:43:31.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.985+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3492892957707453639', time=2024-09-14T13:43:05.436817+0000, chain.objs.size()=9 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.1 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.1_1 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.2 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.2_1 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.3 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.3_1 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.4 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__shadow_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.4_1 2024-09-14T11:43:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.986+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.92__multipart_key1.2~MX3_Y-B5s8hvCWyjuVKM6stCuF7pmMi.5 2024-09-14T11:43:31.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.989+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:31.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.991+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:43:31.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.992+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:31.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.992+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:31.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:43:31.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.122421+0000, chain.objs.size()=120 2024-09-14T11:43:31.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.1 2024-09-14T11:43:31.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.2 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.3 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.4 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.5 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.6 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.7 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.8 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.9 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.10 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.11 2024-09-14T11:43:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.993+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.12 2024-09-14T11:43:31.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.13 2024-09-14T11:43:31.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.14 2024-09-14T11:43:31.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.15 2024-09-14T11:43:31.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.16 2024-09-14T11:43:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.17 2024-09-14T11:43:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.18 2024-09-14T11:43:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.19 2024-09-14T11:43:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.20 2024-09-14T11:43:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.21 2024-09-14T11:43:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.995+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.22 2024-09-14T11:43:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.996+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.23 2024-09-14T11:43:31.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.997+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.24 2024-09-14T11:43:31.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.997+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.25 2024-09-14T11:43:31.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.26 2024-09-14T11:43:31.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.27 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.28 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.29 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.30 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.31 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.32 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.33 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.34 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.998+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.35 2024-09-14T11:43:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:31.999+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.36 2024-09-14T11:43:31.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.000+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.37 2024-09-14T11:43:31.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.000+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.38 2024-09-14T11:43:31.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.001+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.39 2024-09-14T11:43:31.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.001+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.40 2024-09-14T11:43:31.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.001+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.41 2024-09-14T11:43:31.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.001+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.42 2024-09-14T11:43:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.001+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.43 2024-09-14T11:43:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.001+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.44 2024-09-14T11:43:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.001+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.45 2024-09-14T11:43:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.002+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.46 2024-09-14T11:43:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.002+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.47 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.48 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.49 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.50 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.51 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.52 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.53 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.54 2024-09-14T11:43:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.55 2024-09-14T11:43:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.56 2024-09-14T11:43:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.57 2024-09-14T11:43:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.003+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.58 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.59 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.60 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.61 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.62 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.63 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.64 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.65 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.66 2024-09-14T11:43:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.005+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.67 2024-09-14T11:43:32.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.006+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.68 2024-09-14T11:43:32.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.006+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.69 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.70 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.71 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.72 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.73 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.74 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.75 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.76 2024-09-14T11:43:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.77 2024-09-14T11:43:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.78 2024-09-14T11:43:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.79 2024-09-14T11:43:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.008+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.80 2024-09-14T11:43:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.010+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.81 2024-09-14T11:43:32.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.010+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.82 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.83 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.84 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.85 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.86 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.87 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.88 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.89 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.90 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.91 2024-09-14T11:43:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.011+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.92 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.93 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.94 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.95 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.96 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.97 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.98 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.99 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.100 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.101 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.102 2024-09-14T11:43:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.013+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.103 2024-09-14T11:43:32.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.014+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.104 2024-09-14T11:43:32.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.015+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.105 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.015+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.106 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.015+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.107 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.015+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.108 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.015+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.109 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.015+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.110 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.016+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.111 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.016+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.112 2024-09-14T11:43:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.016+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.113 2024-09-14T11:43:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.016+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.114 2024-09-14T11:43:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.016+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.115 2024-09-14T11:43:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.116 2024-09-14T11:43:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.117 2024-09-14T11:43:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.118 2024-09-14T11:43:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.119 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.120 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.140139+0000, chain.objs.size()=9 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.121 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.122 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.123 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.124 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.017+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.125 2024-09-14T11:43:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.018+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.126 2024-09-14T11:43:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.127 2024-09-14T11:43:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.128 2024-09-14T11:43:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.130 2024-09-14T11:43:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.158022+0000, chain.objs.size()=7 2024-09-14T11:43:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.129 2024-09-14T11:43:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.131 2024-09-14T11:43:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.132 2024-09-14T11:43:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.133 2024-09-14T11:43:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.134 2024-09-14T11:43:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.135 2024-09-14T11:43:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.019+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.136 2024-09-14T11:43:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.020+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.176211+0000, chain.objs.size()=9 2024-09-14T11:43:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.020+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.137 2024-09-14T11:43:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.021+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.138 2024-09-14T11:43:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.021+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.139 2024-09-14T11:43:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.021+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.140 2024-09-14T11:43:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.021+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.141 2024-09-14T11:43:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.021+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.142 2024-09-14T11:43:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.022+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.143 2024-09-14T11:43:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.022+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.144 2024-09-14T11:43:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.022+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.145 2024-09-14T11:43:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.022+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.188632+0000, chain.objs.size()=4 2024-09-14T11:43:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.022+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.146 2024-09-14T11:43:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.022+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.147 2024-09-14T11:43:32.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.022+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.148 2024-09-14T11:43:32.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.023+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.149 2024-09-14T11:43:32.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.023+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.211096+0000, chain.objs.size()=10 2024-09-14T11:43:32.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.023+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.150 2024-09-14T11:43:32.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.023+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.151 2024-09-14T11:43:32.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.023+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.152 2024-09-14T11:43:32.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.023+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.153 2024-09-14T11:43:32.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.024+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.154 2024-09-14T11:43:32.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.024+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.155 2024-09-14T11:43:32.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.024+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.156 2024-09-14T11:43:32.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.024+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.157 2024-09-14T11:43:32.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.024+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.158 2024-09-14T11:43:32.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.024+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.159 2024-09-14T11:43:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.025+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.227788+0000, chain.objs.size()=6 2024-09-14T11:43:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.025+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.160 2024-09-14T11:43:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.025+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.161 2024-09-14T11:43:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.025+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.162 2024-09-14T11:43:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.163 2024-09-14T11:43:32.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.164 2024-09-14T11:43:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.165 2024-09-14T11:43:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.247315+0000, chain.objs.size()=7 2024-09-14T11:43:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.166 2024-09-14T11:43:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.167 2024-09-14T11:43:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.168 2024-09-14T11:43:32.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.026+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.169 2024-09-14T11:43:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.027+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.170 2024-09-14T11:43:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.027+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.171 2024-09-14T11:43:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.027+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.172 2024-09-14T11:43:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.027+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.267616+0000, chain.objs.size()=10 2024-09-14T11:43:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.027+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.173 2024-09-14T11:43:32.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.027+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.174 2024-09-14T11:43:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.028+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.175 2024-09-14T11:43:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.028+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.176 2024-09-14T11:43:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.028+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.177 2024-09-14T11:43:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.028+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.178 2024-09-14T11:43:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.028+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.179 2024-09-14T11:43:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.029+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.180 2024-09-14T11:43:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.029+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.181 2024-09-14T11:43:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.029+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.182 2024-09-14T11:43:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.029+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.284670+0000, chain.objs.size()=9 2024-09-14T11:43:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.029+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.183 2024-09-14T11:43:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.029+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.184 2024-09-14T11:43:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.030+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.185 2024-09-14T11:43:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.030+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.186 2024-09-14T11:43:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.030+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.187 2024-09-14T11:43:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.030+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.188 2024-09-14T11:43:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.030+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.189 2024-09-14T11:43:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.030+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.190 2024-09-14T11:43:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.031+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.191 2024-09-14T11:43:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.031+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.304780+0000, chain.objs.size()=7 2024-09-14T11:43:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.031+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.192 2024-09-14T11:43:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.031+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.193 2024-09-14T11:43:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.031+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.194 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.195 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.196 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.197 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.198 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.317257+0000, chain.objs.size()=5 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.199 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.200 2024-09-14T11:43:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.032+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.201 2024-09-14T11:43:32.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.033+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.202 2024-09-14T11:43:32.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.033+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.203 2024-09-14T11:43:32.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.033+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.335278+0000, chain.objs.size()=8 2024-09-14T11:43:32.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.033+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.204 2024-09-14T11:43:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.033+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.205 2024-09-14T11:43:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.034+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.206 2024-09-14T11:43:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.034+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.207 2024-09-14T11:43:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.034+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.208 2024-09-14T11:43:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.034+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.210 2024-09-14T11:43:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.035+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.211 2024-09-14T11:43:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.035+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.212 2024-09-14T11:43:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.035+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7', time=2024-09-14T13:43:19.343081+0000, chain.objs.size()=1 2024-09-14T11:43:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.035+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.106__multipart_key1.2~MU2UiKf5QTf70WeCmc1lORP0IzDwYO7.209 2024-09-14T11:43:32.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.037+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.039+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:43:32.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.041+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.041+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.041+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.042+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:43:32.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.044+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.044+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.044+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.045+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:43:32.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.047+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.047+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.047+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.048+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:43:32.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.049+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9227200005805128459', time=2024-09-14T13:43:06.922458+0000, chain.objs.size()=9 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.1 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.1_1 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.2 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.2_1 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.3 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.3_1 2024-09-14T11:43:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.4 2024-09-14T11:43:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.4_1 2024-09-14T11:43:32.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.050+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~HHC4HNWKRPZ2j1KylHkZm3doQOaRujP.5 2024-09-14T11:43:32.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.053+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.056+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:43:32.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.057+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.057+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.057+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.058+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:43:32.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.060+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.060+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.060+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.060+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11159612513017215379', time=2024-09-14T13:43:16.068787+0000, chain.objs.size()=7 2024-09-14T11:43:32.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.060+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~T_jVXbMhXJsPWzkGhJ0vZFWW6zahgjB.1 2024-09-14T11:43:32.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.061+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~T_jVXbMhXJsPWzkGhJ0vZFWW6zahgjB.1_1 2024-09-14T11:43:32.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.061+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~T_jVXbMhXJsPWzkGhJ0vZFWW6zahgjB.1_2 2024-09-14T11:43:32.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.061+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~T_jVXbMhXJsPWzkGhJ0vZFWW6zahgjB.2 2024-09-14T11:43:32.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.061+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~T_jVXbMhXJsPWzkGhJ0vZFWW6zahgjB.2_1 2024-09-14T11:43:32.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.061+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~T_jVXbMhXJsPWzkGhJ0vZFWW6zahgjB.2_2 2024-09-14T11:43:32.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.061+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~T_jVXbMhXJsPWzkGhJ0vZFWW6zahgjB.3 2024-09-14T11:43:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.063+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.065+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:43:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.067+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.067+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.067+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.067+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13438942755442882518', time=2024-09-14T13:43:09.368316+0000, chain.objs.size()=5 2024-09-14T11:43:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.067+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.94__shadow_.b4bMSWaXljcGkCw9mPoMio0tkogJPpL_1 2024-09-14T11:43:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.067+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.94__shadow_.b4bMSWaXljcGkCw9mPoMio0tkogJPpL_2 2024-09-14T11:43:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.068+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.94__shadow_.b4bMSWaXljcGkCw9mPoMio0tkogJPpL_3 2024-09-14T11:43:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.068+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.94__shadow_.b4bMSWaXljcGkCw9mPoMio0tkogJPpL_4 2024-09-14T11:43:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.068+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.94__shadow_.b4bMSWaXljcGkCw9mPoMio0tkogJPpL_5 2024-09-14T11:43:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.070+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.072+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:43:32.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.073+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16389779130101649985', time=2024-09-14T13:43:12.436490+0000, chain.objs.size()=9 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.1 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.1_1 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.2 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.2_1 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.3 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.3_1 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.4 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__shadow_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.4_1 2024-09-14T11:43:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.074+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.101__multipart_file2.mpg.2~KwcJHzAyQeY6Y-WxNUMaABPG7NXClUV.5 2024-09-14T11:43:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.078+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.080+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:43:32.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.081+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.081+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.082+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.083+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:43:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.084+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.084+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.084+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.084+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11599791726109357398', time=2024-09-14T13:43:02.639574+0000, chain.objs.size()=2 2024-09-14T11:43:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.084+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.84__shadow_.f76dLd7wMR3gemGG4LBv1Sd5obRnEFL_1 2024-09-14T11:43:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.084+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.84__shadow_.f76dLd7wMR3gemGG4LBv1Sd5obRnEFL_2 2024-09-14T11:43:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.087+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.088+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:43:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1', time=2024-09-14T13:43:01.222745+0000, chain.objs.size()=9 2024-09-14T11:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__multipart_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.1 2024-09-14T11:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__shadow_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.1_1 2024-09-14T11:43:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__multipart_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.2 2024-09-14T11:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__shadow_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.2_1 2024-09-14T11:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.090+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__multipart_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.3 2024-09-14T11:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.091+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__shadow_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.3_1 2024-09-14T11:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.091+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__multipart_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.4 2024-09-14T11:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.091+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__shadow_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.4_1 2024-09-14T11:43:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.091+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.80__multipart_key1.2~st3xmJ0jyeCbZ6FwEd-0DqxUFKywfQ1.5 2024-09-14T11:43:32.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.094+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.096+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:43:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.098+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.098+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.098+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.098+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8815932110273388597', time=2024-09-14T13:43:16.376556+0000, chain.objs.size()=7 2024-09-14T11:43:32.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.098+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~DsMNgs7_1SP5pvIvw0WWzff5WaHaz-m.1 2024-09-14T11:43:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.098+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~DsMNgs7_1SP5pvIvw0WWzff5WaHaz-m.1_1 2024-09-14T11:43:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.098+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~DsMNgs7_1SP5pvIvw0WWzff5WaHaz-m.1_2 2024-09-14T11:43:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.099+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~DsMNgs7_1SP5pvIvw0WWzff5WaHaz-m.2 2024-09-14T11:43:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.099+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~DsMNgs7_1SP5pvIvw0WWzff5WaHaz-m.2_1 2024-09-14T11:43:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.099+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~DsMNgs7_1SP5pvIvw0WWzff5WaHaz-m.2_2 2024-09-14T11:43:32.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.099+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~DsMNgs7_1SP5pvIvw0WWzff5WaHaz-m.3 2024-09-14T11:43:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.101+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.103+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:43:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.104+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7084710800815977682', time=2024-09-14T13:43:09.490022+0000, chain.objs.size()=7 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~MCJ5olvSBZAKJ5K1wVV17CA8UBxdJ9y.1 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~MCJ5olvSBZAKJ5K1wVV17CA8UBxdJ9y.1_1 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~MCJ5olvSBZAKJ5K1wVV17CA8UBxdJ9y.1_2 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~MCJ5olvSBZAKJ5K1wVV17CA8UBxdJ9y.2 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~MCJ5olvSBZAKJ5K1wVV17CA8UBxdJ9y.2_1 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~MCJ5olvSBZAKJ5K1wVV17CA8UBxdJ9y.2_2 2024-09-14T11:43:32.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.105+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~MCJ5olvSBZAKJ5K1wVV17CA8UBxdJ9y.3 2024-09-14T11:43:32.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.108+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.111+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:43:32.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.112+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.112+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12119856296040156600', time=2024-09-14T13:43:09.227951+0000, chain.objs.size()=7 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~XGkKGR1vfUCMuVKJdlrNr_4naosXch2.1 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~XGkKGR1vfUCMuVKJdlrNr_4naosXch2.1_1 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~XGkKGR1vfUCMuVKJdlrNr_4naosXch2.1_2 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~XGkKGR1vfUCMuVKJdlrNr_4naosXch2.2 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~XGkKGR1vfUCMuVKJdlrNr_4naosXch2.2_1 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~XGkKGR1vfUCMuVKJdlrNr_4naosXch2.2_2 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~XGkKGR1vfUCMuVKJdlrNr_4naosXch2.3 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1271925951429177189', time=2024-09-14T13:43:15.762036+0000, chain.objs.size()=9 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.1 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.1_1 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.2 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.2_1 2024-09-14T11:43:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.113+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.3 2024-09-14T11:43:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.116+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.3_1 2024-09-14T11:43:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.116+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.4 2024-09-14T11:43:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.116+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.4_1 2024-09-14T11:43:32.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.116+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~bzO_ionMOxw2F0dIKhisqgRqEEGPGuw.5 2024-09-14T11:43:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.118+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.120+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:43:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.122+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.122+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3862082813113057849', time=2024-09-14T13:43:08.814622+0000, chain.objs.size()=7 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~I7B0w750Tq8ruQo_J4WkIW7UbIXcazh.1 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~I7B0w750Tq8ruQo_J4WkIW7UbIXcazh.1_1 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~I7B0w750Tq8ruQo_J4WkIW7UbIXcazh.1_2 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~I7B0w750Tq8ruQo_J4WkIW7UbIXcazh.2 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~I7B0w750Tq8ruQo_J4WkIW7UbIXcazh.2_1 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__shadow_key1.2~I7B0w750Tq8ruQo_J4WkIW7UbIXcazh.2_2 2024-09-14T11:43:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.123+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.95__multipart_key1.2~I7B0w750Tq8ruQo_J4WkIW7UbIXcazh.3 2024-09-14T11:43:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.126+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.128+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:43:32.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.129+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.130+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.130+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.131+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:43:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.132+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.133+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.133+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.134+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:43:32.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.136+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.136+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.136+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.138+0000 7f14b71a7800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:43:32.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.140+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14590014704346369798', time=2024-09-14T13:43:16.514776+0000, chain.objs.size()=7 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~X3Ve9zjdRiJNGptiK2ukzgmJ5Kz1xk4.1 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~X3Ve9zjdRiJNGptiK2ukzgmJ5Kz1xk4.1_1 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~X3Ve9zjdRiJNGptiK2ukzgmJ5Kz1xk4.1_2 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~X3Ve9zjdRiJNGptiK2ukzgmJ5Kz1xk4.2 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~X3Ve9zjdRiJNGptiK2ukzgmJ5Kz1xk4.2_1 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__shadow_key1.2~X3Ve9zjdRiJNGptiK2ukzgmJ5Kz1xk4.2_2 2024-09-14T11:43:32.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.141+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.103__multipart_key1.2~X3Ve9zjdRiJNGptiK2ukzgmJ5Kz1xk4.3 2024-09-14T11:43:32.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.145+0000 7f14b71a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:43:32.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.148+0000 7f136b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:32.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.150+0000 7f14b71a7800 20 remove_watcher() i=0 2024-09-14T11:43:32.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.150+0000 7f14b71a7800 2 removed watcher, disabling cache 2024-09-14T11:43:32.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.151+0000 7f14b71a7800 20 remove_watcher() i=1 2024-09-14T11:43:32.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.152+0000 7f14b71a7800 20 remove_watcher() i=2 2024-09-14T11:43:32.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.153+0000 7f14b71a7800 20 remove_watcher() i=3 2024-09-14T11:43:32.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.154+0000 7f14b71a7800 20 remove_watcher() i=4 2024-09-14T11:43:32.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.155+0000 7f14b71a7800 20 remove_watcher() i=5 2024-09-14T11:43:32.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.156+0000 7f14b71a7800 20 remove_watcher() i=6 2024-09-14T11:43:32.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.157+0000 7f14b71a7800 20 remove_watcher() i=7 2024-09-14T11:43:32.167 DEBUG:teuthology.orchestra.run.smithi007:> radosgw-admin gc process --include-all 2024-09-14T11:43:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:32.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.261+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 20 realm 2024-09-14T11:43:32.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.263+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.264+0000 7fbb96a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.264+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.265+0000 7fbb96a16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:32.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.265+0000 7fbb96a16800 20 searching for the correct realm 2024-09-14T11:43:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.266+0000 7fbb929e8640 0 -- 172.21.15.7:0/1704136564 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fbb8801b040 msgr2=0x7fbb8800a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:32.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.271+0000 7fbb919e6640 0 -- 172.21.15.7:0/1704136564 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fbb840703f0 msgr2=0x7fbb84070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:32.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:32.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:32.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.477+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 zone default found 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 4 Realm: () 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 zonegroup default 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.478+0000 7fbb96a16800 20 rados->read ofs=0 len=0 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.479+0000 7fbb96a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:32.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.479+0000 7fbb96a16800 20 started sync module instance, tier type = 2024-09-14T11:43:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.479+0000 7fbb96a16800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.488+0000 7fbb96a16800 20 add_watcher() i=0 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.488+0000 7fbb96a16800 20 add_watcher() i=1 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.488+0000 7fbb96a16800 20 add_watcher() i=2 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.488+0000 7fbb96a16800 20 add_watcher() i=3 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.488+0000 7fbb96a16800 20 add_watcher() i=4 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.488+0000 7fbb96a16800 20 add_watcher() i=5 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.488+0000 7fbb96a16800 20 add_watcher() i=6 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.489+0000 7fbb96a16800 20 add_watcher() i=7 2024-09-14T11:43:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.489+0000 7fbb96a16800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.490+0000 7fba48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.491+0000 7fbb96a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:32.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.491+0000 7fbb96a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.525+0000 7fb9c37fe640 20 reqs_thread_entry: start 2024-09-14T11:43:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.525+0000 7fbb96a16800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.525+0000 7fbb96a16800 20 Filter name: none 2024-09-14T11:43:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.525+0000 7fb9c17fa640 20 reqs_thread_entry: start 2024-09-14T11:43:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.525+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:43:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.527+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.527+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.527+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.528+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:43:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.530+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.530+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.531+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.532+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:43:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.533+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.533+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.534+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.535+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:43:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.536+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.536+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.536+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.538+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:43:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.540+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.541+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.541+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.542+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:43:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.543+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.544+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.544+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.545+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:43:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.547+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.547+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.548+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.548+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:43:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.550+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.550+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.550+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.551+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:43:32.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.553+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.554+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.554+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.555+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:43:32.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.556+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.557+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.557+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.558+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:43:32.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.559+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.559+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.560+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.560+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:43:32.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.562+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.562+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.562+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.563+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:43:32.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.565+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.565+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.565+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.567+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:43:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.569+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.569+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.569+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.571+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:43:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.572+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.573+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.573+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.574+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:43:32.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.575+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.576+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.576+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.577+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:43:32.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.578+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.579+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.579+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.580+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:43:32.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.582+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.582+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.582+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.583+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:43:32.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.585+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.585+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.586+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.587+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:43:32.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.588+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.589+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.589+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.590+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:43:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.591+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.591+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.592+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.593+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:43:32.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.594+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.594+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.594+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.595+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:43:32.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.597+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.597+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.598+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.598+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:43:32.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.600+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.600+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.600+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.601+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:43:32.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.602+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.603+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.603+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.604+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:43:32.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.605+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.606+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.606+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.607+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:43:32.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.608+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.609+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.609+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.610+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:43:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.611+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.612+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.612+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.613+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:43:32.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.614+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.615+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.615+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.616+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:43:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.617+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.618+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.618+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.619+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:43:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.620+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.621+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.621+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.622+0000 7fbb96a16800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:43:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.624+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.624+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:43:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.624+0000 7fbb96a16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:43:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.626+0000 7fba48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:32.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.628+0000 7fbb96a16800 20 remove_watcher() i=0 2024-09-14T11:43:32.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.628+0000 7fbb96a16800 2 removed watcher, disabling cache 2024-09-14T11:43:32.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.629+0000 7fbb96a16800 20 remove_watcher() i=1 2024-09-14T11:43:32.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.630+0000 7fbb96a16800 20 remove_watcher() i=2 2024-09-14T11:43:32.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.631+0000 7fbb96a16800 20 remove_watcher() i=3 2024-09-14T11:43:32.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.632+0000 7fbb96a16800 20 remove_watcher() i=4 2024-09-14T11:43:32.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.633+0000 7fbb96a16800 20 remove_watcher() i=5 2024-09-14T11:43:32.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.634+0000 7fbb96a16800 20 remove_watcher() i=6 2024-09-14T11:43:32.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:32.635+0000 7fbb96a16800 20 remove_watcher() i=7 2024-09-14T11:43:32.645 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:43:32.665 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:43:32.666 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:43:32.666 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:43:32.666 DEBUG:teuthology.orchestra.run.smithi007:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:43:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:43:33.518 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:43:33.519 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-14T11:43:33.519 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key SLQLDRZHXHYONJRICNCA --secret UWnl1b5b6YFPbw+0MtA/R38/MBHIPnTJBKrELGVIENy6bZspI1hTXQ== --cluster ceph 2024-09-14T11:43:33.626 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:33.626 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.663+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.664+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.664+0000 7f5ea7210800 20 realm 2024-09-14T11:43:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.664+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.664+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.664+0000 7f5ea7210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.664+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.665+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.665+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.666+0000 7f5ea7210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.666+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.666+0000 7f5ea7210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.666+0000 7f5ea7210800 20 searching for the correct realm 2024-09-14T11:43:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.668+0000 7f5ea31bd640 0 -- 172.21.15.7:0/1934004702 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f5e8c045040 msgr2=0x7f5e8c046940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.673+0000 7f5ea21bb640 0 -- 172.21.15.7:0/1934004702 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f5e94048040 msgr2=0x7f5e94038940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.879+0000 7f5ea7210800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.879+0000 7f5ea7210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.879+0000 7f5ea7210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.879+0000 7f5ea7210800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.879+0000 7f5ea7210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.879+0000 7f5ea7210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.879+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 zone default found 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 4 Realm: () 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 zonegroup default 2024-09-14T11:43:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.880+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.881+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.881+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.881+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.881+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.881+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.881+0000 7f5ea7210800 20 started sync module instance, tier type = 2024-09-14T11:43:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.881+0000 7f5ea7210800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.891+0000 7f5ea7210800 20 add_watcher() i=0 2024-09-14T11:43:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.891+0000 7f5ea7210800 20 add_watcher() i=1 2024-09-14T11:43:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.891+0000 7f5ea7210800 20 add_watcher() i=2 2024-09-14T11:43:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.891+0000 7f5ea7210800 20 add_watcher() i=3 2024-09-14T11:43:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.891+0000 7f5ea7210800 20 add_watcher() i=4 2024-09-14T11:43:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.891+0000 7f5ea7210800 20 add_watcher() i=5 2024-09-14T11:43:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.891+0000 7f5ea7210800 20 add_watcher() i=6 2024-09-14T11:43:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.892+0000 7f5ea7210800 20 add_watcher() i=7 2024-09-14T11:43:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.892+0000 7f5ea7210800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.894+0000 7f5d597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.894+0000 7f5ea7210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.894+0000 7f5ea7210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:33.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.894+0000 7f5ea7210800 5 note: GC not initialized 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.894+0000 7f5cd3fff640 20 reqs_thread_entry: start 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.894+0000 7f5ea7210800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 20 Filter name: none 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5cd1ffb640 20 reqs_thread_entry: start 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 10 cache get: name=default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA : miss 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.895+0000 7f5ea7210800 20 rados->read ofs=0 len=0 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.896+0000 7f5ea7210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.896+0000 7f5ea7210800 10 cache put: name=default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA info.flags=0x0 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.896+0000 7f5ea7210800 10 adding default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA to cache LRU end 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.896+0000 7f5ea7210800 10 cache get: name=default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA : hit (negative entry) 2024-09-14T11:43:33.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.896+0000 7f5ea7210800 10 cache get: name=default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA : hit (negative entry) 2024-09-14T11:43:33.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.897+0000 7f5ea7210800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:43:33.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.897+0000 7f5ea7210800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:43:33.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.897+0000 7f5ea7210800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:43:33.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.897+0000 7f5d867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529873 cookie 94236404815232 notifier 8483 bl.length()=645 2024-09-14T11:43:33.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.897+0000 7f5d867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:43:33.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.897+0000 7f5d867fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:43:33.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.899+0000 7f5ea7210800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:43:33.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.899+0000 7f5ea7210800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:43:33.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.899+0000 7f5ea7210800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:43:33.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.899+0000 7f5d867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529874 cookie 94236404829264 notifier 8483 bl.length()=185 2024-09-14T11:43:33.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.899+0000 7f5d867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:43:33.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.899+0000 7f5d867fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:43:33.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.901+0000 7f5ea7210800 10 cache put: name=default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA info.flags=0x7 2024-09-14T11:43:33.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.901+0000 7f5ea7210800 10 moving default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA to cache LRU end 2024-09-14T11:43:33.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.901+0000 7f5ea7210800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:SLQLDRZHXHYONJRICNCA, ofs0, ns] 2024-09-14T11:43:33.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.901+0000 7f5d867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529895 cookie 94236404834368 notifier 8483 bl.length()=186 2024-09-14T11:43:33.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.901+0000 7f5d867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA info.flags=0x7 2024-09-14T11:43:33.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.901+0000 7f5d867fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SLQLDRZHXHYONJRICNCA to cache LRU end 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "foo.client.0", 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr.foo.client.0", 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "foo+test@test.test", 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "foo.client.0", 2024-09-14T11:43:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "SLQLDRZHXHYONJRICNCA", 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "UWnl1b5b6YFPbw+0MtA/R38/MBHIPnTJBKrELGVIENy6bZspI1hTXQ==", 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:33.897582Z" 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:43:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:43:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:43:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:43:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:33.897564Z", 2024-09-14T11:43:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:43:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:43:33.904 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:33.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.903+0000 7f5d597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:33.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.905+0000 7f5ea7210800 20 remove_watcher() i=0 2024-09-14T11:43:33.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.905+0000 7f5ea7210800 2 removed watcher, disabling cache 2024-09-14T11:43:33.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.906+0000 7f5ea7210800 20 remove_watcher() i=1 2024-09-14T11:43:33.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.907+0000 7f5ea7210800 20 remove_watcher() i=2 2024-09-14T11:43:33.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.908+0000 7f5ea7210800 20 remove_watcher() i=3 2024-09-14T11:43:33.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.909+0000 7f5ea7210800 20 remove_watcher() i=4 2024-09-14T11:43:33.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.910+0000 7f5ea7210800 20 remove_watcher() i=5 2024-09-14T11:43:33.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.911+0000 7f5ea7210800 20 remove_watcher() i=6 2024-09-14T11:43:33.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:33.912+0000 7f5ea7210800 20 remove_watcher() i=7 2024-09-14T11:43:33.922 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6062027408 --totp-seed WPJ27FECIENM6E7BGJNZEUSDGVSH4QMHX3VZAJOFHRWADWFS47LRBO5S7IABMBUS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:43:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.232+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 20 realm 2024-09-14T11:43:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.234+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.235+0000 7f222dd28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.235+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.236+0000 7f222dd28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.236+0000 7f222dd28800 20 searching for the correct realm 2024-09-14T11:43:34.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.237+0000 7f222924a640 0 -- 172.21.15.7:0/1168510423 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7f221c03c060 msgr2=0x7f221c0692e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.242+0000 7f222a24c640 0 -- 172.21.15.7:0/1168510423 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f22200bb310 msgr2=0x7f22200a3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:34.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.248+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 zone default found 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 4 Realm: () 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 zonegroup default 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.249+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.250+0000 7f222dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.250+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.250+0000 7f222dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:34.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.250+0000 7f222dd28800 20 started sync module instance, tier type = 2024-09-14T11:43:34.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.250+0000 7f222dd28800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.260+0000 7f222dd28800 20 add_watcher() i=0 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.260+0000 7f222dd28800 20 add_watcher() i=1 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.260+0000 7f222dd28800 20 add_watcher() i=2 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.260+0000 7f222dd28800 20 add_watcher() i=3 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.260+0000 7f222dd28800 20 add_watcher() i=4 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.260+0000 7f222dd28800 20 add_watcher() i=5 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.260+0000 7f222dd28800 20 add_watcher() i=6 2024-09-14T11:43:34.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.261+0000 7f222dd28800 20 add_watcher() i=7 2024-09-14T11:43:34.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.261+0000 7f222dd28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f20db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f222dd28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f222dd28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f222dd28800 5 note: GC not initialized 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f20da7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f222dd28800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f222dd28800 20 Filter name: none 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f204bfff640 20 reqs_thread_entry: start 2024-09-14T11:43:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f222dd28800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:43:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.263+0000 7f222dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.264+0000 7f222dd28800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:43:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.264+0000 7f222dd28800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:43:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.264+0000 7f222dd28800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:43:34.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:34.264+0000 7f222dd28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:35.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.610+0000 7f222dd28800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:43:35.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.610+0000 7f222dd28800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:43:35.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.610+0000 7f222dd28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:43:35.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.610+0000 7f210cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464467 cookie 94111300779408 notifier 9006 bl.length()=659 2024-09-14T11:43:35.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.610+0000 7f210cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:43:35.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.610+0000 7f210cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:43:35.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.612+0000 7f20db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.615+0000 7f222dd28800 20 remove_watcher() i=0 2024-09-14T11:43:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.615+0000 7f222dd28800 2 removed watcher, disabling cache 2024-09-14T11:43:35.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.616+0000 7f222dd28800 20 remove_watcher() i=1 2024-09-14T11:43:35.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.617+0000 7f222dd28800 20 remove_watcher() i=2 2024-09-14T11:43:35.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.618+0000 7f222dd28800 20 remove_watcher() i=3 2024-09-14T11:43:35.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.619+0000 7f222dd28800 20 remove_watcher() i=4 2024-09-14T11:43:35.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.621+0000 7f222dd28800 20 remove_watcher() i=5 2024-09-14T11:43:35.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.622+0000 7f222dd28800 20 remove_watcher() i=6 2024-09-14T11:43:35.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.623+0000 7f222dd28800 20 remove_watcher() i=7 2024-09-14T11:43:35.635 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:43:35.635 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key APLFFSEVNLXYFJORWYMY --secret 8kdYj2AF8fvSJcLgUxhnhCP14r2OXCKcumQL4fmzxQHwfuO7ww3gyg== --cluster ceph 2024-09-14T11:43:35.705 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:35.705 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:35.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.743+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 20 realm 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.745+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.746+0000 7f0a33d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:35.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.746+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:35.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.747+0000 7f0a33d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:35.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.747+0000 7f0a33d40800 20 searching for the correct realm 2024-09-14T11:43:35.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.749+0000 7f0a302c1640 0 -- 172.21.15.7:0/1976809882 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0a24055420 msgr2=0x7f0a24055860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:35.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:35.955+0000 7f0a2f2bf640 0 -- 172.21.15.7:0/1976809882 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f0a20001400 msgr2=0x7f0a20060e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.163+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:36.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 20 zone default found 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 4 Realm: () 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 20 zonegroup default 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.164+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.165+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.165+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.165+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.165+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.165+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.165+0000 7f0a33d40800 20 started sync module instance, tier type = 2024-09-14T11:43:36.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.165+0000 7f0a33d40800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:36.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.176+0000 7f0a33d40800 20 add_watcher() i=0 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.176+0000 7f0a33d40800 20 add_watcher() i=1 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.176+0000 7f0a33d40800 20 add_watcher() i=2 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.176+0000 7f0a33d40800 20 add_watcher() i=3 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.176+0000 7f0a33d40800 20 add_watcher() i=4 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.176+0000 7f0a33d40800 20 add_watcher() i=5 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.176+0000 7f0a33d40800 20 add_watcher() i=6 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.177+0000 7f0a33d40800 20 add_watcher() i=7 2024-09-14T11:43:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.177+0000 7f0a33d40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.179+0000 7f08e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.179+0000 7f0a33d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.179+0000 7f0a33d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.179+0000 7f0a33d40800 5 note: GC not initialized 2024-09-14T11:43:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.179+0000 7f08e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.179+0000 7f0a33d40800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 20 Filter name: none 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f085e7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:43:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.180+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 10 cache get: name=default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY : miss 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 10 cache put: name=default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY info.flags=0x0 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 10 adding default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY to cache LRU end 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 10 cache get: name=default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY : hit (negative entry) 2024-09-14T11:43:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.181+0000 7f0a33d40800 10 cache get: name=default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY : hit (negative entry) 2024-09-14T11:43:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.183+0000 7f0a33d40800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:43:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.183+0000 7f0a33d40800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:43:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.183+0000 7f0a33d40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:43:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.183+0000 7f090effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464377 cookie 94496077166608 notifier 8516 bl.length()=645 2024-09-14T11:43:36.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.183+0000 7f090effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:43:36.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.183+0000 7f090effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.185+0000 7f0a33d40800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.185+0000 7f0a33d40800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:43:36.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.185+0000 7f0a33d40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:43:36.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.185+0000 7f090effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464488 cookie 94496077176224 notifier 8516 bl.length()=185 2024-09-14T11:43:36.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.185+0000 7f090effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:43:36.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.185+0000 7f090effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.187+0000 7f0a33d40800 10 cache put: name=default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY info.flags=0x7 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.187+0000 7f0a33d40800 10 moving default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY to cache LRU end 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.187+0000 7f0a33d40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:APLFFSEVNLXYFJORWYMY, ofs0, ns] 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.187+0000 7f090effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464468 cookie 94496077181744 notifier 8516 bl.length()=186 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.187+0000 7f090effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY info.flags=0x7 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.187+0000 7f090effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+APLFFSEVNLXYFJORWYMY to cache LRU end 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "bar.client.0", 2024-09-14T11:43:36.186 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "bar+test@test.test", 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "bar.client.0", 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "APLFFSEVNLXYFJORWYMY", 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "8kdYj2AF8fvSJcLgUxhnhCP14r2OXCKcumQL4fmzxQHwfuO7ww3gyg==", 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:36.183020Z" 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:43:36.187 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:36.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:36.183007Z", 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:36.189 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.189+0000 7f08e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.191+0000 7f0a33d40800 20 remove_watcher() i=0 2024-09-14T11:43:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.191+0000 7f0a33d40800 2 removed watcher, disabling cache 2024-09-14T11:43:36.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.192+0000 7f0a33d40800 20 remove_watcher() i=1 2024-09-14T11:43:36.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.193+0000 7f0a33d40800 20 remove_watcher() i=2 2024-09-14T11:43:36.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.194+0000 7f0a33d40800 20 remove_watcher() i=3 2024-09-14T11:43:36.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.196+0000 7f0a33d40800 20 remove_watcher() i=4 2024-09-14T11:43:36.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.197+0000 7f0a33d40800 20 remove_watcher() i=5 2024-09-14T11:43:36.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.198+0000 7f0a33d40800 20 remove_watcher() i=6 2024-09-14T11:43:36.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.199+0000 7f0a33d40800 20 remove_watcher() i=7 2024-09-14T11:43:36.210 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7111370612 --totp-seed 437THCAANUSFRG3ANNOS25CEHREUS74UJ7RA47Q5YQS5MM46TPINJVILWDG2VUPJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:43:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:36.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.319+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 20 realm 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.321+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.322+0000 7fd80a40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:36.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.322+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.323+0000 7fd80a40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:36.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.323+0000 7fd80a40f800 20 searching for the correct realm 2024-09-14T11:43:36.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.324+0000 7fd805321640 0 -- 172.21.15.7:0/3937595044 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fd7f802f040 msgr2=0x7fd7f802f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:36.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.531+0000 7fd806323640 0 -- 172.21.15.7:0/3937595044 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fd7fc084070 msgr2=0x7fd7fc085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.538+0000 7fd80a40f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:36.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.538+0000 7fd80a40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.538+0000 7fd80a40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.538+0000 7fd80a40f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.538+0000 7fd80a40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.538+0000 7fd80a40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.538+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:36.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 zone default found 2024-09-14T11:43:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 4 Realm: () 2024-09-14T11:43:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:36.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 zonegroup default 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.539+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.540+0000 7fd80a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.540+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.540+0000 7fd80a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.540+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.540+0000 7fd80a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.540+0000 7fd80a40f800 20 started sync module instance, tier type = 2024-09-14T11:43:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.540+0000 7fd80a40f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.550+0000 7fd80a40f800 20 add_watcher() i=0 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.550+0000 7fd80a40f800 20 add_watcher() i=1 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.550+0000 7fd80a40f800 20 add_watcher() i=2 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.550+0000 7fd80a40f800 20 add_watcher() i=3 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.550+0000 7fd80a40f800 20 add_watcher() i=4 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.550+0000 7fd80a40f800 20 add_watcher() i=5 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.550+0000 7fd80a40f800 20 add_watcher() i=6 2024-09-14T11:43:36.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.551+0000 7fd80a40f800 20 add_watcher() i=7 2024-09-14T11:43:36.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.551+0000 7fd80a40f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd6b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd80a40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd80a40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd80a40f800 5 note: GC not initialized 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd6b67fc640 20 reqs_thread_entry: start 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd80a40f800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd80a40f800 20 Filter name: none 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd627fff640 20 reqs_thread_entry: start 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd80a40f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:43:36.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.553+0000 7fd80a40f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.554+0000 7fd80a40f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:43:36.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.554+0000 7fd80a40f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:43:36.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.554+0000 7fd80a40f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:43:36.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.554+0000 7fd80a40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.557+0000 7fd80a40f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:43:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.557+0000 7fd80a40f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:43:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.557+0000 7fd80a40f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:43:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.557+0000 7fd6e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464378 cookie 94420035272608 notifier 9042 bl.length()=659 2024-09-14T11:43:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.557+0000 7fd6e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:43:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.557+0000 7fd6e97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:43:36.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.559+0000 7fd6b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:36.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.561+0000 7fd80a40f800 20 remove_watcher() i=0 2024-09-14T11:43:36.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.561+0000 7fd80a40f800 2 removed watcher, disabling cache 2024-09-14T11:43:36.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.562+0000 7fd80a40f800 20 remove_watcher() i=1 2024-09-14T11:43:36.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.564+0000 7fd80a40f800 20 remove_watcher() i=2 2024-09-14T11:43:36.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.565+0000 7fd80a40f800 20 remove_watcher() i=3 2024-09-14T11:43:36.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.566+0000 7fd80a40f800 20 remove_watcher() i=4 2024-09-14T11:43:36.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.567+0000 7fd80a40f800 20 remove_watcher() i=5 2024-09-14T11:43:36.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.568+0000 7fd80a40f800 20 remove_watcher() i=6 2024-09-14T11:43:36.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.569+0000 7fd80a40f800 20 remove_watcher() i=7 2024-09-14T11:43:36.579 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-14T11:43:36.579 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key ZRDIDXFDCRXCDZJLIGZA --secret Od8f8xYUadmkWzQTfSQJYh+/2PCcvh0dvz5QY+T/97iejtb9HG6Wpg== --cluster ceph 2024-09-14T11:43:36.648 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:36.648 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.693+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.694+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.694+0000 7f9df900f800 20 realm 2024-09-14T11:43:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.694+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.694+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.694+0000 7f9df900f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.694+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.695+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.695+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.695+0000 7f9df900f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.695+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.696+0000 7f9df900f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.696+0000 7f9df900f800 20 searching for the correct realm 2024-09-14T11:43:36.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.702+0000 7f9df72fa640 0 -- 172.21.15.7:0/2352266984 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f9de0009e90 msgr2=0x7f9de00d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:36.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:36.908+0000 7f9df62f8640 0 -- 172.21.15.7:0/2352266984 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f9de8036c10 msgr2=0x7f9de80173f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:37.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.115+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 20 zone default found 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 4 Realm: () 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 20 zonegroup default 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.116+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.117+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.117+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.117+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.117+0000 7f9df900f800 20 started sync module instance, tier type = 2024-09-14T11:43:37.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.117+0000 7f9df900f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.128+0000 7f9df900f800 20 add_watcher() i=0 2024-09-14T11:43:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.128+0000 7f9df900f800 20 add_watcher() i=1 2024-09-14T11:43:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.128+0000 7f9df900f800 20 add_watcher() i=2 2024-09-14T11:43:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.128+0000 7f9df900f800 20 add_watcher() i=3 2024-09-14T11:43:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.128+0000 7f9df900f800 20 add_watcher() i=4 2024-09-14T11:43:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.128+0000 7f9df900f800 20 add_watcher() i=5 2024-09-14T11:43:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.128+0000 7f9df900f800 20 add_watcher() i=6 2024-09-14T11:43:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.129+0000 7f9df900f800 20 add_watcher() i=7 2024-09-14T11:43:37.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.129+0000 7f9df900f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.130+0000 7f9cad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.130+0000 7f9df900f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.130+0000 7f9df900f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 5 note: GC not initialized 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9c27fff640 20 reqs_thread_entry: start 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 20 Filter name: none 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9c25ffb640 20 reqs_thread_entry: start 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:43:37.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.131+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 10 cache get: name=default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA : miss 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 10 cache put: name=default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA info.flags=0x0 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 10 adding default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA to cache LRU end 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 10 cache get: name=default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA : hit (negative entry) 2024-09-14T11:43:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.132+0000 7f9df900f800 10 cache get: name=default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA : hit (negative entry) 2024-09-14T11:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.133+0000 7f9df900f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.133+0000 7f9df900f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.133+0000 7f9df900f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.134+0000 7f9cda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431785 cookie 94142123184656 notifier 8549 bl.length()=719 2024-09-14T11:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.134+0000 7f9cda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:43:37.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.134+0000 7f9cda7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.136+0000 7f9df900f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.136+0000 7f9df900f800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:43:37.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.136+0000 7f9df900f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:43:37.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.136+0000 7f9cda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94142123186992 notifier 8549 bl.length()=215 2024-09-14T11:43:37.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.136+0000 7f9cda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:43:37.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.136+0000 7f9cda7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.137+0000 7f9df900f800 10 cache put: name=default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA info.flags=0x7 2024-09-14T11:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.137+0000 7f9df900f800 10 moving default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA to cache LRU end 2024-09-14T11:43:37.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.137+0000 7f9df900f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ZRDIDXFDCRXCDZJLIGZA, ofs0, ns] 2024-09-14T11:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.138+0000 7f9cd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431765 cookie 94142123180432 notifier 8549 bl.length()=201 2024-09-14T11:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.138+0000 7f9cd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA info.flags=0x7 2024-09-14T11:43:37.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.138+0000 7f9cd9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZRDIDXFDCRXCDZJLIGZA to cache LRU end 2024-09-14T11:43:37.138 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:43:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-14T11:43:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:43:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:43:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:43:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:43:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:43:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "ZRDIDXFDCRXCDZJLIGZA", 2024-09-14T11:43:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "Od8f8xYUadmkWzQTfSQJYh+/2PCcvh0dvz5QY+T/97iejtb9HG6Wpg==", 2024-09-14T11:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:37.134134Z" 2024-09-14T11:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:43:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:43:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:43:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:43:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:43:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:43:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:43:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:37.134122Z", 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:43:37.144 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.140+0000 7f9cad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.142+0000 7f9df900f800 20 remove_watcher() i=0 2024-09-14T11:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.142+0000 7f9df900f800 2 removed watcher, disabling cache 2024-09-14T11:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.143+0000 7f9df900f800 20 remove_watcher() i=1 2024-09-14T11:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.144+0000 7f9df900f800 20 remove_watcher() i=2 2024-09-14T11:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.145+0000 7f9df900f800 20 remove_watcher() i=3 2024-09-14T11:43:37.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.147+0000 7f9df900f800 20 remove_watcher() i=4 2024-09-14T11:43:37.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.148+0000 7f9df900f800 20 remove_watcher() i=5 2024-09-14T11:43:37.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.149+0000 7f9df900f800 20 remove_watcher() i=6 2024-09-14T11:43:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.150+0000 7f9df900f800 20 remove_watcher() i=7 2024-09-14T11:43:37.160 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3384055952 --totp-seed VEH5Y54BWGIGRIM64SDI6TTZLOD235VM2AFWZRQ7OC7GV6NKJMCPWYVFA2VR6C2H --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:43:37.229 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:37.229 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:37.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.266+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.268+0000 7ff05a2b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.268+0000 7ff05a2b9800 20 realm 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.268+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.268+0000 7ff05a2b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.268+0000 7ff05a2b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.268+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.269+0000 7ff05a2b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.269+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.269+0000 7ff05a2b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:37.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.269+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.270+0000 7ff05a2b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:37.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.270+0000 7ff05a2b9800 20 searching for the correct realm 2024-09-14T11:43:37.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.272+0000 7ff0585a4640 0 -- 172.21.15.7:0/1884120086 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7ff04c046070 msgr2=0x7ff04c047400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:37.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.276+0000 7ff0575a2640 0 -- 172.21.15.7:0/1884120086 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7ff0480ba1f0 msgr2=0x7ff0480ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.483+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 zone default found 2024-09-14T11:43:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 4 Realm: () 2024-09-14T11:43:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 zonegroup default 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.484+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.485+0000 7ff05a2b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.485+0000 7ff05a2b9800 20 started sync module instance, tier type = 2024-09-14T11:43:37.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.485+0000 7ff05a2b9800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=0 2024-09-14T11:43:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=1 2024-09-14T11:43:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=2 2024-09-14T11:43:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=3 2024-09-14T11:43:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=4 2024-09-14T11:43:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=5 2024-09-14T11:43:37.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=6 2024-09-14T11:43:37.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 20 add_watcher() i=7 2024-09-14T11:43:37.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.495+0000 7ff05a2b9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.497+0000 7fef0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.497+0000 7ff05a2b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.497+0000 7ff05a2b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.497+0000 7ff05a2b9800 5 note: GC not initialized 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7fef0cfe1640 20 reqs_thread_entry: start 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 20 Filter name: none 2024-09-14T11:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7fee867fc640 20 reqs_thread_entry: start 2024-09-14T11:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 20 rados_obj.operate() r=0 bl.length=519 2024-09-14T11:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.498+0000 7ff05a2b9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.501+0000 7ff05a2b9800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.501+0000 7ff05a2b9800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.501+0000 7ff05a2b9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.501+0000 7fef36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431786 cookie 94164102268704 notifier 8564 bl.length()=733 2024-09-14T11:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.501+0000 7fef36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.501+0000 7fef36ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.503+0000 7fef0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:37.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.505+0000 7ff05a2b9800 20 remove_watcher() i=0 2024-09-14T11:43:37.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.505+0000 7ff05a2b9800 2 removed watcher, disabling cache 2024-09-14T11:43:37.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.506+0000 7ff05a2b9800 20 remove_watcher() i=1 2024-09-14T11:43:37.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.508+0000 7ff05a2b9800 20 remove_watcher() i=2 2024-09-14T11:43:37.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.509+0000 7ff05a2b9800 20 remove_watcher() i=3 2024-09-14T11:43:37.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.510+0000 7ff05a2b9800 20 remove_watcher() i=4 2024-09-14T11:43:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.511+0000 7ff05a2b9800 20 remove_watcher() i=5 2024-09-14T11:43:37.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.512+0000 7ff05a2b9800 20 remove_watcher() i=6 2024-09-14T11:43:37.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.513+0000 7ff05a2b9800 20 remove_watcher() i=7 2024-09-14T11:43:37.522 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:43:37.523 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key ZHFUFGJDHXESTDJUXOYR --secret 2H8VhEf9e81fzxgECROmI5IcaeWNYwoOu1tSsYrKNVZgEXzVHXDeVg== --cluster ceph 2024-09-14T11:43:37.589 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:37.589 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.628+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 20 realm 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:37.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.630+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.631+0000 7f3f86b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:37.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.631+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:37.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.632+0000 7f3f86b28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:37.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.632+0000 7f3f86b28800 20 searching for the correct realm 2024-09-14T11:43:37.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.634+0000 7f3f83070640 0 -- 172.21.15.7:0/953728255 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f3f6c02c040 msgr2=0x7f3f6c038400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:37.841+0000 7f3f8206e640 0 -- 172.21.15.7:0/953728255 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f3f74090920 msgr2=0x7f3f74055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:38.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:38.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:38.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.048+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 zone default found 2024-09-14T11:43:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 4 Realm: () 2024-09-14T11:43:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 zonegroup default 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.049+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.050+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.050+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.050+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.050+0000 7f3f86b28800 20 started sync module instance, tier type = 2024-09-14T11:43:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.050+0000 7f3f86b28800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.061+0000 7f3f86b28800 20 add_watcher() i=0 2024-09-14T11:43:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.061+0000 7f3f86b28800 20 add_watcher() i=1 2024-09-14T11:43:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.061+0000 7f3f86b28800 20 add_watcher() i=2 2024-09-14T11:43:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.061+0000 7f3f86b28800 20 add_watcher() i=3 2024-09-14T11:43:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.061+0000 7f3f86b28800 20 add_watcher() i=4 2024-09-14T11:43:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.061+0000 7f3f86b28800 20 add_watcher() i=5 2024-09-14T11:43:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.061+0000 7f3f86b28800 20 add_watcher() i=6 2024-09-14T11:43:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.062+0000 7f3f86b28800 20 add_watcher() i=7 2024-09-14T11:43:38.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.062+0000 7f3f86b28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.064+0000 7f3e397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.064+0000 7f3f86b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.064+0000 7f3f86b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.064+0000 7f3f86b28800 5 note: GC not initialized 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.064+0000 7f3db3fff640 20 reqs_thread_entry: start 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.064+0000 7f3f86b28800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.064+0000 7f3f86b28800 20 Filter name: none 2024-09-14T11:43:38.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3db1ffb640 20 reqs_thread_entry: start 2024-09-14T11:43:38.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:43:38.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 10 cache get: name=default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR : miss 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.065+0000 7f3f86b28800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.066+0000 7f3f86b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.066+0000 7f3f86b28800 10 cache put: name=default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR info.flags=0x0 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.066+0000 7f3f86b28800 10 adding default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR to cache LRU end 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.066+0000 7f3f86b28800 10 cache get: name=default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR : hit (negative entry) 2024-09-14T11:43:38.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.066+0000 7f3f86b28800 10 cache get: name=default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR : hit (negative entry) 2024-09-14T11:43:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.067+0000 7f3f86b28800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:43:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.067+0000 7f3f86b28800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.067+0000 7f3f86b28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:43:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.068+0000 7f3e667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94153050391616 notifier 9099 bl.length()=660 2024-09-14T11:43:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.068+0000 7f3e667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:43:38.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.068+0000 7f3e667fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.070+0000 7f3f86b28800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:43:38.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.070+0000 7f3f86b28800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:43:38.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.070+0000 7f3f86b28800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:43:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.070+0000 7f3e667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431675 cookie 94153050373184 notifier 9099 bl.length()=191 2024-09-14T11:43:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.070+0000 7f3e667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:43:38.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.070+0000 7f3e667fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:43:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.072+0000 7f3f86b28800 10 cache put: name=default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR info.flags=0x7 2024-09-14T11:43:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.072+0000 7f3f86b28800 10 moving default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR to cache LRU end 2024-09-14T11:43:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.072+0000 7f3f86b28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:ZHFUFGJDHXESTDJUXOYR, ofs0, ns] 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.072+0000 7f3e667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431766 cookie 94153050371056 notifier 9099 bl.length()=189 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.072+0000 7f3e667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR info.flags=0x7 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.072+0000 7f3e667fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZHFUFGJDHXESTDJUXOYR to cache LRU end 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "foobar.client.0", 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "foobar+test@test.test", 2024-09-14T11:43:38.071 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "foobar.client.0", 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "ZHFUFGJDHXESTDJUXOYR", 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "2H8VhEf9e81fzxgECROmI5IcaeWNYwoOu1tSsYrKNVZgEXzVHXDeVg==", 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:38.067684Z" 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:43:38.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:38.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:38.067664Z", 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:38.074 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.074+0000 7f3e397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.076+0000 7f3f86b28800 20 remove_watcher() i=0 2024-09-14T11:43:38.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.076+0000 7f3f86b28800 2 removed watcher, disabling cache 2024-09-14T11:43:38.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.077+0000 7f3f86b28800 20 remove_watcher() i=1 2024-09-14T11:43:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.078+0000 7f3f86b28800 20 remove_watcher() i=2 2024-09-14T11:43:38.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.079+0000 7f3f86b28800 20 remove_watcher() i=3 2024-09-14T11:43:38.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.081+0000 7f3f86b28800 20 remove_watcher() i=4 2024-09-14T11:43:38.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.082+0000 7f3f86b28800 20 remove_watcher() i=5 2024-09-14T11:43:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.083+0000 7f3f86b28800 20 remove_watcher() i=6 2024-09-14T11:43:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.084+0000 7f3f86b28800 20 remove_watcher() i=7 2024-09-14T11:43:38.095 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 5034252944 --totp-seed 4CRFXZLOS3G2YJRLBUF44N4FOIKWKCRKEMOD2FVRQFEZ37VYUTN7IJOZCAPNS3GH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:43:38.165 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:38.165 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.203+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.204+0000 7f9892f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.204+0000 7f9892f40800 20 realm 2024-09-14T11:43:38.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.204+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.205+0000 7f9892f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.205+0000 7f9892f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.205+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.205+0000 7f9892f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.205+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.206+0000 7f9892f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.206+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.206+0000 7f9892f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:38.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.206+0000 7f9892f40800 20 searching for the correct realm 2024-09-14T11:43:38.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.209+0000 7f988f4ee640 0 -- 172.21.15.7:0/1121709773 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f9884065b40 msgr2=0x7f988407d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.416+0000 7f988e4ec640 0 -- 172.21.15.7:0/1121709773 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f9880041960 msgr2=0x7f988003e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.623+0000 7f9892f40800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.623+0000 7f9892f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.623+0000 7f9892f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.623+0000 7f9892f40800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.623+0000 7f9892f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.623+0000 7f9892f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.624+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.624+0000 7f9892f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.624+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.624+0000 7f9892f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.624+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 20 zone default found 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 4 Realm: () 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:38.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 20 zonegroup default 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.625+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.626+0000 7f9892f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.626+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.626+0000 7f9892f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.626+0000 7f9892f40800 20 started sync module instance, tier type = 2024-09-14T11:43:38.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.626+0000 7f9892f40800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.637+0000 7f9892f40800 20 add_watcher() i=0 2024-09-14T11:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.637+0000 7f9892f40800 20 add_watcher() i=1 2024-09-14T11:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.637+0000 7f9892f40800 20 add_watcher() i=2 2024-09-14T11:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.637+0000 7f9892f40800 20 add_watcher() i=3 2024-09-14T11:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.637+0000 7f9892f40800 20 add_watcher() i=4 2024-09-14T11:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.637+0000 7f9892f40800 20 add_watcher() i=5 2024-09-14T11:43:38.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.637+0000 7f9892f40800 20 add_watcher() i=6 2024-09-14T11:43:38.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.638+0000 7f9892f40800 20 add_watcher() i=7 2024-09-14T11:43:38.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.638+0000 7f9892f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.640+0000 7f9745fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.640+0000 7f9892f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.640+0000 7f9892f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.640+0000 7f9892f40800 5 note: GC not initialized 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.640+0000 7f9744fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.640+0000 7f9892f40800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.640+0000 7f9892f40800 20 Filter name: none 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.641+0000 7f973dffb640 20 reqs_thread_entry: start 2024-09-14T11:43:38.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.641+0000 7f9892f40800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:43:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.641+0000 7f9892f40800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.641+0000 7f9892f40800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:43:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.641+0000 7f9892f40800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:43:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.641+0000 7f9892f40800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.641+0000 7f9892f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.644+0000 7f9892f40800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:43:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.644+0000 7f9892f40800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.644+0000 7f9892f40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:43:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.644+0000 7f97727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94602156243664 notifier 8594 bl.length()=674 2024-09-14T11:43:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.644+0000 7f97727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:43:38.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.644+0000 7f97727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.646+0000 7f9745fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:38.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.648+0000 7f9892f40800 20 remove_watcher() i=0 2024-09-14T11:43:38.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.648+0000 7f9892f40800 2 removed watcher, disabling cache 2024-09-14T11:43:38.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.650+0000 7f9892f40800 20 remove_watcher() i=1 2024-09-14T11:43:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.651+0000 7f9892f40800 20 remove_watcher() i=2 2024-09-14T11:43:38.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.652+0000 7f9892f40800 20 remove_watcher() i=3 2024-09-14T11:43:38.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.653+0000 7f9892f40800 20 remove_watcher() i=4 2024-09-14T11:43:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.654+0000 7f9892f40800 20 remove_watcher() i=5 2024-09-14T11:43:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.656+0000 7f9892f40800 20 remove_watcher() i=6 2024-09-14T11:43:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.657+0000 7f9892f40800 20 remove_watcher() i=7 2024-09-14T11:43:38.668 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:43:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:38.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.770+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 20 realm 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.772+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.773+0000 7fc268b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.773+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.774+0000 7fc268b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:38.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.774+0000 7fc268b2c800 20 searching for the correct realm 2024-09-14T11:43:38.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.774+0000 7fc26484f640 0 -- 172.21.15.7:0/1538514931 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x560ba9c67d00 msgr2=0x560ba9c6a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:38.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.778+0000 7fc26484f640 0 -- 172.21.15.7:0/1538514931 >> [v2:172.21.15.7:6800/3296984494,v1:172.21.15.7:6801/3296984494] conn(0x560ba9c5b1f0 msgr2=0x560ba9c5d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.785+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 zone default found 2024-09-14T11:43:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 4 Realm: () 2024-09-14T11:43:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 zonegroup default 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.786+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.787+0000 7fc268b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.787+0000 7fc268b2c800 20 started sync module instance, tier type = 2024-09-14T11:43:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.787+0000 7fc268b2c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.796+0000 7fc268b2c800 20 add_watcher() i=0 2024-09-14T11:43:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.796+0000 7fc268b2c800 20 add_watcher() i=1 2024-09-14T11:43:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.796+0000 7fc268b2c800 20 add_watcher() i=2 2024-09-14T11:43:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.796+0000 7fc268b2c800 20 add_watcher() i=3 2024-09-14T11:43:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.796+0000 7fc268b2c800 20 add_watcher() i=4 2024-09-14T11:43:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.796+0000 7fc268b2c800 20 add_watcher() i=5 2024-09-14T11:43:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.796+0000 7fc268b2c800 20 add_watcher() i=6 2024-09-14T11:43:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.797+0000 7fc268b2c800 20 add_watcher() i=7 2024-09-14T11:43:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.797+0000 7fc268b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc11afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc268b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc268b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc268b2c800 5 note: GC not initialized 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc119fe3640 20 reqs_thread_entry: start 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc268b2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc268b2c800 20 Filter name: none 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc08b7fe640 20 reqs_thread_entry: start 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc268b2c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.799+0000 7fc268b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.800+0000 7fc268b2c800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.800+0000 7fc268b2c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.800+0000 7fc268b2c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.800+0000 7fc268b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.802+0000 7fc268b2c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:43:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.802+0000 7fc268b2c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.802+0000 7fc268b2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:43:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.802+0000 7fc13bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94608093005712 notifier 9135 bl.length()=727 2024-09-14T11:43:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.802+0000 7fc13bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:43:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.802+0000 7fc13bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:43:38.801 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "foobar.client.0", 2024-09-14T11:43:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:43:38.801 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "foobar+test@test.test", 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "foobar.client.0", 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "ZHFUFGJDHXESTDJUXOYR", 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "2H8VhEf9e81fzxgECROmI5IcaeWNYwoOu1tSsYrKNVZgEXzVHXDeVg==", 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:38.067684Z" 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:38.802 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [ 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "oidc-provider", 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "perm": "*" 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "roles", 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "perm": "*" 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "user-policy", 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: "perm": "*" 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:38.803 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:43:38.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "rgw", 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [ 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "5034252944" 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "", 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:43:38.805 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:38.067664Z", 2024-09-14T11:43:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:43:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:43:38.806 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:38.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:38.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.803+0000 7fc11afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:38.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.806+0000 7fc268b2c800 20 remove_watcher() i=0 2024-09-14T11:43:38.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.806+0000 7fc268b2c800 2 removed watcher, disabling cache 2024-09-14T11:43:38.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.807+0000 7fc268b2c800 20 remove_watcher() i=1 2024-09-14T11:43:38.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.808+0000 7fc268b2c800 20 remove_watcher() i=2 2024-09-14T11:43:38.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.809+0000 7fc268b2c800 20 remove_watcher() i=3 2024-09-14T11:43:38.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.810+0000 7fc268b2c800 20 remove_watcher() i=4 2024-09-14T11:43:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.811+0000 7fc268b2c800 20 remove_watcher() i=5 2024-09-14T11:43:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.812+0000 7fc268b2c800 20 remove_watcher() i=6 2024-09-14T11:43:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.813+0000 7fc268b2c800 20 remove_watcher() i=7 2024-09-14T11:43:38.823 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:43:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.922+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 20 realm 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:38.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.924+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.925+0000 7fdff7c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:38.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.925+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:38.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.926+0000 7fdff7c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:38.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.926+0000 7fdff7c0e800 20 searching for the correct realm 2024-09-14T11:43:38.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:38.928+0000 7fdff3259640 0 -- 172.21.15.7:0/3394555104 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fdfec069d50 msgr2=0x7fdfec0687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:39.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.134+0000 7fdff3259640 0 -- 172.21.15.7:0/3394555104 >> [v2:172.21.15.189:6808/2808372927,v1:172.21.15.189:6809/2808372927] conn(0x7fdfec069d50 msgr2=0x7fdfec0687c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.138+0000 7fdff7c0e800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.138+0000 7fdff7c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.138+0000 7fdff7c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.138+0000 7fdff7c0e800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.138+0000 7fdff7c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.138+0000 7fdff7c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.138+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 zone default found 2024-09-14T11:43:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 4 Realm: () 2024-09-14T11:43:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 zonegroup default 2024-09-14T11:43:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.139+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.140+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.140+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.337+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.337+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.337+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.337+0000 7fdff7c0e800 20 started sync module instance, tier type = 2024-09-14T11:43:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.337+0000 7fdff7c0e800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.347+0000 7fdff7c0e800 20 add_watcher() i=0 2024-09-14T11:43:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.347+0000 7fdff7c0e800 20 add_watcher() i=1 2024-09-14T11:43:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.347+0000 7fdff7c0e800 20 add_watcher() i=2 2024-09-14T11:43:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.347+0000 7fdff7c0e800 20 add_watcher() i=3 2024-09-14T11:43:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.347+0000 7fdff7c0e800 20 add_watcher() i=4 2024-09-14T11:43:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.347+0000 7fdff7c0e800 20 add_watcher() i=5 2024-09-14T11:43:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.347+0000 7fdff7c0e800 20 add_watcher() i=6 2024-09-14T11:43:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.348+0000 7fdff7c0e800 20 add_watcher() i=7 2024-09-14T11:43:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.348+0000 7fdff7c0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdff7c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdff7c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdff7c0e800 5 note: GC not initialized 2024-09-14T11:43:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdea8fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdff7c0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdff7c0e800 20 Filter name: none 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fde227fc640 20 reqs_thread_entry: start 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdff7c0e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.351+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:43:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:43:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:43:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:43:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:43:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:43:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.352+0000 7fdff7c0e800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:43:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.354+0000 7fdff7c0e800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:43:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.354+0000 7fdff7c0e800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:43:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.354+0000 7fdff7c0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:43:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.354+0000 7fded6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431676 cookie 94273227026656 notifier 9150 bl.length()=384 2024-09-14T11:43:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.354+0000 7fded6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:43:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.354+0000 7fded6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:43:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.356+0000 7fdff7c0e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:43:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.356+0000 7fdff7c0e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:43:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.356+0000 7fdff7c0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:43:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.357+0000 7fded6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431767 cookie 94273227039856 notifier 9150 bl.length()=225 2024-09-14T11:43:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.357+0000 7fded6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:43:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.357+0000 7fded6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:43:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.359+0000 7fdff7c0e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:43:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.359+0000 7fdff7c0e800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:43:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.359+0000 7fdff7c0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:43:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.359+0000 7fded6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431667 cookie 94273227031280 notifier 9150 bl.length()=234 2024-09-14T11:43:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.359+0000 7fded6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:43:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.359+0000 7fded6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:43:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.360+0000 7fdea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.363+0000 7fdff7c0e800 20 remove_watcher() i=0 2024-09-14T11:43:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.363+0000 7fdff7c0e800 2 removed watcher, disabling cache 2024-09-14T11:43:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.364+0000 7fdff7c0e800 20 remove_watcher() i=1 2024-09-14T11:43:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.365+0000 7fdff7c0e800 20 remove_watcher() i=2 2024-09-14T11:43:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.366+0000 7fdff7c0e800 20 remove_watcher() i=3 2024-09-14T11:43:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.367+0000 7fdff7c0e800 20 remove_watcher() i=4 2024-09-14T11:43:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.368+0000 7fdff7c0e800 20 remove_watcher() i=5 2024-09-14T11:43:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.370+0000 7fdff7c0e800 20 remove_watcher() i=6 2024-09-14T11:43:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.371+0000 7fdff7c0e800 20 remove_watcher() i=7 2024-09-14T11:43:39.379 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "RGW88888888888888888", 2024-09-14T11:43:39.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tenant": "", 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "quota": { 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:39.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_users": 1000, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_roles": 1000, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_groups": 1000, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max_access_keys": 4 2024-09-14T11:43:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:39.383 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:43:39.383 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key IASBAQWMRCIKJYTMFSQJ --secret oNF6lfcNpezOzrqQrz6KwQ+uDqBxfv608e7RsDBhlLwap2fubuTh0w== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:39.457 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:39.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.494+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 20 realm 2024-09-14T11:43:39.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:39.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.496+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.498+0000 7f048d32f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:39.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.498+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.498+0000 7f048d32f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:39.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.498+0000 7f048d32f800 20 searching for the correct realm 2024-09-14T11:43:39.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.500+0000 7f0489877640 0 -- 172.21.15.7:0/3647474843 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f0480055020 msgr2=0x7f048003a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:39.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.707+0000 7f0488875640 0 -- 172.21.15.7:0/3647474843 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f047c028040 msgr2=0x7f047c039940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.916+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 20 zone default found 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 4 Realm: () 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 20 zonegroup default 2024-09-14T11:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.917+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.918+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.918+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.918+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.918+0000 7f048d32f800 20 started sync module instance, tier type = 2024-09-14T11:43:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.918+0000 7f048d32f800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.929+0000 7f048d32f800 20 add_watcher() i=0 2024-09-14T11:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.929+0000 7f048d32f800 20 add_watcher() i=1 2024-09-14T11:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.929+0000 7f048d32f800 20 add_watcher() i=2 2024-09-14T11:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.929+0000 7f048d32f800 20 add_watcher() i=3 2024-09-14T11:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.929+0000 7f048d32f800 20 add_watcher() i=4 2024-09-14T11:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.929+0000 7f048d32f800 20 add_watcher() i=5 2024-09-14T11:43:39.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.929+0000 7f048d32f800 20 add_watcher() i=6 2024-09-14T11:43:39.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.930+0000 7f048d32f800 20 add_watcher() i=7 2024-09-14T11:43:39.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.930+0000 7f048d32f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:39.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.932+0000 7f033f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:39.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.932+0000 7f048d32f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:39.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.932+0000 7f048d32f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:39.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.932+0000 7f048d32f800 5 note: GC not initialized 2024-09-14T11:43:39.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.932+0000 7f033e7e4640 20 reqs_thread_entry: start 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 20 Filter name: none 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f02affff640 20 reqs_thread_entry: start 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:43:39.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.933+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:43:39.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:43:39.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 10 cache get: name=default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ : miss 2024-09-14T11:43:39.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:39.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 10 cache put: name=default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ info.flags=0x0 2024-09-14T11:43:39.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 10 adding default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ to cache LRU end 2024-09-14T11:43:39.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:43:39.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.934+0000 7f048d32f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.935+0000 7f048d32f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.935+0000 7f048d32f800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.935+0000 7f048d32f800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.935+0000 7f048d32f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.935+0000 7f048d32f800 10 cache get: name=default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ : hit (negative entry) 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.935+0000 7f048d32f800 10 cache get: name=default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ : hit (negative entry) 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.936+0000 7f048d32f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.936+0000 7f048d32f800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:43:39.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.936+0000 7f048d32f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:43:39.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.937+0000 7f036cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431677 cookie 94771249981824 notifier 8645 bl.length()=681 2024-09-14T11:43:39.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.937+0000 7f036cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:43:39.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.937+0000 7f036cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:43:39.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.939+0000 7f048d32f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:43:39.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.939+0000 7f048d32f800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:43:39.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.939+0000 7f048d32f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:43:39.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.939+0000 7f036cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431787 cookie 94771249999264 notifier 8645 bl.length()=189 2024-09-14T11:43:39.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.939+0000 7f036cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:43:39.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.939+0000 7f036cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:43:39.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.941+0000 7f048d32f800 10 cache put: name=default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ info.flags=0x7 2024-09-14T11:43:39.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.941+0000 7f048d32f800 10 moving default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ to cache LRU end 2024-09-14T11:43:39.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.941+0000 7f048d32f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:IASBAQWMRCIKJYTMFSQJ, ofs0, ns] 2024-09-14T11:43:39.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.941+0000 7f036cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94771249992848 notifier 8645 bl.length()=188 2024-09-14T11:43:39.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.941+0000 7f036cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ info.flags=0x7 2024-09-14T11:43:39.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.941+0000 7f036cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IASBAQWMRCIKJYTMFSQJ to cache LRU end 2024-09-14T11:43:39.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.943+0000 7f048d32f800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:43:39.942 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:39.942 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "root1.client.0", 2024-09-14T11:43:39.942 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:43:39.942 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "root1+test@test.test", 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "root1.client.0", 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "IASBAQWMRCIKJYTMFSQJ", 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "oNF6lfcNpezOzrqQrz6KwQ+uDqBxfv608e7RsDBhlLwap2fubuTh0w==", 2024-09-14T11:43:39.943 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:39.936620Z" 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:43:39.944 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:39.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "root", 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:39.936603Z", 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:43:39.946 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:39.947 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:39.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.944+0000 7f033f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:39.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.947+0000 7f048d32f800 20 remove_watcher() i=0 2024-09-14T11:43:39.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.947+0000 7f048d32f800 2 removed watcher, disabling cache 2024-09-14T11:43:39.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.948+0000 7f048d32f800 20 remove_watcher() i=1 2024-09-14T11:43:39.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.949+0000 7f048d32f800 20 remove_watcher() i=2 2024-09-14T11:43:39.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.951+0000 7f048d32f800 20 remove_watcher() i=3 2024-09-14T11:43:39.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.952+0000 7f048d32f800 20 remove_watcher() i=4 2024-09-14T11:43:39.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.953+0000 7f048d32f800 20 remove_watcher() i=5 2024-09-14T11:43:39.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.954+0000 7f048d32f800 20 remove_watcher() i=6 2024-09-14T11:43:39.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:39.955+0000 7f048d32f800 20 remove_watcher() i=7 2024-09-14T11:43:39.966 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0823816185 --totp-seed SEZOGLHZQAX7V347CWLY6Y36CP2A6CBPPR4WBJHWR662TIGCX76NCQAJOFIN6WVS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:43:40.037 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:40.038 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:40.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.076+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 20 realm 2024-09-14T11:43:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:40.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.077+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.078+0000 7f8df3f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.078+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.079+0000 7f8df3f37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.079+0000 7f8df3f37800 20 searching for the correct realm 2024-09-14T11:43:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.081+0000 7f8df0422640 0 -- 172.21.15.7:0/1135441143 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f8de40a9400 msgr2=0x7f8de40a9840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:40.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.287+0000 7f8def420640 0 -- 172.21.15.7:0/1135441143 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f8de001f4d0 msgr2=0x7f8de0044780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:40.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.493+0000 7f8df3f37800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:40.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.493+0000 7f8df3f37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:40.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.493+0000 7f8df3f37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:40.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.493+0000 7f8df3f37800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.493+0000 7f8df3f37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.493+0000 7f8df3f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.493+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.494+0000 7f8df3f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.494+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.494+0000 7f8df3f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.494+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 zone default found 2024-09-14T11:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 4 Realm: () 2024-09-14T11:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 zonegroup default 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.495+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.496+0000 7f8df3f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.496+0000 7f8df3f37800 20 started sync module instance, tier type = 2024-09-14T11:43:40.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.496+0000 7f8df3f37800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.507+0000 7f8df3f37800 20 add_watcher() i=0 2024-09-14T11:43:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.507+0000 7f8df3f37800 20 add_watcher() i=1 2024-09-14T11:43:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.507+0000 7f8df3f37800 20 add_watcher() i=2 2024-09-14T11:43:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.507+0000 7f8df3f37800 20 add_watcher() i=3 2024-09-14T11:43:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.507+0000 7f8df3f37800 20 add_watcher() i=4 2024-09-14T11:43:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.507+0000 7f8df3f37800 20 add_watcher() i=5 2024-09-14T11:43:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.507+0000 7f8df3f37800 20 add_watcher() i=6 2024-09-14T11:43:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.508+0000 7f8df3f37800 20 add_watcher() i=7 2024-09-14T11:43:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.508+0000 7f8df3f37800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.510+0000 7f8ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.510+0000 7f8df3f37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.510+0000 7f8df3f37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.510+0000 7f8df3f37800 5 note: GC not initialized 2024-09-14T11:43:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.510+0000 7f8ca4fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.510+0000 7f8df3f37800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8df3f37800 20 Filter name: none 2024-09-14T11:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8c1e7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8df3f37800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8df3f37800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8df3f37800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8df3f37800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8df3f37800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.511+0000 7f8df3f37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.514+0000 7f8df3f37800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:43:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.514+0000 7f8df3f37800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:43:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.514+0000 7f8df3f37800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:43:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.514+0000 7f8cceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431678 cookie 94846536215840 notifier 8663 bl.length()=695 2024-09-14T11:43:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.514+0000 7f8cceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:43:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.514+0000 7f8cceffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:43:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.515+0000 7f8ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:40.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.519+0000 7f8df3f37800 20 remove_watcher() i=0 2024-09-14T11:43:40.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.519+0000 7f8df3f37800 2 removed watcher, disabling cache 2024-09-14T11:43:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.520+0000 7f8df3f37800 20 remove_watcher() i=1 2024-09-14T11:43:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.521+0000 7f8df3f37800 20 remove_watcher() i=2 2024-09-14T11:43:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.522+0000 7f8df3f37800 20 remove_watcher() i=3 2024-09-14T11:43:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.523+0000 7f8df3f37800 20 remove_watcher() i=4 2024-09-14T11:43:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.524+0000 7f8df3f37800 20 remove_watcher() i=5 2024-09-14T11:43:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.525+0000 7f8df3f37800 20 remove_watcher() i=6 2024-09-14T11:43:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.526+0000 7f8df3f37800 20 remove_watcher() i=7 2024-09-14T11:43:40.537 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.639+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 20 realm 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.641+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.642+0000 7fe7c7b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.642+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.643+0000 7fe7c7b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.643+0000 7fe7c7b0c800 20 searching for the correct realm 2024-09-14T11:43:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.644+0000 7fe7c55f6640 0 -- 172.21.15.7:0/157953813 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x55fe15f49790 msgr2=0x55fe15f4bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:40.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.647+0000 7fe7c5df7640 0 -- 172.21.15.7:0/157953813 >> [v2:172.21.15.7:6800/3296984494,v1:172.21.15.7:6801/3296984494] conn(0x55fe15f3cd10 msgr2=0x55fe15f3f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 zone default found 2024-09-14T11:43:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 4 Realm: () 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 zonegroup default 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.655+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.656+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.656+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.656+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.656+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.656+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.656+0000 7fe7c7b0c800 20 started sync module instance, tier type = 2024-09-14T11:43:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.656+0000 7fe7c7b0c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.665+0000 7fe7c7b0c800 20 add_watcher() i=0 2024-09-14T11:43:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.665+0000 7fe7c7b0c800 20 add_watcher() i=1 2024-09-14T11:43:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.665+0000 7fe7c7b0c800 20 add_watcher() i=2 2024-09-14T11:43:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.665+0000 7fe7c7b0c800 20 add_watcher() i=3 2024-09-14T11:43:40.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.665+0000 7fe7c7b0c800 20 add_watcher() i=4 2024-09-14T11:43:40.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.665+0000 7fe7c7b0c800 20 add_watcher() i=5 2024-09-14T11:43:40.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.666+0000 7fe7c7b0c800 20 add_watcher() i=6 2024-09-14T11:43:40.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.666+0000 7fe7c7b0c800 20 add_watcher() i=7 2024-09-14T11:43:40.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.666+0000 7fe7c7b0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.668+0000 7fe67b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.668+0000 7fe7c7b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.668+0000 7fe7c7b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.668+0000 7fe7c7b0c800 5 note: GC not initialized 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.668+0000 7fe67a7e4640 20 reqs_thread_entry: start 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 20 Filter name: none 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe5ebfff640 20 reqs_thread_entry: start 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:43:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:43:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:43:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:43:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.669+0000 7fe7c7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.670+0000 7fe7c7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.670+0000 7fe7c7b0c800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:43:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.670+0000 7fe7c7b0c800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:43:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.670+0000 7fe7c7b0c800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:43:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.671+0000 7fe7c7b0c800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:43:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.671+0000 7fe7c7b0c800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:43:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.671+0000 7fe7c7b0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:43:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.671+0000 7fe6a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431679 cookie 94549778358160 notifier 9207 bl.length()=384 2024-09-14T11:43:40.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.671+0000 7fe6a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:43:40.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.671+0000 7fe6a8ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:43:40.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.673+0000 7fe7c7b0c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:43:40.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.673+0000 7fe7c7b0c800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:43:40.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.673+0000 7fe7c7b0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:43:40.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.673+0000 7fe6a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431768 cookie 94549778417424 notifier 9207 bl.length()=225 2024-09-14T11:43:40.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.673+0000 7fe6a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:43:40.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.673+0000 7fe6a8ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:43:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.675+0000 7fe7c7b0c800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:43:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.675+0000 7fe7c7b0c800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:43:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.675+0000 7fe7c7b0c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:43:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.676+0000 7fe697fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431669 cookie 94549778409600 notifier 9207 bl.length()=234 2024-09-14T11:43:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.676+0000 7fe697fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:43:40.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.676+0000 7fe697fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:43:40.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.677+0000 7fe67b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:40.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.679+0000 7fe7c7b0c800 20 remove_watcher() i=0 2024-09-14T11:43:40.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.679+0000 7fe7c7b0c800 2 removed watcher, disabling cache 2024-09-14T11:43:40.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.680+0000 7fe7c7b0c800 20 remove_watcher() i=1 2024-09-14T11:43:40.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.681+0000 7fe7c7b0c800 20 remove_watcher() i=2 2024-09-14T11:43:40.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.682+0000 7fe7c7b0c800 20 remove_watcher() i=3 2024-09-14T11:43:40.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.683+0000 7fe7c7b0c800 20 remove_watcher() i=4 2024-09-14T11:43:40.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.685+0000 7fe7c7b0c800 20 remove_watcher() i=5 2024-09-14T11:43:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.685+0000 7fe7c7b0c800 20 remove_watcher() i=6 2024-09-14T11:43:40.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.686+0000 7fe7c7b0c800 20 remove_watcher() i=7 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "RGW99999999999999999", 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tenant": "", 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "quota": { 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:40.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_users": 1000, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_roles": 1000, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_groups": 1000, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max_access_keys": 4 2024-09-14T11:43:40.695 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:40.696 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:43:40.697 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key YMJMCSFTTLIJCQZEJOPC --secret wzPoEORQFz/ERclD8YrE/U+mpK4b7Bq+sjhti76UKCnEcDkhvGKGEw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:43:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:40.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.804+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.805+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.805+0000 7fbe0f728800 20 realm 2024-09-14T11:43:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.805+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.806+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.806+0000 7fbe0f728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.806+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.806+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.806+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.807+0000 7fbe0f728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:40.807+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.010+0000 7fbe0f728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:41.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.010+0000 7fbe0f728800 20 searching for the correct realm 2024-09-14T11:43:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.011+0000 7fbe0bcd7640 0 -- 172.21.15.7:0/700333313 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fbe0006d620 msgr2=0x7fbe0006c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.217+0000 7fbe0acd5640 0 -- 172.21.15.7:0/700333313 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fbdfc0dd120 msgr2=0x7fbdfc0a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.425+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 zone default found 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 4 Realm: () 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 zonegroup default 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.426+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.427+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.427+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.427+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.427+0000 7fbe0f728800 20 started sync module instance, tier type = 2024-09-14T11:43:41.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.427+0000 7fbe0f728800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.438+0000 7fbe0f728800 20 add_watcher() i=0 2024-09-14T11:43:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.438+0000 7fbe0f728800 20 add_watcher() i=1 2024-09-14T11:43:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.438+0000 7fbe0f728800 20 add_watcher() i=2 2024-09-14T11:43:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.438+0000 7fbe0f728800 20 add_watcher() i=3 2024-09-14T11:43:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.438+0000 7fbe0f728800 20 add_watcher() i=4 2024-09-14T11:43:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.438+0000 7fbe0f728800 20 add_watcher() i=5 2024-09-14T11:43:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.438+0000 7fbe0f728800 20 add_watcher() i=6 2024-09-14T11:43:41.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.440+0000 7fbe0f728800 20 add_watcher() i=7 2024-09-14T11:43:41.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.440+0000 7fbe0f728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:41.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.442+0000 7fbcc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.442+0000 7fbe0f728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:41.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.442+0000 7fbe0f728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:41.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.442+0000 7fbe0f728800 5 note: GC not initialized 2024-09-14T11:43:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.442+0000 7fbcc0fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.442+0000 7fbe0f728800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 20 Filter name: none 2024-09-14T11:43:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbc3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:43:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.443+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 10 cache get: name=default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC : miss 2024-09-14T11:43:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 10 cache put: name=default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC info.flags=0x0 2024-09-14T11:43:41.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 10 adding default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC to cache LRU end 2024-09-14T11:43:41.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:43:41.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.444+0000 7fbe0f728800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.445+0000 7fbe0f728800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:43:41.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.445+0000 7fbe0f728800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:43:41.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.445+0000 7fbe0f728800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:43:41.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.445+0000 7fbe0f728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:41.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.445+0000 7fbe0f728800 10 cache get: name=default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC : hit (negative entry) 2024-09-14T11:43:41.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.445+0000 7fbe0f728800 10 cache get: name=default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC : hit (negative entry) 2024-09-14T11:43:41.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.447+0000 7fbe0f728800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:43:41.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.447+0000 7fbe0f728800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:43:41.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.447+0000 7fbe0f728800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:43:41.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.448+0000 7fbceeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431680 cookie 94071884325984 notifier 8696 bl.length()=681 2024-09-14T11:43:41.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.448+0000 7fbceeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:43:41.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.448+0000 7fbceeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:43:41.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.450+0000 7fbe0f728800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:43:41.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.450+0000 7fbe0f728800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:43:41.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.450+0000 7fbe0f728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:43:41.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.450+0000 7fbceeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431788 cookie 94071884341968 notifier 8696 bl.length()=189 2024-09-14T11:43:41.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.450+0000 7fbceeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:43:41.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.450+0000 7fbceeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:43:41.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.452+0000 7fbe0f728800 10 cache put: name=default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC info.flags=0x7 2024-09-14T11:43:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.452+0000 7fbe0f728800 10 moving default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC to cache LRU end 2024-09-14T11:43:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.452+0000 7fbe0f728800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:YMJMCSFTTLIJCQZEJOPC, ofs0, ns] 2024-09-14T11:43:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.452+0000 7fbceeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94071884333664 notifier 8696 bl.length()=188 2024-09-14T11:43:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.453+0000 7fbceeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC info.flags=0x7 2024-09-14T11:43:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.453+0000 7fbceeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YMJMCSFTTLIJCQZEJOPC to cache LRU end 2024-09-14T11:43:41.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.455+0000 7fbe0f728800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:43:41.453 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "user_id": "root2.client.0", 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "email": "root2+test@test.test", 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "suspended": 0, 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max_buckets": 1000, 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "subusers": [], 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "keys": [ 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "user": "root2.client.0", 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "YMJMCSFTTLIJCQZEJOPC", 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "wzPoEORQFz/ERclD8YrE/U+mpK4b7Bq+sjhti76UKCnEcDkhvGKGEw==", 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "active": true, 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:41.446686Z" 2024-09-14T11:43:41.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "swift_keys": [], 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": [], 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "op_mask": "read, write, delete", 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_storage_class": "", 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_tags": [], 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:41.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "temp_url_keys": [], 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "root", 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "mfa_ids": [], 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "create_date": "2024-09-14T11:43:41.446669Z", 2024-09-14T11:43:41.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-14T11:43:41.457 INFO:teuthology.orchestra.run.smithi007.stdout: "group_ids": [] 2024-09-14T11:43:41.457 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:43:41.457 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:43:41.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.456+0000 7fbcc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.458+0000 7fbe0f728800 20 remove_watcher() i=0 2024-09-14T11:43:41.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.458+0000 7fbe0f728800 2 removed watcher, disabling cache 2024-09-14T11:43:41.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.460+0000 7fbe0f728800 20 remove_watcher() i=1 2024-09-14T11:43:41.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.461+0000 7fbe0f728800 20 remove_watcher() i=2 2024-09-14T11:43:41.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.462+0000 7fbe0f728800 20 remove_watcher() i=3 2024-09-14T11:43:41.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.464+0000 7fbe0f728800 20 remove_watcher() i=4 2024-09-14T11:43:41.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.465+0000 7fbe0f728800 20 remove_watcher() i=5 2024-09-14T11:43:41.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.466+0000 7fbe0f728800 20 remove_watcher() i=6 2024-09-14T11:43:41.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.467+0000 7fbe0f728800 20 remove_watcher() i=7 2024-09-14T11:43:41.480 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 6691907884 --totp-seed QW5AHQED4AOPPYUHH7HG4PU22J6PNNIR7YKM2AMJU7CSZOKEMHKG6BVPBYIIUXRW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:43:41.552 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:41.552 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:41.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.593+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.594+0000 7efec232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.594+0000 7efec232c800 20 realm 2024-09-14T11:43:41.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.594+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.594+0000 7efec232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.594+0000 7efec232c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.594+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.595+0000 7efec232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.595+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.595+0000 7efec232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.596+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.596+0000 7efec232c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:41.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.596+0000 7efec232c800 20 searching for the correct realm 2024-09-14T11:43:41.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.598+0000 7efebe762640 0 -- 172.21.15.7:0/457154340 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7efea801c040 msgr2=0x7efea8066f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.603+0000 7efeb5760640 0 -- 172.21.15.7:0/457154340 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7efeb0083bc0 msgr2=0x7efeb006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.810+0000 7efec232c800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.810+0000 7efec232c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.810+0000 7efec232c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.810+0000 7efec232c800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.810+0000 7efec232c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.811+0000 7efec232c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.811+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.811+0000 7efec232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.811+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.811+0000 7efec232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.811+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 zone default found 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 4 Realm: () 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 zonegroup default 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.812+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.813+0000 7efec232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.813+0000 7efec232c800 20 started sync module instance, tier type = 2024-09-14T11:43:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.813+0000 7efec232c800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.824+0000 7efec232c800 20 add_watcher() i=0 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.824+0000 7efec232c800 20 add_watcher() i=1 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.824+0000 7efec232c800 20 add_watcher() i=2 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.824+0000 7efec232c800 20 add_watcher() i=3 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.824+0000 7efec232c800 20 add_watcher() i=4 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.824+0000 7efec232c800 20 add_watcher() i=5 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.824+0000 7efec232c800 20 add_watcher() i=6 2024-09-14T11:43:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.825+0000 7efec232c800 20 add_watcher() i=7 2024-09-14T11:43:41.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.825+0000 7efec232c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.827+0000 7efd73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.827+0000 7efec232c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.827+0000 7efec232c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.827+0000 7efec232c800 5 note: GC not initialized 2024-09-14T11:43:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.827+0000 7efd72fe5640 20 reqs_thread_entry: start 2024-09-14T11:43:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.827+0000 7efec232c800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efec232c800 20 Filter name: none 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efd70fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efec232c800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efec232c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efec232c800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efec232c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efec232c800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:43:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.828+0000 7efec232c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.831+0000 7efec232c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:43:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.831+0000 7efec232c800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:43:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.831+0000 7efec232c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:43:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.831+0000 7efda17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431681 cookie 94201919241024 notifier 9243 bl.length()=695 2024-09-14T11:43:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.831+0000 7efda17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:43:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.831+0000 7efda17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:43:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.833+0000 7efd73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.835+0000 7efec232c800 20 remove_watcher() i=0 2024-09-14T11:43:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.835+0000 7efec232c800 2 removed watcher, disabling cache 2024-09-14T11:43:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.836+0000 7efec232c800 20 remove_watcher() i=1 2024-09-14T11:43:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.837+0000 7efec232c800 20 remove_watcher() i=2 2024-09-14T11:43:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.838+0000 7efec232c800 20 remove_watcher() i=3 2024-09-14T11:43:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.839+0000 7efec232c800 20 remove_watcher() i=4 2024-09-14T11:43:41.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.841+0000 7efec232c800 20 remove_watcher() i=5 2024-09-14T11:43:41.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.842+0000 7efec232c800 20 remove_watcher() i=6 2024-09-14T11:43:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:43:41.843+0000 7efec232c800 20 remove_watcher() i=7 2024-09-14T11:43:41.853 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:43:41.854 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:43:41.854 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:43:41.883 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:43:41.883 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:43:41.883 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:43:41.953 DEBUG:teuthology.orchestra.run.smithi007:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:43:42.136 INFO:teuthology.orchestra.run.smithi007.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:43:42.323 INFO:teuthology.orchestra.run.smithi007.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:43:42.622 INFO:teuthology.orchestra.run.smithi007.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:45:42.879 INFO:teuthology.orchestra.run.smithi007.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:45:44.342 INFO:teuthology.orchestra.run.smithi007.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=800c9bb3fc26a56ba8d31f714b60bc29bc632a73d98630a769c67c7549ae1f42,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:45:44.342 INFO:teuthology.orchestra.run.smithi007.stdout:py run-test-pre: PYTHONHASHSEED='3586857366' 2024-09-14T11:45:44.342 INFO:teuthology.orchestra.run.smithi007.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:45:44.483 INFO:teuthology.orchestra.run.smithi007.stdout:============================= test session starts ============================== 2024-09-14T11:45:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:45:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:45:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:45:44.484 INFO:teuthology.orchestra.run.smithi007.stdout:configfile: pytest.ini 2024-09-14T11:45:46.307 INFO:teuthology.orchestra.run.smithi007.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:45:46.307 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:45:46.639 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:45:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:45:46.989 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:45:47.158 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:45:47.333 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:45:47.458 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:45:47.631 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:45:47.752 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:45:47.841 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:45:47.929 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:45:48.107 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:45:48.283 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:45:48.459 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:45:48.637 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:45:48.724 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:45:48.812 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:45:48.858 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:45:48.904 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:45:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:45:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:45:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:45:49.091 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:45:49.137 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:45:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:45:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:45:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:45:49.323 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:45:49.369 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:45:49.416 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:45:49.463 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.510 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.557 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.604 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.652 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.699 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.746 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.793 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:45:49.840 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:45:49.887 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:45:49.934 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:45:49.981 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:45:50.029 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:45:50.077 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:45:50.124 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:45:50.171 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.218 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.265 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.312 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.360 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.408 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.455 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.503 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:45:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:45:50.995 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:45:51.570 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:45:52.621 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:45:53.712 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:45:55.485 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:45:56.053 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:45:56.829 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:45:57.065 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:45:57.202 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:45:57.421 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:45:57.638 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:45:57.981 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:45:58.179 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:45:58.424 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:45:58.425 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:45:58.426 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:45:58.427 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:45:58.428 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:45:58.428 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:45:58.429 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:45:58.430 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:45:58.431 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:45:58.432 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:45:58.433 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:45:58.436 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:45:58.437 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:45:58.437 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:45:58.437 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:45:58.437 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:45:58.438 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:45:58.438 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:45:58.439 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:45:58.440 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:45:58.441 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:45:58.441 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:45:58.442 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:45:58.443 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:45:58.444 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:45:58.445 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:45:58.445 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:45:58.446 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:45:58.535 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:45:58.551 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:45:59.154 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:46:06.715 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:46:07.123 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:46:07.610 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:46:08.058 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:46:08.499 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:46:08.980 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:46:09.331 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:46:09.802 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:46:10.192 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:46:10.621 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:46:11.046 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:46:11.380 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:46:11.721 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:46:12.025 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:46:12.450 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:46:12.874 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:46:13.345 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:46:13.766 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:46:14.149 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:46:14.571 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:46:14.986 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:46:15.371 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:46:15.747 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:46:16.122 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:46:16.414 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:46:16.749 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:46:17.041 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:46:17.334 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:46:17.626 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:46:18.129 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:46:18.421 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:46:18.733 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:46:19.123 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:46:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:46:19.824 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:46:20.260 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:46:20.658 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:46:21.151 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:46:21.517 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:46:21.917 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:46:22.314 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:46:22.920 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:46:23.396 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:46:23.856 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:46:24.297 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:24.909 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:25.369 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:25.913 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:26.411 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:26.946 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:27.391 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:46:27.933 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:46:28.422 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:46:29.407 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:46:30.134 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:46:30.995 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:46:32.697 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:46:34.971 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:46:36.243 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:46:37.420 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:46:38.338 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:46:38.938 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:46:39.997 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:46:40.771 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:46:41.775 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:46:42.491 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:46:43.757 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:46:44.737 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:46:46.180 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:46:47.547 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:46:48.473 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:46:49.337 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:46:50.078 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:46:51.758 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:46:52.960 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:46:54.391 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:46:55.781 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:46:56.995 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:46:58.200 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:46:59.157 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:46:59.885 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:47:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:47:02.231 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:47:04.215 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:47:05.139 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:47:06.442 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:47:07.749 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:47:08.916 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:47:10.143 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:47:11.478 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:47:12.765 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:47:13.984 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:47:14.827 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:47:15.543 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:47:16.269 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:47:16.989 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:47:18.087 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:47:19.297 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:47:20.417 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:47:21.542 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:47:22.702 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:47:23.834 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:47:24.954 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:47:26.173 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:47:27.302 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:47:28.470 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:47:29.597 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:47:30.721 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:47:31.488 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:47:32.256 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:47:32.968 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:47:33.692 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:47:34.278 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:47:34.888 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:47:35.379 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:47:35.905 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:47:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:47:36.819 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:47:37.307 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:47:37.766 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:47:38.277 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:47:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:47:39.893 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:47:40.367 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:47:40.820 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:47:41.280 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:47:41.737 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:47:42.580 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:47:43.414 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:47:43.873 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:47:44.377 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:47:44.838 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:47:45.324 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:47:45.859 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:47:46.309 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:47:46.777 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:47:47.263 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:47:47.716 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:47:48.165 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:47:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:47:49.140 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:47:49.591 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:47:50.037 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:47:50.484 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:47:50.948 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:47:51.443 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:47:58.918 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:47:59.404 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:47:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:48:00.374 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:48:00.850 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:48:01.298 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:48:01.748 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:48:02.227 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:48:02.753 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:48:03.231 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:48:03.711 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:48:04.200 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:48:04.651 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:48:05.114 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:48:05.598 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:48:06.091 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:48:06.576 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:48:07.061 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:48:07.551 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:48:08.041 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:48:08.527 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:48:08.978 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:48:09.466 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:48:09.958 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:48:10.497 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:48:10.982 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:48:11.443 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:48:11.931 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:48:12.455 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:48:12.755 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:48:13.181 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:48:13.950 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:48:14.754 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:48:15.208 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:48:15.713 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:48:16.162 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:48:16.649 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:48:17.148 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:48:17.658 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:48:18.142 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:48:18.641 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:48:19.180 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:48:19.631 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:48:20.086 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:48:20.590 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:48:21.253 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:48:22.024 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:48:22.495 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:48:22.943 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:48:23.332 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:48:23.733 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:48:24.026 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:48:24.321 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:48:24.615 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:48:25.055 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:48:25.510 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:48:25.853 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:48:26.282 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:48:26.828 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:48:27.249 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:48:27.633 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:48:28.351 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:48:28.950 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:48:29.585 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:48:37.135 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:48:44.561 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:48:44.991 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:48:45.430 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:48:45.853 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:48:46.291 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:48:46.812 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:48:47.275 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:48:47.699 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:48:48.185 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:48:48.590 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:48:49.025 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:48:49.503 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:48:49.990 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:48:50.432 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:48:50.830 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:48:51.292 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:48:51.720 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:48:52.219 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:48:52.730 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:48:53.124 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:48:53.522 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:48:54.036 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:48:54.513 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:48:54.904 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:48:55.304 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:48:55.699 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:48:56.135 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:48:56.564 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:48:56.962 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:48:57.415 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:48:57.811 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:48:58.245 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:48:58.679 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:48:59.117 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:48:59.680 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:49:00.129 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:49:00.563 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:49:00.958 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:49:01.359 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:49:01.791 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:49:02.200 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:49:02.615 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:49:03.047 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:49:03.474 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:49:04.021 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:49:04.489 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:49:04.939 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:49:05.453 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:49:05.979 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:49:07.484 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:49:08.017 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:49:08.510 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:49:09.133 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:49:09.676 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:49:10.194 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:49:10.717 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:49:11.274 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:49:11.872 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:49:12.381 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:49:12.982 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:49:13.454 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:49:13.867 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:49:14.268 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:49:14.728 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:49:15.103 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:49:15.399 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:49:15.946 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:49:16.382 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:49:16.889 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:49:19.624 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:49:20.069 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:49:20.542 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:49:21.022 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:49:21.417 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:49:21.824 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:49:22.225 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:49:22.729 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:49:23.273 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:49:23.751 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:49:24.197 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:49:24.688 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:49:25.177 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:49:25.698 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:49:26.161 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:49:26.647 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:49:27.142 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:49:27.622 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:49:27.916 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:49:28.214 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:49:28.520 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:49:28.891 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:49:29.272 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:49:29.610 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:49:29.978 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:49:30.398 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:49:30.693 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:49:30.988 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:49:31.408 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:49:31.704 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:49:31.999 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:49:32.291 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:49:32.586 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:49:32.972 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:49:33.362 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:49:33.783 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:49:34.208 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:49:34.591 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:49:35.061 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:49:35.445 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:49:35.886 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:49:36.297 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:49:36.722 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:49:37.204 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:49:37.687 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:49:38.207 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:49:38.643 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:49:39.111 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:49:39.639 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:49:40.154 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:49:40.611 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:49:41.104 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:49:41.451 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:49:41.981 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:49:42.500 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:49:43.031 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:49:43.590 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:49:44.129 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:49:44.810 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:49:45.450 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:49:46.121 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:49:46.852 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:49:47.519 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:49:47.998 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:49:48.436 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:49:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:49:49.392 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:49:49.839 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:49:50.374 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:49:51.133 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:49:51.830 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:49:52.562 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:49:53.304 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:49:54.001 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:49:54.729 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:49:55.533 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:49:56.262 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:49:56.991 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:49:57.601 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:49:58.177 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:49:58.759 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:49:59.557 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:50:00.330 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:50:00.621 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:50:00.912 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:50:01.204 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:50:01.664 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:50:02.123 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:50:02.467 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:50:02.802 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:50:03.382 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:50:04.478 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:50:05.008 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:50:05.549 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:50:06.120 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:50:06.695 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:50:07.271 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:50:07.829 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:50:08.274 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:50:08.950 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:50:09.464 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:50:10.108 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:50:10.638 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:50:11.336 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:50:12.053 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:50:12.407 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:50:12.784 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:50:14.122 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:50:14.701 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:50:17.260 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:50:17.787 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:50:18.342 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:50:19.249 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:50:19.750 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:50:20.635 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:50:22.564 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:50:25.224 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:50:27.856 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:50:39.603 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:50:41.027 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:50:43.662 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:50:44.197 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:50:44.991 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:50:45.670 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:50:46.293 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:50:46.768 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:50:47.525 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:50:48.044 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:50:48.535 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:50:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:51:03.413 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:51:05.438 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:51:05.989 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:51:06.333 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:51:06.882 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:51:12.057 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:51:15.603 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:51:19.159 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:51:19.706 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:51:20.246 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:51:20.795 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:51:21.310 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:51:21.826 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:51:22.360 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:51:22.890 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:51:23.460 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:51:24.090 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:51:24.767 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:51:25.442 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:51:26.185 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:51:26.946 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:51:27.556 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:51:28.131 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:51:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:51:29.425 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:51:29.954 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:51:30.662 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:51:31.150 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:51:35.808 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:51:36.284 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:51:36.766 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:51:37.218 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:51:37.725 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:51:38.435 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:51:44.909 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:51:45.482 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:51:46.141 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:51:46.883 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:51:47.613 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:51:50.462 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:51:51.165 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:51:54.722 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:52:07.363 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:52:09.956 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:52:11.035 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:52:12.324 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:52:13.024 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:52:13.745 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:52:14.393 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:52:15.090 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:52:15.705 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:52:16.419 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:52:16.846 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:52:17.274 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:52:17.747 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:52:18.134 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:52:18.569 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:52:19.037 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:52:19.449 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:52:19.866 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:52:20.325 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:52:20.723 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:52:21.091 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:52:21.511 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:52:21.903 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:52:22.330 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:52:22.802 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:52:23.272 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:52:23.688 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:52:24.194 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:52:24.639 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:52:25.120 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:52:25.556 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:52:25.992 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:52:26.411 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:52:26.833 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:52:27.219 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:52:30.603 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:52:34.095 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:52:35.149 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:52:35.664 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:53:37.123 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:54:38.497 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:54:38.955 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:54:39.401 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:54:39.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:54:40.240 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:54:42.723 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:54:43.584 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:54:44.478 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:54:44.988 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:54:45.450 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:54:45.928 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:54:46.338 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:54:46.802 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:54:47.311 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:54:47.795 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:54:48.305 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:54:50.275 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:54:51.051 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:54:51.846 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:54:52.444 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:54:52.918 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:54:53.480 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:54:54.083 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:54:54.609 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:54:55.212 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:54:55.762 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:54:56.422 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:54:56.986 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:54:57.477 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:54:57.956 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:54:58.462 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:54:59.003 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:54:59.539 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:55:00.203 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:55:01.138 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:55:03.180 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:55:03.747 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:55:04.398 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:55:04.979 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:55:05.837 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:55:06.604 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:55:07.081 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:55:07.756 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:55:08.184 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:55:08.602 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:55:09.028 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:55:09.451 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:55:09.958 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:55:10.412 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:55:11.070 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:55:11.467 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:55:11.880 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:55:12.306 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:55:12.723 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:55:13.109 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:55:13.605 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:55:13.988 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:55:14.384 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:55:14.778 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:55:15.202 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:55:15.613 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:55:16.043 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:55:16.522 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:55:16.960 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:55:17.341 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:55:17.810 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:55:18.270 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:55:18.717 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:55:19.162 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:55:19.572 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:55:19.990 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:55:20.430 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:55:20.947 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:55:21.416 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:55:21.942 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:55:22.341 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:55:22.801 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:55:23.237 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:55:23.729 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:55:24.195 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:55:24.673 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:55:25.257 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:55:25.634 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:55:26.043 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:55:26.464 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:55:36.786 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:55:37.263 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:55:47.291 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:55:47.824 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:55:48.379 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:55:48.794 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:49.218 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:49.646 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:50.152 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:55:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:55:51.038 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:55:51.421 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:55:51.892 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:55:52.412 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:55:52.830 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:55:53.429 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:55:53.975 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:55:54.476 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:55:54.907 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:55:55.496 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:55:56.520 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:55:56.896 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:55:57.356 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:55:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:55:58.304 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:55:58.862 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:55:59.336 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:56:00.073 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:56:00.840 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:56:01.337 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:56:06.994 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:56:12.440 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:56:12.989 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:56:13.730 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:56:14.916 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:56:16.267 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:56:17.387 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:56:18.242 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:56:19.087 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:56:19.878 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:56:20.424 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:56:21.564 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:56:22.707 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:56:24.635 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:56:25.697 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:56:26.581 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:56:27.317 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:56:27.911 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:56:28.744 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:56:29.596 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:56:30.418 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:56:31.132 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:56:32.062 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:56:32.881 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:56:33.711 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:56:34.565 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:56:34.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:56:35.878 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:56:37.205 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:56:37.942 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:56:38.658 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:56:39.341 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:56:55.090 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:56:55.334 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:56:56.116 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:56:56.721 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:56:57.191 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:56:57.777 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:56:57.801 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:56:57.801 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.801 INFO:teuthology.orchestra.run.smithi007.stdout:=============================== warnings summary =============================== 2024-09-14T11:56:57.801 INFO:teuthology.orchestra.run.smithi007.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:56:57.801 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:56:57.801 INFO:teuthology.orchestra.run.smithi007.stdout: import imp 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout: if boto_type is 'S3Connection': 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.802 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: if k is 'BucketName': 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:56:57.803 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: @pytest.mark.timeout(10) 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:57.804 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:56:57.805 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.806 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:56:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:56:57.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.806 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:56:57.807 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.808 INFO:teuthology.orchestra.run.smithi007.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T11:56:57.809 INFO:teuthology.orchestra.run.smithi007.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T11:56:57.810 INFO:teuthology.orchestra.run.smithi007.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi007.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:56:57.810 INFO:teuthology.orchestra.run.smithi007.stdout: warnings.warn( 2024-09-14T11:56:57.810 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:56:57.810 INFO:teuthology.orchestra.run.smithi007.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:56:57.810 INFO:teuthology.orchestra.run.smithi007.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 673.32s (0:11:13) = 2024-09-14T11:56:57.938 INFO:teuthology.orchestra.run.smithi007.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:56:57.938 INFO:teuthology.orchestra.run.smithi007.stdout: py: commands succeeded 2024-09-14T11:56:57.938 INFO:teuthology.orchestra.run.smithi007.stdout: congratulations :) 2024-09-14T11:56:57.958 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:56:57.959 DEBUG:teuthology.orchestra.run.smithi007:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:56:58.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:56:58.073 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:56:58.073 DEBUG:teuthology.orchestra.run.smithi007:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:56:58.103 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:56:58.103 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:56:58.304 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:56:58.320 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:56:58.321 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:56:58.321 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:56:58.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:56:58.351 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:56:58.352 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:56:58.421 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:56:58.421 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:56:58.491 INFO:tasks.workunit:timeout=3h 2024-09-14T11:56:58.491 INFO:tasks.workunit:cleanup=True 2024-09-14T11:56:58.491 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:56:58.561 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:57:56.294 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 96% (12416/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:57:56.601 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:57:56.601 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-14T11:57:56.602 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:57:56.603 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:57:56.603 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:57:56.603 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:57:56.604 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:57:56.673 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:57:56.675 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:57:56.675 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:57:56.727 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:57:56.778 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:57:56.819 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:57:56.821 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:57:56.821 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:57:56.860 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:57:56.863 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-14T11:57:56.863 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:57:56.935 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T11:57:56.936 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T11:57:56.936 DEBUG:teuthology.orchestra.run.smithi007:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:57:57.009 INFO:tasks.workunit.client.0.smithi007.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:57:57.009 INFO:tasks.workunit.client.0.smithi007.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:57:57.009 INFO:tasks.workunit.client.0.smithi007.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:57:59.334 INFO:tasks.workunit.client.0.smithi007.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ deactivate nondestructive 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:57:59.335 INFO:tasks.workunit.client.0.smithi007.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:57:59.336 INFO:tasks.workunit.client.0.smithi007.stderr:++ export VIRTUAL_ENV 2024-09-14T11:57:59.336 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:57:59.336 INFO:tasks.workunit.client.0.smithi007.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PATH 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n '' ']' 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -z '' ']' 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ PS1='(rgw) ' 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ export PS1 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:++ hash -r 2024-09-14T11:57:59.337 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install pip --upgrade 2024-09-14T11:57:59.573 INFO:tasks.workunit.client.0.smithi007.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:57:59.758 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting pip 2024-09-14T11:57:59.764 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:57:59.810 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: pip 2024-09-14T11:57:59.810 INFO:tasks.workunit.client.0.smithi007.stdout: Attempting uninstall: pip 2024-09-14T11:57:59.810 INFO:tasks.workunit.client.0.smithi007.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:57:59.973 INFO:tasks.workunit.client.0.smithi007.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:57:59.978 INFO:tasks.workunit.client.0.smithi007.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:58:00.755 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed pip-24.2 2024-09-14T11:58:00.803 INFO:tasks.workunit.client.0.smithi007.stderr:+ pip install boto3 2024-09-14T11:58:01.613 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting boto3 2024-09-14T11:58:01.614 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:58:02.225 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:58:02.226 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:58:02.283 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:58:02.284 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:58:02.337 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:58:02.338 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:58:02.389 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:58:02.390 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:58:02.467 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:58:02.469 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:58:02.669 INFO:tasks.workunit.client.0.smithi007.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:58:02.670 INFO:tasks.workunit.client.0.smithi007.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:58:02.675 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:58:02.676 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:58:02.685 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:58:02.687 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:58:02.688 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:58:02.689 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:58:02.691 INFO:tasks.workunit.client.0.smithi007.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:58:02.767 INFO:tasks.workunit.client.0.smithi007.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:58:03.817 INFO:tasks.workunit.client.0.smithi007.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:58:03.936 INFO:tasks.workunit.client.0.smithi007.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T11:58:04.064 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T11:58:04.100 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:04.100 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:04.140 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.141+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 20 realm 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.143+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.142 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.144+0000 7f53f83af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:04.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.144+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.143 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.145+0000 7f53f83af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:04.144 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.145+0000 7f53f83af800 20 searching for the correct realm 2024-09-14T11:58:04.145 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.147+0000 7f53f669a640 0 -- 172.21.15.7:0/3986108318 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f53ec07c410 msgr2=0x7f53ec07c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:04.351 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.353+0000 7f53f5698640 0 -- 172.21.15.7:0/3986108318 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f53e806ca40 msgr2=0x7f53e806c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:04.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.560+0000 7f53f83af800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:58:04.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.560+0000 7f53f83af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:04.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.560+0000 7f53f83af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:04.559 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.560+0000 7f53f83af800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:58:04.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.560+0000 7f53f83af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:04.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.560+0000 7f53f83af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:04.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.560+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.560 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:04.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:04.561 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 zone default found 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 4 Realm: () 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 zonegroup default 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.561+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.562+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.562+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.562+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.562+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.563+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.563+0000 7f53f83af800 20 started sync module instance, tier type = 2024-09-14T11:58:04.562 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.563+0000 7f53f83af800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:58:04.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.573+0000 7f53f83af800 20 add_watcher() i=0 2024-09-14T11:58:04.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.573+0000 7f53f83af800 20 add_watcher() i=1 2024-09-14T11:58:04.571 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.573+0000 7f53f83af800 20 add_watcher() i=2 2024-09-14T11:58:04.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.573+0000 7f53f83af800 20 add_watcher() i=3 2024-09-14T11:58:04.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.573+0000 7f53f83af800 20 add_watcher() i=4 2024-09-14T11:58:04.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.573+0000 7f53f83af800 20 add_watcher() i=5 2024-09-14T11:58:04.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.573+0000 7f53f83af800 20 add_watcher() i=6 2024-09-14T11:58:04.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.574+0000 7f53f83af800 20 add_watcher() i=7 2024-09-14T11:58:04.572 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.574+0000 7f53f83af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:04.574 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.576+0000 7f52a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:04.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.576+0000 7f53f83af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:04.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.576+0000 7f53f83af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:04.575 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.576+0000 7f53f83af800 5 note: GC not initialized 2024-09-14T11:58:04.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f52a67fc640 20 reqs_thread_entry: start 2024-09-14T11:58:04.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:04.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 20 Filter name: none 2024-09-14T11:58:04.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f5217fff640 20 reqs_thread_entry: start 2024-09-14T11:58:04.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T11:58:04.576 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.577+0000 7f53f83af800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.578+0000 7f53f83af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.578+0000 7f53f83af800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.578+0000 7f53f83af800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.578+0000 7f53f83af800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:58:04.577 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.578+0000 7f53f83af800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:58:04.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.579+0000 7f53f83af800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:58:04.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.579+0000 7f53f83af800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:58:04.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.579+0000 7f53f83af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T11:58:04.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.580+0000 7f52d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432714 cookie 93957405259232 notifier 9261 bl.length()=613 2024-09-14T11:58:04.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.580+0000 7f52d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:58:04.578 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.580+0000 7f52d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:58:04.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.581+0000 7f53f83af800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:58:04.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.581+0000 7f53f83af800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:58:04.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.581+0000 7f53f83af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T11:58:04.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.582+0000 7f52d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432009 cookie 93957405265456 notifier 9261 bl.length()=191 2024-09-14T11:58:04.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.582+0000 7f52d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:58:04.580 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.582+0000 7f52d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:58:04.581 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.583+0000 7f52a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:04.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.585+0000 7f53f83af800 20 remove_watcher() i=0 2024-09-14T11:58:04.584 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.585+0000 7f53f83af800 2 removed watcher, disabling cache 2024-09-14T11:58:04.585 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.587+0000 7f53f83af800 20 remove_watcher() i=1 2024-09-14T11:58:04.586 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.588+0000 7f53f83af800 20 remove_watcher() i=2 2024-09-14T11:58:04.587 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.589+0000 7f53f83af800 20 remove_watcher() i=3 2024-09-14T11:58:04.588 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.590+0000 7f53f83af800 20 remove_watcher() i=4 2024-09-14T11:58:04.589 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.591+0000 7f53f83af800 20 remove_watcher() i=5 2024-09-14T11:58:04.590 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.592+0000 7f53f83af800 20 remove_watcher() i=6 2024-09-14T11:58:04.591 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.593+0000 7f53f83af800 20 remove_watcher() i=7 2024-09-14T11:58:04.741 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:04.742 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:04.788 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:04.788 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:04.834 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:04.834 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:04.848 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:04.848 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:04.852 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T11:58:04.852 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:58:04.855 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:04.855 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:04.864 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:04.864 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:04.871 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:04.871 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:04.881 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:58:04.911 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:04.911 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:04.951 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.952+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 20 realm 2024-09-14T11:58:04.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:04.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.953 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:04.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.954+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.956+0000 7fcfca746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:04.954 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.956+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:04.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.956+0000 7fcfca746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:04.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.956+0000 7fcfca746800 20 searching for the correct realm 2024-09-14T11:58:04.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:04.958+0000 7fcfc8a31640 0 -- 172.21.15.7:0/1985911218 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fcfbc044030 msgr2=0x7fcfbc037430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:05.164 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.165+0000 7fcfc7a2f640 0 -- 172.21.15.7:0/1985911218 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fcfb80a7490 msgr2=0x7fcfb80bb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:05.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:58:05.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:05.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:05.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:58:05.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:05.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:05.372 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:05.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:05.373 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.373+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:05.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 zone default found 2024-09-14T11:58:05.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 4 Realm: () 2024-09-14T11:58:05.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:58:05.375 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 zonegroup default 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.374+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.375+0000 7fcfca746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.375+0000 7fcfca746800 20 started sync module instance, tier type = 2024-09-14T11:58:05.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.375+0000 7fcfca746800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:58:05.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.386+0000 7fcfca746800 20 add_watcher() i=0 2024-09-14T11:58:05.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.386+0000 7fcfca746800 20 add_watcher() i=1 2024-09-14T11:58:05.384 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.386+0000 7fcfca746800 20 add_watcher() i=2 2024-09-14T11:58:05.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.386+0000 7fcfca746800 20 add_watcher() i=3 2024-09-14T11:58:05.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.386+0000 7fcfca746800 20 add_watcher() i=4 2024-09-14T11:58:05.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.386+0000 7fcfca746800 20 add_watcher() i=5 2024-09-14T11:58:05.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.386+0000 7fcfca746800 20 add_watcher() i=6 2024-09-14T11:58:05.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.387+0000 7fcfca746800 20 add_watcher() i=7 2024-09-14T11:58:05.385 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.387+0000 7fcfca746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:05.387 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.388+0000 7fce7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:05.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.389+0000 7fcfca746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:05.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.389+0000 7fcfca746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:05.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.389+0000 7fcfca746800 5 note: GC not initialized 2024-09-14T11:58:05.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.389+0000 7fce7dfdb640 20 reqs_thread_entry: start 2024-09-14T11:58:05.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.389+0000 7fcfca746800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:05.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.389+0000 7fcfca746800 20 Filter name: none 2024-09-14T11:58:05.388 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.390+0000 7fcdef7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:05.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.390+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.390+0000 7fcfca746800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:58:05.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.390+0000 7fcfca746800 20 rados->read ofs=0 len=0 2024-09-14T11:58:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:58:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:58:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:58:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 INFO: main: starting shard=0 2024-09-14T11:58:05.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.0 2024-09-14T11:58:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 INFO: main: starting shard=1 2024-09-14T11:58:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.391+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.1 2024-09-14T11:58:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.392+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.392+0000 7fcfca746800 20 INFO: main: starting shard=2 2024-09-14T11:58:05.391 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.392+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.2 2024-09-14T11:58:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.393+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.393+0000 7fcfca746800 20 INFO: main: starting shard=3 2024-09-14T11:58:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.393+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.3 2024-09-14T11:58:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.393+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.393+0000 7fcfca746800 20 INFO: main: starting shard=4 2024-09-14T11:58:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.393+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.4 2024-09-14T11:58:05.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.394+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.394+0000 7fcfca746800 20 INFO: main: starting shard=5 2024-09-14T11:58:05.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.394+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.5 2024-09-14T11:58:05.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.395+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.395+0000 7fcfca746800 20 INFO: main: starting shard=6 2024-09-14T11:58:05.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.395+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.6 2024-09-14T11:58:05.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.395+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.395+0000 7fcfca746800 20 INFO: main: starting shard=7 2024-09-14T11:58:05.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.395+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.7 2024-09-14T11:58:05.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.396+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.396+0000 7fcfca746800 20 INFO: main: starting shard=8 2024-09-14T11:58:05.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.396+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.8 2024-09-14T11:58:05.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.396+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.396+0000 7fcfca746800 20 INFO: main: starting shard=9 2024-09-14T11:58:05.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.396+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.9 2024-09-14T11:58:05.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.397+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.397+0000 7fcfca746800 20 INFO: main: starting shard=10 2024-09-14T11:58:05.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.397+0000 7fcfca746800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.10 2024-09-14T11:58:05.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.398+0000 7fcfca746800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:05.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.398+0000 7fcfca746800 20 INFO: main: done 2024-09-14T11:58:05.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.399+0000 7fce7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:05.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.401+0000 7fcfca746800 20 remove_watcher() i=0 2024-09-14T11:58:05.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.401+0000 7fcfca746800 2 removed watcher, disabling cache 2024-09-14T11:58:05.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.402+0000 7fcfca746800 20 remove_watcher() i=1 2024-09-14T11:58:05.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.404+0000 7fcfca746800 20 remove_watcher() i=2 2024-09-14T11:58:05.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.405+0000 7fcfca746800 20 remove_watcher() i=3 2024-09-14T11:58:05.404 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.406+0000 7fcfca746800 20 remove_watcher() i=4 2024-09-14T11:58:05.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.407+0000 7fcfca746800 20 remove_watcher() i=5 2024-09-14T11:58:05.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.408+0000 7fcfca746800 20 remove_watcher() i=6 2024-09-14T11:58:05.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.409+0000 7fcfca746800 20 remove_watcher() i=7 2024-09-14T11:58:05.422 INFO:tasks.workunit.client.0.smithi007.stderr:rados -p default.rgw.buckets.data ls | grep 09f8cf2b-0077-4394-b064-35b5d3b1ee28 2024-09-14T11:58:05.446 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:05.446 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:05.489 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:05.490+0000 7fc508b51640 0 -- 172.21.15.7:0/43433020 >> [v2:172.21.15.7:6808/3803654234,v1:172.21.15.7:6809/3803654234] conn(0x7fc4fc00bb40 msgr2=0x7fc4fc005840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:05.495 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T11:58:05.496 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:58:05.497 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:58:06.916 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:06.916 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:06.926 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:58:07.349 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:58:07.378 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:07.378 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:07.418 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.420+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 20 realm 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:07.421 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.422+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.422 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.423+0000 7f84fda10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:07.454 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.424+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.424+0000 7f84fda10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:07.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.424+0000 7f84fda10800 20 searching for the correct realm 2024-09-14T11:58:07.455 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.426+0000 7f84f99bd640 0 -- 172.21.15.7:0/2194029831 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f84f0037070 msgr2=0x7f84f0038400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:07.631 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.632+0000 7f84f89bb640 0 -- 172.21.15.7:0/2194029831 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f84ec0baa60 msgr2=0x7f84ec0ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:07.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:58:07.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:07.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:07.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:58:07.839 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:07.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:07.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:07.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.840+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:07.840 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:07.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 zone default found 2024-09-14T11:58:07.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 4 Realm: () 2024-09-14T11:58:07.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:58:07.841 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 zonegroup default 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.841+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.842+0000 7f84fda10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.842+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.842+0000 7f84fda10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:07.842 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.842+0000 7f84fda10800 20 started sync module instance, tier type = 2024-09-14T11:58:07.843 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.842+0000 7f84fda10800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.852+0000 7f84fda10800 20 add_watcher() i=0 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.852+0000 7f84fda10800 20 add_watcher() i=1 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.852+0000 7f84fda10800 20 add_watcher() i=2 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.852+0000 7f84fda10800 20 add_watcher() i=3 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.852+0000 7f84fda10800 20 add_watcher() i=4 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.852+0000 7f84fda10800 20 add_watcher() i=5 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.852+0000 7f84fda10800 20 add_watcher() i=6 2024-09-14T11:58:07.851 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.853+0000 7f84fda10800 20 add_watcher() i=7 2024-09-14T11:58:07.852 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.853+0000 7f84fda10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:07.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.855+0000 7f83af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:07.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.855+0000 7f84fda10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:07.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.855+0000 7f84fda10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:07.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.855+0000 7f84fda10800 5 note: GC not initialized 2024-09-14T11:58:07.854 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.855+0000 7f83ae7e4640 20 reqs_thread_entry: start 2024-09-14T11:58:07.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.856+0000 7f84fda10800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:07.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.856+0000 7f84fda10800 20 Filter name: none 2024-09-14T11:58:07.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.856+0000 7f831ffff640 20 reqs_thread_entry: start 2024-09-14T11:58:07.855 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.856+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.856+0000 7f84fda10800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:58:07.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.856+0000 7f84fda10800 20 rados->read ofs=0 len=0 2024-09-14T11:58:07.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:58:07.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:58:07.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:58:07.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 INFO: main: starting shard=0 2024-09-14T11:58:07.856 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.0 2024-09-14T11:58:07.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 INFO: main: starting shard=1 2024-09-14T11:58:07.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.857+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.1 2024-09-14T11:58:07.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.858+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.858+0000 7f84fda10800 20 INFO: main: starting shard=2 2024-09-14T11:58:07.857 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.858+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.2 2024-09-14T11:58:07.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.859+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.859+0000 7f84fda10800 20 INFO: main: starting shard=3 2024-09-14T11:58:07.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.859+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.3 2024-09-14T11:58:07.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.859+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.860+0000 7f84fda10800 20 INFO: main: starting shard=4 2024-09-14T11:58:07.858 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.860+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.4 2024-09-14T11:58:07.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.860+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.860+0000 7f84fda10800 20 INFO: main: starting shard=5 2024-09-14T11:58:07.859 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.860+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.5 2024-09-14T11:58:07.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.861+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.861+0000 7f84fda10800 20 INFO: main: starting shard=6 2024-09-14T11:58:07.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.861+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.6 2024-09-14T11:58:07.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.861+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.861+0000 7f84fda10800 20 INFO: main: starting shard=7 2024-09-14T11:58:07.860 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.861+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.7 2024-09-14T11:58:07.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.863+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.863+0000 7f84fda10800 20 INFO: main: starting shard=8 2024-09-14T11:58:07.861 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.863+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.8 2024-09-14T11:58:07.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.863+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.863+0000 7f84fda10800 20 INFO: main: starting shard=9 2024-09-14T11:58:07.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.863+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.9 2024-09-14T11:58:07.862 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.864+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.864+0000 7f84fda10800 20 INFO: main: starting shard=10 2024-09-14T11:58:07.863 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.864+0000 7f84fda10800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.10 2024-09-14T11:58:07.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.865+0000 7f84fda10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:07.864 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.865+0000 7f84fda10800 20 INFO: main: done 2024-09-14T11:58:07.865 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.866+0000 7f83af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:07.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.869+0000 7f84fda10800 20 remove_watcher() i=0 2024-09-14T11:58:07.867 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.869+0000 7f84fda10800 2 removed watcher, disabling cache 2024-09-14T11:58:07.868 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.870+0000 7f84fda10800 20 remove_watcher() i=1 2024-09-14T11:58:07.870 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.871+0000 7f84fda10800 20 remove_watcher() i=2 2024-09-14T11:58:07.871 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.872+0000 7f84fda10800 20 remove_watcher() i=3 2024-09-14T11:58:07.872 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.874+0000 7f84fda10800 20 remove_watcher() i=4 2024-09-14T11:58:07.873 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.875+0000 7f84fda10800 20 remove_watcher() i=5 2024-09-14T11:58:07.874 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.876+0000 7f84fda10800 20 remove_watcher() i=6 2024-09-14T11:58:07.875 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.877+0000 7f84fda10800 20 remove_watcher() i=7 2024-09-14T11:58:07.889 INFO:tasks.workunit.client.0.smithi007.stderr:rados -p default.rgw.buckets.data ls | grep aea0714f-18b2-45ff-8846-b4badb856617 2024-09-14T11:58:07.912 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:07.912 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:07.955 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:07.956+0000 7fa2dc761640 0 -- 172.21.15.7:0/3291605906 >> [v2:172.21.15.189:6800/1267134272,v1:172.21.15.189:6801/1267134272] conn(0x7fa2cc001770 msgr2=0x7fa2cc05f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:07.962 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T11:58:07.962 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:58:07.964 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:07.965 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:07.970 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:07.970 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:07.980 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:07.980 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:07.984 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:58:09.398 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:09.398 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:09.451 INFO:tasks.workunit.client.0.smithi007.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:58:09.453 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:58:09.875 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:09.875 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:09.882 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:09.882 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:09.924 INFO:tasks.workunit.client.0.smithi007.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T11:58:09.924 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-14T11:58:09.926 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:09.926 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:09.971 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:09.971 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:10.015 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:10.015 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:10.023 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T11:58:11.441 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:11.441 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:11.445 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:11.445 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:13.459 INFO:tasks.workunit.client.0.smithi007.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T11:58:13.885 INFO:tasks.workunit.client.0.smithi007.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T11:58:13.916 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:13.916 INFO:tasks.workunit.client.0.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:13.956 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.958+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:13.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.959+0000 7fc50573a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:13.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.959+0000 7fc50573a800 20 realm 2024-09-14T11:58:13.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.959+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:13.958 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.960+0000 7fc50573a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:13.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.960+0000 7fc50573a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:13.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.960+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:13.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.960+0000 7fc50573a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:13.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.960+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:13.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.961+0000 7fc50573a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:13.959 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.961+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:13.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.962+0000 7fc50573a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:13.960 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.962+0000 7fc50573a800 20 searching for the correct realm 2024-09-14T11:58:13.962 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:13.964+0000 7fc501cbc640 0 -- 172.21.15.7:0/583194784 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7fc4f8018070 msgr2=0x7fc4f807a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:14.169 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.170+0000 7fc500cba640 0 -- 172.21.15.7:0/583194784 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7fc4f4072ef0 msgr2=0x7fc4f4080980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:14.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.377+0000 7fc50573a800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:58:14.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.377+0000 7fc50573a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:14.376 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.377+0000 7fc50573a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:14.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.377+0000 7fc50573a800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:58:14.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.377+0000 7fc50573a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:14.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.377+0000 7fc50573a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:14.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.377+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.378+0000 7fc50573a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:14.377 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.378+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.378+0000 7fc50573a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:14.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.378+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.378+0000 7fc50573a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:14.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 20 zone default found 2024-09-14T11:58:14.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 4 Realm: () 2024-09-14T11:58:14.378 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 20 zonegroup default 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.379+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.380+0000 7fc50573a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.380+0000 7fc50573a800 20 started sync module instance, tier type = 2024-09-14T11:58:14.379 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.380+0000 7fc50573a800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.390+0000 7fc50573a800 20 add_watcher() i=0 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.390+0000 7fc50573a800 20 add_watcher() i=1 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.390+0000 7fc50573a800 20 add_watcher() i=2 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.390+0000 7fc50573a800 20 add_watcher() i=3 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.390+0000 7fc50573a800 20 add_watcher() i=4 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.390+0000 7fc50573a800 20 add_watcher() i=5 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.390+0000 7fc50573a800 20 add_watcher() i=6 2024-09-14T11:58:14.389 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.391+0000 7fc50573a800 20 add_watcher() i=7 2024-09-14T11:58:14.390 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.391+0000 7fc50573a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:14.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.393+0000 7fc3b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:14.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc50573a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:14.392 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc50573a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:14.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc50573a800 5 note: GC not initialized 2024-09-14T11:58:14.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc3b6fe5640 20 reqs_thread_entry: start 2024-09-14T11:58:14.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc50573a800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:14.393 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc50573a800 20 Filter name: none 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc3b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc50573a800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.394+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783 : miss 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 20 rados->read ofs=0 len=0 2024-09-14T11:58:14.394 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783 info.flags=0x17 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783 to cache LRU end 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.395+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.0 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.396+0000 7fc50573a800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:58:14.395 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.396+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.1 2024-09-14T11:58:14.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.397+0000 7fc50573a800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:58:14.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.397+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.2 2024-09-14T11:58:14.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.398+0000 7fc50573a800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:58:14.396 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.398+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.3 2024-09-14T11:58:14.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.398+0000 7fc50573a800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:58:14.397 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.398+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.4 2024-09-14T11:58:14.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.399+0000 7fc50573a800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:58:14.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.399+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.5 2024-09-14T11:58:14.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.400+0000 7fc50573a800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:58:14.398 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.400+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.6 2024-09-14T11:58:14.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.400+0000 7fc50573a800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:58:14.399 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.400+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.7 2024-09-14T11:58:14.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.401+0000 7fc50573a800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:58:14.400 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.401+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.8 2024-09-14T11:58:14.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.402+0000 7fc50573a800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:58:14.401 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.402+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.9 2024-09-14T11:58:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.403+0000 7fc50573a800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:58:14.402 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.403+0000 7fc50573a800 20 bucket index object: :.dir.00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.783.10 2024-09-14T11:58:14.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.404+0000 7fc50573a800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:58:14.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.404+0000 7fc50573a800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:58:14.403 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.405+0000 7fc3b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:14.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.408+0000 7fc50573a800 20 remove_watcher() i=0 2024-09-14T11:58:14.406 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.408+0000 7fc50573a800 2 removed watcher, disabling cache 2024-09-14T11:58:14.407 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.409+0000 7fc50573a800 20 remove_watcher() i=1 2024-09-14T11:58:14.408 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.410+0000 7fc50573a800 20 remove_watcher() i=2 2024-09-14T11:58:14.409 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.411+0000 7fc50573a800 20 remove_watcher() i=3 2024-09-14T11:58:14.411 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.412+0000 7fc50573a800 20 remove_watcher() i=4 2024-09-14T11:58:14.412 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.413+0000 7fc50573a800 20 remove_watcher() i=5 2024-09-14T11:58:14.413 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.414+0000 7fc50573a800 20 remove_watcher() i=6 2024-09-14T11:58:14.414 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-14T11:58:14.415+0000 7fc50573a800 20 remove_watcher() i=7 2024-09-14T11:58:14.428 INFO:tasks.workunit.client.0.smithi007.stderr:Deleting bucket versioning-bucket 2024-09-14T11:58:14.430 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:14.430 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:14.436 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:58:14.436 INFO:tasks.workunit.client.0.smithi007.stderr: warnings.warn( 2024-09-14T11:58:14.468 INFO:tasks.workunit.client.0.smithi007.stderr:Completed bucket versioning tests 2024-09-14T11:58:14.468 INFO:tasks.workunit.client.0.smithi007.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:58:14.468 INFO:tasks.workunit.client.0.smithi007.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:58:14.468 INFO:tasks.workunit.client.0.smithi007.stdout:connected to https://localhost:443 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ deactivate 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ export PATH 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ hash -r 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' -n '' ']' 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ unset -f deactivate 2024-09-14T11:58:14.534 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo OK. 2024-09-14T11:58:14.535 INFO:tasks.workunit.client.0.smithi007.stdout:OK. 2024-09-14T11:58:14.536 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:58:14.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:58:14.616 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T11:58:14.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:58:15.013 DEBUG:teuthology.parallel:result is None 2024-09-14T11:58:15.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:58:15.053 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:58:15.054 DEBUG:teuthology.orchestra.run.smithi007:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:58:15.123 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:58:15.124 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T11:58:15.133 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T11:58:15.155 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T11:58:15.155 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T11:58:15.155 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:58:15.228 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T11:58:15.228 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T11:58:15.287 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:15.287 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:15.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.326+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 20 realm 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.328+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.329+0000 7f474d919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:15.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.329+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.330+0000 7f474d919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.330+0000 7f474d919800 20 searching for the correct realm 2024-09-14T11:58:15.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.332+0000 7f474bc0b640 0 -- 172.21.15.7:0/2635409597 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4734067a60 msgr2=0x7f47340674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.539+0000 7f474ac09640 0 -- 172.21.15.7:0/2635409597 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f473c0b04b0 msgr2=0x7f473c0adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:58:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:58:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:15.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:15.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.747+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:15.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 20 zone default found 2024-09-14T11:58:15.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 4 Realm: () 2024-09-14T11:58:15.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:58:15.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:58:15.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 20 zonegroup default 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.748+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.749+0000 7f474d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.749+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.749+0000 7f474d919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.749+0000 7f474d919800 20 started sync module instance, tier type = 2024-09-14T11:58:15.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.749+0000 7f474d919800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:58:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.759+0000 7f474d919800 20 add_watcher() i=0 2024-09-14T11:58:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.759+0000 7f474d919800 20 add_watcher() i=1 2024-09-14T11:58:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.759+0000 7f474d919800 20 add_watcher() i=2 2024-09-14T11:58:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.759+0000 7f474d919800 20 add_watcher() i=3 2024-09-14T11:58:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.759+0000 7f474d919800 20 add_watcher() i=4 2024-09-14T11:58:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.759+0000 7f474d919800 20 add_watcher() i=5 2024-09-14T11:58:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.759+0000 7f474d919800 20 add_watcher() i=6 2024-09-14T11:58:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.760+0000 7f474d919800 20 add_watcher() i=7 2024-09-14T11:58:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.760+0000 7f474d919800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.761+0000 7f4601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.761+0000 7f474d919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.761+0000 7f474d919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.799+0000 7f4600fe1640 20 reqs_thread_entry: start 2024-09-14T11:58:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.799+0000 7f474d919800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.799+0000 7f474d919800 20 Filter name: none 2024-09-14T11:58:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.799+0000 7f457a7fc640 20 reqs_thread_entry: start 2024-09-14T11:58:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.799+0000 7f474d919800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:58:15.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.799+0000 7f474d919800 20 rados->read ofs=0 len=0 2024-09-14T11:58:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.800+0000 7f474d919800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T11:58:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.800+0000 7f474d919800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T11:58:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.800+0000 7f474d919800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:58:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.800+0000 7f474d919800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:15.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.800+0000 7f474d919800 10 removing key index: SHJHKKFXTORLDFCHWECX 2024-09-14T11:58:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.801+0000 7f474d919800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:SHJHKKFXTORLDFCHWECX, ofs0, ns] 2024-09-14T11:58:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.802+0000 7f462effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432715 cookie 94365177956560 notifier 8840 bl.length()=170 2024-09-14T11:58:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.802+0000 7f474d919800 10 removing email index: tester.client.0_test@test.test 2024-09-14T11:58:15.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.803+0000 7f474d919800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:58:15.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.803+0000 7f462e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431929 cookie 94365177951856 notifier 8840 bl.length()=181 2024-09-14T11:58:15.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.804+0000 7f474d919800 10 removing user buckets index 2024-09-14T11:58:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.805+0000 7f474d919800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T11:58:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.805+0000 7f462effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432716 cookie 94365177956560 notifier 8840 bl.length()=172 2024-09-14T11:58:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.806+0000 7f474d919800 10 removing user index: tester.client.0 2024-09-14T11:58:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.807+0000 7f474d919800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T11:58:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.807+0000 7f474d919800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:58:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.808+0000 7f462e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432012 cookie 94365177964128 notifier 8840 bl.length()=164 2024-09-14T11:58:15.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.809+0000 7f4601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:15.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.811+0000 7f474d919800 20 remove_watcher() i=0 2024-09-14T11:58:15.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.811+0000 7f474d919800 2 removed watcher, disabling cache 2024-09-14T11:58:15.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.812+0000 7f474d919800 20 remove_watcher() i=1 2024-09-14T11:58:15.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.813+0000 7f474d919800 20 remove_watcher() i=2 2024-09-14T11:58:15.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.814+0000 7f474d919800 20 remove_watcher() i=3 2024-09-14T11:58:15.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.816+0000 7f474d919800 20 remove_watcher() i=4 2024-09-14T11:58:15.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.817+0000 7f474d919800 20 remove_watcher() i=5 2024-09-14T11:58:15.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.818+0000 7f474d919800 20 remove_watcher() i=6 2024-09-14T11:58:15.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:15.819+0000 7f474d919800 20 remove_watcher() i=7 2024-09-14T11:58:15.830 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T11:58:15.840 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T11:58:15.851 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T11:58:15.909 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T11:58:15.919 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T11:58:15.919 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:58:15.920 INFO:tasks.rgw.client.0.smithi007.stdout:2024-09-14T11:58:15.922+0000 7fd1bbd27640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 43978) UID: 0 2024-09-14T11:58:15.920 INFO:tasks.rgw.client.0.smithi007.stdout:2024-09-14T11:58:15.922+0000 7fd1bf582880 -1 shutting down 2024-09-14T11:58:46.428 INFO:tasks.rgw.client.0:Stopped 2024-09-14T11:58:46.432 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T11:58:46.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T11:58:46.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T11:58:46.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T11:58:46.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T11:58:46.597 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T11:58:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:46.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.737+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 20 realm 2024-09-14T11:58:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.739+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.740+0000 7f478dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.740+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.741+0000 7f478dfaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.741+0000 7f478dfaf800 20 searching for the correct realm 2024-09-14T11:58:46.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.743+0000 7f478c29a640 0 -- 172.21.15.7:0/3267652473 >> [v2:172.21.15.7:6818/2124660824,v1:172.21.15.7:6820/2124660824] conn(0x7f4780051040 msgr2=0x7f4780051930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:46.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:46.951+0000 7f478b298640 0 -- 172.21.15.7:0/3267652473 >> [v2:172.21.15.7:6816/2474842914,v1:172.21.15.7:6817/2474842914] conn(0x7f477c0b6620 msgr2=0x7f477c0ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 RGWRados::pool_iterate: got zone_info.00289ab1-7de4-4b62-b8d0-ad917abd1b51 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 RGWRados::pool_iterate: got zonegroup_info.e8bd4bec-fdbf-4295-8536-c8993e4bcc0c 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.158+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 zone default found 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 4 Realm: () 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 4 ZoneGroup: default (e8bd4bec-fdbf-4295-8536-c8993e4bcc0c) 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 4 Zone: default (00289ab1-7de4-4b62-b8d0-ad917abd1b51) 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 zonegroup default 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.159+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.160+0000 7f478dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.160+0000 7f478dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.160+0000 7f478dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.160+0000 7f478dfaf800 20 started sync module instance, tier type = 2024-09-14T11:58:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.160+0000 7f478dfaf800 20 started zone id=00289ab1-7de4-4b62-b8d0-ad917abd1b51 (name=default) with tier type = 2024-09-14T11:58:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.171+0000 7f478dfaf800 20 add_watcher() i=0 2024-09-14T11:58:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.171+0000 7f478dfaf800 20 add_watcher() i=1 2024-09-14T11:58:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.171+0000 7f478dfaf800 20 add_watcher() i=2 2024-09-14T11:58:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.171+0000 7f478dfaf800 20 add_watcher() i=3 2024-09-14T11:58:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.171+0000 7f478dfaf800 20 add_watcher() i=4 2024-09-14T11:58:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.171+0000 7f478dfaf800 20 add_watcher() i=5 2024-09-14T11:58:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.172+0000 7f478dfaf800 20 add_watcher() i=6 2024-09-14T11:58:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.172+0000 7f478dfaf800 20 add_watcher() i=7 2024-09-14T11:58:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.172+0000 7f478dfaf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.174+0000 7f4641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.174+0000 7f478dfaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.174+0000 7f478dfaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.213+0000 7f4640fe1640 20 reqs_thread_entry: start 2024-09-14T11:58:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.213+0000 7f478dfaf800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.213+0000 7f478dfaf800 20 Filter name: none 2024-09-14T11:58:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.213+0000 7f45ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:58:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.213+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:58:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.215+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.216+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.216+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:47.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.216+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15504382929849363899', time=2024-09-14T13:50:39.957526+0000, chain.objs.size()=1 2024-09-14T11:58:47.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.216+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~0FvC7vzrUxiO_32jf8-AC2QAjnDyhDc.1 2024-09-14T11:58:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.217+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.220+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:58:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.221+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~E2Zvg33jABVKGlnz-rsQ0O1VgwoNbIk', time=2024-09-14T13:46:25.644104+0000, chain.objs.size()=2 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.203__multipart_mymultipart.2~E2Zvg33jABVKGlnz-rsQ0O1VgwoNbIk.1 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.203__shadow_mymultipart.2~E2Zvg33jABVKGlnz-rsQ0O1VgwoNbIk.1_1 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~mW7xjWvw99gpO_QCudofU0d0YtKMolX', time=2024-09-14T13:50:30.217056+0000, chain.objs.size()=2 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.2 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__shadow_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.2_1 2024-09-14T11:58:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2153756429044080879', time=2024-09-14T13:54:54.944890+0000, chain.objs.size()=1 2024-09-14T11:58:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.222+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.648__shadow_.jpiEvEAaal7tU0CqdA6csyS5OcKqe1v_1 2024-09-14T11:58:47.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.225+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.227+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:58:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.228+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4335920668397302212', time=2024-09-14T13:45:53.450862+0000, chain.objs.size()=3 2024-09-14T11:58:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.24MDi01pycYtJzLFksSZRiCEUWfJd8P_0 2024-09-14T11:58:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.24MDi01pycYtJzLFksSZRiCEUWfJd8P_1 2024-09-14T11:58:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.24MDi01pycYtJzLFksSZRiCEUWfJd8P_2 2024-09-14T11:58:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_Wg2QNkMtEcKmfV2LDe-Mh8nb_eVp60Q', time=2024-09-14T13:45:54.203022+0000, chain.objs.size()=1 2024-09-14T11:58:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.229+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.leUUNbKxYJFCkIFYNxo8TtJ0xOUnWXg_0 2024-09-14T11:58:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.232+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.234+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:58:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.235+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_uxBPiEdIXb0JW7pEWAtZMpxv2vR3EXa', time=2024-09-14T13:45:52.891693+0000, chain.objs.size()=3 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.hpVhY-Ta7kAMMaJghCvTLcfh845Zv_s_0 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.hpVhY-Ta7kAMMaJghCvTLcfh845Zv_s_1 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.hpVhY-Ta7kAMMaJghCvTLcfh845Zv_s_2 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_QByLeYjIMr3_BmTs1-pZSClU_1C8_bq', time=2024-09-14T13:45:53.533077+0000, chain.objs.size()=2 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.Gs8VA4CNgxspmGGZ4WfSaFTSZaotOuN_1 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.Gs8VA4CNgxspmGGZ4WfSaFTSZaotOuN_2 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1955151131075033360', time=2024-09-14T13:52:30.344145+0000, chain.objs.size()=12 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__multipart_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.1 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__shadow_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.1_1 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__multipart_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.2 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__shadow_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.2_1 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__multipart_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.3 2024-09-14T11:58:47.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.236+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__shadow_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.3_1 2024-09-14T11:58:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.237+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__multipart_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.4 2024-09-14T11:58:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.240+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__shadow_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.4_1 2024-09-14T11:58:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.240+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__multipart_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.5 2024-09-14T11:58:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.240+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__shadow_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.5_1 2024-09-14T11:58:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.240+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__multipart_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.6 2024-09-14T11:58:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.240+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.614__shadow_multipart_enc.2~G8nvZtG-6V8V7lV4Xx7FrzA8Ef1zNKa.6_1 2024-09-14T11:58:47.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.243+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.246+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:58:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.247+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.247+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_4PZopeoxFtaQXiFn242kQxqTGB9H-A2', time=2024-09-14T13:45:53.205132+0000, chain.objs.size()=2 2024-09-14T11:58:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.4Dr2HWY3Zbi92l_F_49XKBV4DslM98b_1 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.4Dr2HWY3Zbi92l_F_49XKBV4DslM98b_2 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_-tiqCvJcfmYtHPE9FF1XzPp-LbAlcOE', time=2024-09-14T13:45:55.453870+0000, chain.objs.size()=3 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.6rjKu_HL59PEL48La-5ojCR-dgHVyeN_0 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.6rjKu_HL59PEL48La-5ojCR-dgHVyeN_1 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.6rjKu_HL59PEL48La-5ojCR-dgHVyeN_2 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_mK14TqbpXr5zcgEE9RId59VTke07xMV', time=2024-09-14T13:45:56.026065+0000, chain.objs.size()=1 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.164__shadow_.wZpAszoBYN_X2yMPOdbEIXdh0eRe5Qj_0 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8003610086917552604', time=2024-09-14T13:54:42.452888+0000, chain.objs.size()=12 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__multipart_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.1 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__shadow_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.1_1 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__multipart_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.2 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__shadow_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.2_1 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__multipart_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.3 2024-09-14T11:58:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.248+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__shadow_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.3_1 2024-09-14T11:58:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.252+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__multipart_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.4 2024-09-14T11:58:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.253+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__shadow_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.4_1 2024-09-14T11:58:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.253+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__multipart_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.5 2024-09-14T11:58:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.253+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__shadow_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.5_1 2024-09-14T11:58:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.253+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__multipart_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.6 2024-09-14T11:58:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.253+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.624__shadow_multipart_enc.2~U2I6pBTiWLfMiPdjyKJa6CkqavoSYjQ.6_1 2024-09-14T11:58:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.255+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.257+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:58:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.258+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.259+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.259+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.259+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3233124791675284861', time=2024-09-14T13:50:18.994031+0000, chain.objs.size()=1 2024-09-14T11:58:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.259+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.514__multipart_mymultipart.2~BjoTpX7Krun_iSotfvQn-m9UrESuyjL.1 2024-09-14T11:58:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.259+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14273308834442617097', time=2024-09-14T13:50:42.355016+0000, chain.objs.size()=2 2024-09-14T11:58:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.259+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~p1rVPUtOJ8vQe3esje-CKEb6wosg382.1 2024-09-14T11:58:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.259+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~p1rVPUtOJ8vQe3esje-CKEb6wosg382.2 2024-09-14T11:58:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.261+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.263+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:58:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.264+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~fMWcvWQ3s1wFla03ek1EFvTOgOM__Qg', time=2024-09-14T13:46:25.086623+0000, chain.objs.size()=1 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.202__multipart_mymultipart.2~fMWcvWQ3s1wFla03ek1EFvTOgOM__Qg.1 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7189230820405138106', time=2024-09-14T13:50:40.281424+0000, chain.objs.size()=2 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~YbJq7tq4EFNk1GkwRARGYnhVH3u7_DX.1 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~YbJq7tq4EFNk1GkwRARGYnhVH3u7_DX.2 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3580922095829471138', time=2024-09-14T13:51:05.181508+0000, chain.objs.size()=1 2024-09-14T11:58:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.265+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.537__multipart_mymultipart.2~M90yHeeStRL7C_tGZwwgIIYvHLe5nog.1 2024-09-14T11:58:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.267+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.269+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:58:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.270+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_DOspBQY33xPmLogRwe_jqOHmwx-qOKo', time=2024-09-14T13:45:56.021538+0000, chain.objs.size()=1 2024-09-14T11:58:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.164__shadow_.zbXE4qKHKs_iqo2IclKryCf-3voizqO_0 2024-09-14T11:58:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~L3hmJjbnOBrtn0libVeGc4snE5Ovduu', time=2024-09-14T13:50:47.202180+0000, chain.objs.size()=1 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.532__multipart_mymultipart2.2~L3hmJjbnOBrtn0libVeGc4snE5Ovduu.1 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18100995497872916594', time=2024-09-14T13:52:34.883052+0000, chain.objs.size()=12 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__multipart_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.1 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__shadow_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.1_1 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__multipart_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.2 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__shadow_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.2_1 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__multipart_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.3 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__shadow_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.3_1 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__multipart_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.4 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__shadow_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.4_1 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__multipart_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.5 2024-09-14T11:58:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.271+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__shadow_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.5_1 2024-09-14T11:58:47.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.273+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__multipart_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.6 2024-09-14T11:58:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.274+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.616__shadow_multipart_enc.2~kYYQ0qsVzItYNhYC1ElKQA6DiPSUT6f.6_1 2024-09-14T11:58:47.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.275+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4689674707160905975', time=2024-09-14T13:55:59.810269+0000, chain.objs.size()=1 2024-09-14T11:58:47.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.275+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.743__multipart_mymultipart3.2~BFiyQYOayru5SDwaPCsK4NA7YvbmQ-S.1 2024-09-14T11:58:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.277+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.279+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:58:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.280+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_V3U-HU5cG7sUSxjgwm87joP9DBcdcfV', time=2024-09-14T13:45:55.295734+0000, chain.objs.size()=2 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.90n5CJM-cgjZU3unDgSm8kdziCC43XW_1 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.90n5CJM-cgjZU3unDgSm8kdziCC43XW_2 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5467245620484107246', time=2024-09-14T13:50:27.172148+0000, chain.objs.size()=3 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~4jDXDYrzvcMaF6QHGV-Uon-_4PyD28m.1 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~4jDXDYrzvcMaF6QHGV-Uon-_4PyD28m.2 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.281+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~4jDXDYrzvcMaF6QHGV-Uon-_4PyD28m.3 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9109333528599803900', time=2024-09-14T13:50:32.319584+0000, chain.objs.size()=12 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.1 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__shadow_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.1_1 2024-09-14T11:58:47.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.IQODUYRZSWKZ00NZBNM480V1wGB-ktbb.2 2024-09-14T11:58:47.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__shadow_mymultipart.IQODUYRZSWKZ00NZBNM480V1wGB-ktbb.2_1 2024-09-14T11:58:47.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.3 2024-09-14T11:58:47.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__shadow_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.3_1 2024-09-14T11:58:47.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.282+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.4 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.284+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__shadow_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.4_1 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.284+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.5 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.284+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__shadow_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.5_1 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.284+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.6 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.284+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__shadow_mymultipart.2~mW7xjWvw99gpO_QCudofU0d0YtKMolX.6_1 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.284+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj', time=2024-09-14T13:50:43.986530+0000, chain.objs.size()=10 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.284+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.1 2024-09-14T11:58:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.285+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.2 2024-09-14T11:58:47.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.286+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.3 2024-09-14T11:58:47.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.286+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.4 2024-09-14T11:58:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.287+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.5 2024-09-14T11:58:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.287+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.6 2024-09-14T11:58:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.287+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.7 2024-09-14T11:58:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.287+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.8 2024-09-14T11:58:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.287+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.9 2024-09-14T11:58:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.287+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.527__multipart_mymultipart.2~lntV_cgBQL08Weu4I1qR-NYcT70yiNj.10 2024-09-14T11:58:47.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.289+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.291+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:58:47.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.292+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4687826216080862241', time=2024-09-14T13:45:54.664649+0000, chain.objs.size()=5 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-LUKEWARM.2~Kw3p2Q-zHA-5sF7fhEGZ7et8RnOCpuW.1 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_foo-LUKEWARM.2~Kw3p2Q-zHA-5sF7fhEGZ7et8RnOCpuW.1_1 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-LUKEWARM.2~Kw3p2Q-zHA-5sF7fhEGZ7et8RnOCpuW.2 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_foo-LUKEWARM.2~Kw3p2Q-zHA-5sF7fhEGZ7et8RnOCpuW.2_1 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-LUKEWARM.2~Kw3p2Q-zHA-5sF7fhEGZ7et8RnOCpuW.3 2024-09-14T11:58:47.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1812976428368081991', time=2024-09-14T13:50:16.766252+0000, chain.objs.size()=12 2024-09-14T11:58:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1 2024-09-14T11:58:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1_1 2024-09-14T11:58:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2 2024-09-14T11:58:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2_1 2024-09-14T11:58:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3 2024-09-14T11:58:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3_1 2024-09-14T11:58:47.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.293+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4 2024-09-14T11:58:47.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.296+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4_1 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.296+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.296+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5_1 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.296+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6_1 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.913477173877499464', time=2024-09-14T13:50:16.881062+0000, chain.objs.size()=12 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1_1 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2_1 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3 2024-09-14T11:58:47.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.297+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3_1 2024-09-14T11:58:47.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4 2024-09-14T11:58:47.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4_1 2024-09-14T11:58:47.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5 2024-09-14T11:58:47.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5_1 2024-09-14T11:58:47.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6 2024-09-14T11:58:47.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6_1 2024-09-14T11:58:47.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~sv5bFKrZMJsAb1UerB4IHNaLnBGHsSt', time=2024-09-14T13:50:32.313903+0000, chain.objs.size()=1 2024-09-14T11:58:47.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.299+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~sv5bFKrZMJsAb1UerB4IHNaLnBGHsSt.3 2024-09-14T11:58:47.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.300+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.303+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:58:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.304+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.305+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.305+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.305+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17097700028083405446', time=2024-09-14T13:45:56.721888+0000, chain.objs.size()=2 2024-09-14T11:58:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.305+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.165__multipart_foo.2~9AQjz6a_BVyTZwuIq0LOMVR_rypYIKI.1 2024-09-14T11:58:47.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.305+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.165__multipart_foo.2~9AQjz6a_BVyTZwuIq0LOMVR_rypYIKI.2 2024-09-14T11:58:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.306+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.308+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:58:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.310+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.310+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_7DoGtE_K5Qff4kRT60RtkuvuiJuirzK', time=2024-09-14T13:45:56.796622+0000, chain.objs.size()=1 2024-09-14T11:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.166__shadow_.LxZWqHWk3aYyw_I2DU7IAs9hxfn_zPM_0 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9607964098372941817', time=2024-09-14T13:50:27.599314+0000, chain.objs.size()=3 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~jiyjsAQo2qPNpRcDSPDigVxzExPAy-G.1 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~jiyjsAQo2qPNpRcDSPDigVxzExPAy-G.2 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~jiyjsAQo2qPNpRcDSPDigVxzExPAy-G.3 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~5g3TgwyeQ12c3GmeQO7aZivmlife-AT', time=2024-09-14T13:50:28.265602+0000, chain.objs.size()=1 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~5g3TgwyeQ12c3GmeQO7aZivmlife-AT.1 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7804257168878266318', time=2024-09-14T13:50:41.746071+0000, chain.objs.size()=1 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~09THxdH6Ku7Pl0CLv4_ex6hAvnV6Tjo.1 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14670333594281494521', time=2024-09-14T13:55:24.998861+0000, chain.objs.size()=1 2024-09-14T11:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.311+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.712__multipart_file1.2~pShHbfnDa3TmBFIUYMinYbId3uVjISS.1 2024-09-14T11:58:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.313+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.315+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:58:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.316+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7877442773130721222', time=2024-09-14T13:45:51.531748+0000, chain.objs.size()=3 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.159__shadow_.4BGuT9qtIiNesa0QVOvPO8us01TGqkG_0 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.159__shadow_.4BGuT9qtIiNesa0QVOvPO8us01TGqkG_1 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.159__shadow_.4BGuT9qtIiNesa0QVOvPO8us01TGqkG_2 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13580057140538600178', time=2024-09-14T13:50:42.053546+0000, chain.objs.size()=3 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~MuQA5wEsDEPA5xXdPAcfXoNddMXJ0Fn.1 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__shadow_mymultipart.2~MuQA5wEsDEPA5xXdPAcfXoNddMXJ0Fn.1_1 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~MuQA5wEsDEPA5xXdPAcfXoNddMXJ0Fn.2 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~OjkEvquReMycXV6Vc_CUkN6F2pXXWoB', time=2024-09-14T13:50:48.323480+0000, chain.objs.size()=1 2024-09-14T11:58:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.317+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.534__multipart_mymultipart.2~OjkEvquReMycXV6Vc_CUkN6F2pXXWoB.1 2024-09-14T11:58:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.320+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.322+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:58:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.323+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.323+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7505641284441560227', time=2024-09-14T13:45:54.135007+0000, chain.objs.size()=3 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-STANDARD.2~DET8WjnUrnZtGcnC1v3Xgh6-F7IaaGw.1 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-STANDARD.2~DET8WjnUrnZtGcnC1v3Xgh6-F7IaaGw.2 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-STANDARD.2~DET8WjnUrnZtGcnC1v3Xgh6-F7IaaGw.3 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1552995185193449294', time=2024-09-14T13:50:18.083041+0000, chain.objs.size()=1 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.512__multipart_mymultipart.2~XCb8qjil73g60vD69ayGoQsKboLg0gn.1 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6800268327027442830', time=2024-09-14T13:50:34.635409+0000, chain.objs.size()=6 2024-09-14T11:58:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~sv5bFKrZMJsAb1UerB4IHNaLnBGHsSt.1 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~sv5bFKrZMJsAb1UerB4IHNaLnBGHsSt.2 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.j0yTNFzzCYcR1mrne3FAe19RWjlDQXgz.3 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~sv5bFKrZMJsAb1UerB4IHNaLnBGHsSt.4 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~sv5bFKrZMJsAb1UerB4IHNaLnBGHsSt.5 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~sv5bFKrZMJsAb1UerB4IHNaLnBGHsSt.6 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3152743639259526309', time=2024-09-14T13:51:30.405501+0000, chain.objs.size()=1 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.562__multipart_mymultipart.slS1wh3si0Brlh3CAAhBv3O3_0Unf6Zj.1 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.9304974380435854459', time=2024-09-14T13:56:54.822335+0000, chain.objs.size()=4 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.324+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.780__shadow_.00Rii3MuYloeHLrqudomzg5vuA7e4qs_1 2024-09-14T11:58:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.326+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.780__shadow_.00Rii3MuYloeHLrqudomzg5vuA7e4qs_2 2024-09-14T11:58:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.326+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.780__shadow_.00Rii3MuYloeHLrqudomzg5vuA7e4qs_3 2024-09-14T11:58:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.326+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.780__shadow_.00Rii3MuYloeHLrqudomzg5vuA7e4qs_4 2024-09-14T11:58:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.329+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.332+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:58:47.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.333+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.334+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:58:47.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.11927471508013651297', time=2024-09-14T13:50:16.765439+0000, chain.objs.size()=12 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1_1 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2_1 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3_1 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4_1 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5_1 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6 2024-09-14T11:58:47.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.335+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6_1 2024-09-14T11:58:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~0Z69A8-MmjL5irxq1nBoEkRMkujC8qF', time=2024-09-14T13:50:45.891864+0000, chain.objs.size()=2 2024-09-14T11:58:47.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.530__multipart_mymultipart.2~0Z69A8-MmjL5irxq1nBoEkRMkujC8qF.1 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.530__multipart_mymultipart.2~0Z69A8-MmjL5irxq1nBoEkRMkujC8qF.2 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO', time=2024-09-14T13:54:44.257533+0000, chain.objs.size()=12 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__multipart_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.1 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__shadow_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.1_1 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__multipart_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.2 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__shadow_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.2_1 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__multipart_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.3 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__shadow_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.3_1 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__multipart_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.4 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__shadow_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.4_1 2024-09-14T11:58:47.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.337+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__multipart_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.5 2024-09-14T11:58:47.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.340+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__shadow_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.5_1 2024-09-14T11:58:47.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.340+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__multipart_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.6 2024-09-14T11:58:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.340+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.626__shadow_multipart_enc.2~JgYSLFMJtSA0UkRuvXNY1rtBFoBH9MO.6_1 2024-09-14T11:58:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.340+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10836820070626673619', time=2024-09-14T13:54:56.154608+0000, chain.objs.size()=1 2024-09-14T11:58:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.340+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.650__shadow_.Ce3CIGrcR5XffXfuyKboM2bghCuKckE_1 2024-09-14T11:58:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.340+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13517807214188604454', time=2024-09-14T13:55:20.616319+0000, chain.objs.size()=1 2024-09-14T11:58:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.340+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.703__multipart_file1.2~lCEYdir2yQN4ZJFZIhXue-q-ESXG5jq.1 2024-09-14T11:58:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.342+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.345+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:58:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.347+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.347+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1465850742095619164', time=2024-09-14T13:50:24.768531+0000, chain.objs.size()=6 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.520__multipart_mymultipart.2~6SjJ-vODMJDAr9mtNi1UfzZ3ddLlzmM.1 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.520__multipart_mymultipart.2~6SjJ-vODMJDAr9mtNi1UfzZ3ddLlzmM.2 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.520__multipart_mymultipart.2~6SjJ-vODMJDAr9mtNi1UfzZ3ddLlzmM.3 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.520__multipart_mymultipart.2~6SjJ-vODMJDAr9mtNi1UfzZ3ddLlzmM.4 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.520__multipart_mymultipart.2~6SjJ-vODMJDAr9mtNi1UfzZ3ddLlzmM.5 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.520__multipart_mymultipart.2~6SjJ-vODMJDAr9mtNi1UfzZ3ddLlzmM.6 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.93197838850137598', time=2024-09-14T13:50:42.747310+0000, chain.objs.size()=3 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~rpc9FRO4QBcK7hVEvXRYO8yLnj7yij6.1 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~rpc9FRO4QBcK7hVEvXRYO8yLnj7yij6.2 2024-09-14T11:58:47.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~rpc9FRO4QBcK7hVEvXRYO8yLnj7yij6.3 2024-09-14T11:58:47.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~3__T0Zg9qbqerhcCW8iC04p0CvZosSE', time=2024-09-14T13:50:49.428119+0000, chain.objs.size()=1 2024-09-14T11:58:47.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.536__multipart_mymultipart.2~3__T0Zg9qbqerhcCW8iC04p0CvZosSE.3 2024-09-14T11:58:47.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1961668721935276302', time=2024-09-14T13:54:52.191686+0000, chain.objs.size()=1 2024-09-14T11:58:47.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.348+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.643__shadow_.qzxXVIIj383yiQZZZm-Bfj1r1mV19Ls_1 2024-09-14T11:58:47.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.350+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.353+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:58:47.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.354+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.354+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16622065421447531478', time=2024-09-14T13:50:16.990767+0000, chain.objs.size()=12 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1_1 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2_1 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3_1 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4 2024-09-14T11:58:47.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4_1 2024-09-14T11:58:47.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5 2024-09-14T11:58:47.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5_1 2024-09-14T11:58:47.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6 2024-09-14T11:58:47.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.355+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6_1 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.18306561310818172370', time=2024-09-14T13:50:21.279350+0000, chain.objs.size()=1 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.519__multipart_mymultipart.2~iwJTgW_8eWPSQbPxVbRk-2-0uJ7M0tH.1 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10300959344215329222', time=2024-09-14T13:50:43.409584+0000, chain.objs.size()=2 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~kcEBXtWMXAOcAmScdJpndK8eNem1cRw.1 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~kcEBXtWMXAOcAmScdJpndK8eNem1cRw.2 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8388983741963006198', time=2024-09-14T13:55:02.697180+0000, chain.objs.size()=6 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.661__multipart_bar.2~4EuVT02eGzAx7-9aOmyhqzeoISINtCV.1 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.661__multipart_bar.2~4EuVT02eGzAx7-9aOmyhqzeoISINtCV.2 2024-09-14T11:58:47.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.357+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.661__multipart_bar.2~4EuVT02eGzAx7-9aOmyhqzeoISINtCV.3 2024-09-14T11:58:47.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.358+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.661__multipart_bar.2~4EuVT02eGzAx7-9aOmyhqzeoISINtCV.4 2024-09-14T11:58:47.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.358+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.661__multipart_bar.2~4EuVT02eGzAx7-9aOmyhqzeoISINtCV.5 2024-09-14T11:58:47.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.358+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.661__multipart_bar.2~4EuVT02eGzAx7-9aOmyhqzeoISINtCV.6 2024-09-14T11:58:47.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.360+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.362+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:58:47.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.364+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2324626153065791440', time=2024-09-14T13:45:52.592682+0000, chain.objs.size()=3 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-STANDARD.2~UeJimRKxbVoyhfGbnnr5n_GkhRyVcmO.1 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-STANDARD.2~UeJimRKxbVoyhfGbnnr5n_GkhRyVcmO.2 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-STANDARD.2~UeJimRKxbVoyhfGbnnr5n_GkhRyVcmO.3 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1292204937795629278', time=2024-09-14T13:45:52.814348+0000, chain.objs.size()=2 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.mBAz9F2U7ZLljcQGye8VAVLCA_Mlluk_1 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.mBAz9F2U7ZLljcQGye8VAVLCA_Mlluk_2 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~M4ni9Z0dC6Pma4xAviQGl6rj-UTiZxs', time=2024-09-14T13:50:48.850157+0000, chain.objs.size()=1 2024-09-14T11:58:47.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.535__multipart_mymultipart.2~M4ni9Z0dC6Pma4xAviQGl6rj-UTiZxs.1 2024-09-14T11:58:47.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.5721791720401882069', time=2024-09-14T13:51:35.549593+0000, chain.objs.size()=2 2024-09-14T11:58:47.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.564__shadow_.sp37PCIcMwaZTiIlGii7Ep2-YtA-122_1 2024-09-14T11:58:47.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.365+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.564__shadow_.sp37PCIcMwaZTiIlGii7Ep2-YtA-122_2 2024-09-14T11:58:47.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.368+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.371+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:58:47.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.372+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.372+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.7980373758349585272', time=2024-09-14T13:45:55.208123+0000, chain.objs.size()=5 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-FROZEN.2~gocXpAyszyzBhXYrsYObFwIe8M8cMnB.1 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_foo-FROZEN.2~gocXpAyszyzBhXYrsYObFwIe8M8cMnB.1_1 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-FROZEN.2~gocXpAyszyzBhXYrsYObFwIe8M8cMnB.2 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_foo-FROZEN.2~gocXpAyszyzBhXYrsYObFwIe8M8cMnB.2_1 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__multipart_foo-FROZEN.2~gocXpAyszyzBhXYrsYObFwIe8M8cMnB.3 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL', time=2024-09-14T13:50:34.627855+0000, chain.objs.size()=1 2024-09-14T11:58:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL.2 2024-09-14T11:58:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL', time=2024-09-14T13:50:34.629158+0000, chain.objs.size()=1 2024-09-14T11:58:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL.3 2024-09-14T11:58:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2869247787965725181', time=2024-09-14T13:50:44.736030+0000, chain.objs.size()=4 2024-09-14T11:58:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.528__multipart_mymultipart.2~_T_DjHaFUOKvkV4AzjNEdvCqmy8VYKf.1 2024-09-14T11:58:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.528__multipart_mymultipart.2~_T_DjHaFUOKvkV4AzjNEdvCqmy8VYKf.2 2024-09-14T11:58:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.528__multipart_mymultipart.2~_T_DjHaFUOKvkV4AzjNEdvCqmy8VYKf.3 2024-09-14T11:58:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.373+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.528__multipart_mymultipart.2~_T_DjHaFUOKvkV4AzjNEdvCqmy8VYKf.4 2024-09-14T11:58:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.376+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.378+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:58:47.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.379+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_BhL56YvO7EwEwbYXmgT4w4LfJ_VF0Wv', time=2024-09-14T13:45:56.802123+0000, chain.objs.size()=1 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.166__shadow_.OC-OjyJBFnWx9flt2OF_a7mKlf9emTL_0 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4457084284653336556', time=2024-09-14T13:50:40.080473+0000, chain.objs.size()=3 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~BUaw09-FsCeqiz7BZBuLXjAEYAI18Ug.1 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__shadow_mymultipart.2~BUaw09-FsCeqiz7BZBuLXjAEYAI18Ug.1_1 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~BUaw09-FsCeqiz7BZBuLXjAEYAI18Ug.2 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14257544467411260855', time=2024-09-14T13:50:40.491879+0000, chain.objs.size()=5 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~d0kjzA7gukSfMoqGB1P0pBVx9o-l1wq.1 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__shadow_mymultipart.2~d0kjzA7gukSfMoqGB1P0pBVx9o-l1wq.1_1 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~d0kjzA7gukSfMoqGB1P0pBVx9o-l1wq.2 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__shadow_mymultipart.2~d0kjzA7gukSfMoqGB1P0pBVx9o-l1wq.2_1 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~d0kjzA7gukSfMoqGB1P0pBVx9o-l1wq.3 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2805775581667830941', time=2024-09-14T13:55:02.810640+0000, chain.objs.size()=6 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.662__multipart_baz.2~UTRZzKulP5-fpqzPjbCx1VMQ2Bx4s5e.1 2024-09-14T11:58:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.662__multipart_baz.2~UTRZzKulP5-fpqzPjbCx1VMQ2Bx4s5e.2 2024-09-14T11:58:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.380+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.662__multipart_baz.2~UTRZzKulP5-fpqzPjbCx1VMQ2Bx4s5e.3 2024-09-14T11:58:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.382+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.662__multipart_baz.2~UTRZzKulP5-fpqzPjbCx1VMQ2Bx4s5e.4 2024-09-14T11:58:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.382+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.662__multipart_baz.2~UTRZzKulP5-fpqzPjbCx1VMQ2Bx4s5e.5 2024-09-14T11:58:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.382+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.662__multipart_baz.2~UTRZzKulP5-fpqzPjbCx1VMQ2Bx4s5e.6 2024-09-14T11:58:47.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.384+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.386+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:58:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.387+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_eWUs52NtwuOb5JLQqCtbFu6HhF9M4t4', time=2024-09-14T13:45:55.448167+0000, chain.objs.size()=3 2024-09-14T11:58:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.DszPJBPMYNIBKiXoduYci_KR3cCGXoe_0 2024-09-14T11:58:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.DszPJBPMYNIBKiXoduYci_KR3cCGXoe_1 2024-09-14T11:58:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.DszPJBPMYNIBKiXoduYci_KR3cCGXoe_2 2024-09-14T11:58:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17253045900829528471', time=2024-09-14T13:56:00.588909+0000, chain.objs.size()=6 2024-09-14T11:58:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.744__multipart_mymultipart3.2~mtzD_YfNCOx4GpWJkuIGrnxODkBwSrg.1 2024-09-14T11:58:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.744__shadow_mymultipart3.2~mtzD_YfNCOx4GpWJkuIGrnxODkBwSrg.1_1 2024-09-14T11:58:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.744__multipart_mymultipart3.2~mtzD_YfNCOx4GpWJkuIGrnxODkBwSrg.2 2024-09-14T11:58:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.744__shadow_mymultipart3.2~mtzD_YfNCOx4GpWJkuIGrnxODkBwSrg.2_1 2024-09-14T11:58:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.744__multipart_mymultipart3.2~mtzD_YfNCOx4GpWJkuIGrnxODkBwSrg.3 2024-09-14T11:58:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.388+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.744__shadow_mymultipart3.2~mtzD_YfNCOx4GpWJkuIGrnxODkBwSrg.3_1 2024-09-14T11:58:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.392+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.394+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:58:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.396+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.396+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:58:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_a94U3LtW5b83kucOcy-F5W5Mx3Wxhib', time=2024-09-14T13:45:53.683881+0000, chain.objs.size()=3 2024-09-14T11:58:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.3LvJC_B2L2bQHrHsggbzOJSXlVMT7k8_0 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.3LvJC_B2L2bQHrHsggbzOJSXlVMT7k8_1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.3LvJC_B2L2bQHrHsggbzOJSXlVMT7k8_2 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~__JXS2Y-O1eQM1n-hLeaY1bFWangtCR', time=2024-09-14T13:50:47.195003+0000, chain.objs.size()=2 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.532__multipart_mymultipart.2~__JXS2Y-O1eQM1n-hLeaY1bFWangtCR.1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.532__multipart_mymultipart.2~__JXS2Y-O1eQM1n-hLeaY1bFWangtCR.2 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.4010016753402732493', time=2024-09-14T13:51:28.352143+0000, chain.objs.size()=1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.559__shadow_.qHFdvPHYDkEOyPTodAhWfQsMVPN1UXq_1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~q7aKcYViSjMO8xQhbV8wzbqHsdOId29', time=2024-09-14T13:51:30.159855+0000, chain.objs.size()=1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.562__multipart_mymultipart.2~q7aKcYViSjMO8xQhbV8wzbqHsdOId29.1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71', time=2024-09-14T13:54:43.367671+0000, chain.objs.size()=12 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__multipart_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__shadow_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.1_1 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__multipart_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.2 2024-09-14T11:58:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__shadow_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.2_1 2024-09-14T11:58:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.397+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__multipart_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.3 2024-09-14T11:58:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.399+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__shadow_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.3_1 2024-09-14T11:58:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.400+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__multipart_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.4 2024-09-14T11:58:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.400+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__shadow_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.4_1 2024-09-14T11:58:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.400+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__multipart_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.5 2024-09-14T11:58:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.400+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__shadow_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.5_1 2024-09-14T11:58:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.400+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__multipart_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.6 2024-09-14T11:58:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.400+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.625__shadow_multipart_enc.2~N7po2jVBM8yqWaT9ftrVtCDk1UFrP71.6_1 2024-09-14T11:58:47.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.404+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.406+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:58:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:58:47.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_VqrRGpjVE_ZaPrI03Je521fP2t5Bodr', time=2024-09-14T13:45:53.672924+0000, chain.objs.size()=3 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.K1F-Qh8ADJ4GZgRpASR_rwaNaPf0drb_0 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.K1F-Qh8ADJ4GZgRpASR_rwaNaPf0drb_1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.K1F-Qh8ADJ4GZgRpASR_rwaNaPf0drb_2 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_C9P7foeuVnpjPMzRBZ2VkakKxEvcoXZ', time=2024-09-14T13:45:55.458888+0000, chain.objs.size()=1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.408+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.4qMPeH7At0QkRn4VPheNizeuUD5_O2H_0 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.8374110591914696280', time=2024-09-14T13:50:21.953733+0000, chain.objs.size()=1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.519__multipart_mymultipart.2~5WQJhKn8UetNuMgXQgvFnxiFvK98MaQ.1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt', time=2024-09-14T13:50:37.416720+0000, chain.objs.size()=1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt.1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt', time=2024-09-14T13:50:37.418268+0000, chain.objs.size()=1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt.2 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt', time=2024-09-14T13:50:37.419716+0000, chain.objs.size()=1 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt.3 2024-09-14T11:58:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt', time=2024-09-14T13:50:37.421230+0000, chain.objs.size()=1 2024-09-14T11:58:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt.4 2024-09-14T11:58:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt', time=2024-09-14T13:50:37.422740+0000, chain.objs.size()=1 2024-09-14T11:58:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt.5 2024-09-14T11:58:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt', time=2024-09-14T13:50:37.425058+0000, chain.objs.size()=1 2024-09-14T11:58:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~UEvnOQqRub751ccKXUtxq9w1xKuX3lt.6 2024-09-14T11:58:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3550373072948505814', time=2024-09-14T13:50:37.431738+0000, chain.objs.size()=6 2024-09-14T11:58:47.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.409+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL.1 2024-09-14T11:58:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.411+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.YA3768idCm4TU_VCBuIB3_yushC6_cqD.2 2024-09-14T11:58:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.412+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.xdV_Ox1dNFfJS-VI0JjFJJ58g72QoDqg.3 2024-09-14T11:58:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.412+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL.4 2024-09-14T11:58:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.412+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL.5 2024-09-14T11:58:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.412+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~4-x5fdDE2oC6ykA1axcFkBnVozPgdoL.6 2024-09-14T11:58:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.412+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12914686082090036721', time=2024-09-14T13:54:56.734292+0000, chain.objs.size()=1 2024-09-14T11:58:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.412+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.651__shadow_.KS15mFlhYOCQhbl-_GnlOur-RMS0cNX_1 2024-09-14T11:58:47.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.413+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.415+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:58:47.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.417+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.417+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10307772291550392325', time=2024-09-14T13:50:40.649724+0000, chain.objs.size()=5 2024-09-14T11:58:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~2QamTY6SHnZs9IMdW8MJ8zVCvKQAtDX.1 2024-09-14T11:58:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__shadow_mymultipart.2~2QamTY6SHnZs9IMdW8MJ8zVCvKQAtDX.1_1 2024-09-14T11:58:47.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~2QamTY6SHnZs9IMdW8MJ8zVCvKQAtDX.2 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__shadow_mymultipart.2~2QamTY6SHnZs9IMdW8MJ8zVCvKQAtDX.2_1 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~2QamTY6SHnZs9IMdW8MJ8zVCvKQAtDX.3 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~hCtq7W6GHX7RbDYUdvZs0mAnJVkc7I-', time=2024-09-14T13:50:47.186682+0000, chain.objs.size()=2 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.532__multipart_mymultipart.2~hCtq7W6GHX7RbDYUdvZs0mAnJVkc7I-.1 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.532__shadow_mymultipart.2~hCtq7W6GHX7RbDYUdvZs0mAnJVkc7I-.1_1 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2317219501312956986', time=2024-09-14T13:52:33.827909+0000, chain.objs.size()=12 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__multipart_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.1 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__shadow_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.1_1 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__multipart_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.2 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__shadow_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.2_1 2024-09-14T11:58:47.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.418+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__multipart_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.3 2024-09-14T11:58:47.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.420+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__shadow_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.3_1 2024-09-14T11:58:47.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.421+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__multipart_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.4 2024-09-14T11:58:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__shadow_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.4_1 2024-09-14T11:58:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__multipart_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.5 2024-09-14T11:58:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__shadow_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.5_1 2024-09-14T11:58:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__multipart_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.6 2024-09-14T11:58:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.615__shadow_multipart_enc.2~3o8FrM2-GiW4uELRWAXZkr2TGGjcknC.6_1 2024-09-14T11:58:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2593475194416561103', time=2024-09-14T13:55:02.927519+0000, chain.objs.size()=6 2024-09-14T11:58:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.663__multipart_foo.2~-umksO0Kf7s-aBnnxtsyv-UhnGF2piz.1 2024-09-14T11:58:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.663__multipart_foo.2~-umksO0Kf7s-aBnnxtsyv-UhnGF2piz.2 2024-09-14T11:58:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.663__multipart_foo.2~-umksO0Kf7s-aBnnxtsyv-UhnGF2piz.3 2024-09-14T11:58:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.422+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.663__multipart_foo.2~-umksO0Kf7s-aBnnxtsyv-UhnGF2piz.4 2024-09-14T11:58:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.423+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.663__multipart_foo.2~-umksO0Kf7s-aBnnxtsyv-UhnGF2piz.5 2024-09-14T11:58:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.423+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.663__multipart_foo.2~-umksO0Kf7s-aBnnxtsyv-UhnGF2piz.6 2024-09-14T11:58:47.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.427+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.429+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.430+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.430+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13087882646475229019', time=2024-09-14T13:45:52.582138+0000, chain.objs.size()=5 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-FROZEN.2~DJ7NRl63hK44cY2SRgZ4mILrP0pjo3V.1 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__shadow_mymultipart-FROZEN.2~DJ7NRl63hK44cY2SRgZ4mILrP0pjo3V.1_1 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-FROZEN.2~DJ7NRl63hK44cY2SRgZ4mILrP0pjo3V.2 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__shadow_mymultipart-FROZEN.2~DJ7NRl63hK44cY2SRgZ4mILrP0pjo3V.2_1 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-FROZEN.2~DJ7NRl63hK44cY2SRgZ4mILrP0pjo3V.3 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14304496893328416149', time=2024-09-14T13:45:52.587549+0000, chain.objs.size()=5 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-LUKEWARM.2~N6wBMThDkcEdZXckPAcPRXlFGJyUdsw.1 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__shadow_mymultipart-LUKEWARM.2~N6wBMThDkcEdZXckPAcPRXlFGJyUdsw.1_1 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-LUKEWARM.2~N6wBMThDkcEdZXckPAcPRXlFGJyUdsw.2 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__shadow_mymultipart-LUKEWARM.2~N6wBMThDkcEdZXckPAcPRXlFGJyUdsw.2_1 2024-09-14T11:58:47.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.160__multipart_mymultipart-LUKEWARM.2~N6wBMThDkcEdZXckPAcPRXlFGJyUdsw.3 2024-09-14T11:58:47.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15761239757434721600', time=2024-09-14T13:45:53.121699+0000, chain.objs.size()=3 2024-09-14T11:58:47.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.9UhtGsYN42wXRgkDkqXxPsyzac5xM41_0 2024-09-14T11:58:47.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.431+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.9UhtGsYN42wXRgkDkqXxPsyzac5xM41_1 2024-09-14T11:58:47.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.9UhtGsYN42wXRgkDkqXxPsyzac5xM41_2 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1891819867379369963', time=2024-09-14T13:50:21.589754+0000, chain.objs.size()=1 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.519__multipart_mymultipart.2~OBo4M96sbLLSDDd3D_JL1jDDBSizr2w.1 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1824406439399850853', time=2024-09-14T13:50:26.684481+0000, chain.objs.size()=3 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~k6YN0A2Wln4P8bitG42YNGkCL76Trvh.1 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~k6YN0A2Wln4P8bitG42YNGkCL76Trvh.2 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.522__multipart_mymultipart.2~k6YN0A2Wln4P8bitG42YNGkCL76Trvh.3 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.17611319766616809799', time=2024-09-14T13:50:45.413767+0000, chain.objs.size()=2 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.529__multipart_mymultipart.2~kPOnQ8JebnE2NNzjGn273_I6F6FAW9a.1 2024-09-14T11:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.434+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.529__multipart_mymultipart.2~kPOnQ8JebnE2NNzjGn273_I6F6FAW9a.2 2024-09-14T11:58:47.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.437+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.439+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:58:47.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.440+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:47.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.2023945466270929090', time=2024-09-14T13:45:51.536932+0000, chain.objs.size()=3 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.159__shadow_.5bVTLI_Z8pJ-P3v83_wuKJNG5oV1luD_0 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.159__shadow_.5bVTLI_Z8pJ-P3v83_wuKJNG5oV1luD_1 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.159__shadow_.5bVTLI_Z8pJ-P3v83_wuKJNG5oV1luD_2 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16116180741173753410', time=2024-09-14T13:50:16.765145+0000, chain.objs.size()=12 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1_1 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2_1 2024-09-14T11:58:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3 2024-09-14T11:58:47.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3_1 2024-09-14T11:58:47.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.441+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4 2024-09-14T11:58:47.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.442+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4_1 2024-09-14T11:58:47.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.442+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5 2024-09-14T11:58:47.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.445+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5_1 2024-09-14T11:58:47.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.445+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6 2024-09-14T11:58:47.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.445+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6_1 2024-09-14T11:58:47.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.446+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.448+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:58:47.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:47.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.13090511064622343258', time=2024-09-14T13:52:09.353920+0000, chain.objs.size()=4 2024-09-14T11:58:47.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~QW6MXPr1kJ0QHyvDG8WWrJ3Wa0c7bpI.1 2024-09-14T11:58:47.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~QW6MXPr1kJ0QHyvDG8WWrJ3Wa0c7bpI.2 2024-09-14T11:58:47.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~QW6MXPr1kJ0QHyvDG8WWrJ3Wa0c7bpI.3 2024-09-14T11:58:47.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.450+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~QW6MXPr1kJ0QHyvDG8WWrJ3Wa0c7bpI.4 2024-09-14T11:58:47.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.452+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.454+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:58:47.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.455+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:58:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_8EByY86hZG6qq7gHEgyo4vOjt4MGFPm', time=2024-09-14T13:45:53.678216+0000, chain.objs.size()=3 2024-09-14T11:58:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.Iy9cXn2GH25V-XVfzKBx09CYiAJUoww_0 2024-09-14T11:58:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.Iy9cXn2GH25V-XVfzKBx09CYiAJUoww_1 2024-09-14T11:58:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.161__shadow_.Iy9cXn2GH25V-XVfzKBx09CYiAJUoww_2 2024-09-14T11:58:47.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='_Z0BYm18gGkCH01qDz_2gGkIvDhj4OpR', time=2024-09-14T13:45:54.767410+0000, chain.objs.size()=2 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.tyaMDiz6Uxt5_pdKY1-PPle9Kg9EkyW_1 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.162__shadow_.tyaMDiz6Uxt5_pdKY1-PPle9Kg9EkyW_2 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12117751011150927226', time=2024-09-14T13:50:22.309789+0000, chain.objs.size()=1 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.519__multipart_mymultipart.2~bQFad5XACjG5FnRDCuz2WC8nbE6Zsqy.1 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14757996944356318012', time=2024-09-14T13:52:09.015053+0000, chain.objs.size()=4 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~MuB2Ugp62WUyjNa4k8dliOBd6usph-a.1 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~MuB2Ugp62WUyjNa4k8dliOBd6usph-a.2 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~MuB2Ugp62WUyjNa4k8dliOBd6usph-a.3 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~MuB2Ugp62WUyjNa4k8dliOBd6usph-a.4 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.15308036475936954778', time=2024-09-14T13:54:52.665517+0000, chain.objs.size()=1 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.644__shadow_.Ir8xyTnvMLUzC6MDhM6GsQ07ucxsvZf_1 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~kg11qUvgX_JBOlrlT0HZt0O56M7MNo5', time=2024-09-14T13:55:59.862381+0000, chain.objs.size()=1 2024-09-14T11:58:47.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.456+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.743__multipart_mymultipart.2~kg11qUvgX_JBOlrlT0HZt0O56M7MNo5.1 2024-09-14T11:58:47.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.460+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.462+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:58:47.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.463+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:58:47.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.10677854263741715860', time=2024-09-14T13:50:16.990228+0000, chain.objs.size()=12 2024-09-14T11:58:47.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1 2024-09-14T11:58:47.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.1_1 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.2_1 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.3_1 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.4_1 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.464+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.5_1 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.465+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__multipart_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6 2024-09-14T11:58:47.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.465+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.508__shadow_srcmultipart.2~jt-VLFv9fWRoJgGyfrXtVCz6b9_ES4u.6_1 2024-09-14T11:58:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.467+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.12035835617838930595', time=2024-09-14T13:50:30.223319+0000, chain.objs.size()=6 2024-09-14T11:58:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.467+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.I1t5nHzbXj3pZHSZlmsacSOQO12Q6K92.1 2024-09-14T11:58:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~5g3TgwyeQ12c3GmeQO7aZivmlife-AT.2 2024-09-14T11:58:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~5g3TgwyeQ12c3GmeQO7aZivmlife-AT.3 2024-09-14T11:58:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~5g3TgwyeQ12c3GmeQO7aZivmlife-AT.4 2024-09-14T11:58:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~5g3TgwyeQ12c3GmeQO7aZivmlife-AT.5 2024-09-14T11:58:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.2~5g3TgwyeQ12c3GmeQO7aZivmlife-AT.6 2024-09-14T11:58:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16267061546010233110', time=2024-09-14T13:50:43.091750+0000, chain.objs.size()=3 2024-09-14T11:58:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~0p6J8WtMIIVPxSZwjjb766CbnDmMSVK.1 2024-09-14T11:58:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~0p6J8WtMIIVPxSZwjjb766CbnDmMSVK.2 2024-09-14T11:58:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.526__multipart_mymultipart.2~0p6J8WtMIIVPxSZwjjb766CbnDmMSVK.3 2024-09-14T11:58:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3024368057199258744', time=2024-09-14T13:50:43.290700+0000, chain.objs.size()=2 2024-09-14T11:58:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.525__shadow_.GfZbstDyp_ybhFF1uOKjpk7K2HvvfST_1 2024-09-14T11:58:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.468+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.525__shadow_.GfZbstDyp_ybhFF1uOKjpk7K2HvvfST_2 2024-09-14T11:58:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.471+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.473+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:58:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.475+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.475+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.475+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:58:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.475+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1555773417267165719', time=2024-09-14T13:50:20.378706+0000, chain.objs.size()=1 2024-09-14T11:58:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.475+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.517__multipart_mymultipartcopy.2~X9KW-_DdUUEb9dH33wRuciAksRgIw_4.1 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.6984600967614883715', time=2024-09-14T13:50:40.761042+0000, chain.objs.size()=2 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~-JQsfmYIbamysjkgS4QhSW4kVPSMruh.1 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.524__multipart_mymultipart.2~-JQsfmYIbamysjkgS4QhSW4kVPSMruh.2 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.16502511466303644573', time=2024-09-14T13:51:03.156828+0000, chain.objs.size()=4 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.536__multipart_mymultipart.2~3__T0Zg9qbqerhcCW8iC04p0CvZosSE.1 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.536__multipart_mymultipart.2~3__T0Zg9qbqerhcCW8iC04p0CvZosSE.2 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.536__multipart_mymultipart.eL5stTowVX2UZwNhhIag0pxFB8MXA5XO.3 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.536__multipart_mymultipart.2~3__T0Zg9qbqerhcCW8iC04p0CvZosSE.4 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1328850059475393169', time=2024-09-14T13:52:09.631397+0000, chain.objs.size()=7 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~SJbMoztxqXQmbscegIcuT_BQHjoNBLM.1 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__shadow_testobj.2~SJbMoztxqXQmbscegIcuT_BQHjoNBLM.1_1 2024-09-14T11:58:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~SJbMoztxqXQmbscegIcuT_BQHjoNBLM.2 2024-09-14T11:58:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__shadow_testobj.2~SJbMoztxqXQmbscegIcuT_BQHjoNBLM.2_1 2024-09-14T11:58:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.476+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~SJbMoztxqXQmbscegIcuT_BQHjoNBLM.3 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__shadow_testobj.2~SJbMoztxqXQmbscegIcuT_BQHjoNBLM.3_1 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.579__multipart_testobj.2~SJbMoztxqXQmbscegIcuT_BQHjoNBLM.4 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.14606726892177712538', time=2024-09-14T13:55:56.266112+0000, chain.objs.size()=10 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.1 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.2 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.3 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.4 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.5 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.6 2024-09-14T11:58:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.478+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.7 2024-09-14T11:58:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.480+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.8 2024-09-14T11:58:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.480+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.9 2024-09-14T11:58:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.480+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.736__multipart_foo.2~1F1vITfstONIRIN4tn_2_cTk2x0l-tp.10 2024-09-14T11:58:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.481+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.483+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:58:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.485+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.485+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.486+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.486+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.3923951442167587999', time=2024-09-14T13:51:30.090094+0000, chain.objs.size()=1 2024-09-14T11:58:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.486+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.562__multipart_mymultipart.2~lLPDlogdV87EFX6HVzNKsxi6JumJZhr.1 2024-09-14T11:58:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.487+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.489+0000 7f478dfaf800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:58:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.490+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.490+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.1316233807848311231', time=2024-09-14T13:50:39.344830+0000, chain.objs.size()=6 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.1lIXQtXP0437JG8vrhxlHHjDoEuKxeXP.1 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.TjBdJLek66nh_YaWs4IpbjmuzhdXPYfp.2 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.z-ooHrqJuIT7VaS4kQLai_9ORbR9HcDj.3 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.qkEEwIlT7a2thuczHPaFnqpLiocyH8Jn.4 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.ysCAQdDH_VbctiJLA-onCuRrOmQ5uFMj.5 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.523__multipart_mymultipart.0EhRKstwqhXOrsrc7nAGUI2JdtLZhhLB.6 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 20 garbage collection: RGWGC::process iterating over entry tag='2~QS1toi6wWW0FmjvV_FkkxSE-sMgLgHR', time=2024-09-14T13:55:59.866999+0000, chain.objs.size()=1 2024-09-14T11:58:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.491+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:00289ab1-7de4-4b62-b8d0-ad917abd1b51.4566.743__multipart_mymultipart2.2~QS1toi6wWW0FmjvV_FkkxSE-sMgLgHR.1 2024-09-14T11:58:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.492+0000 7f478dfaf800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.495+0000 7f4641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.497+0000 7f478dfaf800 20 remove_watcher() i=0 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.497+0000 7f478dfaf800 2 removed watcher, disabling cache 2024-09-14T11:58:47.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.498+0000 7f478dfaf800 20 remove_watcher() i=1 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.499+0000 7f478dfaf800 20 remove_watcher() i=2 2024-09-14T11:58:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.500+0000 7f478dfaf800 20 remove_watcher() i=3 2024-09-14T11:58:47.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.501+0000 7f478dfaf800 20 remove_watcher() i=4 2024-09-14T11:58:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.502+0000 7f478dfaf800 20 remove_watcher() i=5 2024-09-14T11:58:47.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.503+0000 7f478dfaf800 20 remove_watcher() i=6 2024-09-14T11:58:47.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-14T11:58:47.504+0000 7f478dfaf800 20 remove_watcher() i=7 2024-09-14T11:58:47.514 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T11:58:47.525 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T11:58:47.555 DEBUG:teuthology.orchestra.run.smithi007:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:58:47.623 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T11:58:47.692 DEBUG:teuthology.orchestra.run.smithi007:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:58:47.762 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T11:58:47.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo update-ca-trust 2024-09-14T11:58:48.902 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T11:58:48.914 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:58:48.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:58:49.267 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:58:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1564,"stamp":"2024-09-14T11:58:48.781510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610820012,"num_objects":993,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":295489,"num_read_kb":2699435,"num_write":146111,"num_write_kb":2447707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14023,"ondisk_log_size":14023,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2475648,"kb_used_data":1222592,"kb_used_omap":12,"kb_used_meta":1252915,"kb_avail":752499072,"statfs":{"total":773094113280,"available":770559049728,"internally_reserved":0,"allocated":1251934208,"data_stored":1237865176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1282985520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005035"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877231+0000","last_change":"2024-09-14T11:43:35.602913+0000","last_active":"2024-09-14T11:56:08.877231+0000","last_peered":"2024-09-14T11:56:08.877231+0000","last_clean":"2024-09-14T11:56:08.877231+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:56:08.877231+0000","last_undegraded":"2024-09-14T11:56:08.877231+0000","last_fullsized":"2024-09-14T11:56:08.877231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:06.258234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867970+0000","last_change":"2024-09-14T11:32:32.583802+0000","last_active":"2024-09-14T11:55:03.867970+0000","last_peered":"2024-09-14T11:55:03.867970+0000","last_clean":"2024-09-14T11:55:03.867970+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:55:03.867970+0000","last_undegraded":"2024-09-14T11:55:03.867970+0000","last_fullsized":"2024-09-14T11:55:03.867970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:58.807468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.868463+0000","last_change":"2024-09-14T11:32:29.554679+0000","last_active":"2024-09-14T11:54:58.868463+0000","last_peered":"2024-09-14T11:54:58.868463+0000","last_clean":"2024-09-14T11:54:58.868463+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:54:58.868463+0000","last_undegraded":"2024-09-14T11:54:58.868463+0000","last_fullsized":"2024-09-14T11:54:58.868463+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:20.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.865041+0000","last_change":"2024-09-14T11:30:45.179357+0000","last_active":"2024-09-14T11:55:48.865041+0000","last_peered":"2024-09-14T11:55:48.865041+0000","last_clean":"2024-09-14T11:55:48.865041+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:55:48.865041+0000","last_undegraded":"2024-09-14T11:55:48.865041+0000","last_fullsized":"2024-09-14T11:55:48.865041+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:03.066351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866530+0000","last_change":"2024-09-14T11:43:35.602901+0000","last_active":"2024-09-14T11:56:08.866530+0000","last_peered":"2024-09-14T11:56:08.866530+0000","last_clean":"2024-09-14T11:56:08.866530+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:56:08.866530+0000","last_undegraded":"2024-09-14T11:56:08.866530+0000","last_fullsized":"2024-09-14T11:56:08.866530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:07.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:04.005187+0000","last_change":"2024-09-14T11:32:32.582294+0000","last_active":"2024-09-14T11:55:04.005187+0000","last_peered":"2024-09-14T11:55:04.005187+0000","last_clean":"2024-09-14T11:55:04.005187+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:55:04.005187+0000","last_undegraded":"2024-09-14T11:55:04.005187+0000","last_fullsized":"2024-09-14T11:55:04.005187+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.399340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.864287+0000","last_change":"2024-09-14T11:32:29.558121+0000","last_active":"2024-09-14T11:55:00.864287+0000","last_peered":"2024-09-14T11:55:00.864287+0000","last_clean":"2024-09-14T11:55:00.864287+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:55:00.864287+0000","last_undegraded":"2024-09-14T11:55:00.864287+0000","last_fullsized":"2024-09-14T11:55:00.864287+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:52.777925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.438178+0000","last_change":"2024-09-14T11:30:45.185345+0000","last_active":"2024-09-14T11:56:00.438178+0000","last_peered":"2024-09-14T11:56:00.438178+0000","last_clean":"2024-09-14T11:56:00.438178+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:56:00.438178+0000","last_undegraded":"2024-09-14T11:56:00.438178+0000","last_fullsized":"2024-09-14T11:56:00.438178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:42.584514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.954160+0000","last_change":"2024-09-14T11:43:35.597712+0000","last_active":"2024-09-14T11:55:43.954160+0000","last_peered":"2024-09-14T11:55:43.954160+0000","last_clean":"2024-09-14T11:55:43.954160+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:55:43.954160+0000","last_undegraded":"2024-09-14T11:55:43.954160+0000","last_fullsized":"2024-09-14T11:55:43.954160+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:12.892547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'6","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.862548+0000","last_change":"2024-09-14T11:32:32.578401+0000","last_active":"2024-09-14T11:55:28.862548+0000","last_peered":"2024-09-14T11:55:28.862548+0000","last_clean":"2024-09-14T11:55:28.862548+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:55:28.862548+0000","last_undegraded":"2024-09-14T11:55:28.862548+0000","last_fullsized":"2024-09-14T11:55:28.862548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:07.530877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":13314,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.868976+0000","last_change":"2024-09-14T11:32:29.550110+0000","last_active":"2024-09-14T11:56:33.868976+0000","last_peered":"2024-09-14T11:56:33.868976+0000","last_clean":"2024-09-14T11:56:33.868976+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:56:33.868976+0000","last_undegraded":"2024-09-14T11:56:33.868976+0000","last_fullsized":"2024-09-14T11:56:33.868976+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:36.277584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.864987+0000","last_change":"2024-09-14T11:30:45.186185+0000","last_active":"2024-09-14T11:55:48.864987+0000","last_peered":"2024-09-14T11:55:48.864987+0000","last_clean":"2024-09-14T11:55:48.864987+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:55:48.864987+0000","last_undegraded":"2024-09-14T11:55:48.864987+0000","last_fullsized":"2024-09-14T11:55:48.864987+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.774513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875479+0000","last_change":"2024-09-14T11:43:35.603929+0000","last_active":"2024-09-14T11:55:48.875479+0000","last_peered":"2024-09-14T11:55:48.875479+0000","last_clean":"2024-09-14T11:55:48.875479+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:55:48.875479+0000","last_undegraded":"2024-09-14T11:55:48.875479+0000","last_fullsized":"2024-09-14T11:55:48.875479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:33.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'3","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882072+0000","last_change":"2024-09-14T11:32:32.589192+0000","last_active":"2024-09-14T11:56:43.882072+0000","last_peered":"2024-09-14T11:56:43.882072+0000","last_clean":"2024-09-14T11:56:43.882072+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:56:43.882072+0000","last_undegraded":"2024-09-14T11:56:43.882072+0000","last_fullsized":"2024-09-14T11:56:43.882072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:52.225210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":3,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.007703+0000","last_change":"2024-09-14T11:32:29.549479+0000","last_active":"2024-09-14T11:55:24.007703+0000","last_peered":"2024-09-14T11:55:24.007703+0000","last_clean":"2024-09-14T11:55:24.007703+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:55:24.007703+0000","last_undegraded":"2024-09-14T11:55:24.007703+0000","last_fullsized":"2024-09-14T11:55:24.007703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:56.796049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875525+0000","last_change":"2024-09-14T11:30:45.187877+0000","last_active":"2024-09-14T11:55:48.875525+0000","last_peered":"2024-09-14T11:55:48.875525+0000","last_clean":"2024-09-14T11:55:48.875525+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:55:48.875525+0000","last_undegraded":"2024-09-14T11:55:48.875525+0000","last_fullsized":"2024-09-14T11:55:48.875525+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:40.426491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874894+0000","last_change":"2024-09-14T11:43:35.601032+0000","last_active":"2024-09-14T11:55:43.874894+0000","last_peered":"2024-09-14T11:55:43.874894+0000","last_clean":"2024-09-14T11:55:43.874894+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:55:43.874894+0000","last_undegraded":"2024-09-14T11:55:43.874894+0000","last_fullsized":"2024-09-14T11:55:43.874894+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.697673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.863023+0000","last_change":"2024-09-14T11:33:08.805104+0000","last_active":"2024-09-14T11:54:28.863023+0000","last_peered":"2024-09-14T11:54:28.863023+0000","last_clean":"2024-09-14T11:54:28.863023+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:54:28.863023+0000","last_undegraded":"2024-09-14T11:54:28.863023+0000","last_fullsized":"2024-09-14T11:54:28.863023+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:03.683048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'6","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.853295+0000","last_change":"2024-09-14T11:32:29.558168+0000","last_active":"2024-09-14T11:54:13.853295+0000","last_peered":"2024-09-14T11:54:13.853295+0000","last_clean":"2024-09-14T11:54:13.853295+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:54:13.853295+0000","last_undegraded":"2024-09-14T11:54:13.853295+0000","last_fullsized":"2024-09-14T11:54:13.853295+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:28.837548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875505+0000","last_change":"2024-09-14T11:30:45.184142+0000","last_active":"2024-09-14T11:55:48.875505+0000","last_peered":"2024-09-14T11:55:48.875505+0000","last_clean":"2024-09-14T11:55:48.875505+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:55:48.875505+0000","last_undegraded":"2024-09-14T11:55:48.875505+0000","last_fullsized":"2024-09-14T11:55:48.875505+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:48.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872788+0000","last_change":"2024-09-14T11:43:35.605737+0000","last_active":"2024-09-14T11:56:05.872788+0000","last_peered":"2024-09-14T11:56:05.872788+0000","last_clean":"2024-09-14T11:56:05.872788+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:56:05.872788+0000","last_undegraded":"2024-09-14T11:56:05.872788+0000","last_fullsized":"2024-09-14T11:56:05.872788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'1","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.942976+0000","last_change":"2024-09-14T11:32:32.582277+0000","last_active":"2024-09-14T11:54:18.942976+0000","last_peered":"2024-09-14T11:54:18.942976+0000","last_clean":"2024-09-14T11:54:18.942976+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:54:18.942976+0000","last_undegraded":"2024-09-14T11:54:18.942976+0000","last_fullsized":"2024-09-14T11:54:18.942976+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.963034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.998852+0000","last_change":"2024-09-14T11:32:29.550064+0000","last_active":"2024-09-14T11:54:13.998852+0000","last_peered":"2024-09-14T11:54:13.998852+0000","last_clean":"2024-09-14T11:54:13.998852+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:54:13.998852+0000","last_undegraded":"2024-09-14T11:54:13.998852+0000","last_fullsized":"2024-09-14T11:54:13.998852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:24.276918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954746+0000","last_change":"2024-09-14T11:30:45.178964+0000","last_active":"2024-09-14T11:55:48.954746+0000","last_peered":"2024-09-14T11:55:48.954746+0000","last_clean":"2024-09-14T11:55:48.954746+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:55:48.954746+0000","last_undegraded":"2024-09-14T11:55:48.954746+0000","last_fullsized":"2024-09-14T11:55:48.954746+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:14.255189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877316+0000","last_change":"2024-09-14T11:43:35.605759+0000","last_active":"2024-09-14T11:56:08.877316+0000","last_peered":"2024-09-14T11:56:08.877316+0000","last_clean":"2024-09-14T11:56:08.877316+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:56:08.877316+0000","last_undegraded":"2024-09-14T11:56:08.877316+0000","last_fullsized":"2024-09-14T11:56:08.877316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.948842+0000","last_change":"2024-09-14T11:32:32.580274+0000","last_active":"2024-09-14T11:55:03.948842+0000","last_peered":"2024-09-14T11:55:03.948842+0000","last_clean":"2024-09-14T11:55:03.948842+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:55:03.948842+0000","last_undegraded":"2024-09-14T11:55:03.948842+0000","last_fullsized":"2024-09-14T11:55:03.948842+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:14.222467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004336+0000","last_change":"2024-09-14T11:32:29.555376+0000","last_active":"2024-09-14T11:54:59.004336+0000","last_peered":"2024-09-14T11:54:59.004336+0000","last_clean":"2024-09-14T11:54:59.004336+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:54:59.004336+0000","last_undegraded":"2024-09-14T11:54:59.004336+0000","last_fullsized":"2024-09-14T11:54:59.004336+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.859610+0000","last_change":"2024-09-14T11:30:45.175070+0000","last_active":"2024-09-14T11:55:03.859610+0000","last_peered":"2024-09-14T11:55:03.859610+0000","last_clean":"2024-09-14T11:55:03.859610+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:55:03.859610+0000","last_undegraded":"2024-09-14T11:55:03.859610+0000","last_fullsized":"2024-09-14T11:55:03.859610+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.836949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877363+0000","last_change":"2024-09-14T11:43:35.607526+0000","last_active":"2024-09-14T11:56:08.877363+0000","last_peered":"2024-09-14T11:56:08.877363+0000","last_clean":"2024-09-14T11:56:08.877363+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:56:08.877363+0000","last_undegraded":"2024-09-14T11:56:08.877363+0000","last_fullsized":"2024-09-14T11:56:08.877363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.745235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869068+0000","last_change":"2024-09-14T11:32:32.587761+0000","last_active":"2024-09-14T11:55:03.869068+0000","last_peered":"2024-09-14T11:55:03.869068+0000","last_clean":"2024-09-14T11:55:03.869068+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:55:03.869068+0000","last_undegraded":"2024-09-14T11:55:03.869068+0000","last_fullsized":"2024-09-14T11:55:03.869068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:27.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859019+0000","last_change":"2024-09-14T11:32:29.555600+0000","last_active":"2024-09-14T11:54:58.859019+0000","last_peered":"2024-09-14T11:54:58.859019+0000","last_clean":"2024-09-14T11:54:58.859019+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:54:58.859019+0000","last_undegraded":"2024-09-14T11:54:58.859019+0000","last_fullsized":"2024-09-14T11:54:58.859019+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.338753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863479+0000","last_change":"2024-09-14T11:30:45.182076+0000","last_active":"2024-09-14T11:54:55.863479+0000","last_peered":"2024-09-14T11:54:55.863479+0000","last_clean":"2024-09-14T11:54:55.863479+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:54:55.863479+0000","last_undegraded":"2024-09-14T11:54:55.863479+0000","last_fullsized":"2024-09-14T11:54:55.863479+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:51.625984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866051+0000","last_change":"2024-09-14T11:43:35.603298+0000","last_active":"2024-09-14T11:55:15.866051+0000","last_peered":"2024-09-14T11:55:15.866051+0000","last_clean":"2024-09-14T11:55:15.866051+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:55:15.866051+0000","last_undegraded":"2024-09-14T11:55:15.866051+0000","last_fullsized":"2024-09-14T11:55:15.866051+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.863213+0000","last_change":"2024-09-14T11:32:32.585885+0000","last_active":"2024-09-14T11:54:18.863213+0000","last_peered":"2024-09-14T11:54:18.863213+0000","last_clean":"2024-09-14T11:54:18.863213+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:54:18.863213+0000","last_undegraded":"2024-09-14T11:54:18.863213+0000","last_fullsized":"2024-09-14T11:54:18.863213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:13.003196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.875756+0000","last_change":"2024-09-14T11:32:29.556257+0000","last_active":"2024-09-14T11:55:58.875756+0000","last_peered":"2024-09-14T11:55:58.875756+0000","last_clean":"2024-09-14T11:55:58.875756+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:55:58.875756+0000","last_undegraded":"2024-09-14T11:55:58.875756+0000","last_fullsized":"2024-09-14T11:55:58.875756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:03.738228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859107+0000","last_change":"2024-09-14T11:30:45.181226+0000","last_active":"2024-09-14T11:54:58.859107+0000","last_peered":"2024-09-14T11:54:58.859107+0000","last_clean":"2024-09-14T11:54:58.859107+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:54:58.859107+0000","last_undegraded":"2024-09-14T11:54:58.859107+0000","last_fullsized":"2024-09-14T11:54:58.859107+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:13.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.860482+0000","last_change":"2024-09-14T11:43:35.601936+0000","last_active":"2024-09-14T11:55:18.860482+0000","last_peered":"2024-09-14T11:55:18.860482+0000","last_clean":"2024-09-14T11:55:18.860482+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:55:18.860482+0000","last_undegraded":"2024-09-14T11:55:18.860482+0000","last_fullsized":"2024-09-14T11:55:18.860482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:28.098855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877364+0000","last_change":"2024-09-14T11:32:32.588409+0000","last_active":"2024-09-14T11:56:03.877364+0000","last_peered":"2024-09-14T11:56:03.877364+0000","last_clean":"2024-09-14T11:56:03.877364+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:56:03.877364+0000","last_undegraded":"2024-09-14T11:56:03.877364+0000","last_fullsized":"2024-09-14T11:56:03.877364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:05.997127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.860625+0000","last_change":"2024-09-14T11:32:29.554191+0000","last_active":"2024-09-14T11:54:13.860625+0000","last_peered":"2024-09-14T11:54:13.860625+0000","last_clean":"2024-09-14T11:54:13.860625+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:54:13.860625+0000","last_undegraded":"2024-09-14T11:54:13.860625+0000","last_fullsized":"2024-09-14T11:54:13.860625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4123,"num_write":3,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.870574+0000","last_change":"2024-09-14T11:30:45.186297+0000","last_active":"2024-09-14T11:55:59.870574+0000","last_peered":"2024-09-14T11:55:59.870574+0000","last_clean":"2024-09-14T11:55:59.870574+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:55:59.870574+0000","last_undegraded":"2024-09-14T11:55:59.870574+0000","last_fullsized":"2024-09-14T11:55:59.870574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.503260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869999+0000","last_change":"2024-09-14T11:43:35.602751+0000","last_active":"2024-09-14T11:55:18.869999+0000","last_peered":"2024-09-14T11:55:18.869999+0000","last_clean":"2024-09-14T11:55:18.869999+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:55:18.869999+0000","last_undegraded":"2024-09-14T11:55:18.869999+0000","last_fullsized":"2024-09-14T11:55:18.869999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:27.871586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'1","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.863266+0000","last_change":"2024-09-14T11:32:32.582994+0000","last_active":"2024-09-14T11:54:18.863266+0000","last_peered":"2024-09-14T11:54:18.863266+0000","last_clean":"2024-09-14T11:54:18.863266+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:54:18.863266+0000","last_undegraded":"2024-09-14T11:54:18.863266+0000","last_fullsized":"2024-09-14T11:54:18.863266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:49.256978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'3","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.852923+0000","last_change":"2024-09-14T11:32:29.544034+0000","last_active":"2024-09-14T11:54:13.852923+0000","last_peered":"2024-09-14T11:54:13.852923+0000","last_clean":"2024-09-14T11:54:13.852923+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:54:13.852923+0000","last_undegraded":"2024-09-14T11:54:13.852923+0000","last_fullsized":"2024-09-14T11:54:13.852923+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858457+0000","last_change":"2024-09-14T11:30:45.184378+0000","last_active":"2024-09-14T11:54:58.858457+0000","last_peered":"2024-09-14T11:54:58.858457+0000","last_clean":"2024-09-14T11:54:58.858457+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:54:58.858457+0000","last_undegraded":"2024-09-14T11:54:58.858457+0000","last_fullsized":"2024-09-14T11:54:58.858457+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:03.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869969+0000","last_change":"2024-09-14T11:43:35.601578+0000","last_active":"2024-09-14T11:55:18.869969+0000","last_peered":"2024-09-14T11:55:18.869969+0000","last_clean":"2024-09-14T11:55:18.869969+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:55:18.869969+0000","last_undegraded":"2024-09-14T11:55:18.869969+0000","last_fullsized":"2024-09-14T11:55:18.869969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:45.561461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999626+0000","last_change":"2024-09-14T11:32:32.581631+0000","last_active":"2024-09-14T11:54:18.999626+0000","last_peered":"2024-09-14T11:54:18.999626+0000","last_clean":"2024-09-14T11:54:18.999626+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:54:18.999626+0000","last_undegraded":"2024-09-14T11:54:18.999626+0000","last_fullsized":"2024-09-14T11:54:18.999626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:08.950123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.853433+0000","last_change":"2024-09-14T11:32:29.550009+0000","last_active":"2024-09-14T11:54:13.853433+0000","last_peered":"2024-09-14T11:54:13.853433+0000","last_clean":"2024-09-14T11:54:13.853433+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:54:13.853433+0000","last_undegraded":"2024-09-14T11:54:13.853433+0000","last_fullsized":"2024-09-14T11:54:13.853433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:07.302819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":768,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.860570+0000","last_change":"2024-09-14T11:30:45.185397+0000","last_active":"2024-09-14T11:54:13.860570+0000","last_peered":"2024-09-14T11:54:13.860570+0000","last_clean":"2024-09-14T11:54:13.860570+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:54:13.860570+0000","last_undegraded":"2024-09-14T11:54:13.860570+0000","last_fullsized":"2024-09-14T11:54:13.860570+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:30.178621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874909+0000","last_change":"2024-09-14T11:43:35.603719+0000","last_active":"2024-09-14T11:55:43.874909+0000","last_peered":"2024-09-14T11:55:43.874909+0000","last_clean":"2024-09-14T11:55:43.874909+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:55:43.874909+0000","last_undegraded":"2024-09-14T11:55:43.874909+0000","last_fullsized":"2024-09-14T11:55:43.874909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:21.587122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'3","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.871640+0000","last_change":"2024-09-14T11:32:32.583371+0000","last_active":"2024-09-14T11:55:55.871640+0000","last_peered":"2024-09-14T11:55:55.871640+0000","last_clean":"2024-09-14T11:55:55.871640+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:55:55.871640+0000","last_undegraded":"2024-09-14T11:55:55.871640+0000","last_fullsized":"2024-09-14T11:55:55.871640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:26.139200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'6","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011289+0000","last_change":"2024-09-14T11:32:29.556494+0000","last_active":"2024-09-14T11:55:49.011289+0000","last_peered":"2024-09-14T11:55:49.011289+0000","last_clean":"2024-09-14T11:55:49.011289+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:55:49.011289+0000","last_undegraded":"2024-09-14T11:55:49.011289+0000","last_fullsized":"2024-09-14T11:55:49.011289+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:44.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7227,"num_write":11,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":173,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.859808+0000","last_change":"2024-09-14T11:30:45.184935+0000","last_active":"2024-09-14T11:54:08.859808+0000","last_peered":"2024-09-14T11:54:08.859808+0000","last_clean":"2024-09-14T11:54:08.859808+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:54:08.859808+0000","last_undegraded":"2024-09-14T11:54:08.859808+0000","last_fullsized":"2024-09-14T11:54:08.859808+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:16.452875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864520+0000","last_change":"2024-09-14T11:43:35.606065+0000","last_active":"2024-09-14T11:55:43.864520+0000","last_peered":"2024-09-14T11:55:43.864520+0000","last_clean":"2024-09-14T11:55:43.864520+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:55:43.864520+0000","last_undegraded":"2024-09-14T11:55:43.864520+0000","last_fullsized":"2024-09-14T11:55:43.864520+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:45.826564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'5","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.871596+0000","last_change":"2024-09-14T11:32:32.581191+0000","last_active":"2024-09-14T11:55:55.871596+0000","last_peered":"2024-09-14T11:55:55.871596+0000","last_clean":"2024-09-14T11:55:55.871596+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:55:55.871596+0000","last_undegraded":"2024-09-14T11:55:55.871596+0000","last_fullsized":"2024-09-14T11:55:55.871596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:56.670374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875460+0000","last_change":"2024-09-14T11:32:29.543122+0000","last_active":"2024-09-14T11:55:48.875460+0000","last_peered":"2024-09-14T11:55:48.875460+0000","last_clean":"2024-09-14T11:55:48.875460+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:55:48.875460+0000","last_undegraded":"2024-09-14T11:55:48.875460+0000","last_fullsized":"2024-09-14T11:55:48.875460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:34.079866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.657310+0000","last_change":"2024-09-14T11:30:45.187136+0000","last_active":"2024-09-14T11:55:59.657310+0000","last_peered":"2024-09-14T11:55:59.657310+0000","last_clean":"2024-09-14T11:55:59.657310+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:55:59.657310+0000","last_undegraded":"2024-09-14T11:55:59.657310+0000","last_fullsized":"2024-09-14T11:55:59.657310+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:42.845918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861900+0000","last_change":"2024-09-14T11:43:35.608421+0000","last_active":"2024-09-14T11:55:23.861900+0000","last_peered":"2024-09-14T11:55:23.861900+0000","last_clean":"2024-09-14T11:55:23.861900+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:55:23.861900+0000","last_undegraded":"2024-09-14T11:55:23.861900+0000","last_fullsized":"2024-09-14T11:55:23.861900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:33.729484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.876137+0000","last_change":"2024-09-14T11:32:32.590267+0000","last_active":"2024-09-14T11:55:53.876137+0000","last_peered":"2024-09-14T11:55:53.876137+0000","last_clean":"2024-09-14T11:55:53.876137+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:55:53.876137+0000","last_undegraded":"2024-09-14T11:55:53.876137+0000","last_fullsized":"2024-09-14T11:55:53.876137+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.861311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954756+0000","last_change":"2024-09-14T11:32:29.557676+0000","last_active":"2024-09-14T11:55:48.954756+0000","last_peered":"2024-09-14T11:55:48.954756+0000","last_clean":"2024-09-14T11:55:48.954756+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:55:48.954756+0000","last_undegraded":"2024-09-14T11:55:48.954756+0000","last_fullsized":"2024-09-14T11:55:48.954756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:16.569296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.998083+0000","last_change":"2024-09-14T11:30:45.183316+0000","last_active":"2024-09-14T11:54:08.998083+0000","last_peered":"2024-09-14T11:54:08.998083+0000","last_clean":"2024-09-14T11:54:08.998083+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:54:08.998083+0000","last_undegraded":"2024-09-14T11:54:08.998083+0000","last_fullsized":"2024-09-14T11:54:08.998083+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:21.498493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874873+0000","last_change":"2024-09-14T11:43:35.603573+0000","last_active":"2024-09-14T11:55:43.874873+0000","last_peered":"2024-09-14T11:55:43.874873+0000","last_clean":"2024-09-14T11:55:43.874873+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:55:43.874873+0000","last_undegraded":"2024-09-14T11:55:43.874873+0000","last_fullsized":"2024-09-14T11:55:43.874873+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:21.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.955285+0000","last_change":"2024-09-14T11:32:32.583874+0000","last_active":"2024-09-14T11:55:53.955285+0000","last_peered":"2024-09-14T11:55:53.955285+0000","last_clean":"2024-09-14T11:55:53.955285+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:55:53.955285+0000","last_undegraded":"2024-09-14T11:55:53.955285+0000","last_fullsized":"2024-09-14T11:55:53.955285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.827399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874557+0000","last_change":"2024-09-14T11:32:29.557054+0000","last_active":"2024-09-14T11:55:48.874557+0000","last_peered":"2024-09-14T11:55:48.874557+0000","last_clean":"2024-09-14T11:55:48.874557+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:55:48.874557+0000","last_undegraded":"2024-09-14T11:55:48.874557+0000","last_fullsized":"2024-09-14T11:55:48.874557+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:17.332064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.797072+0000","last_change":"2024-09-14T11:30:45.188008+0000","last_active":"2024-09-14T11:55:24.797072+0000","last_peered":"2024-09-14T11:55:24.797072+0000","last_clean":"2024-09-14T11:55:24.797072+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:55:24.797072+0000","last_undegraded":"2024-09-14T11:55:24.797072+0000","last_fullsized":"2024-09-14T11:55:24.797072+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:10.454288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.855636+0000","last_change":"2024-09-14T11:43:35.601146+0000","last_active":"2024-09-14T11:54:33.855636+0000","last_peered":"2024-09-14T11:54:33.855636+0000","last_clean":"2024-09-14T11:54:33.855636+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:54:33.855636+0000","last_undegraded":"2024-09-14T11:54:33.855636+0000","last_fullsized":"2024-09-14T11:54:33.855636+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:58.732885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869141+0000","last_change":"2024-09-14T11:32:32.585896+0000","last_active":"2024-09-14T11:55:03.869141+0000","last_peered":"2024-09-14T11:55:03.869141+0000","last_clean":"2024-09-14T11:55:03.869141+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:55:03.869141+0000","last_undegraded":"2024-09-14T11:55:03.869141+0000","last_fullsized":"2024-09-14T11:55:03.869141+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:46.169476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867339+0000","last_change":"2024-09-14T11:32:29.550392+0000","last_active":"2024-09-14T11:54:58.867339+0000","last_peered":"2024-09-14T11:54:58.867339+0000","last_clean":"2024-09-14T11:54:58.867339+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:54:58.867339+0000","last_undegraded":"2024-09-14T11:54:58.867339+0000","last_fullsized":"2024-09-14T11:54:58.867339+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.897313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":98,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874939+0000","last_change":"2024-09-14T11:30:45.187527+0000","last_active":"2024-09-14T11:55:43.874939+0000","last_peered":"2024-09-14T11:55:43.874939+0000","last_clean":"2024-09-14T11:55:43.874939+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:55:43.874939+0000","last_undegraded":"2024-09-14T11:55:43.874939+0000","last_fullsized":"2024-09-14T11:55:43.874939+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:10.115937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866776+0000","last_change":"2024-09-14T11:43:35.607758+0000","last_active":"2024-09-14T11:54:53.866776+0000","last_peered":"2024-09-14T11:54:53.866776+0000","last_clean":"2024-09-14T11:54:53.866776+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:54:53.866776+0000","last_undegraded":"2024-09-14T11:54:53.866776+0000","last_fullsized":"2024-09-14T11:54:53.866776+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:25.238514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869108+0000","last_change":"2024-09-14T11:32:32.589816+0000","last_active":"2024-09-14T11:55:03.869108+0000","last_peered":"2024-09-14T11:55:03.869108+0000","last_clean":"2024-09-14T11:55:03.869108+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:55:03.869108+0000","last_undegraded":"2024-09-14T11:55:03.869108+0000","last_fullsized":"2024-09-14T11:55:03.869108+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:48.593038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858469+0000","last_change":"2024-09-14T11:32:29.550400+0000","last_active":"2024-09-14T11:54:58.858469+0000","last_peered":"2024-09-14T11:54:58.858469+0000","last_clean":"2024-09-14T11:54:58.858469+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:54:58.858469+0000","last_undegraded":"2024-09-14T11:54:58.858469+0000","last_fullsized":"2024-09-14T11:54:58.858469+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:37.276571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872259+0000","last_change":"2024-09-14T11:30:45.175794+0000","last_active":"2024-09-14T11:55:33.872259+0000","last_peered":"2024-09-14T11:55:33.872259+0000","last_clean":"2024-09-14T11:55:33.872259+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:55:33.872259+0000","last_undegraded":"2024-09-14T11:55:33.872259+0000","last_fullsized":"2024-09-14T11:55:33.872259+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:12.580971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944465+0000","last_change":"2024-09-14T11:43:35.603624+0000","last_active":"2024-09-14T11:54:28.944465+0000","last_peered":"2024-09-14T11:54:28.944465+0000","last_clean":"2024-09-14T11:54:28.944465+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:54:28.944465+0000","last_undegraded":"2024-09-14T11:54:28.944465+0000","last_fullsized":"2024-09-14T11:54:28.944465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:06.649979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865526+0000","last_change":"2024-09-14T11:32:32.582078+0000","last_active":"2024-09-14T11:55:10.865526+0000","last_peered":"2024-09-14T11:55:10.865526+0000","last_clean":"2024-09-14T11:55:10.865526+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:55:10.865526+0000","last_undegraded":"2024-09-14T11:55:10.865526+0000","last_fullsized":"2024-09-14T11:55:10.865526+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.729935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859071+0000","last_change":"2024-09-14T11:32:29.556788+0000","last_active":"2024-09-14T11:54:58.859071+0000","last_peered":"2024-09-14T11:54:58.859071+0000","last_clean":"2024-09-14T11:54:58.859071+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:54:58.859071+0000","last_undegraded":"2024-09-14T11:54:58.859071+0000","last_fullsized":"2024-09-14T11:54:58.859071+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:25.298432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.952685+0000","last_change":"2024-09-14T11:30:45.181601+0000","last_active":"2024-09-14T11:55:33.952685+0000","last_peered":"2024-09-14T11:55:33.952685+0000","last_clean":"2024-09-14T11:55:33.952685+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:55:33.952685+0000","last_undegraded":"2024-09-14T11:55:33.952685+0000","last_fullsized":"2024-09-14T11:55:33.952685+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.863012+0000","last_change":"2024-09-14T11:43:35.603524+0000","last_active":"2024-09-14T11:54:28.863012+0000","last_peered":"2024-09-14T11:54:28.863012+0000","last_clean":"2024-09-14T11:54:28.863012+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:54:28.863012+0000","last_undegraded":"2024-09-14T11:54:28.863012+0000","last_fullsized":"2024-09-14T11:54:28.863012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:22.177315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869154+0000","last_change":"2024-09-14T11:32:32.588422+0000","last_active":"2024-09-14T11:55:03.869154+0000","last_peered":"2024-09-14T11:55:03.869154+0000","last_clean":"2024-09-14T11:55:03.869154+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:55:03.869154+0000","last_undegraded":"2024-09-14T11:55:03.869154+0000","last_fullsized":"2024-09-14T11:55:03.869154+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.486355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864803+0000","last_change":"2024-09-14T11:32:29.558855+0000","last_active":"2024-09-14T11:55:05.864803+0000","last_peered":"2024-09-14T11:55:05.864803+0000","last_clean":"2024-09-14T11:55:05.864803+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:55:05.864803+0000","last_undegraded":"2024-09-14T11:55:05.864803+0000","last_fullsized":"2024-09-14T11:55:05.864803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.718076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":172,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.862421+0000","last_change":"2024-09-14T11:30:45.186320+0000","last_active":"2024-09-14T11:55:33.862421+0000","last_peered":"2024-09-14T11:55:33.862421+0000","last_clean":"2024-09-14T11:55:33.862421+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:55:33.862421+0000","last_undegraded":"2024-09-14T11:55:33.862421+0000","last_fullsized":"2024-09-14T11:55:33.862421+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:02.402885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867996+0000","last_change":"2024-09-14T11:43:35.607826+0000","last_active":"2024-09-14T11:54:53.867996+0000","last_peered":"2024-09-14T11:54:53.867996+0000","last_clean":"2024-09-14T11:54:53.867996+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:54:53.867996+0000","last_undegraded":"2024-09-14T11:54:53.867996+0000","last_fullsized":"2024-09-14T11:54:53.867996+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:17.558008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.016002+0000","last_change":"2024-09-14T11:32:32.590048+0000","last_active":"2024-09-14T11:56:24.016002+0000","last_peered":"2024-09-14T11:56:24.016002+0000","last_clean":"2024-09-14T11:56:24.016002+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:56:24.016002+0000","last_undegraded":"2024-09-14T11:56:24.016002+0000","last_fullsized":"2024-09-14T11:56:24.016002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:10.124434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868576+0000","last_change":"2024-09-14T11:32:29.557361+0000","last_active":"2024-09-14T11:56:18.868576+0000","last_peered":"2024-09-14T11:56:18.868576+0000","last_clean":"2024-09-14T11:56:18.868576+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:56:18.868576+0000","last_undegraded":"2024-09-14T11:56:18.868576+0000","last_fullsized":"2024-09-14T11:56:18.868576+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:06.391010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863103+0000","last_change":"2024-09-14T11:30:45.189776+0000","last_active":"2024-09-14T11:55:33.863103+0000","last_peered":"2024-09-14T11:55:33.863103+0000","last_clean":"2024-09-14T11:55:33.863103+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:55:33.863103+0000","last_undegraded":"2024-09-14T11:55:33.863103+0000","last_fullsized":"2024-09-14T11:55:33.863103+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:07.248111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867381+0000","last_change":"2024-09-14T11:43:35.605135+0000","last_active":"2024-09-14T11:54:58.867381+0000","last_peered":"2024-09-14T11:54:58.867381+0000","last_clean":"2024-09-14T11:54:58.867381+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:54:58.867381+0000","last_undegraded":"2024-09-14T11:54:58.867381+0000","last_fullsized":"2024-09-14T11:54:58.867381+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879560+0000","last_change":"2024-09-14T11:32:32.579119+0000","last_active":"2024-09-14T11:56:23.879560+0000","last_peered":"2024-09-14T11:56:23.879560+0000","last_clean":"2024-09-14T11:56:23.879560+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:56:23.879560+0000","last_undegraded":"2024-09-14T11:56:23.879560+0000","last_fullsized":"2024-09-14T11:56:23.879560+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:39.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.874789+0000","last_change":"2024-09-14T11:32:29.558623+0000","last_active":"2024-09-14T11:56:20.874789+0000","last_peered":"2024-09-14T11:56:20.874789+0000","last_clean":"2024-09-14T11:56:20.874789+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:56:20.874789+0000","last_undegraded":"2024-09-14T11:56:20.874789+0000","last_fullsized":"2024-09-14T11:56:20.874789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:00.753847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.547369+0000","last_change":"2024-09-14T11:30:45.184693+0000","last_active":"2024-09-14T11:55:02.547369+0000","last_peered":"2024-09-14T11:55:02.547369+0000","last_clean":"2024-09-14T11:55:02.547369+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:55:02.547369+0000","last_undegraded":"2024-09-14T11:55:02.547369+0000","last_fullsized":"2024-09-14T11:55:02.547369+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:26.556025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866795+0000","last_change":"2024-09-14T11:43:35.606592+0000","last_active":"2024-09-14T11:54:53.866795+0000","last_peered":"2024-09-14T11:54:53.866795+0000","last_clean":"2024-09-14T11:54:53.866795+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:54:53.866795+0000","last_undegraded":"2024-09-14T11:54:53.866795+0000","last_fullsized":"2024-09-14T11:54:53.866795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:47.717972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864758+0000","last_change":"2024-09-14T11:32:32.582791+0000","last_active":"2024-09-14T11:55:05.864758+0000","last_peered":"2024-09-14T11:55:05.864758+0000","last_clean":"2024-09-14T11:55:05.864758+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:55:05.864758+0000","last_undegraded":"2024-09-14T11:55:05.864758+0000","last_fullsized":"2024-09-14T11:55:05.864758+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.426108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.869202+0000","last_change":"2024-09-14T11:32:29.556753+0000","last_active":"2024-09-14T11:56:23.869202+0000","last_peered":"2024-09-14T11:56:23.869202+0000","last_clean":"2024-09-14T11:56:23.869202+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:56:23.869202+0000","last_undegraded":"2024-09-14T11:56:23.869202+0000","last_fullsized":"2024-09-14T11:56:23.869202+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:34.099936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.865798+0000","last_change":"2024-09-14T11:30:45.185455+0000","last_active":"2024-09-14T11:55:59.865798+0000","last_peered":"2024-09-14T11:55:59.865798+0000","last_clean":"2024-09-14T11:55:59.865798+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:55:59.865798+0000","last_undegraded":"2024-09-14T11:55:59.865798+0000","last_fullsized":"2024-09-14T11:55:59.865798+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:25.948213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.858467+0000","last_change":"2024-09-14T11:43:35.603825+0000","last_active":"2024-09-14T11:54:53.858467+0000","last_peered":"2024-09-14T11:54:53.858467+0000","last_clean":"2024-09-14T11:54:53.858467+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:54:53.858467+0000","last_undegraded":"2024-09-14T11:54:53.858467+0000","last_fullsized":"2024-09-14T11:54:53.858467+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:22.239624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880311+0000","last_change":"2024-09-14T11:32:32.590037+0000","last_active":"2024-09-14T11:56:28.880311+0000","last_peered":"2024-09-14T11:56:28.880311+0000","last_clean":"2024-09-14T11:56:28.880311+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:56:28.880311+0000","last_undegraded":"2024-09-14T11:56:28.880311+0000","last_fullsized":"2024-09-14T11:56:28.880311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:48.742115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004361+0000","last_change":"2024-09-14T11:32:29.552051+0000","last_active":"2024-09-14T11:54:59.004361+0000","last_peered":"2024-09-14T11:54:59.004361+0000","last_clean":"2024-09-14T11:54:59.004361+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:54:59.004361+0000","last_undegraded":"2024-09-14T11:54:59.004361+0000","last_fullsized":"2024-09-14T11:54:59.004361+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.824552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945791+0000","last_change":"2024-09-14T11:30:45.183254+0000","last_active":"2024-09-14T11:54:38.945791+0000","last_peered":"2024-09-14T11:54:38.945791+0000","last_clean":"2024-09-14T11:54:38.945791+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:54:38.945791+0000","last_undegraded":"2024-09-14T11:54:38.945791+0000","last_fullsized":"2024-09-14T11:54:38.945791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:04.016656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877254+0000","last_change":"2024-09-14T11:43:35.604116+0000","last_active":"2024-09-14T11:56:08.877254+0000","last_peered":"2024-09-14T11:56:08.877254+0000","last_clean":"2024-09-14T11:56:08.877254+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:56:08.877254+0000","last_undegraded":"2024-09-14T11:56:08.877254+0000","last_fullsized":"2024-09-14T11:56:08.877254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:16.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863176+0000","last_change":"2024-09-14T11:32:32.583981+0000","last_active":"2024-09-14T11:55:33.863176+0000","last_peered":"2024-09-14T11:55:33.863176+0000","last_clean":"2024-09-14T11:55:33.863176+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:55:33.863176+0000","last_undegraded":"2024-09-14T11:55:33.863176+0000","last_fullsized":"2024-09-14T11:55:33.863176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:37.109384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870848+0000","last_change":"2024-09-14T11:32:29.553611+0000","last_active":"2024-09-14T11:55:23.870848+0000","last_peered":"2024-09-14T11:55:23.870848+0000","last_clean":"2024-09-14T11:55:23.870848+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:55:23.870848+0000","last_undegraded":"2024-09-14T11:55:23.870848+0000","last_fullsized":"2024-09-14T11:55:23.870848+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:23.400420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.064541+0000","last_change":"2024-09-14T11:30:45.182248+0000","last_active":"2024-09-14T11:55:02.064541+0000","last_peered":"2024-09-14T11:55:02.064541+0000","last_clean":"2024-09-14T11:55:02.064541+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:55:02.064541+0000","last_undegraded":"2024-09-14T11:55:02.064541+0000","last_fullsized":"2024-09-14T11:55:02.064541+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:12.204716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877270+0000","last_change":"2024-09-14T11:43:35.603484+0000","last_active":"2024-09-14T11:56:08.877270+0000","last_peered":"2024-09-14T11:56:08.877270+0000","last_clean":"2024-09-14T11:56:08.877270+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:56:08.877270+0000","last_undegraded":"2024-09-14T11:56:08.877270+0000","last_fullsized":"2024-09-14T11:56:08.877270+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.596092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'1","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.862484+0000","last_change":"2024-09-14T11:32:32.575572+0000","last_active":"2024-09-14T11:55:28.862484+0000","last_peered":"2024-09-14T11:55:28.862484+0000","last_clean":"2024-09-14T11:55:28.862484+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:55:28.862484+0000","last_undegraded":"2024-09-14T11:55:28.862484+0000","last_fullsized":"2024-09-14T11:55:28.862484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:01.425017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.861591+0000","last_change":"2024-09-14T11:32:29.551182+0000","last_active":"2024-09-14T11:55:28.861591+0000","last_peered":"2024-09-14T11:55:28.861591+0000","last_clean":"2024-09-14T11:55:28.861591+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:55:28.861591+0000","last_undegraded":"2024-09-14T11:55:28.861591+0000","last_fullsized":"2024-09-14T11:55:28.861591+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.092021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945893+0000","last_change":"2024-09-14T11:30:45.184179+0000","last_active":"2024-09-14T11:54:38.945893+0000","last_peered":"2024-09-14T11:54:38.945893+0000","last_clean":"2024-09-14T11:54:38.945893+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:54:38.945893+0000","last_undegraded":"2024-09-14T11:54:38.945893+0000","last_fullsized":"2024-09-14T11:54:38.945893+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.455784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869499+0000","last_change":"2024-09-14T11:43:35.607506+0000","last_active":"2024-09-14T11:55:40.869499+0000","last_peered":"2024-09-14T11:55:40.869499+0000","last_clean":"2024-09-14T11:55:40.869499+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:55:40.869499+0000","last_undegraded":"2024-09-14T11:55:40.869499+0000","last_fullsized":"2024-09-14T11:55:40.869499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:13.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879696+0000","last_change":"2024-09-14T11:32:32.583839+0000","last_active":"2024-09-14T11:56:23.879696+0000","last_peered":"2024-09-14T11:56:23.879696+0000","last_clean":"2024-09-14T11:56:23.879696+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:56:23.879696+0000","last_undegraded":"2024-09-14T11:56:23.879696+0000","last_fullsized":"2024-09-14T11:56:23.879696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:03.004208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.878633+0000","last_change":"2024-09-14T11:32:29.554290+0000","last_active":"2024-09-14T11:56:18.878633+0000","last_peered":"2024-09-14T11:56:18.878633+0000","last_clean":"2024-09-14T11:56:18.878633+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:56:18.878633+0000","last_undegraded":"2024-09-14T11:56:18.878633+0000","last_fullsized":"2024-09-14T11:56:18.878633+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:54.635912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":64,"num_write":3,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.875265+0000","last_change":"2024-09-14T11:30:45.188717+0000","last_active":"2024-09-14T11:55:53.875265+0000","last_peered":"2024-09-14T11:55:53.875265+0000","last_clean":"2024-09-14T11:55:53.875265+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:55:53.875265+0000","last_undegraded":"2024-09-14T11:55:53.875265+0000","last_fullsized":"2024-09-14T11:55:53.875265+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:22.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013869+0000","last_change":"2024-09-14T11:43:35.604229+0000","last_active":"2024-09-14T11:56:09.013869+0000","last_peered":"2024-09-14T11:56:09.013869+0000","last_clean":"2024-09-14T11:56:09.013869+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:56:09.013869+0000","last_undegraded":"2024-09-14T11:56:09.013869+0000","last_fullsized":"2024-09-14T11:56:09.013869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:36.198961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.016119+0000","last_change":"2024-09-14T11:32:32.579628+0000","last_active":"2024-09-14T11:56:24.016119+0000","last_peered":"2024-09-14T11:56:24.016119+0000","last_clean":"2024-09-14T11:56:24.016119+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:56:24.016119+0000","last_undegraded":"2024-09-14T11:56:24.016119+0000","last_fullsized":"2024-09-14T11:56:24.016119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:15.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.878920+0000","last_change":"2024-09-14T11:32:29.555597+0000","last_active":"2024-09-14T11:56:18.878920+0000","last_peered":"2024-09-14T11:56:18.878920+0000","last_clean":"2024-09-14T11:56:18.878920+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:56:18.878920+0000","last_undegraded":"2024-09-14T11:56:18.878920+0000","last_fullsized":"2024-09-14T11:56:18.878920+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:41.029993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870178+0000","last_change":"2024-09-14T11:30:45.176934+0000","last_active":"2024-09-14T11:55:45.870178+0000","last_peered":"2024-09-14T11:55:45.870178+0000","last_clean":"2024-09-14T11:55:45.870178+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:55:45.870178+0000","last_undegraded":"2024-09-14T11:55:45.870178+0000","last_fullsized":"2024-09-14T11:55:45.870178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:07.587565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.855078+0000","last_change":"2024-09-14T11:43:35.606492+0000","last_active":"2024-09-14T11:54:28.855078+0000","last_peered":"2024-09-14T11:54:28.855078+0000","last_clean":"2024-09-14T11:54:28.855078+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:54:28.855078+0000","last_undegraded":"2024-09-14T11:54:28.855078+0000","last_fullsized":"2024-09-14T11:54:28.855078+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:37.980270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.868028+0000","last_change":"2024-09-14T11:32:32.587253+0000","last_active":"2024-09-14T11:55:30.868028+0000","last_peered":"2024-09-14T11:55:30.868028+0000","last_clean":"2024-09-14T11:55:30.868028+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:55:30.868028+0000","last_undegraded":"2024-09-14T11:55:30.868028+0000","last_fullsized":"2024-09-14T11:55:30.868028+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:48.236842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.881108+0000","last_change":"2024-09-14T11:32:29.554686+0000","last_active":"2024-09-14T11:56:33.881108+0000","last_peered":"2024-09-14T11:56:33.881108+0000","last_clean":"2024-09-14T11:56:33.881108+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:56:33.881108+0000","last_undegraded":"2024-09-14T11:56:33.881108+0000","last_fullsized":"2024-09-14T11:56:33.881108+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:47.349081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874577+0000","last_change":"2024-09-14T11:30:45.181837+0000","last_active":"2024-09-14T11:55:48.874577+0000","last_peered":"2024-09-14T11:55:48.874577+0000","last_clean":"2024-09-14T11:55:48.874577+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:55:48.874577+0000","last_undegraded":"2024-09-14T11:55:48.874577+0000","last_fullsized":"2024-09-14T11:55:48.874577+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:59.286638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.855431+0000","last_change":"2024-09-14T11:43:35.601443+0000","last_active":"2024-09-14T11:54:28.855431+0000","last_peered":"2024-09-14T11:54:28.855431+0000","last_clean":"2024-09-14T11:54:28.855431+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:54:28.855431+0000","last_undegraded":"2024-09-14T11:54:28.855431+0000","last_fullsized":"2024-09-14T11:54:28.855431+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.372764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882441+0000","last_change":"2024-09-14T11:32:32.587278+0000","last_active":"2024-09-14T11:56:43.882441+0000","last_peered":"2024-09-14T11:56:43.882441+0000","last_clean":"2024-09-14T11:56:43.882441+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:56:43.882441+0000","last_undegraded":"2024-09-14T11:56:43.882441+0000","last_fullsized":"2024-09-14T11:56:43.882441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.322094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870808+0000","last_change":"2024-09-14T11:32:29.548859+0000","last_active":"2024-09-14T11:55:23.870808+0000","last_peered":"2024-09-14T11:55:23.870808+0000","last_clean":"2024-09-14T11:55:23.870808+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:55:23.870808+0000","last_undegraded":"2024-09-14T11:55:23.870808+0000","last_fullsized":"2024-09-14T11:55:23.870808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:45.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":210,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011327+0000","last_change":"2024-09-14T11:30:45.187608+0000","last_active":"2024-09-14T11:55:49.011327+0000","last_peered":"2024-09-14T11:55:49.011327+0000","last_clean":"2024-09-14T11:55:49.011327+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:55:49.011327+0000","last_undegraded":"2024-09-14T11:55:49.011327+0000","last_fullsized":"2024-09-14T11:55:49.011327+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:16.607409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.867231+0000","last_change":"2024-09-14T11:43:35.605855+0000","last_active":"2024-09-14T11:56:08.867231+0000","last_peered":"2024-09-14T11:56:08.867231+0000","last_clean":"2024-09-14T11:56:08.867231+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:56:08.867231+0000","last_undegraded":"2024-09-14T11:56:08.867231+0000","last_fullsized":"2024-09-14T11:56:08.867231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:26.463408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'2","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.951981+0000","last_change":"2024-09-14T11:32:32.590849+0000","last_active":"2024-09-14T11:55:28.951981+0000","last_peered":"2024-09-14T11:55:28.951981+0000","last_clean":"2024-09-14T11:55:28.951981+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:55:28.951981+0000","last_undegraded":"2024-09-14T11:55:28.951981+0000","last_fullsized":"2024-09-14T11:55:28.951981+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:53.175496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108940,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2166,"num_write":2,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'6","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:25.867386+0000","last_change":"2024-09-14T11:32:29.553146+0000","last_active":"2024-09-14T11:55:25.867386+0000","last_peered":"2024-09-14T11:55:25.867386+0000","last_clean":"2024-09-14T11:55:25.867386+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:55:25.867386+0000","last_undegraded":"2024-09-14T11:55:25.867386+0000","last_fullsized":"2024-09-14T11:55:25.867386+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:39.348345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":87,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954727+0000","last_change":"2024-09-14T11:30:45.183295+0000","last_active":"2024-09-14T11:55:48.954727+0000","last_peered":"2024-09-14T11:55:48.954727+0000","last_clean":"2024-09-14T11:55:48.954727+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:55:48.954727+0000","last_undegraded":"2024-09-14T11:55:48.954727+0000","last_fullsized":"2024-09-14T11:55:48.954727+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:30.030410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.878101+0000","last_change":"2024-09-14T11:43:35.604955+0000","last_active":"2024-09-14T11:56:13.878101+0000","last_peered":"2024-09-14T11:56:13.878101+0000","last_clean":"2024-09-14T11:56:13.878101+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:56:13.878101+0000","last_undegraded":"2024-09-14T11:56:13.878101+0000","last_fullsized":"2024-09-14T11:56:13.878101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.840822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'13","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:29.008243+0000","last_change":"2024-09-14T11:32:32.584702+0000","last_active":"2024-09-14T11:55:29.008243+0000","last_peered":"2024-09-14T11:55:29.008243+0000","last_clean":"2024-09-14T11:55:29.008243+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:55:29.008243+0000","last_undegraded":"2024-09-14T11:55:29.008243+0000","last_fullsized":"2024-09-14T11:55:29.008243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:19.580871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19460,"num_write":23,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951168+0000","last_change":"2024-09-14T11:32:29.553252+0000","last_active":"2024-09-14T11:55:23.951168+0000","last_peered":"2024-09-14T11:55:23.951168+0000","last_clean":"2024-09-14T11:55:23.951168+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:55:23.951168+0000","last_undegraded":"2024-09-14T11:55:23.951168+0000","last_fullsized":"2024-09-14T11:55:23.951168+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:40.879039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:20.521654+0000","last_change":"2024-09-14T11:30:45.183283+0000","last_active":"2024-09-14T11:55:20.521654+0000","last_peered":"2024-09-14T11:55:20.521654+0000","last_clean":"2024-09-14T11:55:20.521654+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:55:20.521654+0000","last_undegraded":"2024-09-14T11:55:20.521654+0000","last_fullsized":"2024-09-14T11:55:20.521654+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:00.428598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'194","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.556201+0000","last_change":"2024-09-14T11:15:32.311949+0000","last_active":"2024-09-14T11:55:17.556201+0000","last_peered":"2024-09-14T11:55:17.556201+0000","last_clean":"2024-09-14T11:55:17.556201+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:55:17.556201+0000","last_undegraded":"2024-09-14T11:55:17.556201+0000","last_fullsized":"2024-09-14T11:55:17.556201+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:25.643807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9487068,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":68162,"num_write":953,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'445","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465587+0000","last_change":"2024-09-14T11:15:34.326897+0000","last_active":"2024-09-14T11:56:38.465587+0000","last_peered":"2024-09-14T11:56:38.465587+0000","last_clean":"2024-09-14T11:56:38.465587+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:56:38.465587+0000","last_undegraded":"2024-09-14T11:56:38.465587+0000","last_fullsized":"2024-09-14T11:56:38.465587+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:44.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'194","reported_seq":838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865508+0000","last_change":"2024-09-14T11:15:32.317583+0000","last_active":"2024-09-14T11:55:10.865508+0000","last_peered":"2024-09-14T11:55:10.865508+0000","last_clean":"2024-09-14T11:55:10.865508+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:55:10.865508+0000","last_undegraded":"2024-09-14T11:55:10.865508+0000","last_fullsized":"2024-09-14T11:55:10.865508+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:37.196534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11154863,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":84673,"num_write":938,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998595+0000","last_change":"2024-09-14T11:15:34.330220+0000","last_active":"2024-09-14T11:56:36.998595+0000","last_peered":"2024-09-14T11:56:36.998595+0000","last_clean":"2024-09-14T11:56:36.998595+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:56:36.998595+0000","last_undegraded":"2024-09-14T11:56:36.998595+0000","last_fullsized":"2024-09-14T11:56:36.998595+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:39.172882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'212","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.074819+0000","last_change":"2024-09-14T11:15:32.302813+0000","last_active":"2024-09-14T11:56:39.074819+0000","last_peered":"2024-09-14T11:56:39.074819+0000","last_clean":"2024-09-14T11:56:39.074819+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:56:39.074819+0000","last_undegraded":"2024-09-14T11:56:39.074819+0000","last_fullsized":"2024-09-14T11:56:39.074819+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:48.865990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":1085,"num_write":1014,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'743","reported_seq":2196,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815132+0000","last_change":"2024-09-14T11:15:34.316987+0000","last_active":"2024-09-14T11:56:31.815132+0000","last_peered":"2024-09-14T11:56:31.815132+0000","last_clean":"2024-09-14T11:56:31.815132+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:56:31.815132+0000","last_undegraded":"2024-09-14T11:56:31.815132+0000","last_fullsized":"2024-09-14T11:56:31.815132+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:20.185745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'233","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.967008+0000","last_change":"2024-09-14T11:15:32.322744+0000","last_active":"2024-09-14T11:55:55.967008+0000","last_peered":"2024-09-14T11:55:55.967008+0000","last_clean":"2024-09-14T11:55:55.967008+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:55:55.967008+0000","last_undegraded":"2024-09-14T11:55:55.967008+0000","last_fullsized":"2024-09-14T11:55:55.967008+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:12.738315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957164,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":528,"num_read_kb":30923,"num_write":1125,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2085,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136947+0000","last_change":"2024-09-14T11:15:34.323811+0000","last_active":"2024-09-14T11:56:39.136947+0000","last_peered":"2024-09-14T11:56:39.136947+0000","last_clean":"2024-09-14T11:56:39.136947+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:56:39.136947+0000","last_undegraded":"2024-09-14T11:56:39.136947+0000","last_fullsized":"2024-09-14T11:56:39.136947+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.122736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'216","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872289+0000","last_change":"2024-09-14T11:15:32.313227+0000","last_active":"2024-09-14T11:55:33.872289+0000","last_peered":"2024-09-14T11:55:33.872289+0000","last_clean":"2024-09-14T11:55:33.872289+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:55:33.872289+0000","last_undegraded":"2024-09-14T11:55:33.872289+0000","last_fullsized":"2024-09-14T11:55:33.872289+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:24.665300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'966","reported_seq":2607,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518596+0000","last_change":"2024-09-14T11:15:34.323939+0000","last_active":"2024-09-14T11:56:33.518596+0000","last_peered":"2024-09-14T11:56:33.518596+0000","last_clean":"2024-09-14T11:56:33.518596+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:56:33.518596+0000","last_undegraded":"2024-09-14T11:56:33.518596+0000","last_fullsized":"2024-09-14T11:56:33.518596+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:54.340034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'178","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.486361+0000","last_change":"2024-09-14T11:15:32.323327+0000","last_active":"2024-09-14T11:56:28.486361+0000","last_peered":"2024-09-14T11:56:28.486361+0000","last_clean":"2024-09-14T11:56:28.486361+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:56:28.486361+0000","last_undegraded":"2024-09-14T11:56:28.486361+0000","last_fullsized":"2024-09-14T11:56:28.486361+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:45.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4279447,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":540,"num_read_kb":10177,"num_write":895,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466977+0000","last_change":"2024-09-14T11:15:34.316280+0000","last_active":"2024-09-14T11:58:14.466977+0000","last_peered":"2024-09-14T11:58:14.466977+0000","last_clean":"2024-09-14T11:58:14.466977+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:58:14.466977+0000","last_undegraded":"2024-09-14T11:58:14.466977+0000","last_fullsized":"2024-09-14T11:58:14.466977+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:00.310713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'189","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.439143+0000","last_change":"2024-09-14T11:15:32.317672+0000","last_active":"2024-09-14T11:56:22.439143+0000","last_peered":"2024-09-14T11:56:22.439143+0000","last_clean":"2024-09-14T11:56:22.439143+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:56:22.439143+0000","last_undegraded":"2024-09-14T11:56:22.439143+0000","last_fullsized":"2024-09-14T11:56:22.439143+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:04.495027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9687544,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":12539,"num_write":920,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'490","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465061+0000","last_change":"2024-09-14T11:15:34.328589+0000","last_active":"2024-09-14T11:56:38.465061+0000","last_peered":"2024-09-14T11:56:38.465061+0000","last_clean":"2024-09-14T11:56:38.465061+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:56:38.465061+0000","last_undegraded":"2024-09-14T11:56:38.465061+0000","last_fullsized":"2024-09-14T11:56:38.465061+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.473320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'213","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.120521+0000","last_change":"2024-09-14T11:15:32.320364+0000","last_active":"2024-09-14T11:55:48.120521+0000","last_peered":"2024-09-14T11:55:48.120521+0000","last_clean":"2024-09-14T11:55:48.120521+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:55:48.120521+0000","last_undegraded":"2024-09-14T11:55:48.120521+0000","last_fullsized":"2024-09-14T11:55:48.120521+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:11.338356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4594609,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":31152,"num_write":976,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'593","reported_seq":2457,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882772+0000","last_change":"2024-09-14T11:16:07.517907+0000","last_active":"2024-09-14T11:56:54.882772+0000","last_peered":"2024-09-14T11:56:54.882772+0000","last_clean":"2024-09-14T11:56:54.882772+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:56:54.882772+0000","last_undegraded":"2024-09-14T11:56:54.882772+0000","last_fullsized":"2024-09-14T11:56:54.882772+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:13.243462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466795+0000","last_change":"2024-09-14T11:15:34.313439+0000","last_active":"2024-09-14T11:58:14.466795+0000","last_peered":"2024-09-14T11:58:14.466795+0000","last_clean":"2024-09-14T11:58:14.466795+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:58:14.466795+0000","last_undegraded":"2024-09-14T11:58:14.466795+0000","last_fullsized":"2024-09-14T11:58:14.466795+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:34.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'221","reported_seq":838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.617964+0000","last_change":"2024-09-14T11:15:32.319484+0000","last_active":"2024-09-14T11:56:35.617964+0000","last_peered":"2024-09-14T11:56:35.617964+0000","last_clean":"2024-09-14T11:56:35.617964+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:56:35.617964+0000","last_undegraded":"2024-09-14T11:56:35.617964+0000","last_fullsized":"2024-09-14T11:56:35.617964+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:12.735898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4728445,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":556,"num_read_kb":8015,"num_write":1055,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'455","reported_seq":2042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.991606+0000","last_change":"2024-09-14T11:15:34.330160+0000","last_active":"2024-09-14T11:56:56.991606+0000","last_peered":"2024-09-14T11:56:56.991606+0000","last_clean":"2024-09-14T11:56:56.991606+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:56:56.991606+0000","last_undegraded":"2024-09-14T11:56:56.991606+0000","last_fullsized":"2024-09-14T11:56:56.991606+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:22.426308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'220","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.751609+0000","last_change":"2024-09-14T11:15:32.315600+0000","last_active":"2024-09-14T11:56:31.751609+0000","last_peered":"2024-09-14T11:56:31.751609+0000","last_clean":"2024-09-14T11:56:31.751609+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:56:31.751609+0000","last_undegraded":"2024-09-14T11:56:31.751609+0000","last_fullsized":"2024-09-14T11:56:31.751609+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:22.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":24963,"num_write":1048,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'441","reported_seq":1986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.890926+0000","last_change":"2024-09-14T11:15:34.326565+0000","last_active":"2024-09-14T11:57:43.890926+0000","last_peered":"2024-09-14T11:57:43.890926+0000","last_clean":"2024-09-14T11:57:43.890926+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:57:43.890926+0000","last_undegraded":"2024-09-14T11:57:43.890926+0000","last_fullsized":"2024-09-14T11:57:43.890926+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:36.647727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'205","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.932757+0000","last_change":"2024-09-14T11:15:32.315148+0000","last_active":"2024-09-14T11:56:36.932757+0000","last_peered":"2024-09-14T11:56:36.932757+0000","last_clean":"2024-09-14T11:56:36.932757+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:56:36.932757+0000","last_undegraded":"2024-09-14T11:56:36.932757+0000","last_fullsized":"2024-09-14T11:56:36.932757+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:49.800357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274173,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17257,"num_write":953,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'393","reported_seq":1858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465278+0000","last_change":"2024-09-14T11:15:34.323271+0000","last_active":"2024-09-14T11:56:38.465278+0000","last_peered":"2024-09-14T11:56:38.465278+0000","last_clean":"2024-09-14T11:56:38.465278+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:56:38.465278+0000","last_undegraded":"2024-09-14T11:56:38.465278+0000","last_fullsized":"2024-09-14T11:56:38.465278+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:05.710670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'250","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.153294+0000","last_change":"2024-09-14T11:15:32.313147+0000","last_active":"2024-09-14T11:56:20.153294+0000","last_peered":"2024-09-14T11:56:20.153294+0000","last_clean":"2024-09-14T11:56:20.153294+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:56:20.153294+0000","last_undegraded":"2024-09-14T11:56:20.153294+0000","last_fullsized":"2024-09-14T11:56:20.153294+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:40.375363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8378626,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":644,"num_read_kb":20644,"num_write":1060,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.129016+0000","last_change":"2024-09-14T11:15:34.315634+0000","last_active":"2024-09-14T11:56:39.129016+0000","last_peered":"2024-09-14T11:56:39.129016+0000","last_clean":"2024-09-14T11:56:39.129016+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:56:39.129016+0000","last_undegraded":"2024-09-14T11:56:39.129016+0000","last_fullsized":"2024-09-14T11:56:39.129016+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'282","reported_seq":1022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.080467+0000","last_change":"2024-09-14T11:15:32.317614+0000","last_active":"2024-09-14T11:56:52.080467+0000","last_peered":"2024-09-14T11:56:52.080467+0000","last_clean":"2024-09-14T11:56:52.080467+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:56:52.080467+0000","last_undegraded":"2024-09-14T11:56:52.080467+0000","last_fullsized":"2024-09-14T11:56:52.080467+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:00.703910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14529092,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1010,"num_read_kb":39546,"num_write":1286,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'571","reported_seq":2414,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456133+0000","last_change":"2024-09-14T11:15:34.328085+0000","last_active":"2024-09-14T11:58:14.456133+0000","last_peered":"2024-09-14T11:58:14.456133+0000","last_clean":"2024-09-14T11:58:14.456133+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:58:14.456133+0000","last_undegraded":"2024-09-14T11:58:14.456133+0000","last_fullsized":"2024-09-14T11:58:14.456133+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:40.805688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'227","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.457817+0000","last_change":"2024-09-14T11:15:32.309339+0000","last_active":"2024-09-14T11:58:13.457817+0000","last_peered":"2024-09-14T11:58:13.457817+0000","last_clean":"2024-09-14T11:58:13.457817+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:58:13.457817+0000","last_undegraded":"2024-09-14T11:58:13.457817+0000","last_fullsized":"2024-09-14T11:58:13.457817+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:16.044046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9003847,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":31277,"num_write":1073,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.583992+0000","last_change":"2024-09-14T11:15:42.348963+0000","last_active":"2024-09-14T11:56:57.583992+0000","last_peered":"2024-09-14T11:56:57.583992+0000","last_clean":"2024-09-14T11:56:57.583992+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:56:57.583992+0000","last_undegraded":"2024-09-14T11:56:57.583992+0000","last_fullsized":"2024-09-14T11:56:57.583992+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:41.155224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'823","reported_seq":2528,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883828+0000","last_change":"2024-09-14T11:15:34.329854+0000","last_active":"2024-09-14T11:56:54.883828+0000","last_peered":"2024-09-14T11:56:54.883828+0000","last_clean":"2024-09-14T11:56:54.883828+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:56:54.883828+0000","last_undegraded":"2024-09-14T11:56:54.883828+0000","last_fullsized":"2024-09-14T11:56:54.883828+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:48.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'194","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.175364+0000","last_change":"2024-09-14T11:15:32.318773+0000","last_active":"2024-09-14T11:56:12.175364+0000","last_peered":"2024-09-14T11:56:12.175364+0000","last_clean":"2024-09-14T11:56:12.175364+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:56:12.175364+0000","last_undegraded":"2024-09-14T11:56:12.175364+0000","last_fullsized":"2024-09-14T11:56:12.175364+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:41.470746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314134,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":881,"num_read_kb":29517,"num_write":950,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861599+0000","last_change":"2024-09-14T11:15:36.329405+0000","last_active":"2024-09-14T11:54:18.861599+0000","last_peered":"2024-09-14T11:54:18.861599+0000","last_clean":"2024-09-14T11:54:18.861599+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:54:18.861599+0000","last_undegraded":"2024-09-14T11:54:18.861599+0000","last_fullsized":"2024-09-14T11:54:18.861599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.437495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'196","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.823610+0000","last_change":"2024-09-14T11:15:38.337357+0000","last_active":"2024-09-14T11:56:54.823610+0000","last_peered":"2024-09-14T11:56:54.823610+0000","last_clean":"2024-09-14T11:56:54.823610+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:56:54.823610+0000","last_undegraded":"2024-09-14T11:56:54.823610+0000","last_fullsized":"2024-09-14T11:56:54.823610+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.259312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":248,"num_write":148,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.862314+0000","last_change":"2024-09-14T11:15:40.343299+0000","last_active":"2024-09-14T11:54:23.862314+0000","last_peered":"2024-09-14T11:54:23.862314+0000","last_clean":"2024-09-14T11:54:23.862314+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:54:23.862314+0000","last_undegraded":"2024-09-14T11:54:23.862314+0000","last_fullsized":"2024-09-14T11:54:23.862314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:21.470841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2483","reported_seq":4315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884659+0000","last_change":"2024-09-14T11:15:42.346740+0000","last_active":"2024-09-14T11:56:58.884659+0000","last_peered":"2024-09-14T11:56:58.884659+0000","last_clean":"2024-09-14T11:56:58.884659+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:56:58.884659+0000","last_undegraded":"2024-09-14T11:56:58.884659+0000","last_fullsized":"2024-09-14T11:56:58.884659+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":2400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:08.150839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'431","reported_seq":2262,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.519771+0000","last_change":"2024-09-14T11:15:34.327076+0000","last_active":"2024-09-14T11:56:57.519771+0000","last_peered":"2024-09-14T11:56:57.519771+0000","last_clean":"2024-09-14T11:56:57.519771+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:56:57.519771+0000","last_undegraded":"2024-09-14T11:56:57.519771+0000","last_fullsized":"2024-09-14T11:56:57.519771+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:08.246401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'262","reported_seq":952,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.022548+0000","last_change":"2024-09-14T11:15:32.308280+0000","last_active":"2024-09-14T11:55:18.022548+0000","last_peered":"2024-09-14T11:55:18.022548+0000","last_clean":"2024-09-14T11:55:18.022548+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:55:18.022548+0000","last_undegraded":"2024-09-14T11:55:18.022548+0000","last_fullsized":"2024-09-14T11:55:18.022548+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:16.723135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6141367,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":737,"num_read_kb":16466,"num_write":1197,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.872400+0000","last_change":"2024-09-14T11:15:36.334689+0000","last_active":"2024-09-14T11:55:28.872400+0000","last_peered":"2024-09-14T11:55:28.872400+0000","last_clean":"2024-09-14T11:55:28.872400+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:55:28.872400+0000","last_undegraded":"2024-09-14T11:55:28.872400+0000","last_fullsized":"2024-09-14T11:55:28.872400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.914528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'91","reported_seq":605,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.185623+0000","last_change":"2024-09-14T11:15:38.334852+0000","last_active":"2024-09-14T11:55:48.185623+0000","last_peered":"2024-09-14T11:55:48.185623+0000","last_clean":"2024-09-14T11:55:48.185623+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:55:48.185623+0000","last_undegraded":"2024-09-14T11:55:48.185623+0000","last_fullsized":"2024-09-14T11:55:48.185623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:06.733877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.000326+0000","last_change":"2024-09-14T11:15:40.346053+0000","last_active":"2024-09-14T11:54:24.000326+0000","last_peered":"2024-09-14T11:54:24.000326+0000","last_clean":"2024-09-14T11:54:24.000326+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:54:24.000326+0000","last_undegraded":"2024-09-14T11:54:24.000326+0000","last_fullsized":"2024-09-14T11:54:24.000326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.054969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'107","reported_seq":595,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.810718+0000","last_change":"2024-09-14T11:15:42.347308+0000","last_active":"2024-09-14T11:56:31.810718+0000","last_peered":"2024-09-14T11:56:31.810718+0000","last_clean":"2024-09-14T11:56:31.810718+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:56:31.810718+0000","last_undegraded":"2024-09-14T11:56:31.810718+0000","last_fullsized":"2024-09-14T11:56:31.810718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:53.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'424","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883698+0000","last_change":"2024-09-14T11:15:34.328884+0000","last_active":"2024-09-14T11:56:54.883698+0000","last_peered":"2024-09-14T11:56:54.883698+0000","last_clean":"2024-09-14T11:56:54.883698+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:56:54.883698+0000","last_undegraded":"2024-09-14T11:56:54.883698+0000","last_fullsized":"2024-09-14T11:56:54.883698+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'186","reported_seq":796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:47.557485+0000","last_change":"2024-09-14T11:15:32.316916+0000","last_active":"2024-09-14T11:55:47.557485+0000","last_peered":"2024-09-14T11:55:47.557485+0000","last_clean":"2024-09-14T11:55:47.557485+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:55:47.557485+0000","last_undegraded":"2024-09-14T11:55:47.557485+0000","last_fullsized":"2024-09-14T11:55:47.557485+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:45.239724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":30179,"num_write":920,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"36'3","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.319326+0000","last_change":"2024-09-14T11:15:36.333013+0000","last_active":"2024-09-14T11:58:15.319326+0000","last_peered":"2024-09-14T11:58:15.319326+0000","last_clean":"2024-09-14T11:58:15.319326+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:58:15.319326+0000","last_undegraded":"2024-09-14T11:58:15.319326+0000","last_fullsized":"2024-09-14T11:58:15.319326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.296621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'115","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.680045+0000","last_change":"2024-09-14T11:15:38.337017+0000","last_active":"2024-09-14T11:56:32.680045+0000","last_peered":"2024-09-14T11:56:32.680045+0000","last_clean":"2024-09-14T11:56:32.680045+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:56:32.680045+0000","last_undegraded":"2024-09-14T11:56:32.680045+0000","last_fullsized":"2024-09-14T11:56:32.680045+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.412101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'748","reported_seq":2522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842710+0000","last_change":"2024-09-14T11:15:40.343642+0000","last_active":"2024-09-14T11:58:15.842710+0000","last_peered":"2024-09-14T11:58:15.842710+0000","last_clean":"2024-09-14T11:58:15.842710+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:58:15.842710+0000","last_undegraded":"2024-09-14T11:58:15.842710+0000","last_fullsized":"2024-09-14T11:58:15.842710+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.527132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'193","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.636145+0000","last_change":"2024-09-14T11:15:42.341730+0000","last_active":"2024-09-14T11:56:57.636145+0000","last_peered":"2024-09-14T11:56:57.636145+0000","last_clean":"2024-09-14T11:56:57.636145+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:56:57.636145+0000","last_undegraded":"2024-09-14T11:56:57.636145+0000","last_fullsized":"2024-09-14T11:56:57.636145+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.359150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1027","reported_seq":2587,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.126763+0000","last_change":"2024-09-14T11:15:34.325968+0000","last_active":"2024-09-14T11:56:39.126763+0000","last_peered":"2024-09-14T11:56:39.126763+0000","last_clean":"2024-09-14T11:56:39.126763+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:56:39.126763+0000","last_undegraded":"2024-09-14T11:56:39.126763+0000","last_fullsized":"2024-09-14T11:56:39.126763+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:31.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'192","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.932639+0000","last_change":"2024-09-14T11:15:32.317790+0000","last_active":"2024-09-14T11:56:16.932639+0000","last_peered":"2024-09-14T11:56:16.932639+0000","last_clean":"2024-09-14T11:56:16.932639+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:56:16.932639+0000","last_undegraded":"2024-09-14T11:56:16.932639+0000","last_fullsized":"2024-09-14T11:56:16.932639+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:32.748526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421713,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":5281,"num_write":855,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861627+0000","last_change":"2024-09-14T11:15:36.330106+0000","last_active":"2024-09-14T11:54:18.861627+0000","last_peered":"2024-09-14T11:54:18.861627+0000","last_clean":"2024-09-14T11:54:18.861627+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:54:18.861627+0000","last_undegraded":"2024-09-14T11:54:18.861627+0000","last_fullsized":"2024-09-14T11:54:18.861627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:38.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'119","reported_seq":671,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882554+0000","last_change":"2024-09-14T11:15:38.337426+0000","last_active":"2024-09-14T11:56:43.882554+0000","last_peered":"2024-09-14T11:56:43.882554+0000","last_clean":"2024-09-14T11:56:43.882554+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:56:43.882554+0000","last_undegraded":"2024-09-14T11:56:43.882554+0000","last_fullsized":"2024-09-14T11:56:43.882554+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:10.689123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":161,"num_write":72,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'809","reported_seq":2224,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.843154+0000","last_change":"2024-09-14T11:15:40.349078+0000","last_active":"2024-09-14T11:58:15.843154+0000","last_peered":"2024-09-14T11:58:15.843154+0000","last_clean":"2024-09-14T11:58:15.843154+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:58:15.843154+0000","last_undegraded":"2024-09-14T11:58:15.843154+0000","last_fullsized":"2024-09-14T11:58:15.843154+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:29.118650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'734","reported_seq":2277,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465422+0000","last_change":"2024-09-14T11:15:34.326626+0000","last_active":"2024-09-14T11:56:38.465422+0000","last_peered":"2024-09-14T11:56:38.465422+0000","last_clean":"2024-09-14T11:56:38.465422+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:56:38.465422+0000","last_undegraded":"2024-09-14T11:56:38.465422+0000","last_fullsized":"2024-09-14T11:56:38.465422+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:29.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'202","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.925790+0000","last_change":"2024-09-14T11:15:32.318817+0000","last_active":"2024-09-14T11:58:06.925790+0000","last_peered":"2024-09-14T11:58:06.925790+0000","last_clean":"2024-09-14T11:58:06.925790+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:06.925790+0000","last_undegraded":"2024-09-14T11:58:06.925790+0000","last_fullsized":"2024-09-14T11:58:06.925790+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:39.582918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1378406,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":726,"num_read_kb":30459,"num_write":895,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864459+0000","last_change":"2024-09-14T11:15:36.334240+0000","last_active":"2024-09-14T11:54:38.864459+0000","last_peered":"2024-09-14T11:54:38.864459+0000","last_clean":"2024-09-14T11:54:38.864459+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:54:38.864459+0000","last_undegraded":"2024-09-14T11:54:38.864459+0000","last_fullsized":"2024-09-14T11:54:38.864459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:52.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'209","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884714+0000","last_change":"2024-09-14T11:15:38.335040+0000","last_active":"2024-09-14T11:56:58.884714+0000","last_peered":"2024-09-14T11:56:58.884714+0000","last_clean":"2024-09-14T11:56:58.884714+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:56:58.884714+0000","last_undegraded":"2024-09-14T11:56:58.884714+0000","last_fullsized":"2024-09-14T11:56:58.884714+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.960934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14935,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":278,"num_read_kb":338,"num_write":166,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.873529+0000","last_change":"2024-09-14T11:15:40.345833+0000","last_active":"2024-09-14T11:56:10.873529+0000","last_peered":"2024-09-14T11:56:10.873529+0000","last_clean":"2024-09-14T11:56:10.873529+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:56:10.873529+0000","last_undegraded":"2024-09-14T11:56:10.873529+0000","last_fullsized":"2024-09-14T11:56:10.873529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'552","reported_seq":1347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801804+0000","last_change":"2024-09-14T11:15:42.350220+0000","last_active":"2024-09-14T11:58:15.801804+0000","last_peered":"2024-09-14T11:58:15.801804+0000","last_clean":"2024-09-14T11:58:15.801804+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:58:15.801804+0000","last_undegraded":"2024-09-14T11:58:15.801804+0000","last_fullsized":"2024-09-14T11:58:15.801804+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:29.655558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'833","reported_seq":2317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.019226+0000","last_change":"2024-09-14T11:15:34.329906+0000","last_active":"2024-09-14T11:56:44.019226+0000","last_peered":"2024-09-14T11:56:44.019226+0000","last_clean":"2024-09-14T11:56:44.019226+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:56:44.019226+0000","last_undegraded":"2024-09-14T11:56:44.019226+0000","last_fullsized":"2024-09-14T11:56:44.019226+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:09.186132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'283","reported_seq":924,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.876535+0000","last_change":"2024-09-14T11:15:32.321404+0000","last_active":"2024-09-14T11:56:03.876535+0000","last_peered":"2024-09-14T11:56:03.876535+0000","last_clean":"2024-09-14T11:56:03.876535+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:56:03.876535+0000","last_undegraded":"2024-09-14T11:56:03.876535+0000","last_fullsized":"2024-09-14T11:56:03.876535+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:33.160296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5250566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":15958,"num_write":1144,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856235+0000","last_change":"2024-09-14T11:15:36.323224+0000","last_active":"2024-09-14T11:54:38.856235+0000","last_peered":"2024-09-14T11:54:38.856235+0000","last_clean":"2024-09-14T11:54:38.856235+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:54:38.856235+0000","last_undegraded":"2024-09-14T11:54:38.856235+0000","last_fullsized":"2024-09-14T11:54:38.856235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:40.252261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'116","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.766607+0000","last_change":"2024-09-14T11:15:38.336933+0000","last_active":"2024-09-14T11:58:15.766607+0000","last_peered":"2024-09-14T11:58:15.766607+0000","last_clean":"2024-09-14T11:58:15.766607+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:58:15.766607+0000","last_undegraded":"2024-09-14T11:58:15.766607+0000","last_fullsized":"2024-09-14T11:58:15.766607+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.373870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":179,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867935+0000","last_change":"2024-09-14T11:15:40.349051+0000","last_active":"2024-09-14T11:54:53.867935+0000","last_peered":"2024-09-14T11:54:53.867935+0000","last_clean":"2024-09-14T11:54:53.867935+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:54:53.867935+0000","last_undegraded":"2024-09-14T11:54:53.867935+0000","last_fullsized":"2024-09-14T11:54:53.867935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.147760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'124","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.968464+0000","last_change":"2024-09-14T11:15:42.351151+0000","last_active":"2024-09-14T11:57:28.968464+0000","last_peered":"2024-09-14T11:57:28.968464+0000","last_clean":"2024-09-14T11:57:28.968464+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:57:28.968464+0000","last_undegraded":"2024-09-14T11:57:28.968464+0000","last_fullsized":"2024-09-14T11:57:28.968464+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:13.693118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'688","reported_seq":2326,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456533+0000","last_change":"2024-09-14T11:15:34.331821+0000","last_active":"2024-09-14T11:58:14.456533+0000","last_peered":"2024-09-14T11:58:14.456533+0000","last_clean":"2024-09-14T11:58:14.456533+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:58:14.456533+0000","last_undegraded":"2024-09-14T11:58:14.456533+0000","last_fullsized":"2024-09-14T11:58:14.456533+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:17.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'233","reported_seq":862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.451832+0000","last_change":"2024-09-14T11:16:07.518583+0000","last_active":"2024-09-14T11:56:33.451832+0000","last_peered":"2024-09-14T11:56:33.451832+0000","last_clean":"2024-09-14T11:56:33.451832+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:56:33.451832+0000","last_undegraded":"2024-09-14T11:56:33.451832+0000","last_fullsized":"2024-09-14T11:56:33.451832+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:49.410450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":671,"num_read_kb":32200,"num_write":1032,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866558+0000","last_change":"2024-09-14T11:15:36.326783+0000","last_active":"2024-09-14T11:56:08.866558+0000","last_peered":"2024-09-14T11:56:08.866558+0000","last_clean":"2024-09-14T11:56:08.866558+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:56:08.866558+0000","last_undegraded":"2024-09-14T11:56:08.866558+0000","last_fullsized":"2024-09-14T11:56:08.866558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'163","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.883105+0000","last_change":"2024-09-14T11:15:38.339476+0000","last_active":"2024-09-14T11:56:48.883105+0000","last_peered":"2024-09-14T11:56:48.883105+0000","last_clean":"2024-09-14T11:56:48.883105+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:56:48.883105+0000","last_undegraded":"2024-09-14T11:56:48.883105+0000","last_fullsized":"2024-09-14T11:56:48.883105+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:23.876347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22913,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":280,"num_write":118,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'800","reported_seq":4156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842862+0000","last_change":"2024-09-14T11:15:40.344136+0000","last_active":"2024-09-14T11:58:15.842862+0000","last_peered":"2024-09-14T11:58:15.842862+0000","last_clean":"2024-09-14T11:58:15.842862+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:58:15.842862+0000","last_undegraded":"2024-09-14T11:58:15.842862+0000","last_fullsized":"2024-09-14T11:58:15.842862+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:19.808946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'140","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.396582+0000","last_change":"2024-09-14T11:15:42.354873+0000","last_active":"2024-09-14T11:58:14.396582+0000","last_peered":"2024-09-14T11:58:14.396582+0000","last_clean":"2024-09-14T11:58:14.396582+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:58:14.396582+0000","last_undegraded":"2024-09-14T11:58:14.396582+0000","last_fullsized":"2024-09-14T11:58:14.396582+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:42.946889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.123392+0000","last_change":"2024-09-14T11:15:34.330206+0000","last_active":"2024-09-14T11:56:27.123392+0000","last_peered":"2024-09-14T11:56:27.123392+0000","last_clean":"2024-09-14T11:56:27.123392+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:56:27.123392+0000","last_undegraded":"2024-09-14T11:56:27.123392+0000","last_fullsized":"2024-09-14T11:56:27.123392+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:08.630914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'258","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:04.881290+0000","last_change":"2024-09-14T11:16:07.390362+0000","last_active":"2024-09-14T11:58:04.881290+0000","last_peered":"2024-09-14T11:58:04.881290+0000","last_clean":"2024-09-14T11:58:04.881290+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:04.881290+0000","last_undegraded":"2024-09-14T11:58:04.881290+0000","last_fullsized":"2024-09-14T11:58:04.881290+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:12.368811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8039247,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":835,"num_read_kb":40477,"num_write":1084,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856857+0000","last_change":"2024-09-14T11:15:36.330224+0000","last_active":"2024-09-14T11:54:43.856857+0000","last_peered":"2024-09-14T11:54:43.856857+0000","last_clean":"2024-09-14T11:54:43.856857+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:54:43.856857+0000","last_undegraded":"2024-09-14T11:54:43.856857+0000","last_fullsized":"2024-09-14T11:54:43.856857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.235014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'196","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.770042+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:58:15.770042+0000","last_peered":"2024-09-14T11:58:15.770042+0000","last_clean":"2024-09-14T11:58:15.770042+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:58:15.770042+0000","last_undegraded":"2024-09-14T11:58:15.770042+0000","last_fullsized":"2024-09-14T11:58:15.770042+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:38.723325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72046,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":490,"num_write":144,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856808+0000","last_change":"2024-09-14T11:15:40.342222+0000","last_active":"2024-09-14T11:54:43.856808+0000","last_peered":"2024-09-14T11:54:43.856808+0000","last_clean":"2024-09-14T11:54:43.856808+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:54:43.856808+0000","last_undegraded":"2024-09-14T11:54:43.856808+0000","last_fullsized":"2024-09-14T11:54:43.856808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:48.145919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'132","reported_seq":645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:54.698739+0000","last_change":"2024-09-14T11:15:42.350823+0000","last_active":"2024-09-14T11:55:54.698739+0000","last_peered":"2024-09-14T11:55:54.698739+0000","last_clean":"2024-09-14T11:55:54.698739+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:55:54.698739+0000","last_undegraded":"2024-09-14T11:55:54.698739+0000","last_fullsized":"2024-09-14T11:55:54.698739+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:46.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'485","reported_seq":2086,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321026+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:42.583484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'216","reported_seq":916,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877337+0000","last_change":"2024-09-14T11:15:32.318996+0000","last_active":"2024-09-14T11:56:03.877337+0000","last_peered":"2024-09-14T11:56:03.877337+0000","last_clean":"2024-09-14T11:56:03.877337+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:56:03.877337+0000","last_undegraded":"2024-09-14T11:56:03.877337+0000","last_fullsized":"2024-09-14T11:56:03.877337+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:29.686806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24803905,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":665,"num_read_kb":211571,"num_write":947,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866594+0000","last_change":"2024-09-14T11:15:36.334662+0000","last_active":"2024-09-14T11:56:08.866594+0000","last_peered":"2024-09-14T11:56:08.866594+0000","last_clean":"2024-09-14T11:56:08.866594+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:56:08.866594+0000","last_undegraded":"2024-09-14T11:56:08.866594+0000","last_fullsized":"2024-09-14T11:56:08.866594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'139","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.770844+0000","last_change":"2024-09-14T11:15:38.335114+0000","last_active":"2024-09-14T11:58:15.770844+0000","last_peered":"2024-09-14T11:58:15.770844+0000","last_clean":"2024-09-14T11:58:15.770844+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:58:15.770844+0000","last_undegraded":"2024-09-14T11:58:15.770844+0000","last_fullsized":"2024-09-14T11:58:15.770844+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:02.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":262,"num_write":164,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868727+0000","last_change":"2024-09-14T11:15:40.352052+0000","last_active":"2024-09-14T11:56:18.868727+0000","last_peered":"2024-09-14T11:56:18.868727+0000","last_clean":"2024-09-14T11:56:18.868727+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:56:18.868727+0000","last_undegraded":"2024-09-14T11:56:18.868727+0000","last_fullsized":"2024-09-14T11:56:18.868727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:06.160840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'120","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.892807+0000","last_change":"2024-09-14T11:15:42.350884+0000","last_active":"2024-09-14T11:57:53.892807+0000","last_peered":"2024-09-14T11:57:53.892807+0000","last_clean":"2024-09-14T11:57:53.892807+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:57:53.892807+0000","last_undegraded":"2024-09-14T11:57:53.892807+0000","last_fullsized":"2024-09-14T11:57:53.892807+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.299714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'399","reported_seq":2034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.814843+0000","last_change":"2024-09-14T11:15:34.315484+0000","last_active":"2024-09-14T11:56:31.814843+0000","last_peered":"2024-09-14T11:56:31.814843+0000","last_clean":"2024-09-14T11:56:31.814843+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:56:31.814843+0000","last_undegraded":"2024-09-14T11:56:31.814843+0000","last_fullsized":"2024-09-14T11:56:31.814843+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:48.314937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'218","reported_seq":1028,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.985453+0000","last_change":"2024-09-14T11:15:32.316393+0000","last_active":"2024-09-14T11:58:09.985453+0000","last_peered":"2024-09-14T11:58:09.985453+0000","last_clean":"2024-09-14T11:58:09.985453+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:09.985453+0000","last_undegraded":"2024-09-14T11:58:09.985453+0000","last_fullsized":"2024-09-14T11:58:09.985453+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:19.207524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973023,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1174,"num_read_kb":14840,"num_write":1003,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872741+0000","last_change":"2024-09-14T11:15:36.331915+0000","last_active":"2024-09-14T11:56:05.872741+0000","last_peered":"2024-09-14T11:56:05.872741+0000","last_clean":"2024-09-14T11:56:05.872741+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:56:05.872741+0000","last_undegraded":"2024-09-14T11:56:05.872741+0000","last_fullsized":"2024-09-14T11:56:05.872741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:44.896969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'159","reported_seq":734,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.799963+0000","last_change":"2024-09-14T11:15:38.333787+0000","last_active":"2024-09-14T11:58:15.799963+0000","last_peered":"2024-09-14T11:58:15.799963+0000","last_clean":"2024-09-14T11:58:15.799963+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:58:15.799963+0000","last_undegraded":"2024-09-14T11:58:15.799963+0000","last_fullsized":"2024-09-14T11:58:15.799963+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12670,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":287,"num_write":126,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'734","reported_seq":2515,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:16.100715+0000","last_change":"2024-09-14T11:15:40.337972+0000","last_active":"2024-09-14T11:58:16.100715+0000","last_peered":"2024-09-14T11:58:16.100715+0000","last_clean":"2024-09-14T11:58:16.100715+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:58:16.100715+0000","last_undegraded":"2024-09-14T11:58:16.100715+0000","last_fullsized":"2024-09-14T11:58:16.100715+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:41.159033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.461101+0000","last_change":"2024-09-14T11:15:42.355458+0000","last_active":"2024-09-14T11:56:38.461101+0000","last_peered":"2024-09-14T11:56:38.461101+0000","last_clean":"2024-09-14T11:56:38.461101+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:56:38.461101+0000","last_undegraded":"2024-09-14T11:56:38.461101+0000","last_fullsized":"2024-09-14T11:56:38.461101+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:20.221336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1221","reported_seq":2786,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321994+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.102163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'198","reported_seq":814,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.001730+0000","last_change":"2024-09-14T11:15:32.310048+0000","last_active":"2024-09-14T11:54:34.001730+0000","last_peered":"2024-09-14T11:54:34.001730+0000","last_clean":"2024-09-14T11:54:34.001730+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:54:34.001730+0000","last_undegraded":"2024-09-14T11:54:34.001730+0000","last_fullsized":"2024-09-14T11:54:34.001730+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.033083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1757315,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":33043,"num_write":875,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1432,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.748939+0000","last_change":"2024-09-14T11:15:36.330154+0000","last_active":"2024-09-14T11:58:15.748939+0000","last_peered":"2024-09-14T11:58:15.748939+0000","last_clean":"2024-09-14T11:58:15.748939+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:58:15.748939+0000","last_undegraded":"2024-09-14T11:58:15.748939+0000","last_fullsized":"2024-09-14T11:58:15.748939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":947,"num_read_kb":947,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'89","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.878066+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:56:08.878066+0000","last_peered":"2024-09-14T11:56:08.878066+0000","last_clean":"2024-09-14T11:56:08.878066+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:56:08.878066+0000","last_undegraded":"2024-09-14T11:56:08.878066+0000","last_fullsized":"2024-09-14T11:56:08.878066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.353564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'766","reported_seq":2230,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:16.101716+0000","last_change":"2024-09-14T11:15:40.344574+0000","last_active":"2024-09-14T11:58:16.101716+0000","last_peered":"2024-09-14T11:58:16.101716+0000","last_clean":"2024-09-14T11:58:16.101716+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:58:16.101716+0000","last_undegraded":"2024-09-14T11:58:16.101716+0000","last_fullsized":"2024-09-14T11:58:16.101716+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:07.380196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'148","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.994130+0000","last_change":"2024-09-14T11:15:42.354665+0000","last_active":"2024-09-14T11:56:36.994130+0000","last_peered":"2024-09-14T11:56:36.994130+0000","last_clean":"2024-09-14T11:56:36.994130+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:56:36.994130+0000","last_undegraded":"2024-09-14T11:56:36.994130+0000","last_fullsized":"2024-09-14T11:56:36.994130+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:56.500802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'422","reported_seq":2140,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992323+0000","last_change":"2024-09-14T11:15:34.335198+0000","last_active":"2024-09-14T11:56:56.992323+0000","last_peered":"2024-09-14T11:56:56.992323+0000","last_clean":"2024-09-14T11:56:56.992323+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:56:56.992323+0000","last_undegraded":"2024-09-14T11:56:56.992323+0000","last_fullsized":"2024-09-14T11:56:56.992323+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:17.261692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'173","reported_seq":778,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.978158+0000","last_change":"2024-09-14T11:15:32.310770+0000","last_active":"2024-09-14T11:56:17.978158+0000","last_peered":"2024-09-14T11:56:17.978158+0000","last_clean":"2024-09-14T11:56:17.978158+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:56:17.978158+0000","last_undegraded":"2024-09-14T11:56:17.978158+0000","last_fullsized":"2024-09-14T11:56:17.978158+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:39.610888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":26947,"num_write":784,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013965+0000","last_change":"2024-09-14T11:15:36.335046+0000","last_active":"2024-09-14T11:56:09.013965+0000","last_peered":"2024-09-14T11:56:09.013965+0000","last_clean":"2024-09-14T11:56:09.013965+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:56:09.013965+0000","last_undegraded":"2024-09-14T11:56:09.013965+0000","last_fullsized":"2024-09-14T11:56:09.013965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:54.481756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'206","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.785316+0000","last_change":"2024-09-14T11:15:38.333929+0000","last_active":"2024-09-14T11:58:15.785316+0000","last_peered":"2024-09-14T11:58:15.785316+0000","last_clean":"2024-09-14T11:58:15.785316+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:58:15.785316+0000","last_undegraded":"2024-09-14T11:58:15.785316+0000","last_fullsized":"2024-09-14T11:58:15.785316+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.403088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14187,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":887,"num_read_kb":938,"num_write":1414,"num_write_kb":1293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.958089+0000","last_change":"2024-09-14T11:15:40.349110+0000","last_active":"2024-09-14T11:56:13.958089+0000","last_peered":"2024-09-14T11:56:13.958089+0000","last_clean":"2024-09-14T11:56:13.958089+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:56:13.958089+0000","last_undegraded":"2024-09-14T11:56:13.958089+0000","last_fullsized":"2024-09-14T11:56:13.958089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.798885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'145","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.161350+0000","last_change":"2024-09-14T11:15:42.351759+0000","last_active":"2024-09-14T11:55:57.161350+0000","last_peered":"2024-09-14T11:55:57.161350+0000","last_clean":"2024-09-14T11:55:57.161350+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:55:57.161350+0000","last_undegraded":"2024-09-14T11:55:57.161350+0000","last_fullsized":"2024-09-14T11:55:57.161350+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:09.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'800","reported_seq":2315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531202+0000","last_change":"2024-09-14T11:15:34.322606+0000","last_active":"2024-09-14T11:56:57.531202+0000","last_peered":"2024-09-14T11:56:57.531202+0000","last_clean":"2024-09-14T11:56:57.531202+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:56:57.531202+0000","last_undegraded":"2024-09-14T11:56:57.531202+0000","last_fullsized":"2024-09-14T11:56:57.531202+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:47.471242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870764+0000","last_change":"2024-09-14T11:15:15.722374+0000","last_active":"2024-09-14T11:55:23.870764+0000","last_peered":"2024-09-14T11:55:23.870764+0000","last_clean":"2024-09-14T11:55:23.870764+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:55:23.870764+0000","last_undegraded":"2024-09-14T11:55:23.870764+0000","last_fullsized":"2024-09-14T11:55:23.870764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_clean_scrub_stamp":"2024-09-14T11:15:14.033306+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:20.114027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867317+0000","last_change":"2024-09-14T11:15:23.082390+0000","last_active":"2024-09-14T11:54:58.867317+0000","last_peered":"2024-09-14T11:54:58.867317+0000","last_clean":"2024-09-14T11:54:58.867317+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:54:58.867317+0000","last_undegraded":"2024-09-14T11:54:58.867317+0000","last_fullsized":"2024-09-14T11:54:58.867317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:33.700173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'236","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.424746+0000","last_change":"2024-09-14T11:15:32.324361+0000","last_active":"2024-09-14T11:55:24.424746+0000","last_peered":"2024-09-14T11:55:24.424746+0000","last_clean":"2024-09-14T11:55:24.424746+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:55:24.424746+0000","last_undegraded":"2024-09-14T11:55:24.424746+0000","last_fullsized":"2024-09-14T11:55:24.424746+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:30.273764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5200503,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":31904,"num_write":1125,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.869304+0000","last_change":"2024-09-14T11:15:36.333660+0000","last_active":"2024-09-14T11:55:13.869304+0000","last_peered":"2024-09-14T11:55:13.869304+0000","last_clean":"2024-09-14T11:55:13.869304+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:55:13.869304+0000","last_undegraded":"2024-09-14T11:55:13.869304+0000","last_fullsized":"2024-09-14T11:55:13.869304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:23.212696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'293","reported_seq":966,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.787626+0000","last_change":"2024-09-14T11:15:38.335792+0000","last_active":"2024-09-14T11:58:15.787626+0000","last_peered":"2024-09-14T11:58:15.787626+0000","last_clean":"2024-09-14T11:58:15.787626+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:58:15.787626+0000","last_undegraded":"2024-09-14T11:58:15.787626+0000","last_fullsized":"2024-09-14T11:58:15.787626+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:30.822708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48957,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":722,"num_write":488,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.857414+0000","last_change":"2024-09-14T11:15:40.350659+0000","last_active":"2024-09-14T11:54:43.857414+0000","last_peered":"2024-09-14T11:54:43.857414+0000","last_clean":"2024-09-14T11:54:43.857414+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:54:43.857414+0000","last_undegraded":"2024-09-14T11:54:43.857414+0000","last_fullsized":"2024-09-14T11:54:43.857414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:02.205911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'189","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.537414+0000","last_change":"2024-09-14T11:15:42.350534+0000","last_active":"2024-09-14T11:56:57.537414+0000","last_peered":"2024-09-14T11:56:57.537414+0000","last_clean":"2024-09-14T11:56:57.537414+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:56:57.537414+0000","last_undegraded":"2024-09-14T11:56:57.537414+0000","last_fullsized":"2024-09-14T11:56:57.537414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:58.455641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'494","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136421+0000","last_change":"2024-09-14T11:15:34.330808+0000","last_active":"2024-09-14T11:56:39.136421+0000","last_peered":"2024-09-14T11:56:39.136421+0000","last_clean":"2024-09-14T11:56:39.136421+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:56:39.136421+0000","last_undegraded":"2024-09-14T11:56:39.136421+0000","last_fullsized":"2024-09-14T11:56:39.136421+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:23.183357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.871431+0000","last_change":"2024-09-14T11:15:23.927708+0000","last_active":"2024-09-14T11:55:28.871431+0000","last_peered":"2024-09-14T11:55:28.871431+0000","last_clean":"2024-09-14T11:55:28.871431+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:55:28.871431+0000","last_undegraded":"2024-09-14T11:55:28.871431+0000","last_fullsized":"2024-09-14T11:55:28.871431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.482495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'187","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.544588+0000","last_change":"2024-09-14T11:15:32.306329+0000","last_active":"2024-09-14T11:55:59.544588+0000","last_peered":"2024-09-14T11:55:59.544588+0000","last_clean":"2024-09-14T11:55:59.544588+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:55:59.544588+0000","last_undegraded":"2024-09-14T11:55:59.544588+0000","last_fullsized":"2024-09-14T11:55:59.544588+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:59.382027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9103571,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":755,"num_read_kb":134470,"num_write":895,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864617+0000","last_change":"2024-09-14T11:15:36.329488+0000","last_active":"2024-09-14T11:54:38.864617+0000","last_peered":"2024-09-14T11:54:38.864617+0000","last_clean":"2024-09-14T11:54:38.864617+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:54:38.864617+0000","last_undegraded":"2024-09-14T11:54:38.864617+0000","last_fullsized":"2024-09-14T11:54:38.864617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.992710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'841","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842898+0000","last_change":"2024-09-14T11:15:38.335641+0000","last_active":"2024-09-14T11:58:15.842898+0000","last_peered":"2024-09-14T11:58:15.842898+0000","last_clean":"2024-09-14T11:58:15.842898+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:58:15.842898+0000","last_undegraded":"2024-09-14T11:58:15.842898+0000","last_fullsized":"2024-09-14T11:58:15.842898+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:31.939839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1141,"num_read_kb":1308,"num_write":264,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870881+0000","last_change":"2024-09-14T11:15:40.344759+0000","last_active":"2024-09-14T11:55:23.870881+0000","last_peered":"2024-09-14T11:55:23.870881+0000","last_clean":"2024-09-14T11:55:23.870881+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:55:23.870881+0000","last_undegraded":"2024-09-14T11:55:23.870881+0000","last_fullsized":"2024-09-14T11:55:23.870881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.591931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'99","reported_seq":599,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.131967+0000","last_change":"2024-09-14T11:15:42.346979+0000","last_active":"2024-09-14T11:56:39.131967+0000","last_peered":"2024-09-14T11:56:39.131967+0000","last_clean":"2024-09-14T11:56:39.131967+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:56:39.131967+0000","last_undegraded":"2024-09-14T11:56:39.131967+0000","last_fullsized":"2024-09-14T11:56:39.131967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:56.582504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'537","reported_seq":2057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.982239+0000","last_change":"2024-09-14T11:15:34.328947+0000","last_active":"2024-09-14T11:56:56.982239+0000","last_peered":"2024-09-14T11:56:56.982239+0000","last_clean":"2024-09-14T11:56:56.982239+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:56:56.982239+0000","last_undegraded":"2024-09-14T11:56:56.982239+0000","last_fullsized":"2024-09-14T11:56:56.982239+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:22.306344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858408+0000","last_change":"2024-09-14T11:15:23.072067+0000","last_active":"2024-09-14T11:54:58.858408+0000","last_peered":"2024-09-14T11:54:58.858408+0000","last_clean":"2024-09-14T11:54:58.858408+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:54:58.858408+0000","last_undegraded":"2024-09-14T11:54:58.858408+0000","last_fullsized":"2024-09-14T11:54:58.858408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:39.257423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'171","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869519+0000","last_change":"2024-09-14T11:15:32.308521+0000","last_active":"2024-09-14T11:55:40.869519+0000","last_peered":"2024-09-14T11:55:40.869519+0000","last_clean":"2024-09-14T11:55:40.869519+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:55:40.869519+0000","last_undegraded":"2024-09-14T11:55:40.869519+0000","last_fullsized":"2024-09-14T11:55:40.869519+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.589077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11682040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":392,"num_read_kb":27621,"num_write":837,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856296+0000","last_change":"2024-09-14T11:15:36.322255+0000","last_active":"2024-09-14T11:54:38.856296+0000","last_peered":"2024-09-14T11:54:38.856296+0000","last_clean":"2024-09-14T11:54:38.856296+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:54:38.856296+0000","last_undegraded":"2024-09-14T11:54:38.856296+0000","last_fullsized":"2024-09-14T11:54:38.856296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:41.156825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'213","reported_seq":1266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842747+0000","last_change":"2024-09-14T11:15:38.338714+0000","last_active":"2024-09-14T11:58:15.842747+0000","last_peered":"2024-09-14T11:58:15.842747+0000","last_clean":"2024-09-14T11:58:15.842747+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:58:15.842747+0000","last_undegraded":"2024-09-14T11:58:15.842747+0000","last_fullsized":"2024-09-14T11:58:15.842747+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:12.349920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861300+0000","last_change":"2024-09-14T11:15:40.351390+0000","last_active":"2024-09-14T11:55:18.861300+0000","last_peered":"2024-09-14T11:55:18.861300+0000","last_clean":"2024-09-14T11:55:18.861300+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:55:18.861300+0000","last_undegraded":"2024-09-14T11:55:18.861300+0000","last_fullsized":"2024-09-14T11:55:18.861300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.483392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'280","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.803304+0000","last_change":"2024-09-14T11:15:42.351361+0000","last_active":"2024-09-14T11:58:15.803304+0000","last_peered":"2024-09-14T11:58:15.803304+0000","last_clean":"2024-09-14T11:58:15.803304+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:58:15.803304+0000","last_undegraded":"2024-09-14T11:58:15.803304+0000","last_fullsized":"2024-09-14T11:58:15.803304+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'555","reported_seq":2127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.371131+0000","last_change":"2024-09-14T11:15:34.326991+0000","last_active":"2024-09-14T11:56:34.371131+0000","last_peered":"2024-09-14T11:56:34.371131+0000","last_clean":"2024-09-14T11:56:34.371131+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:56:34.371131+0000","last_undegraded":"2024-09-14T11:56:34.371131+0000","last_fullsized":"2024-09-14T11:56:34.371131+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:01.433893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867284+0000","last_change":"2024-09-14T11:15:23.082813+0000","last_active":"2024-09-14T11:54:58.867284+0000","last_peered":"2024-09-14T11:54:58.867284+0000","last_clean":"2024-09-14T11:54:58.867284+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:54:58.867284+0000","last_undegraded":"2024-09-14T11:54:58.867284+0000","last_fullsized":"2024-09-14T11:54:58.867284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:09.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'207","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.421575+0000","last_change":"2024-09-14T11:15:32.304267+0000","last_active":"2024-09-14T11:56:00.421575+0000","last_peered":"2024-09-14T11:56:00.421575+0000","last_clean":"2024-09-14T11:56:00.421575+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:56:00.421575+0000","last_undegraded":"2024-09-14T11:56:00.421575+0000","last_fullsized":"2024-09-14T11:56:00.421575+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:11.058375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7691978,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":485,"num_read_kb":21127,"num_write":1020,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861326+0000","last_change":"2024-09-14T11:15:36.327923+0000","last_active":"2024-09-14T11:55:18.861326+0000","last_peered":"2024-09-14T11:55:18.861326+0000","last_clean":"2024-09-14T11:55:18.861326+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:55:18.861326+0000","last_undegraded":"2024-09-14T11:55:18.861326+0000","last_fullsized":"2024-09-14T11:55:18.861326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:19.678938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'124","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.882670+0000","last_change":"2024-09-14T11:15:38.340290+0000","last_active":"2024-09-14T11:56:48.882670+0000","last_peered":"2024-09-14T11:56:48.882670+0000","last_clean":"2024-09-14T11:56:48.882670+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:56:48.882670+0000","last_undegraded":"2024-09-14T11:56:48.882670+0000","last_fullsized":"2024-09-14T11:56:48.882670+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:51.345233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.946533+0000","last_change":"2024-09-14T11:15:40.343946+0000","last_active":"2024-09-14T11:54:43.946533+0000","last_peered":"2024-09-14T11:54:43.946533+0000","last_clean":"2024-09-14T11:54:43.946533+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:54:43.946533+0000","last_undegraded":"2024-09-14T11:54:43.946533+0000","last_fullsized":"2024-09-14T11:54:43.946533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.497566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'166","reported_seq":727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.995883+0000","last_change":"2024-09-14T11:15:42.351795+0000","last_active":"2024-09-14T11:56:36.995883+0000","last_peered":"2024-09-14T11:56:36.995883+0000","last_clean":"2024-09-14T11:56:36.995883+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:56:36.995883+0000","last_undegraded":"2024-09-14T11:56:36.995883+0000","last_fullsized":"2024-09-14T11:56:36.995883+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:00.523427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'890","reported_seq":2625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531193+0000","last_change":"2024-09-14T11:15:34.330814+0000","last_active":"2024-09-14T11:56:57.531193+0000","last_peered":"2024-09-14T11:56:57.531193+0000","last_clean":"2024-09-14T11:56:57.531193+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:56:57.531193+0000","last_undegraded":"2024-09-14T11:56:57.531193+0000","last_fullsized":"2024-09-14T11:56:57.531193+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:26.576464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'205","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.335228+0000","last_change":"2024-09-14T11:15:32.322181+0000","last_active":"2024-09-14T11:56:29.335228+0000","last_peered":"2024-09-14T11:56:29.335228+0000","last_clean":"2024-09-14T11:56:29.335228+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:56:29.335228+0000","last_undegraded":"2024-09-14T11:56:29.335228+0000","last_fullsized":"2024-09-14T11:56:29.335228+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:25.998267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17058791,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":7241,"num_write":961,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863547+0000","last_change":"2024-09-14T11:15:23.085013+0000","last_active":"2024-09-14T11:54:55.863547+0000","last_peered":"2024-09-14T11:54:55.863547+0000","last_clean":"2024-09-14T11:54:55.863547+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:54:55.863547+0000","last_undegraded":"2024-09-14T11:54:55.863547+0000","last_fullsized":"2024-09-14T11:54:55.863547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:25.505724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.860745+0000","last_change":"2024-09-14T11:15:36.327557+0000","last_active":"2024-09-14T11:55:13.860745+0000","last_peered":"2024-09-14T11:55:13.860745+0000","last_clean":"2024-09-14T11:55:13.860745+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:55:13.860745+0000","last_undegraded":"2024-09-14T11:55:13.860745+0000","last_fullsized":"2024-09-14T11:55:13.860745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:46.694330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'262","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.779630+0000","last_change":"2024-09-14T11:15:38.333171+0000","last_active":"2024-09-14T11:58:15.779630+0000","last_peered":"2024-09-14T11:58:15.779630+0000","last_clean":"2024-09-14T11:58:15.779630+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:58:15.779630+0000","last_undegraded":"2024-09-14T11:58:15.779630+0000","last_fullsized":"2024-09-14T11:58:15.779630+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:45.638370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25607,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":347,"num_read_kb":438,"num_write":196,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.007091+0000","last_change":"2024-09-14T11:15:40.348810+0000","last_active":"2024-09-14T11:55:19.007091+0000","last_peered":"2024-09-14T11:55:19.007091+0000","last_clean":"2024-09-14T11:55:19.007091+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:55:19.007091+0000","last_undegraded":"2024-09-14T11:55:19.007091+0000","last_fullsized":"2024-09-14T11:55:19.007091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:45.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'169","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.464163+0000","last_change":"2024-09-14T11:15:42.354465+0000","last_active":"2024-09-14T11:58:14.464163+0000","last_peered":"2024-09-14T11:58:14.464163+0000","last_clean":"2024-09-14T11:58:14.464163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:58:14.464163+0000","last_undegraded":"2024-09-14T11:58:14.464163+0000","last_fullsized":"2024-09-14T11:58:14.464163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:00.902965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'771","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531136+0000","last_change":"2024-09-14T11:15:34.328838+0000","last_active":"2024-09-14T11:56:57.531136+0000","last_peered":"2024-09-14T11:56:57.531136+0000","last_clean":"2024-09-14T11:56:57.531136+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:56:57.531136+0000","last_undegraded":"2024-09-14T11:56:57.531136+0000","last_fullsized":"2024-09-14T11:56:57.531136+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:06.220137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'258","reported_seq":887,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.768883+0000","last_change":"2024-09-14T11:15:32.309908+0000","last_active":"2024-09-14T11:56:52.768883+0000","last_peered":"2024-09-14T11:56:52.768883+0000","last_clean":"2024-09-14T11:56:52.768883+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:56:52.768883+0000","last_undegraded":"2024-09-14T11:56:52.768883+0000","last_fullsized":"2024-09-14T11:56:52.768883+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:42.117912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14696566,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":40043,"num_write":1038,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867981+0000","last_change":"2024-09-14T11:15:23.927653+0000","last_active":"2024-09-14T11:55:03.867981+0000","last_peered":"2024-09-14T11:55:03.867981+0000","last_clean":"2024-09-14T11:55:03.867981+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:55:03.867981+0000","last_undegraded":"2024-09-14T11:55:03.867981+0000","last_fullsized":"2024-09-14T11:55:03.867981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:15.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"36'4","reported_seq":962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.317972+0000","last_change":"2024-09-14T11:15:36.327972+0000","last_active":"2024-09-14T11:58:15.317972+0000","last_peered":"2024-09-14T11:58:15.317972+0000","last_clean":"2024-09-14T11:58:15.317972+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:58:15.317972+0000","last_undegraded":"2024-09-14T11:58:15.317972+0000","last_fullsized":"2024-09-14T11:58:15.317972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:19.046696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'167","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.919058+0000","last_change":"2024-09-14T11:15:38.327367+0000","last_active":"2024-09-14T11:57:15.919058+0000","last_peered":"2024-09-14T11:57:15.919058+0000","last_clean":"2024-09-14T11:57:15.919058+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:57:15.919058+0000","last_undegraded":"2024-09-14T11:57:15.919058+0000","last_fullsized":"2024-09-14T11:57:15.919058+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:37.848547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'795","reported_seq":4695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842667+0000","last_change":"2024-09-14T11:15:40.337171+0000","last_active":"2024-09-14T11:58:15.842667+0000","last_peered":"2024-09-14T11:58:15.842667+0000","last_clean":"2024-09-14T11:58:15.842667+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:58:15.842667+0000","last_undegraded":"2024-09-14T11:58:15.842667+0000","last_fullsized":"2024-09-14T11:58:15.842667+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.203863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'132","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.805016+0000","last_change":"2024-09-14T11:15:42.349144+0000","last_active":"2024-09-14T11:58:15.805016+0000","last_peered":"2024-09-14T11:58:15.805016+0000","last_clean":"2024-09-14T11:58:15.805016+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:58:15.805016+0000","last_undegraded":"2024-09-14T11:58:15.805016+0000","last_fullsized":"2024-09-14T11:58:15.805016+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:09.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'891","reported_seq":2471,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.891391+0000","last_change":"2024-09-14T11:15:34.334008+0000","last_active":"2024-09-14T11:57:43.891391+0000","last_peered":"2024-09-14T11:57:43.891391+0000","last_clean":"2024-09-14T11:57:43.891391+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:57:43.891391+0000","last_undegraded":"2024-09-14T11:57:43.891391+0000","last_fullsized":"2024-09-14T11:57:43.891391+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.699506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'239","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.255976+0000","last_change":"2024-09-14T11:15:32.315658+0000","last_active":"2024-09-14T11:55:19.255976+0000","last_peered":"2024-09-14T11:55:19.255976+0000","last_clean":"2024-09-14T11:55:19.255976+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:55:19.255976+0000","last_undegraded":"2024-09-14T11:55:19.255976+0000","last_fullsized":"2024-09-14T11:55:19.255976+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:05.378692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7981226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":686,"num_read_kb":25317,"num_write":1127,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.875825+0000","last_change":"2024-09-14T11:15:23.084925+0000","last_active":"2024-09-14T11:56:30.875825+0000","last_peered":"2024-09-14T11:56:30.875825+0000","last_clean":"2024-09-14T11:56:30.875825+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:56:30.875825+0000","last_undegraded":"2024-09-14T11:56:30.875825+0000","last_fullsized":"2024-09-14T11:56:30.875825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.357227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:14.006501+0000","last_change":"2024-09-14T11:15:36.331117+0000","last_active":"2024-09-14T11:55:14.006501+0000","last_peered":"2024-09-14T11:55:14.006501+0000","last_clean":"2024-09-14T11:55:14.006501+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:55:14.006501+0000","last_undegraded":"2024-09-14T11:55:14.006501+0000","last_fullsized":"2024-09-14T11:55:14.006501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:51.839727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'111","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.942678+0000","last_change":"2024-09-14T11:15:38.337313+0000","last_active":"2024-09-14T11:56:30.942678+0000","last_peered":"2024-09-14T11:56:30.942678+0000","last_clean":"2024-09-14T11:56:30.942678+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:56:30.942678+0000","last_undegraded":"2024-09-14T11:56:30.942678+0000","last_fullsized":"2024-09-14T11:56:30.942678+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:15.549271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'809","reported_seq":2427,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842929+0000","last_change":"2024-09-14T11:15:40.353831+0000","last_active":"2024-09-14T11:58:15.842929+0000","last_peered":"2024-09-14T11:58:15.842929+0000","last_clean":"2024-09-14T11:58:15.842929+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:58:15.842929+0000","last_undegraded":"2024-09-14T11:58:15.842929+0000","last_fullsized":"2024-09-14T11:58:15.842929+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:41.935731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'282","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.867897+0000","last_change":"2024-09-14T11:15:42.349524+0000","last_active":"2024-09-14T11:56:13.867897+0000","last_peered":"2024-09-14T11:56:13.867897+0000","last_clean":"2024-09-14T11:56:13.867897+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:56:13.867897+0000","last_undegraded":"2024-09-14T11:56:13.867897+0000","last_fullsized":"2024-09-14T11:56:13.867897+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:39.795329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'401","reported_seq":1934,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882633+0000","last_change":"2024-09-14T11:15:34.326976+0000","last_active":"2024-09-14T11:56:54.882633+0000","last_peered":"2024-09-14T11:56:54.882633+0000","last_clean":"2024-09-14T11:56:54.882633+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:56:54.882633+0000","last_undegraded":"2024-09-14T11:56:54.882633+0000","last_fullsized":"2024-09-14T11:56:54.882633+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:16.837130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'210","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.422593+0000","last_change":"2024-09-14T11:15:32.314679+0000","last_active":"2024-09-14T11:55:24.422593+0000","last_peered":"2024-09-14T11:55:24.422593+0000","last_clean":"2024-09-14T11:55:24.422593+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:55:24.422593+0000","last_undegraded":"2024-09-14T11:55:24.422593+0000","last_fullsized":"2024-09-14T11:55:24.422593+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:39.815598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4535993,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":11357,"num_write":1010,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.960844+0000","last_change":"2024-09-14T11:15:23.927661+0000","last_active":"2024-09-14T11:56:33.960844+0000","last_peered":"2024-09-14T11:56:33.960844+0000","last_clean":"2024-09-14T11:56:33.960844+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:56:33.960844+0000","last_undegraded":"2024-09-14T11:56:33.960844+0000","last_fullsized":"2024-09-14T11:56:33.960844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:47.701947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875423+0000","last_change":"2024-09-14T11:15:36.331051+0000","last_active":"2024-09-14T11:55:48.875423+0000","last_peered":"2024-09-14T11:55:48.875423+0000","last_clean":"2024-09-14T11:55:48.875423+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:55:48.875423+0000","last_undegraded":"2024-09-14T11:55:48.875423+0000","last_fullsized":"2024-09-14T11:55:48.875423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:18.610941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'295","reported_seq":988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.776029+0000","last_change":"2024-09-14T11:15:38.337405+0000","last_active":"2024-09-14T11:58:15.776029+0000","last_peered":"2024-09-14T11:58:15.776029+0000","last_clean":"2024-09-14T11:58:15.776029+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:58:15.776029+0000","last_undegraded":"2024-09-14T11:58:15.776029+0000","last_fullsized":"2024-09-14T11:58:15.776029+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:37.729796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37514,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":628,"num_write":218,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870986+0000","last_change":"2024-09-14T11:15:40.349294+0000","last_active":"2024-09-14T11:55:18.870986+0000","last_peered":"2024-09-14T11:55:18.870986+0000","last_clean":"2024-09-14T11:55:18.870986+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:55:18.870986+0000","last_undegraded":"2024-09-14T11:55:18.870986+0000","last_fullsized":"2024-09-14T11:55:18.870986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:06.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'134","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.668467+0000","last_change":"2024-09-14T11:15:42.351815+0000","last_active":"2024-09-14T11:56:19.668467+0000","last_peered":"2024-09-14T11:56:19.668467+0000","last_clean":"2024-09-14T11:56:19.668467+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:56:19.668467+0000","last_undegraded":"2024-09-14T11:56:19.668467+0000","last_fullsized":"2024-09-14T11:56:19.668467+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:31.950118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'146","reported_seq":688,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.639329+0000","last_change":"2024-09-14T11:15:42.348937+0000","last_active":"2024-09-14T11:56:57.639329+0000","last_peered":"2024-09-14T11:56:57.639329+0000","last_clean":"2024-09-14T11:56:57.639329+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:56:57.639329+0000","last_undegraded":"2024-09-14T11:56:57.639329+0000","last_fullsized":"2024-09-14T11:56:57.639329+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'563","reported_seq":2425,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.458556+0000","last_change":"2024-09-14T11:15:34.319146+0000","last_active":"2024-09-14T11:58:14.458556+0000","last_peered":"2024-09-14T11:58:14.458556+0000","last_clean":"2024-09-14T11:58:14.458556+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:58:14.458556+0000","last_undegraded":"2024-09-14T11:58:14.458556+0000","last_fullsized":"2024-09-14T11:58:14.458556+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:44.411480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'198","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.821360+0000","last_change":"2024-09-14T11:15:32.313281+0000","last_active":"2024-09-14T11:56:54.821360+0000","last_peered":"2024-09-14T11:56:54.821360+0000","last_clean":"2024-09-14T11:56:54.821360+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:56:54.821360+0000","last_undegraded":"2024-09-14T11:56:54.821360+0000","last_fullsized":"2024-09-14T11:56:54.821360+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:47.748935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352987,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":19870,"num_write":900,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866061+0000","last_change":"2024-09-14T11:15:36.335097+0000","last_active":"2024-09-14T11:55:15.866061+0000","last_peered":"2024-09-14T11:55:15.866061+0000","last_clean":"2024-09-14T11:55:15.866061+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:55:15.866061+0000","last_undegraded":"2024-09-14T11:55:15.866061+0000","last_fullsized":"2024-09-14T11:55:15.866061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:16.648545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'153","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890794+0000","last_change":"2024-09-14T11:15:38.334700+0000","last_active":"2024-09-14T11:57:38.890794+0000","last_peered":"2024-09-14T11:57:38.890794+0000","last_clean":"2024-09-14T11:57:38.890794+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:57:38.890794+0000","last_undegraded":"2024-09-14T11:57:38.890794+0000","last_fullsized":"2024-09-14T11:57:38.890794+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:17.379507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11421,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":185,"num_read_kb":246,"num_write":110,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.871577+0000","last_change":"2024-09-14T11:15:40.349844+0000","last_active":"2024-09-14T11:55:23.871577+0000","last_peered":"2024-09-14T11:55:23.871577+0000","last_clean":"2024-09-14T11:55:23.871577+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:55:23.871577+0000","last_undegraded":"2024-09-14T11:55:23.871577+0000","last_fullsized":"2024-09-14T11:55:23.871577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:12.340019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.002060+0000","last_change":"2024-09-14T11:15:42.351873+0000","last_active":"2024-09-14T11:56:57.002060+0000","last_peered":"2024-09-14T11:56:57.002060+0000","last_clean":"2024-09-14T11:56:57.002060+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:56:57.002060+0000","last_undegraded":"2024-09-14T11:56:57.002060+0000","last_fullsized":"2024-09-14T11:56:57.002060+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.030349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1370","reported_seq":3005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.687050+0000","last_change":"2024-09-14T11:15:34.330128+0000","last_active":"2024-09-14T11:56:35.687050+0000","last_peered":"2024-09-14T11:56:35.687050+0000","last_clean":"2024-09-14T11:56:35.687050+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:56:35.687050+0000","last_undegraded":"2024-09-14T11:56:35.687050+0000","last_fullsized":"2024-09-14T11:56:35.687050+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.528231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'161","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.340997+0000","last_change":"2024-09-14T11:15:32.321575+0000","last_active":"2024-09-14T11:56:00.340997+0000","last_peered":"2024-09-14T11:56:00.340997+0000","last_clean":"2024-09-14T11:56:00.340997+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:56:00.340997+0000","last_undegraded":"2024-09-14T11:56:00.340997+0000","last_fullsized":"2024-09-14T11:56:00.340997+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:37.366540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21298259,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":349,"num_read_kb":34031,"num_write":730,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.871010+0000","last_change":"2024-09-14T11:15:36.330880+0000","last_active":"2024-09-14T11:55:18.871010+0000","last_peered":"2024-09-14T11:55:18.871010+0000","last_clean":"2024-09-14T11:55:18.871010+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:55:18.871010+0000","last_undegraded":"2024-09-14T11:55:18.871010+0000","last_fullsized":"2024-09-14T11:55:18.871010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:31.962906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'43","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.223600+0000","last_change":"2024-09-14T11:15:38.332435+0000","last_active":"2024-09-14T11:56:30.223600+0000","last_peered":"2024-09-14T11:56:30.223600+0000","last_clean":"2024-09-14T11:56:30.223600+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:56:30.223600+0000","last_undegraded":"2024-09-14T11:56:30.223600+0000","last_fullsized":"2024-09-14T11:56:30.223600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:58.253268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870821+0000","last_change":"2024-09-14T11:15:40.344174+0000","last_active":"2024-09-14T11:55:23.870821+0000","last_peered":"2024-09-14T11:55:23.870821+0000","last_clean":"2024-09-14T11:55:23.870821+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:55:23.870821+0000","last_undegraded":"2024-09-14T11:55:23.870821+0000","last_fullsized":"2024-09-14T11:55:23.870821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:53.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'215","reported_seq":729,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.995205+0000","last_change":"2024-09-14T11:15:42.348738+0000","last_active":"2024-09-14T11:56:56.995205+0000","last_peered":"2024-09-14T11:56:56.995205+0000","last_clean":"2024-09-14T11:56:56.995205+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:56:56.995205+0000","last_undegraded":"2024-09-14T11:56:56.995205+0000","last_fullsized":"2024-09-14T11:56:56.995205+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:07.647856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'455","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.674512+0000","last_change":"2024-09-14T11:15:34.322075+0000","last_active":"2024-09-14T11:56:19.674512+0000","last_peered":"2024-09-14T11:56:19.674512+0000","last_clean":"2024-09-14T11:56:19.674512+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:56:19.674512+0000","last_undegraded":"2024-09-14T11:56:19.674512+0000","last_fullsized":"2024-09-14T11:56:19.674512+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:01.128060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'345","reported_seq":989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.613050+0000","last_change":"2024-09-14T11:16:07.497232+0000","last_active":"2024-09-14T11:56:32.613050+0000","last_peered":"2024-09-14T11:56:32.613050+0000","last_clean":"2024-09-14T11:56:32.613050+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:56:32.613050+0000","last_undegraded":"2024-09-14T11:56:32.613050+0000","last_fullsized":"2024-09-14T11:56:32.613050+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:57.221580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8346231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":976,"num_read_kb":18899,"num_write":1297,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870031+0000","last_change":"2024-09-14T11:15:36.339369+0000","last_active":"2024-09-14T11:55:18.870031+0000","last_peered":"2024-09-14T11:55:18.870031+0000","last_clean":"2024-09-14T11:55:18.870031+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:55:18.870031+0000","last_undegraded":"2024-09-14T11:55:18.870031+0000","last_fullsized":"2024-09-14T11:55:18.870031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:43.628492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'155","reported_seq":734,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890822+0000","last_change":"2024-09-14T11:15:38.334637+0000","last_active":"2024-09-14T11:57:38.890822+0000","last_peered":"2024-09-14T11:57:38.890822+0000","last_clean":"2024-09-14T11:57:38.890822+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:57:38.890822+0000","last_undegraded":"2024-09-14T11:57:38.890822+0000","last_fullsized":"2024-09-14T11:57:38.890822+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:56.809543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9202,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":247,"num_write":110,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951144+0000","last_change":"2024-09-14T11:15:40.343098+0000","last_active":"2024-09-14T11:55:23.951144+0000","last_peered":"2024-09-14T11:55:23.951144+0000","last_clean":"2024-09-14T11:55:23.951144+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:55:23.951144+0000","last_undegraded":"2024-09-14T11:55:23.951144+0000","last_fullsized":"2024-09-14T11:55:23.951144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.732839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'115","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.989039+0000","last_change":"2024-09-14T11:15:42.348868+0000","last_active":"2024-09-14T11:56:56.989039+0000","last_peered":"2024-09-14T11:56:56.989039+0000","last_clean":"2024-09-14T11:56:56.989039+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:56:56.989039+0000","last_undegraded":"2024-09-14T11:56:56.989039+0000","last_fullsized":"2024-09-14T11:56:56.989039+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.040910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'810","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.890119+0000","last_change":"2024-09-14T11:15:34.332878+0000","last_active":"2024-09-14T11:57:33.890119+0000","last_peered":"2024-09-14T11:57:33.890119+0000","last_clean":"2024-09-14T11:57:33.890119+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:57:33.890119+0000","last_undegraded":"2024-09-14T11:57:33.890119+0000","last_fullsized":"2024-09-14T11:57:33.890119+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:47.822581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'259","reported_seq":864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:21.550580+0000","last_change":"2024-09-14T11:15:32.313576+0000","last_active":"2024-09-14T11:55:21.550580+0000","last_peered":"2024-09-14T11:55:21.550580+0000","last_clean":"2024-09-14T11:55:21.550580+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:55:21.550580+0000","last_undegraded":"2024-09-14T11:55:21.550580+0000","last_fullsized":"2024-09-14T11:55:21.550580+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:01.256758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924463,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":14443,"num_write":1154,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.950374+0000","last_change":"2024-09-14T11:15:36.330819+0000","last_active":"2024-09-14T11:55:18.950374+0000","last_peered":"2024-09-14T11:55:18.950374+0000","last_clean":"2024-09-14T11:55:18.950374+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:55:18.950374+0000","last_undegraded":"2024-09-14T11:55:18.950374+0000","last_fullsized":"2024-09-14T11:55:18.950374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:42.392337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'132","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890163+0000","last_change":"2024-09-14T11:15:38.338705+0000","last_active":"2024-09-14T11:57:38.890163+0000","last_peered":"2024-09-14T11:57:38.890163+0000","last_clean":"2024-09-14T11:57:38.890163+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:57:38.890163+0000","last_undegraded":"2024-09-14T11:57:38.890163+0000","last_fullsized":"2024-09-14T11:57:38.890163+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:13.916538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":330,"num_write":102,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861871+0000","last_change":"2024-09-14T11:15:40.351822+0000","last_active":"2024-09-14T11:55:23.861871+0000","last_peered":"2024-09-14T11:55:23.861871+0000","last_clean":"2024-09-14T11:55:23.861871+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:55:23.861871+0000","last_undegraded":"2024-09-14T11:55:23.861871+0000","last_fullsized":"2024-09-14T11:55:23.861871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'849","reported_seq":2468,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.966335+0000","last_change":"2024-09-14T11:15:34.327038+0000","last_active":"2024-09-14T11:57:13.966335+0000","last_peered":"2024-09-14T11:57:13.966335+0000","last_clean":"2024-09-14T11:57:13.966335+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:57:13.966335+0000","last_undegraded":"2024-09-14T11:57:13.966335+0000","last_fullsized":"2024-09-14T11:57:13.966335+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:27.678371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'190","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.588372+0000","last_change":"2024-09-14T11:15:32.318761+0000","last_active":"2024-09-14T11:56:00.588372+0000","last_peered":"2024-09-14T11:56:00.588372+0000","last_clean":"2024-09-14T11:56:00.588372+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:56:00.588372+0000","last_undegraded":"2024-09-14T11:56:00.588372+0000","last_fullsized":"2024-09-14T11:56:00.588372+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:06.906697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10691710,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":38160,"num_write":901,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864502+0000","last_change":"2024-09-14T11:15:36.334440+0000","last_active":"2024-09-14T11:55:43.864502+0000","last_peered":"2024-09-14T11:55:43.864502+0000","last_clean":"2024-09-14T11:55:43.864502+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:55:43.864502+0000","last_undegraded":"2024-09-14T11:55:43.864502+0000","last_fullsized":"2024-09-14T11:55:43.864502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:33.779211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'191","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.772385+0000","last_change":"2024-09-14T11:15:38.334848+0000","last_active":"2024-09-14T11:58:15.772385+0000","last_peered":"2024-09-14T11:58:15.772385+0000","last_clean":"2024-09-14T11:58:15.772385+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:58:15.772385+0000","last_undegraded":"2024-09-14T11:58:15.772385+0000","last_fullsized":"2024-09-14T11:58:15.772385+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25104,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":274,"num_read_kb":349,"num_write":172,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.873860+0000","last_change":"2024-09-14T11:15:40.348746+0000","last_active":"2024-09-14T11:55:43.873860+0000","last_peered":"2024-09-14T11:55:43.873860+0000","last_clean":"2024-09-14T11:55:43.873860+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:55:43.873860+0000","last_undegraded":"2024-09-14T11:55:43.873860+0000","last_fullsized":"2024-09-14T11:55:43.873860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:48.113026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'159","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.879691+0000","last_change":"2024-09-14T11:15:42.352372+0000","last_active":"2024-09-14T11:55:59.879691+0000","last_peered":"2024-09-14T11:55:59.879691+0000","last_clean":"2024-09-14T11:55:59.879691+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:55:59.879691+0000","last_undegraded":"2024-09-14T11:55:59.879691+0000","last_fullsized":"2024-09-14T11:55:59.879691+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:49.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":1996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530068+0000","last_change":"2024-09-14T11:15:34.318828+0000","last_active":"2024-09-14T11:56:57.530068+0000","last_peered":"2024-09-14T11:56:57.530068+0000","last_clean":"2024-09-14T11:56:57.530068+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:56:57.530068+0000","last_undegraded":"2024-09-14T11:56:57.530068+0000","last_fullsized":"2024-09-14T11:56:57.530068+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:26.298183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'217","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.230535+0000","last_change":"2024-09-14T11:15:32.312194+0000","last_active":"2024-09-14T11:55:55.230535+0000","last_peered":"2024-09-14T11:55:55.230535+0000","last_clean":"2024-09-14T11:55:55.230535+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:55:55.230535+0000","last_undegraded":"2024-09-14T11:55:55.230535+0000","last_fullsized":"2024-09-14T11:55:55.230535+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.459882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423889,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":11796,"num_write":1006,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.949977+0000","last_change":"2024-09-14T11:15:36.330927+0000","last_active":"2024-09-14T11:55:13.949977+0000","last_peered":"2024-09-14T11:55:13.949977+0000","last_clean":"2024-09-14T11:55:13.949977+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:55:13.949977+0000","last_undegraded":"2024-09-14T11:55:13.949977+0000","last_fullsized":"2024-09-14T11:55:13.949977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:56.526006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'153","reported_seq":720,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.894696+0000","last_change":"2024-09-14T11:15:38.341444+0000","last_active":"2024-09-14T11:58:08.894696+0000","last_peered":"2024-09-14T11:58:08.894696+0000","last_clean":"2024-09-14T11:58:08.894696+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:58:08.894696+0000","last_undegraded":"2024-09-14T11:58:08.894696+0000","last_fullsized":"2024-09-14T11:58:08.894696+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:11.384017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10257,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":257,"num_write":128,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869587+0000","last_change":"2024-09-14T11:15:40.346858+0000","last_active":"2024-09-14T11:55:40.869587+0000","last_peered":"2024-09-14T11:55:40.869587+0000","last_clean":"2024-09-14T11:55:40.869587+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:55:40.869587+0000","last_undegraded":"2024-09-14T11:55:40.869587+0000","last_fullsized":"2024-09-14T11:55:40.869587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:12.423799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'255","reported_seq":1118,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.480297+0000","last_change":"2024-09-14T11:15:42.347978+0000","last_active":"2024-09-14T11:56:55.480297+0000","last_peered":"2024-09-14T11:56:55.480297+0000","last_clean":"2024-09-14T11:56:55.480297+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:56:55.480297+0000","last_undegraded":"2024-09-14T11:56:55.480297+0000","last_fullsized":"2024-09-14T11:56:55.480297+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:59.600834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'851","reported_seq":2419,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518009+0000","last_change":"2024-09-14T11:15:34.327867+0000","last_active":"2024-09-14T11:56:33.518009+0000","last_peered":"2024-09-14T11:56:33.518009+0000","last_clean":"2024-09-14T11:56:33.518009+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:56:33.518009+0000","last_undegraded":"2024-09-14T11:56:33.518009+0000","last_fullsized":"2024-09-14T11:56:33.518009+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:01.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'194","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.009084+0000","last_change":"2024-09-14T11:15:32.312185+0000","last_active":"2024-09-14T11:55:34.009084+0000","last_peered":"2024-09-14T11:55:34.009084+0000","last_clean":"2024-09-14T11:55:34.009084+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:55:34.009084+0000","last_undegraded":"2024-09-14T11:55:34.009084+0000","last_fullsized":"2024-09-14T11:55:34.009084+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:40.741870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.009957+0000","last_change":"2024-09-14T11:15:36.330057+0000","last_active":"2024-09-14T11:55:39.009957+0000","last_peered":"2024-09-14T11:55:39.009957+0000","last_clean":"2024-09-14T11:55:39.009957+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:55:39.009957+0000","last_undegraded":"2024-09-14T11:55:39.009957+0000","last_fullsized":"2024-09-14T11:55:39.009957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.691223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'127","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.886603+0000","last_change":"2024-09-14T11:15:38.336865+0000","last_active":"2024-09-14T11:57:18.886603+0000","last_peered":"2024-09-14T11:57:18.886603+0000","last_clean":"2024-09-14T11:57:18.886603+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:57:18.886603+0000","last_undegraded":"2024-09-14T11:57:18.886603+0000","last_fullsized":"2024-09-14T11:57:18.886603+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:20.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10212,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":241,"num_write":96,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870237+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:55:45.870237+0000","last_peered":"2024-09-14T11:55:45.870237+0000","last_clean":"2024-09-14T11:55:45.870237+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:55:45.870237+0000","last_undegraded":"2024-09-14T11:55:45.870237+0000","last_fullsized":"2024-09-14T11:55:45.870237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.612855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'145","reported_seq":635,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801285+0000","last_change":"2024-09-14T11:15:42.348516+0000","last_active":"2024-09-14T11:58:15.801285+0000","last_peered":"2024-09-14T11:58:15.801285+0000","last_clean":"2024-09-14T11:58:15.801285+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:58:15.801285+0000","last_undegraded":"2024-09-14T11:58:15.801285+0000","last_fullsized":"2024-09-14T11:58:15.801285+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:57.841456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'425","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.459589+0000","last_change":"2024-09-14T11:16:07.518584+0000","last_active":"2024-09-14T11:58:14.459589+0000","last_peered":"2024-09-14T11:58:14.459589+0000","last_clean":"2024-09-14T11:58:14.459589+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:14.459589+0000","last_undegraded":"2024-09-14T11:58:14.459589+0000","last_fullsized":"2024-09-14T11:58:14.459589+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:45.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'214","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.307617+0000","last_change":"2024-09-14T11:15:32.310716+0000","last_active":"2024-09-14T11:56:21.307617+0000","last_peered":"2024-09-14T11:56:21.307617+0000","last_clean":"2024-09-14T11:56:21.307617+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:56:21.307617+0000","last_undegraded":"2024-09-14T11:56:21.307617+0000","last_fullsized":"2024-09-14T11:56:21.307617+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:42.627407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5299376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":514,"num_read_kb":12620,"num_write":950,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:35.868896+0000","last_change":"2024-09-14T11:15:36.330575+0000","last_active":"2024-09-14T11:55:35.868896+0000","last_peered":"2024-09-14T11:55:35.868896+0000","last_clean":"2024-09-14T11:55:35.868896+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:55:35.868896+0000","last_undegraded":"2024-09-14T11:55:35.868896+0000","last_fullsized":"2024-09-14T11:55:35.868896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:23.577919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'99","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.374104+0000","last_change":"2024-09-14T11:15:38.335710+0000","last_active":"2024-09-14T11:56:21.374104+0000","last_peered":"2024-09-14T11:56:21.374104+0000","last_clean":"2024-09-14T11:56:21.374104+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:56:21.374104+0000","last_undegraded":"2024-09-14T11:56:21.374104+0000","last_fullsized":"2024-09-14T11:56:21.374104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:16.942605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'766","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842678+0000","last_change":"2024-09-14T11:15:40.347027+0000","last_active":"2024-09-14T11:58:15.842678+0000","last_peered":"2024-09-14T11:58:15.842678+0000","last_clean":"2024-09-14T11:58:15.842678+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:58:15.842678+0000","last_undegraded":"2024-09-14T11:58:15.842678+0000","last_fullsized":"2024-09-14T11:58:15.842678+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.157408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":604,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.934707+0000","last_change":"2024-09-14T11:15:42.350291+0000","last_active":"2024-09-14T11:56:30.934707+0000","last_peered":"2024-09-14T11:56:30.934707+0000","last_clean":"2024-09-14T11:56:30.934707+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:56:30.934707+0000","last_undegraded":"2024-09-14T11:56:30.934707+0000","last_fullsized":"2024-09-14T11:56:30.934707+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.774415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'894","reported_seq":2466,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.677671+0000","last_change":"2024-09-14T11:15:34.322958+0000","last_active":"2024-09-14T11:56:32.677671+0000","last_peered":"2024-09-14T11:56:32.677671+0000","last_clean":"2024-09-14T11:56:32.677671+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:56:32.677671+0000","last_undegraded":"2024-09-14T11:56:32.677671+0000","last_fullsized":"2024-09-14T11:56:32.677671+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'208","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:06.727058+0000","last_change":"2024-09-14T11:15:32.310372+0000","last_active":"2024-09-14T11:56:06.727058+0000","last_peered":"2024-09-14T11:56:06.727058+0000","last_clean":"2024-09-14T11:56:06.727058+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:56:06.727058+0000","last_undegraded":"2024-09-14T11:56:06.727058+0000","last_fullsized":"2024-09-14T11:56:06.727058+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:20.309040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7368312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":924,"num_read_kb":28634,"num_write":965,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872979+0000","last_change":"2024-09-14T11:15:36.334783+0000","last_active":"2024-09-14T11:55:38.872979+0000","last_peered":"2024-09-14T11:55:38.872979+0000","last_clean":"2024-09-14T11:55:38.872979+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:55:38.872979+0000","last_undegraded":"2024-09-14T11:55:38.872979+0000","last_fullsized":"2024-09-14T11:55:38.872979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:31.368261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'152","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.884022+0000","last_change":"2024-09-14T11:15:38.333129+0000","last_active":"2024-09-14T11:56:53.884022+0000","last_peered":"2024-09-14T11:56:53.884022+0000","last_clean":"2024-09-14T11:56:53.884022+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:56:53.884022+0000","last_undegraded":"2024-09-14T11:56:53.884022+0000","last_fullsized":"2024-09-14T11:56:53.884022+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:23.609841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13591,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":260,"num_write":110,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.854707+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:54:23.854707+0000","last_peered":"2024-09-14T11:54:23.854707+0000","last_clean":"2024-09-14T11:54:23.854707+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:54:23.854707+0000","last_undegraded":"2024-09-14T11:54:23.854707+0000","last_fullsized":"2024-09-14T11:54:23.854707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:23.255804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'105","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513654+0000","last_change":"2024-09-14T11:15:42.354717+0000","last_active":"2024-09-14T11:56:33.513654+0000","last_peered":"2024-09-14T11:56:33.513654+0000","last_clean":"2024-09-14T11:56:33.513654+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:56:33.513654+0000","last_undegraded":"2024-09-14T11:56:33.513654+0000","last_fullsized":"2024-09-14T11:56:33.513654+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:10.490861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'654","reported_seq":2517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456955+0000","last_change":"2024-09-14T11:15:34.319956+0000","last_active":"2024-09-14T11:58:14.456955+0000","last_peered":"2024-09-14T11:58:14.456955+0000","last_clean":"2024-09-14T11:58:14.456955+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:58:14.456955+0000","last_undegraded":"2024-09-14T11:58:14.456955+0000","last_fullsized":"2024-09-14T11:58:14.456955+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:38.765206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'192","reported_seq":798,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.683000+0000","last_change":"2024-09-14T11:15:32.311339+0000","last_active":"2024-09-14T11:56:37.683000+0000","last_peered":"2024-09-14T11:56:37.683000+0000","last_clean":"2024-09-14T11:56:37.683000+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:56:37.683000+0000","last_undegraded":"2024-09-14T11:56:37.683000+0000","last_fullsized":"2024-09-14T11:56:37.683000+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:40.088024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8864078,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":24057,"num_write":873,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872982+0000","last_change":"2024-09-14T11:15:36.323716+0000","last_active":"2024-09-14T11:55:38.872982+0000","last_peered":"2024-09-14T11:55:38.872982+0000","last_clean":"2024-09-14T11:55:38.872982+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:55:38.872982+0000","last_undegraded":"2024-09-14T11:55:38.872982+0000","last_fullsized":"2024-09-14T11:55:38.872982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:05.232742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'142","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.871358+0000","last_change":"2024-09-14T11:15:38.333174+0000","last_active":"2024-09-14T11:56:43.871358+0000","last_peered":"2024-09-14T11:56:43.871358+0000","last_clean":"2024-09-14T11:56:43.871358+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:56:43.871358+0000","last_undegraded":"2024-09-14T11:56:43.871358+0000","last_fullsized":"2024-09-14T11:56:43.871358+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:29.536985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":240,"num_write":96,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944488+0000","last_change":"2024-09-14T11:15:40.344604+0000","last_active":"2024-09-14T11:54:28.944488+0000","last_peered":"2024-09-14T11:54:28.944488+0000","last_clean":"2024-09-14T11:54:28.944488+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:54:28.944488+0000","last_undegraded":"2024-09-14T11:54:28.944488+0000","last_fullsized":"2024-09-14T11:54:28.944488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:07.536782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'141","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.134030+0000","last_change":"2024-09-14T11:15:42.348390+0000","last_active":"2024-09-14T11:56:39.134030+0000","last_peered":"2024-09-14T11:56:39.134030+0000","last_clean":"2024-09-14T11:56:39.134030+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:56:39.134030+0000","last_undegraded":"2024-09-14T11:56:39.134030+0000","last_fullsized":"2024-09-14T11:56:39.134030+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:35.472396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'745","reported_seq":2355,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.981012+0000","last_change":"2024-09-14T11:15:34.323276+0000","last_active":"2024-09-14T11:56:56.981012+0000","last_peered":"2024-09-14T11:56:56.981012+0000","last_clean":"2024-09-14T11:56:56.981012+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:56:56.981012+0000","last_undegraded":"2024-09-14T11:56:56.981012+0000","last_fullsized":"2024-09-14T11:56:56.981012+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:11.314085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'236","reported_seq":987,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874920+0000","last_change":"2024-09-14T11:15:32.314412+0000","last_active":"2024-09-14T11:55:43.874920+0000","last_peered":"2024-09-14T11:55:43.874920+0000","last_clean":"2024-09-14T11:55:43.874920+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:55:43.874920+0000","last_undegraded":"2024-09-14T11:55:43.874920+0000","last_fullsized":"2024-09-14T11:55:43.874920+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:54.314072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7372429,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":845,"num_read_kb":149417,"num_write":1042,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999537+0000","last_change":"2024-09-14T11:15:36.334370+0000","last_active":"2024-09-14T11:54:18.999537+0000","last_peered":"2024-09-14T11:54:18.999537+0000","last_clean":"2024-09-14T11:54:18.999537+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:54:18.999537+0000","last_undegraded":"2024-09-14T11:54:18.999537+0000","last_fullsized":"2024-09-14T11:54:18.999537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:16.183616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'94","reported_seq":641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.894830+0000","last_change":"2024-09-14T11:15:38.339773+0000","last_active":"2024-09-14T11:58:08.894830+0000","last_peered":"2024-09-14T11:58:08.894830+0000","last_clean":"2024-09-14T11:58:08.894830+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:58:08.894830+0000","last_undegraded":"2024-09-14T11:58:08.894830+0000","last_fullsized":"2024-09-14T11:58:08.894830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.547669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":164,"num_write":52,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.010579+0000","last_change":"2024-09-14T11:15:40.345970+0000","last_active":"2024-09-14T11:55:44.010579+0000","last_peered":"2024-09-14T11:55:44.010579+0000","last_clean":"2024-09-14T11:55:44.010579+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:55:44.010579+0000","last_undegraded":"2024-09-14T11:55:44.010579+0000","last_fullsized":"2024-09-14T11:55:44.010579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.446853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'154","reported_seq":1252,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.149214+0000","last_change":"2024-09-14T11:15:42.354185+0000","last_active":"2024-09-14T11:56:55.149214+0000","last_peered":"2024-09-14T11:56:55.149214+0000","last_clean":"2024-09-14T11:56:55.149214+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:56:55.149214+0000","last_undegraded":"2024-09-14T11:56:55.149214+0000","last_fullsized":"2024-09-14T11:56:55.149214+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:00.385532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'446","reported_seq":1936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.748803+0000","last_change":"2024-09-14T11:15:34.320209+0000","last_active":"2024-09-14T11:56:37.748803+0000","last_peered":"2024-09-14T11:56:37.748803+0000","last_clean":"2024-09-14T11:56:37.748803+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:56:37.748803+0000","last_undegraded":"2024-09-14T11:56:37.748803+0000","last_fullsized":"2024-09-14T11:56:37.748803+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:44.754267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'202","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.455627+0000","last_change":"2024-09-14T11:15:32.314784+0000","last_active":"2024-09-14T11:56:13.455627+0000","last_peered":"2024-09-14T11:56:13.455627+0000","last_clean":"2024-09-14T11:56:13.455627+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:56:13.455627+0000","last_undegraded":"2024-09-14T11:56:13.455627+0000","last_fullsized":"2024-09-14T11:56:13.455627+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.987083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079014,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":525,"num_read_kb":36694,"num_write":983,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.858535+0000","last_change":"2024-09-14T11:15:36.334335+0000","last_active":"2024-09-14T11:54:20.858535+0000","last_peered":"2024-09-14T11:54:20.858535+0000","last_clean":"2024-09-14T11:54:20.858535+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:54:20.858535+0000","last_undegraded":"2024-09-14T11:54:20.858535+0000","last_fullsized":"2024-09-14T11:54:20.858535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:15.469593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'144","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.031982+0000","last_change":"2024-09-14T11:15:38.340747+0000","last_active":"2024-09-14T11:58:09.031982+0000","last_peered":"2024-09-14T11:58:09.031982+0000","last_clean":"2024-09-14T11:58:09.031982+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:58:09.031982+0000","last_undegraded":"2024-09-14T11:58:09.031982+0000","last_fullsized":"2024-09-14T11:58:09.031982+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:13.972291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":256,"num_write":112,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864425+0000","last_change":"2024-09-14T11:15:40.351076+0000","last_active":"2024-09-14T11:55:43.864425+0000","last_peered":"2024-09-14T11:55:43.864425+0000","last_clean":"2024-09-14T11:55:43.864425+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:55:43.864425+0000","last_undegraded":"2024-09-14T11:55:43.864425+0000","last_fullsized":"2024-09-14T11:55:43.864425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:55.409953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'93","reported_seq":570,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.455750+0000","last_change":"2024-09-14T11:15:42.354581+0000","last_active":"2024-09-14T11:58:14.455750+0000","last_peered":"2024-09-14T11:58:14.455750+0000","last_clean":"2024-09-14T11:58:14.455750+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:58:14.455750+0000","last_undegraded":"2024-09-14T11:58:14.455750+0000","last_fullsized":"2024-09-14T11:58:14.455750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:56.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'422","reported_seq":1871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.440972+0000","last_change":"2024-09-14T11:15:34.326286+0000","last_active":"2024-09-14T11:56:24.440972+0000","last_peered":"2024-09-14T11:56:24.440972+0000","last_clean":"2024-09-14T11:56:24.440972+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:56:24.440972+0000","last_undegraded":"2024-09-14T11:56:24.440972+0000","last_fullsized":"2024-09-14T11:56:24.440972+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:42.344126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'187","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.949331+0000","last_change":"2024-09-14T11:15:32.318065+0000","last_active":"2024-09-14T11:55:08.949331+0000","last_peered":"2024-09-14T11:55:08.949331+0000","last_clean":"2024-09-14T11:55:08.949331+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:55:08.949331+0000","last_undegraded":"2024-09-14T11:55:08.949331+0000","last_fullsized":"2024-09-14T11:55:08.949331+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:17.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1219547,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":66072,"num_write":888,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.217987+0000","last_change":"2024-09-14T11:15:34.326738+0000","last_active":"2024-09-14T11:56:20.217987+0000","last_peered":"2024-09-14T11:56:20.217987+0000","last_clean":"2024-09-14T11:56:20.217987+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:56:20.217987+0000","last_undegraded":"2024-09-14T11:56:20.217987+0000","last_fullsized":"2024-09-14T11:56:20.217987+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:19.559783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'205","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.769120+0000","last_change":"2024-09-14T11:16:07.388971+0000","last_active":"2024-09-14T11:56:52.769120+0000","last_peered":"2024-09-14T11:56:52.769120+0000","last_clean":"2024-09-14T11:56:52.769120+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:56:52.769120+0000","last_undegraded":"2024-09-14T11:56:52.769120+0000","last_fullsized":"2024-09-14T11:56:52.769120+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:24.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874406,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":30107,"num_write":963,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'535","reported_seq":2201,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.748702+0000","last_change":"2024-09-14T11:15:34.327112+0000","last_active":"2024-09-14T11:56:37.748702+0000","last_peered":"2024-09-14T11:56:37.748702+0000","last_clean":"2024-09-14T11:56:37.748702+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:56:37.748702+0000","last_undegraded":"2024-09-14T11:56:37.748702+0000","last_fullsized":"2024-09-14T11:56:37.748702+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:38.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'178","reported_seq":758,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:56.061418+0000","last_change":"2024-09-14T11:15:32.322695+0000","last_active":"2024-09-14T11:55:56.061418+0000","last_peered":"2024-09-14T11:55:56.061418+0000","last_clean":"2024-09-14T11:55:56.061418+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:55:56.061418+0000","last_undegraded":"2024-09-14T11:55:56.061418+0000","last_fullsized":"2024-09-14T11:55:56.061418+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:51.640989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4543689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":13678,"num_write":820,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'686","reported_seq":2125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815081+0000","last_change":"2024-09-14T11:15:34.326696+0000","last_active":"2024-09-14T11:56:31.815081+0000","last_peered":"2024-09-14T11:56:31.815081+0000","last_clean":"2024-09-14T11:56:31.815081+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:56:31.815081+0000","last_undegraded":"2024-09-14T11:56:31.815081+0000","last_fullsized":"2024-09-14T11:56:31.815081+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:33.740522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'218","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.306735+0000","last_change":"2024-09-14T11:15:32.316203+0000","last_active":"2024-09-14T11:56:34.306735+0000","last_peered":"2024-09-14T11:56:34.306735+0000","last_clean":"2024-09-14T11:56:34.306735+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:56:34.306735+0000","last_undegraded":"2024-09-14T11:56:34.306735+0000","last_fullsized":"2024-09-14T11:56:34.306735+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:22.666605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6140506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":667,"num_read_kb":8461,"num_write":1061,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'577","reported_seq":2174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.999003+0000","last_change":"2024-09-14T11:15:34.321891+0000","last_active":"2024-09-14T11:56:36.999003+0000","last_peered":"2024-09-14T11:56:36.999003+0000","last_clean":"2024-09-14T11:56:36.999003+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:56:36.999003+0000","last_undegraded":"2024-09-14T11:56:36.999003+0000","last_fullsized":"2024-09-14T11:56:36.999003+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:57.912381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'249","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.079998+0000","last_change":"2024-09-14T11:15:32.318820+0000","last_active":"2024-09-14T11:56:52.079998+0000","last_peered":"2024-09-14T11:56:52.079998+0000","last_clean":"2024-09-14T11:56:52.079998+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:56:52.079998+0000","last_undegraded":"2024-09-14T11:56:52.079998+0000","last_fullsized":"2024-09-14T11:56:52.079998+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:03.579946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20178710,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":615,"num_read_kb":65552,"num_write":1151,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1210","reported_seq":2813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.749031+0000","last_change":"2024-09-14T11:15:34.321918+0000","last_active":"2024-09-14T11:56:37.749031+0000","last_peered":"2024-09-14T11:56:37.749031+0000","last_clean":"2024-09-14T11:56:37.749031+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:56:37.749031+0000","last_undegraded":"2024-09-14T11:56:37.749031+0000","last_fullsized":"2024-09-14T11:56:37.749031+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:50.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'189","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:16.645586+0000","last_change":"2024-09-14T11:15:32.315289+0000","last_active":"2024-09-14T11:55:16.645586+0000","last_peered":"2024-09-14T11:55:16.645586+0000","last_clean":"2024-09-14T11:55:16.645586+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:55:16.645586+0000","last_undegraded":"2024-09-14T11:55:16.645586+0000","last_fullsized":"2024-09-14T11:55:16.645586+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.565051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9439257,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":18861,"num_write":889,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'487","reported_seq":2135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.885876+0000","last_change":"2024-09-14T11:15:34.331577+0000","last_active":"2024-09-14T11:57:13.885876+0000","last_peered":"2024-09-14T11:57:13.885876+0000","last_clean":"2024-09-14T11:57:13.885876+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:57:13.885876+0000","last_undegraded":"2024-09-14T11:57:13.885876+0000","last_fullsized":"2024-09-14T11:57:13.885876+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:11.178476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'180","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.655711+0000","last_change":"2024-09-14T11:15:32.316992+0000","last_active":"2024-09-14T11:56:27.655711+0000","last_peered":"2024-09-14T11:56:27.655711+0000","last_clean":"2024-09-14T11:56:27.655711+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:56:27.655711+0000","last_undegraded":"2024-09-14T11:56:27.655711+0000","last_fullsized":"2024-09-14T11:56:27.655711+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:26.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1732164,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":3776,"num_write":814,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'438","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992326+0000","last_change":"2024-09-14T11:15:34.320939+0000","last_active":"2024-09-14T11:56:56.992326+0000","last_peered":"2024-09-14T11:56:56.992326+0000","last_clean":"2024-09-14T11:56:56.992326+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:56:56.992326+0000","last_undegraded":"2024-09-14T11:56:56.992326+0000","last_fullsized":"2024-09-14T11:56:56.992326+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:48.296671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'266","reported_seq":914,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:47.024102+0000","last_change":"2024-09-14T11:15:32.313940+0000","last_active":"2024-09-14T11:55:47.024102+0000","last_peered":"2024-09-14T11:55:47.024102+0000","last_clean":"2024-09-14T11:55:47.024102+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:55:47.024102+0000","last_undegraded":"2024-09-14T11:55:47.024102+0000","last_fullsized":"2024-09-14T11:55:47.024102+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:20.479935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7395300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":36414,"num_write":1097,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'491","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815278+0000","last_change":"2024-09-14T11:15:34.329614+0000","last_active":"2024-09-14T11:56:31.815278+0000","last_peered":"2024-09-14T11:56:31.815278+0000","last_clean":"2024-09-14T11:56:31.815278+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:56:31.815278+0000","last_undegraded":"2024-09-14T11:56:31.815278+0000","last_fullsized":"2024-09-14T11:56:31.815278+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:54.327097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'273","reported_seq":919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.153726+0000","last_change":"2024-09-14T11:15:32.315107+0000","last_active":"2024-09-14T11:56:30.153726+0000","last_peered":"2024-09-14T11:56:30.153726+0000","last_clean":"2024-09-14T11:56:30.153726+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:56:30.153726+0000","last_undegraded":"2024-09-14T11:56:30.153726+0000","last_fullsized":"2024-09-14T11:56:30.153726+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:38.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10535606,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":57959,"num_write":1164,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'745","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.401835+0000","last_change":"2024-09-14T11:15:34.315526+0000","last_active":"2024-09-14T11:56:29.401835+0000","last_peered":"2024-09-14T11:56:29.401835+0000","last_clean":"2024-09-14T11:56:29.401835+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:56:29.401835+0000","last_undegraded":"2024-09-14T11:56:29.401835+0000","last_fullsized":"2024-09-14T11:56:29.401835+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:14.858173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'196","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877283+0000","last_change":"2024-09-14T11:15:32.314904+0000","last_active":"2024-09-14T11:56:03.877283+0000","last_peered":"2024-09-14T11:56:03.877283+0000","last_clean":"2024-09-14T11:56:03.877283+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:56:03.877283+0000","last_undegraded":"2024-09-14T11:56:03.877283+0000","last_fullsized":"2024-09-14T11:56:03.877283+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:26.432997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6318765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":507,"num_read_kb":27346,"num_write":949,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518380+0000","last_change":"2024-09-14T11:15:34.319049+0000","last_active":"2024-09-14T11:56:33.518380+0000","last_peered":"2024-09-14T11:56:33.518380+0000","last_clean":"2024-09-14T11:56:33.518380+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:56:33.518380+0000","last_undegraded":"2024-09-14T11:56:33.518380+0000","last_fullsized":"2024-09-14T11:56:33.518380+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:49.759336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'210","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.403461+0000","last_change":"2024-09-14T11:15:32.323060+0000","last_active":"2024-09-14T11:56:38.403461+0000","last_peered":"2024-09-14T11:56:38.403461+0000","last_clean":"2024-09-14T11:56:38.403461+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:56:38.403461+0000","last_undegraded":"2024-09-14T11:56:38.403461+0000","last_fullsized":"2024-09-14T11:56:38.403461+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:45.398432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9461002,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":6791,"num_write":1018,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1091","reported_seq":2577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465397+0000","last_change":"2024-09-14T11:15:34.322193+0000","last_active":"2024-09-14T11:56:38.465397+0000","last_peered":"2024-09-14T11:56:38.465397+0000","last_clean":"2024-09-14T11:56:38.465397+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:56:38.465397+0000","last_undegraded":"2024-09-14T11:56:38.465397+0000","last_fullsized":"2024-09-14T11:56:38.465397+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":1000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:22.542879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.866601+0000","last_change":"2024-09-14T11:15:32.310112+0000","last_active":"2024-09-14T11:56:03.866601+0000","last_peered":"2024-09-14T11:56:03.866601+0000","last_clean":"2024-09-14T11:56:03.866601+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:56:03.866601+0000","last_undegraded":"2024-09-14T11:56:03.866601+0000","last_fullsized":"2024-09-14T11:56:03.866601+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:07.469578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291482,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":8671,"num_write":965,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'890","reported_seq":2796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530140+0000","last_change":"2024-09-14T11:15:34.324712+0000","last_active":"2024-09-14T11:56:57.530140+0000","last_peered":"2024-09-14T11:56:57.530140+0000","last_clean":"2024-09-14T11:56:57.530140+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:56:57.530140+0000","last_undegraded":"2024-09-14T11:56:57.530140+0000","last_fullsized":"2024-09-14T11:56:57.530140+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.495184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'210","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.956619+0000","last_change":"2024-09-14T11:15:32.318750+0000","last_active":"2024-09-14T11:56:03.956619+0000","last_peered":"2024-09-14T11:56:03.956619+0000","last_clean":"2024-09-14T11:56:03.956619+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:56:03.956619+0000","last_undegraded":"2024-09-14T11:56:03.956619+0000","last_fullsized":"2024-09-14T11:56:03.956619+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.743260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":9098,"num_write":1055,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.467024+0000","last_change":"2024-09-14T11:15:34.332778+0000","last_active":"2024-09-14T11:58:14.467024+0000","last_peered":"2024-09-14T11:58:14.467024+0000","last_clean":"2024-09-14T11:58:14.467024+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:58:14.467024+0000","last_undegraded":"2024-09-14T11:58:14.467024+0000","last_fullsized":"2024-09-14T11:58:14.467024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:54.250812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'219","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877344+0000","last_change":"2024-09-14T11:15:32.312591+0000","last_active":"2024-09-14T11:56:08.877344+0000","last_peered":"2024-09-14T11:56:08.877344+0000","last_clean":"2024-09-14T11:56:08.877344+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:56:08.877344+0000","last_undegraded":"2024-09-14T11:56:08.877344+0000","last_fullsized":"2024-09-14T11:56:08.877344+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:10.213620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5597074,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":650,"num_read_kb":2234,"num_write":1091,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1087","reported_seq":2853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466283+0000","last_change":"2024-09-14T11:15:34.328111+0000","last_active":"2024-09-14T11:58:14.466283+0000","last_peered":"2024-09-14T11:58:14.466283+0000","last_clean":"2024-09-14T11:58:14.466283+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:58:14.466283+0000","last_undegraded":"2024-09-14T11:58:14.466283+0000","last_fullsized":"2024-09-14T11:58:14.466283+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":1000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:12.718283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'208","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.084352+0000","last_change":"2024-09-14T11:15:32.313441+0000","last_active":"2024-09-14T11:55:59.084352+0000","last_peered":"2024-09-14T11:55:59.084352+0000","last_clean":"2024-09-14T11:55:59.084352+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:55:59.084352+0000","last_undegraded":"2024-09-14T11:55:59.084352+0000","last_fullsized":"2024-09-14T11:55:59.084352+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:11.822923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194329,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":34303,"num_write":986,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998517+0000","last_change":"2024-09-14T11:15:34.327960+0000","last_active":"2024-09-14T11:56:36.998517+0000","last_peered":"2024-09-14T11:56:36.998517+0000","last_clean":"2024-09-14T11:56:36.998517+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:56:36.998517+0000","last_undegraded":"2024-09-14T11:56:36.998517+0000","last_fullsized":"2024-09-14T11:56:36.998517+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:15.598992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'248","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.644775+0000","last_change":"2024-09-14T11:15:32.319862+0000","last_active":"2024-09-14T11:55:59.644775+0000","last_peered":"2024-09-14T11:55:59.644775+0000","last_clean":"2024-09-14T11:55:59.644775+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:55:59.644775+0000","last_undegraded":"2024-09-14T11:55:59.644775+0000","last_fullsized":"2024-09-14T11:55:59.644775+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:02.612992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242961,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":43532,"num_write":1119,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'181","reported_seq":779,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.921103+0000","last_change":"2024-09-14T11:15:32.313012+0000","last_active":"2024-09-14T11:55:55.921103+0000","last_peered":"2024-09-14T11:55:55.921103+0000","last_clean":"2024-09-14T11:55:55.921103+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:55:55.921103+0000","last_undegraded":"2024-09-14T11:55:55.921103+0000","last_fullsized":"2024-09-14T11:55:55.921103+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:04.134671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7369327,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":446,"num_read_kb":29604,"num_write":899,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'412","reported_seq":1879,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136779+0000","last_change":"2024-09-14T11:15:34.329317+0000","last_active":"2024-09-14T11:56:39.136779+0000","last_peered":"2024-09-14T11:56:39.136779+0000","last_clean":"2024-09-14T11:56:39.136779+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:56:39.136779+0000","last_undegraded":"2024-09-14T11:56:39.136779+0000","last_fullsized":"2024-09-14T11:56:39.136779+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:48.380875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'275","reported_seq":1047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.046588+0000","last_change":"2024-09-14T11:15:32.312792+0000","last_active":"2024-09-14T11:55:58.046588+0000","last_peered":"2024-09-14T11:55:58.046588+0000","last_clean":"2024-09-14T11:55:58.046588+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:55:58.046588+0000","last_undegraded":"2024-09-14T11:55:58.046588+0000","last_fullsized":"2024-09-14T11:55:58.046588+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.357853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5951631,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1006,"num_read_kb":66938,"num_write":1370,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'573","reported_seq":2170,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.863303+0000","last_change":"2024-09-14T11:15:34.326395+0000","last_active":"2024-09-14T11:57:45.863303+0000","last_peered":"2024-09-14T11:57:45.863303+0000","last_clean":"2024-09-14T11:57:45.863303+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:57:45.863303+0000","last_undegraded":"2024-09-14T11:57:45.863303+0000","last_fullsized":"2024-09-14T11:57:45.863303+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:54.259695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":627,"ondisk_log_size":627,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":498831,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8040,"num_read_kb":9895,"num_write":5491,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":761856,"data_stored":249734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1889,"ondisk_log_size":1889,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2384,"num_read_kb":2846,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4076,"ondisk_log_size":4076,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":464712376,"num_objects":477,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":477,"num_whiteouts":0,"num_read":38553,"num_read_kb":2111644,"num_write":64115,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":931250176,"data_stored":929424752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4363,"ondisk_log_size":4363,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72500675,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":137,"num_read_kb":180487,"num_write":158,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145006592,"data_stored":145001350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72500675,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":134,"num_read_kb":169164,"num_write":158,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145006592,"data_stored":145001350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509967,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375884,"kb_used_data":155900,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93995956,"statfs":{"total":96636764160,"available":96251858944,"internally_reserved":0,"allocated":159641600,"data_stored":157815266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509967,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309688,"kb_used_data":89704,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94062152,"statfs":{"total":96636764160,"available":96319643648,"internally_reserved":0,"allocated":91856896,"data_stored":90219580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509968,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229120,"kb_used_data":139696,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94142720,"statfs":{"total":96636764160,"available":96402145280,"internally_reserved":0,"allocated":143048704,"data_stored":141168794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509967,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240900,"kb_used_data":165300,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94130940,"statfs":{"total":96636764160,"available":96390082560,"internally_reserved":0,"allocated":169267200,"data_stored":167511993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509969,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":445588,"kb_used_data":215876,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93926252,"statfs":{"total":96636764160,"available":96180482048,"internally_reserved":0,"allocated":221057024,"data_stored":219210462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509967,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183136,"kb_used_data":115856,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94188704,"statfs":{"total":96636764160,"available":96449232896,"internally_reserved":0,"allocated":118636544,"data_stored":117025884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509965,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412228,"kb_used_data":182516,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93959612,"statfs":{"total":96636764160,"available":96214642688,"internally_reserved":0,"allocated":186896384,"data_stored":185041393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575374,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279104,"kb_used_data":157744,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94092736,"statfs":{"total":96636764160,"available":96350961664,"internally_reserved":0,"allocated":161529856,"data_stored":159871804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136409088,"data_stored":136109756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102232064,"data_stored":102093234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80318464,"data_stored":80187460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":193044480,"data_stored":192754866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118382592,"data_stored":118092216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":114061312,"data_stored":113775120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71327744,"data_stored":71195635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":115474432,"data_stored":115216465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":35768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":39296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":12957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":42327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":8255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":54512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":19841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":36778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3207168,"data_stored":3206092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27324416,"data_stored":27323340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10534912,"data_stored":10534182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21082112,"data_stored":21080306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":6351820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:49.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:58:49.649 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:58:49.651 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1564,"stamp":"2024-09-14T11:58:48.781510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610820012,"num_objects":993,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":295489,"num_read_kb":2699435,"num_write":146111,"num_write_kb":2447707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14023,"ondisk_log_size":14023,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2475648,"kb_used_data":1222592,"kb_used_omap":12,"kb_used_meta":1252915,"kb_avail":752499072,"statfs":{"total":773094113280,"available":770559049728,"internally_reserved":0,"allocated":1251934208,"data_stored":1237865176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1282985520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005035"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877231+0000","last_change":"2024-09-14T11:43:35.602913+0000","last_active":"2024-09-14T11:56:08.877231+0000","last_peered":"2024-09-14T11:56:08.877231+0000","last_clean":"2024-09-14T11:56:08.877231+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:56:08.877231+0000","last_undegraded":"2024-09-14T11:56:08.877231+0000","last_fullsized":"2024-09-14T11:56:08.877231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:06.258234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867970+0000","last_change":"2024-09-14T11:32:32.583802+0000","last_active":"2024-09-14T11:55:03.867970+0000","last_peered":"2024-09-14T11:55:03.867970+0000","last_clean":"2024-09-14T11:55:03.867970+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:55:03.867970+0000","last_undegraded":"2024-09-14T11:55:03.867970+0000","last_fullsized":"2024-09-14T11:55:03.867970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:58.807468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.868463+0000","last_change":"2024-09-14T11:32:29.554679+0000","last_active":"2024-09-14T11:54:58.868463+0000","last_peered":"2024-09-14T11:54:58.868463+0000","last_clean":"2024-09-14T11:54:58.868463+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:54:58.868463+0000","last_undegraded":"2024-09-14T11:54:58.868463+0000","last_fullsized":"2024-09-14T11:54:58.868463+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:20.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.865041+0000","last_change":"2024-09-14T11:30:45.179357+0000","last_active":"2024-09-14T11:55:48.865041+0000","last_peered":"2024-09-14T11:55:48.865041+0000","last_clean":"2024-09-14T11:55:48.865041+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:55:48.865041+0000","last_undegraded":"2024-09-14T11:55:48.865041+0000","last_fullsized":"2024-09-14T11:55:48.865041+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:03.066351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866530+0000","last_change":"2024-09-14T11:43:35.602901+0000","last_active":"2024-09-14T11:56:08.866530+0000","last_peered":"2024-09-14T11:56:08.866530+0000","last_clean":"2024-09-14T11:56:08.866530+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:56:08.866530+0000","last_undegraded":"2024-09-14T11:56:08.866530+0000","last_fullsized":"2024-09-14T11:56:08.866530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:07.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:04.005187+0000","last_change":"2024-09-14T11:32:32.582294+0000","last_active":"2024-09-14T11:55:04.005187+0000","last_peered":"2024-09-14T11:55:04.005187+0000","last_clean":"2024-09-14T11:55:04.005187+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:55:04.005187+0000","last_undegraded":"2024-09-14T11:55:04.005187+0000","last_fullsized":"2024-09-14T11:55:04.005187+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.399340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.864287+0000","last_change":"2024-09-14T11:32:29.558121+0000","last_active":"2024-09-14T11:55:00.864287+0000","last_peered":"2024-09-14T11:55:00.864287+0000","last_clean":"2024-09-14T11:55:00.864287+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:55:00.864287+0000","last_undegraded":"2024-09-14T11:55:00.864287+0000","last_fullsized":"2024-09-14T11:55:00.864287+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:52.777925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.438178+0000","last_change":"2024-09-14T11:30:45.185345+0000","last_active":"2024-09-14T11:56:00.438178+0000","last_peered":"2024-09-14T11:56:00.438178+0000","last_clean":"2024-09-14T11:56:00.438178+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:56:00.438178+0000","last_undegraded":"2024-09-14T11:56:00.438178+0000","last_fullsized":"2024-09-14T11:56:00.438178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:42.584514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.954160+0000","last_change":"2024-09-14T11:43:35.597712+0000","last_active":"2024-09-14T11:55:43.954160+0000","last_peered":"2024-09-14T11:55:43.954160+0000","last_clean":"2024-09-14T11:55:43.954160+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:55:43.954160+0000","last_undegraded":"2024-09-14T11:55:43.954160+0000","last_fullsized":"2024-09-14T11:55:43.954160+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:12.892547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'6","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.862548+0000","last_change":"2024-09-14T11:32:32.578401+0000","last_active":"2024-09-14T11:55:28.862548+0000","last_peered":"2024-09-14T11:55:28.862548+0000","last_clean":"2024-09-14T11:55:28.862548+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:55:28.862548+0000","last_undegraded":"2024-09-14T11:55:28.862548+0000","last_fullsized":"2024-09-14T11:55:28.862548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:07.530877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":13314,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.868976+0000","last_change":"2024-09-14T11:32:29.550110+0000","last_active":"2024-09-14T11:56:33.868976+0000","last_peered":"2024-09-14T11:56:33.868976+0000","last_clean":"2024-09-14T11:56:33.868976+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:56:33.868976+0000","last_undegraded":"2024-09-14T11:56:33.868976+0000","last_fullsized":"2024-09-14T11:56:33.868976+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:36.277584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.864987+0000","last_change":"2024-09-14T11:30:45.186185+0000","last_active":"2024-09-14T11:55:48.864987+0000","last_peered":"2024-09-14T11:55:48.864987+0000","last_clean":"2024-09-14T11:55:48.864987+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:55:48.864987+0000","last_undegraded":"2024-09-14T11:55:48.864987+0000","last_fullsized":"2024-09-14T11:55:48.864987+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.774513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875479+0000","last_change":"2024-09-14T11:43:35.603929+0000","last_active":"2024-09-14T11:55:48.875479+0000","last_peered":"2024-09-14T11:55:48.875479+0000","last_clean":"2024-09-14T11:55:48.875479+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:55:48.875479+0000","last_undegraded":"2024-09-14T11:55:48.875479+0000","last_fullsized":"2024-09-14T11:55:48.875479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:33.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'3","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882072+0000","last_change":"2024-09-14T11:32:32.589192+0000","last_active":"2024-09-14T11:56:43.882072+0000","last_peered":"2024-09-14T11:56:43.882072+0000","last_clean":"2024-09-14T11:56:43.882072+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:56:43.882072+0000","last_undegraded":"2024-09-14T11:56:43.882072+0000","last_fullsized":"2024-09-14T11:56:43.882072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:52.225210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":3,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.007703+0000","last_change":"2024-09-14T11:32:29.549479+0000","last_active":"2024-09-14T11:55:24.007703+0000","last_peered":"2024-09-14T11:55:24.007703+0000","last_clean":"2024-09-14T11:55:24.007703+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:55:24.007703+0000","last_undegraded":"2024-09-14T11:55:24.007703+0000","last_fullsized":"2024-09-14T11:55:24.007703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:56.796049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875525+0000","last_change":"2024-09-14T11:30:45.187877+0000","last_active":"2024-09-14T11:55:48.875525+0000","last_peered":"2024-09-14T11:55:48.875525+0000","last_clean":"2024-09-14T11:55:48.875525+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:55:48.875525+0000","last_undegraded":"2024-09-14T11:55:48.875525+0000","last_fullsized":"2024-09-14T11:55:48.875525+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:40.426491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874894+0000","last_change":"2024-09-14T11:43:35.601032+0000","last_active":"2024-09-14T11:55:43.874894+0000","last_peered":"2024-09-14T11:55:43.874894+0000","last_clean":"2024-09-14T11:55:43.874894+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:55:43.874894+0000","last_undegraded":"2024-09-14T11:55:43.874894+0000","last_fullsized":"2024-09-14T11:55:43.874894+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.697673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.863023+0000","last_change":"2024-09-14T11:33:08.805104+0000","last_active":"2024-09-14T11:54:28.863023+0000","last_peered":"2024-09-14T11:54:28.863023+0000","last_clean":"2024-09-14T11:54:28.863023+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:54:28.863023+0000","last_undegraded":"2024-09-14T11:54:28.863023+0000","last_fullsized":"2024-09-14T11:54:28.863023+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:03.683048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'6","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.853295+0000","last_change":"2024-09-14T11:32:29.558168+0000","last_active":"2024-09-14T11:54:13.853295+0000","last_peered":"2024-09-14T11:54:13.853295+0000","last_clean":"2024-09-14T11:54:13.853295+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:54:13.853295+0000","last_undegraded":"2024-09-14T11:54:13.853295+0000","last_fullsized":"2024-09-14T11:54:13.853295+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:28.837548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875505+0000","last_change":"2024-09-14T11:30:45.184142+0000","last_active":"2024-09-14T11:55:48.875505+0000","last_peered":"2024-09-14T11:55:48.875505+0000","last_clean":"2024-09-14T11:55:48.875505+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:55:48.875505+0000","last_undegraded":"2024-09-14T11:55:48.875505+0000","last_fullsized":"2024-09-14T11:55:48.875505+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:48.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872788+0000","last_change":"2024-09-14T11:43:35.605737+0000","last_active":"2024-09-14T11:56:05.872788+0000","last_peered":"2024-09-14T11:56:05.872788+0000","last_clean":"2024-09-14T11:56:05.872788+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:56:05.872788+0000","last_undegraded":"2024-09-14T11:56:05.872788+0000","last_fullsized":"2024-09-14T11:56:05.872788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'1","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.942976+0000","last_change":"2024-09-14T11:32:32.582277+0000","last_active":"2024-09-14T11:54:18.942976+0000","last_peered":"2024-09-14T11:54:18.942976+0000","last_clean":"2024-09-14T11:54:18.942976+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:54:18.942976+0000","last_undegraded":"2024-09-14T11:54:18.942976+0000","last_fullsized":"2024-09-14T11:54:18.942976+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.963034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.998852+0000","last_change":"2024-09-14T11:32:29.550064+0000","last_active":"2024-09-14T11:54:13.998852+0000","last_peered":"2024-09-14T11:54:13.998852+0000","last_clean":"2024-09-14T11:54:13.998852+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:54:13.998852+0000","last_undegraded":"2024-09-14T11:54:13.998852+0000","last_fullsized":"2024-09-14T11:54:13.998852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:24.276918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954746+0000","last_change":"2024-09-14T11:30:45.178964+0000","last_active":"2024-09-14T11:55:48.954746+0000","last_peered":"2024-09-14T11:55:48.954746+0000","last_clean":"2024-09-14T11:55:48.954746+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:55:48.954746+0000","last_undegraded":"2024-09-14T11:55:48.954746+0000","last_fullsized":"2024-09-14T11:55:48.954746+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:14.255189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877316+0000","last_change":"2024-09-14T11:43:35.605759+0000","last_active":"2024-09-14T11:56:08.877316+0000","last_peered":"2024-09-14T11:56:08.877316+0000","last_clean":"2024-09-14T11:56:08.877316+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:56:08.877316+0000","last_undegraded":"2024-09-14T11:56:08.877316+0000","last_fullsized":"2024-09-14T11:56:08.877316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.948842+0000","last_change":"2024-09-14T11:32:32.580274+0000","last_active":"2024-09-14T11:55:03.948842+0000","last_peered":"2024-09-14T11:55:03.948842+0000","last_clean":"2024-09-14T11:55:03.948842+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:55:03.948842+0000","last_undegraded":"2024-09-14T11:55:03.948842+0000","last_fullsized":"2024-09-14T11:55:03.948842+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:14.222467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004336+0000","last_change":"2024-09-14T11:32:29.555376+0000","last_active":"2024-09-14T11:54:59.004336+0000","last_peered":"2024-09-14T11:54:59.004336+0000","last_clean":"2024-09-14T11:54:59.004336+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:54:59.004336+0000","last_undegraded":"2024-09-14T11:54:59.004336+0000","last_fullsized":"2024-09-14T11:54:59.004336+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.859610+0000","last_change":"2024-09-14T11:30:45.175070+0000","last_active":"2024-09-14T11:55:03.859610+0000","last_peered":"2024-09-14T11:55:03.859610+0000","last_clean":"2024-09-14T11:55:03.859610+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:55:03.859610+0000","last_undegraded":"2024-09-14T11:55:03.859610+0000","last_fullsized":"2024-09-14T11:55:03.859610+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.836949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877363+0000","last_change":"2024-09-14T11:43:35.607526+0000","last_active":"2024-09-14T11:56:08.877363+0000","last_peered":"2024-09-14T11:56:08.877363+0000","last_clean":"2024-09-14T11:56:08.877363+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:56:08.877363+0000","last_undegraded":"2024-09-14T11:56:08.877363+0000","last_fullsized":"2024-09-14T11:56:08.877363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.745235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869068+0000","last_change":"2024-09-14T11:32:32.587761+0000","last_active":"2024-09-14T11:55:03.869068+0000","last_peered":"2024-09-14T11:55:03.869068+0000","last_clean":"2024-09-14T11:55:03.869068+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:55:03.869068+0000","last_undegraded":"2024-09-14T11:55:03.869068+0000","last_fullsized":"2024-09-14T11:55:03.869068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:27.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859019+0000","last_change":"2024-09-14T11:32:29.555600+0000","last_active":"2024-09-14T11:54:58.859019+0000","last_peered":"2024-09-14T11:54:58.859019+0000","last_clean":"2024-09-14T11:54:58.859019+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:54:58.859019+0000","last_undegraded":"2024-09-14T11:54:58.859019+0000","last_fullsized":"2024-09-14T11:54:58.859019+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.338753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863479+0000","last_change":"2024-09-14T11:30:45.182076+0000","last_active":"2024-09-14T11:54:55.863479+0000","last_peered":"2024-09-14T11:54:55.863479+0000","last_clean":"2024-09-14T11:54:55.863479+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:54:55.863479+0000","last_undegraded":"2024-09-14T11:54:55.863479+0000","last_fullsized":"2024-09-14T11:54:55.863479+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:51.625984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866051+0000","last_change":"2024-09-14T11:43:35.603298+0000","last_active":"2024-09-14T11:55:15.866051+0000","last_peered":"2024-09-14T11:55:15.866051+0000","last_clean":"2024-09-14T11:55:15.866051+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:55:15.866051+0000","last_undegraded":"2024-09-14T11:55:15.866051+0000","last_fullsized":"2024-09-14T11:55:15.866051+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.863213+0000","last_change":"2024-09-14T11:32:32.585885+0000","last_active":"2024-09-14T11:54:18.863213+0000","last_peered":"2024-09-14T11:54:18.863213+0000","last_clean":"2024-09-14T11:54:18.863213+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:54:18.863213+0000","last_undegraded":"2024-09-14T11:54:18.863213+0000","last_fullsized":"2024-09-14T11:54:18.863213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:13.003196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.875756+0000","last_change":"2024-09-14T11:32:29.556257+0000","last_active":"2024-09-14T11:55:58.875756+0000","last_peered":"2024-09-14T11:55:58.875756+0000","last_clean":"2024-09-14T11:55:58.875756+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:55:58.875756+0000","last_undegraded":"2024-09-14T11:55:58.875756+0000","last_fullsized":"2024-09-14T11:55:58.875756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:03.738228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859107+0000","last_change":"2024-09-14T11:30:45.181226+0000","last_active":"2024-09-14T11:54:58.859107+0000","last_peered":"2024-09-14T11:54:58.859107+0000","last_clean":"2024-09-14T11:54:58.859107+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:54:58.859107+0000","last_undegraded":"2024-09-14T11:54:58.859107+0000","last_fullsized":"2024-09-14T11:54:58.859107+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:13.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.860482+0000","last_change":"2024-09-14T11:43:35.601936+0000","last_active":"2024-09-14T11:55:18.860482+0000","last_peered":"2024-09-14T11:55:18.860482+0000","last_clean":"2024-09-14T11:55:18.860482+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:55:18.860482+0000","last_undegraded":"2024-09-14T11:55:18.860482+0000","last_fullsized":"2024-09-14T11:55:18.860482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:28.098855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877364+0000","last_change":"2024-09-14T11:32:32.588409+0000","last_active":"2024-09-14T11:56:03.877364+0000","last_peered":"2024-09-14T11:56:03.877364+0000","last_clean":"2024-09-14T11:56:03.877364+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:56:03.877364+0000","last_undegraded":"2024-09-14T11:56:03.877364+0000","last_fullsized":"2024-09-14T11:56:03.877364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:05.997127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.860625+0000","last_change":"2024-09-14T11:32:29.554191+0000","last_active":"2024-09-14T11:54:13.860625+0000","last_peered":"2024-09-14T11:54:13.860625+0000","last_clean":"2024-09-14T11:54:13.860625+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:54:13.860625+0000","last_undegraded":"2024-09-14T11:54:13.860625+0000","last_fullsized":"2024-09-14T11:54:13.860625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4123,"num_write":3,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.870574+0000","last_change":"2024-09-14T11:30:45.186297+0000","last_active":"2024-09-14T11:55:59.870574+0000","last_peered":"2024-09-14T11:55:59.870574+0000","last_clean":"2024-09-14T11:55:59.870574+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:55:59.870574+0000","last_undegraded":"2024-09-14T11:55:59.870574+0000","last_fullsized":"2024-09-14T11:55:59.870574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.503260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869999+0000","last_change":"2024-09-14T11:43:35.602751+0000","last_active":"2024-09-14T11:55:18.869999+0000","last_peered":"2024-09-14T11:55:18.869999+0000","last_clean":"2024-09-14T11:55:18.869999+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:55:18.869999+0000","last_undegraded":"2024-09-14T11:55:18.869999+0000","last_fullsized":"2024-09-14T11:55:18.869999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:27.871586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'1","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.863266+0000","last_change":"2024-09-14T11:32:32.582994+0000","last_active":"2024-09-14T11:54:18.863266+0000","last_peered":"2024-09-14T11:54:18.863266+0000","last_clean":"2024-09-14T11:54:18.863266+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:54:18.863266+0000","last_undegraded":"2024-09-14T11:54:18.863266+0000","last_fullsized":"2024-09-14T11:54:18.863266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:49.256978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'3","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.852923+0000","last_change":"2024-09-14T11:32:29.544034+0000","last_active":"2024-09-14T11:54:13.852923+0000","last_peered":"2024-09-14T11:54:13.852923+0000","last_clean":"2024-09-14T11:54:13.852923+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:54:13.852923+0000","last_undegraded":"2024-09-14T11:54:13.852923+0000","last_fullsized":"2024-09-14T11:54:13.852923+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858457+0000","last_change":"2024-09-14T11:30:45.184378+0000","last_active":"2024-09-14T11:54:58.858457+0000","last_peered":"2024-09-14T11:54:58.858457+0000","last_clean":"2024-09-14T11:54:58.858457+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:54:58.858457+0000","last_undegraded":"2024-09-14T11:54:58.858457+0000","last_fullsized":"2024-09-14T11:54:58.858457+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:03.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869969+0000","last_change":"2024-09-14T11:43:35.601578+0000","last_active":"2024-09-14T11:55:18.869969+0000","last_peered":"2024-09-14T11:55:18.869969+0000","last_clean":"2024-09-14T11:55:18.869969+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:55:18.869969+0000","last_undegraded":"2024-09-14T11:55:18.869969+0000","last_fullsized":"2024-09-14T11:55:18.869969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:45.561461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999626+0000","last_change":"2024-09-14T11:32:32.581631+0000","last_active":"2024-09-14T11:54:18.999626+0000","last_peered":"2024-09-14T11:54:18.999626+0000","last_clean":"2024-09-14T11:54:18.999626+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:54:18.999626+0000","last_undegraded":"2024-09-14T11:54:18.999626+0000","last_fullsized":"2024-09-14T11:54:18.999626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:08.950123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.853433+0000","last_change":"2024-09-14T11:32:29.550009+0000","last_active":"2024-09-14T11:54:13.853433+0000","last_peered":"2024-09-14T11:54:13.853433+0000","last_clean":"2024-09-14T11:54:13.853433+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:54:13.853433+0000","last_undegraded":"2024-09-14T11:54:13.853433+0000","last_fullsized":"2024-09-14T11:54:13.853433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:07.302819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":768,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.860570+0000","last_change":"2024-09-14T11:30:45.185397+0000","last_active":"2024-09-14T11:54:13.860570+0000","last_peered":"2024-09-14T11:54:13.860570+0000","last_clean":"2024-09-14T11:54:13.860570+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:54:13.860570+0000","last_undegraded":"2024-09-14T11:54:13.860570+0000","last_fullsized":"2024-09-14T11:54:13.860570+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:30.178621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874909+0000","last_change":"2024-09-14T11:43:35.603719+0000","last_active":"2024-09-14T11:55:43.874909+0000","last_peered":"2024-09-14T11:55:43.874909+0000","last_clean":"2024-09-14T11:55:43.874909+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:55:43.874909+0000","last_undegraded":"2024-09-14T11:55:43.874909+0000","last_fullsized":"2024-09-14T11:55:43.874909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:21.587122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'3","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.871640+0000","last_change":"2024-09-14T11:32:32.583371+0000","last_active":"2024-09-14T11:55:55.871640+0000","last_peered":"2024-09-14T11:55:55.871640+0000","last_clean":"2024-09-14T11:55:55.871640+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:55:55.871640+0000","last_undegraded":"2024-09-14T11:55:55.871640+0000","last_fullsized":"2024-09-14T11:55:55.871640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:26.139200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'6","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011289+0000","last_change":"2024-09-14T11:32:29.556494+0000","last_active":"2024-09-14T11:55:49.011289+0000","last_peered":"2024-09-14T11:55:49.011289+0000","last_clean":"2024-09-14T11:55:49.011289+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:55:49.011289+0000","last_undegraded":"2024-09-14T11:55:49.011289+0000","last_fullsized":"2024-09-14T11:55:49.011289+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:44.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7227,"num_write":11,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":173,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.859808+0000","last_change":"2024-09-14T11:30:45.184935+0000","last_active":"2024-09-14T11:54:08.859808+0000","last_peered":"2024-09-14T11:54:08.859808+0000","last_clean":"2024-09-14T11:54:08.859808+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:54:08.859808+0000","last_undegraded":"2024-09-14T11:54:08.859808+0000","last_fullsized":"2024-09-14T11:54:08.859808+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:16.452875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864520+0000","last_change":"2024-09-14T11:43:35.606065+0000","last_active":"2024-09-14T11:55:43.864520+0000","last_peered":"2024-09-14T11:55:43.864520+0000","last_clean":"2024-09-14T11:55:43.864520+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:55:43.864520+0000","last_undegraded":"2024-09-14T11:55:43.864520+0000","last_fullsized":"2024-09-14T11:55:43.864520+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:45.826564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'5","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.871596+0000","last_change":"2024-09-14T11:32:32.581191+0000","last_active":"2024-09-14T11:55:55.871596+0000","last_peered":"2024-09-14T11:55:55.871596+0000","last_clean":"2024-09-14T11:55:55.871596+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:55:55.871596+0000","last_undegraded":"2024-09-14T11:55:55.871596+0000","last_fullsized":"2024-09-14T11:55:55.871596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:56.670374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875460+0000","last_change":"2024-09-14T11:32:29.543122+0000","last_active":"2024-09-14T11:55:48.875460+0000","last_peered":"2024-09-14T11:55:48.875460+0000","last_clean":"2024-09-14T11:55:48.875460+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:55:48.875460+0000","last_undegraded":"2024-09-14T11:55:48.875460+0000","last_fullsized":"2024-09-14T11:55:48.875460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:34.079866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.657310+0000","last_change":"2024-09-14T11:30:45.187136+0000","last_active":"2024-09-14T11:55:59.657310+0000","last_peered":"2024-09-14T11:55:59.657310+0000","last_clean":"2024-09-14T11:55:59.657310+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:55:59.657310+0000","last_undegraded":"2024-09-14T11:55:59.657310+0000","last_fullsized":"2024-09-14T11:55:59.657310+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:42.845918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861900+0000","last_change":"2024-09-14T11:43:35.608421+0000","last_active":"2024-09-14T11:55:23.861900+0000","last_peered":"2024-09-14T11:55:23.861900+0000","last_clean":"2024-09-14T11:55:23.861900+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:55:23.861900+0000","last_undegraded":"2024-09-14T11:55:23.861900+0000","last_fullsized":"2024-09-14T11:55:23.861900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:33.729484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.876137+0000","last_change":"2024-09-14T11:32:32.590267+0000","last_active":"2024-09-14T11:55:53.876137+0000","last_peered":"2024-09-14T11:55:53.876137+0000","last_clean":"2024-09-14T11:55:53.876137+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:55:53.876137+0000","last_undegraded":"2024-09-14T11:55:53.876137+0000","last_fullsized":"2024-09-14T11:55:53.876137+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.861311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954756+0000","last_change":"2024-09-14T11:32:29.557676+0000","last_active":"2024-09-14T11:55:48.954756+0000","last_peered":"2024-09-14T11:55:48.954756+0000","last_clean":"2024-09-14T11:55:48.954756+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:55:48.954756+0000","last_undegraded":"2024-09-14T11:55:48.954756+0000","last_fullsized":"2024-09-14T11:55:48.954756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:16.569296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.998083+0000","last_change":"2024-09-14T11:30:45.183316+0000","last_active":"2024-09-14T11:54:08.998083+0000","last_peered":"2024-09-14T11:54:08.998083+0000","last_clean":"2024-09-14T11:54:08.998083+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:54:08.998083+0000","last_undegraded":"2024-09-14T11:54:08.998083+0000","last_fullsized":"2024-09-14T11:54:08.998083+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:21.498493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874873+0000","last_change":"2024-09-14T11:43:35.603573+0000","last_active":"2024-09-14T11:55:43.874873+0000","last_peered":"2024-09-14T11:55:43.874873+0000","last_clean":"2024-09-14T11:55:43.874873+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:55:43.874873+0000","last_undegraded":"2024-09-14T11:55:43.874873+0000","last_fullsized":"2024-09-14T11:55:43.874873+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:21.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.955285+0000","last_change":"2024-09-14T11:32:32.583874+0000","last_active":"2024-09-14T11:55:53.955285+0000","last_peered":"2024-09-14T11:55:53.955285+0000","last_clean":"2024-09-14T11:55:53.955285+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:55:53.955285+0000","last_undegraded":"2024-09-14T11:55:53.955285+0000","last_fullsized":"2024-09-14T11:55:53.955285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.827399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874557+0000","last_change":"2024-09-14T11:32:29.557054+0000","last_active":"2024-09-14T11:55:48.874557+0000","last_peered":"2024-09-14T11:55:48.874557+0000","last_clean":"2024-09-14T11:55:48.874557+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:55:48.874557+0000","last_undegraded":"2024-09-14T11:55:48.874557+0000","last_fullsized":"2024-09-14T11:55:48.874557+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:17.332064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.797072+0000","last_change":"2024-09-14T11:30:45.188008+0000","last_active":"2024-09-14T11:55:24.797072+0000","last_peered":"2024-09-14T11:55:24.797072+0000","last_clean":"2024-09-14T11:55:24.797072+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:55:24.797072+0000","last_undegraded":"2024-09-14T11:55:24.797072+0000","last_fullsized":"2024-09-14T11:55:24.797072+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:10.454288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.855636+0000","last_change":"2024-09-14T11:43:35.601146+0000","last_active":"2024-09-14T11:54:33.855636+0000","last_peered":"2024-09-14T11:54:33.855636+0000","last_clean":"2024-09-14T11:54:33.855636+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:54:33.855636+0000","last_undegraded":"2024-09-14T11:54:33.855636+0000","last_fullsized":"2024-09-14T11:54:33.855636+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:58.732885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869141+0000","last_change":"2024-09-14T11:32:32.585896+0000","last_active":"2024-09-14T11:55:03.869141+0000","last_peered":"2024-09-14T11:55:03.869141+0000","last_clean":"2024-09-14T11:55:03.869141+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:55:03.869141+0000","last_undegraded":"2024-09-14T11:55:03.869141+0000","last_fullsized":"2024-09-14T11:55:03.869141+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:46.169476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867339+0000","last_change":"2024-09-14T11:32:29.550392+0000","last_active":"2024-09-14T11:54:58.867339+0000","last_peered":"2024-09-14T11:54:58.867339+0000","last_clean":"2024-09-14T11:54:58.867339+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:54:58.867339+0000","last_undegraded":"2024-09-14T11:54:58.867339+0000","last_fullsized":"2024-09-14T11:54:58.867339+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.897313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":98,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874939+0000","last_change":"2024-09-14T11:30:45.187527+0000","last_active":"2024-09-14T11:55:43.874939+0000","last_peered":"2024-09-14T11:55:43.874939+0000","last_clean":"2024-09-14T11:55:43.874939+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:55:43.874939+0000","last_undegraded":"2024-09-14T11:55:43.874939+0000","last_fullsized":"2024-09-14T11:55:43.874939+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:10.115937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866776+0000","last_change":"2024-09-14T11:43:35.607758+0000","last_active":"2024-09-14T11:54:53.866776+0000","last_peered":"2024-09-14T11:54:53.866776+0000","last_clean":"2024-09-14T11:54:53.866776+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:54:53.866776+0000","last_undegraded":"2024-09-14T11:54:53.866776+0000","last_fullsized":"2024-09-14T11:54:53.866776+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:25.238514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869108+0000","last_change":"2024-09-14T11:32:32.589816+0000","last_active":"2024-09-14T11:55:03.869108+0000","last_peered":"2024-09-14T11:55:03.869108+0000","last_clean":"2024-09-14T11:55:03.869108+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:55:03.869108+0000","last_undegraded":"2024-09-14T11:55:03.869108+0000","last_fullsized":"2024-09-14T11:55:03.869108+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:48.593038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858469+0000","last_change":"2024-09-14T11:32:29.550400+0000","last_active":"2024-09-14T11:54:58.858469+0000","last_peered":"2024-09-14T11:54:58.858469+0000","last_clean":"2024-09-14T11:54:58.858469+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:54:58.858469+0000","last_undegraded":"2024-09-14T11:54:58.858469+0000","last_fullsized":"2024-09-14T11:54:58.858469+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:37.276571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872259+0000","last_change":"2024-09-14T11:30:45.175794+0000","last_active":"2024-09-14T11:55:33.872259+0000","last_peered":"2024-09-14T11:55:33.872259+0000","last_clean":"2024-09-14T11:55:33.872259+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:55:33.872259+0000","last_undegraded":"2024-09-14T11:55:33.872259+0000","last_fullsized":"2024-09-14T11:55:33.872259+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:12.580971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944465+0000","last_change":"2024-09-14T11:43:35.603624+0000","last_active":"2024-09-14T11:54:28.944465+0000","last_peered":"2024-09-14T11:54:28.944465+0000","last_clean":"2024-09-14T11:54:28.944465+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:54:28.944465+0000","last_undegraded":"2024-09-14T11:54:28.944465+0000","last_fullsized":"2024-09-14T11:54:28.944465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:06.649979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865526+0000","last_change":"2024-09-14T11:32:32.582078+0000","last_active":"2024-09-14T11:55:10.865526+0000","last_peered":"2024-09-14T11:55:10.865526+0000","last_clean":"2024-09-14T11:55:10.865526+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:55:10.865526+0000","last_undegraded":"2024-09-14T11:55:10.865526+0000","last_fullsized":"2024-09-14T11:55:10.865526+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.729935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859071+0000","last_change":"2024-09-14T11:32:29.556788+0000","last_active":"2024-09-14T11:54:58.859071+0000","last_peered":"2024-09-14T11:54:58.859071+0000","last_clean":"2024-09-14T11:54:58.859071+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:54:58.859071+0000","last_undegraded":"2024-09-14T11:54:58.859071+0000","last_fullsized":"2024-09-14T11:54:58.859071+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:25.298432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.952685+0000","last_change":"2024-09-14T11:30:45.181601+0000","last_active":"2024-09-14T11:55:33.952685+0000","last_peered":"2024-09-14T11:55:33.952685+0000","last_clean":"2024-09-14T11:55:33.952685+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:55:33.952685+0000","last_undegraded":"2024-09-14T11:55:33.952685+0000","last_fullsized":"2024-09-14T11:55:33.952685+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.863012+0000","last_change":"2024-09-14T11:43:35.603524+0000","last_active":"2024-09-14T11:54:28.863012+0000","last_peered":"2024-09-14T11:54:28.863012+0000","last_clean":"2024-09-14T11:54:28.863012+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:54:28.863012+0000","last_undegraded":"2024-09-14T11:54:28.863012+0000","last_fullsized":"2024-09-14T11:54:28.863012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:22.177315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869154+0000","last_change":"2024-09-14T11:32:32.588422+0000","last_active":"2024-09-14T11:55:03.869154+0000","last_peered":"2024-09-14T11:55:03.869154+0000","last_clean":"2024-09-14T11:55:03.869154+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:55:03.869154+0000","last_undegraded":"2024-09-14T11:55:03.869154+0000","last_fullsized":"2024-09-14T11:55:03.869154+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.486355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864803+0000","last_change":"2024-09-14T11:32:29.558855+0000","last_active":"2024-09-14T11:55:05.864803+0000","last_peered":"2024-09-14T11:55:05.864803+0000","last_clean":"2024-09-14T11:55:05.864803+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:55:05.864803+0000","last_undegraded":"2024-09-14T11:55:05.864803+0000","last_fullsized":"2024-09-14T11:55:05.864803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.718076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":172,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.862421+0000","last_change":"2024-09-14T11:30:45.186320+0000","last_active":"2024-09-14T11:55:33.862421+0000","last_peered":"2024-09-14T11:55:33.862421+0000","last_clean":"2024-09-14T11:55:33.862421+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:55:33.862421+0000","last_undegraded":"2024-09-14T11:55:33.862421+0000","last_fullsized":"2024-09-14T11:55:33.862421+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:02.402885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867996+0000","last_change":"2024-09-14T11:43:35.607826+0000","last_active":"2024-09-14T11:54:53.867996+0000","last_peered":"2024-09-14T11:54:53.867996+0000","last_clean":"2024-09-14T11:54:53.867996+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:54:53.867996+0000","last_undegraded":"2024-09-14T11:54:53.867996+0000","last_fullsized":"2024-09-14T11:54:53.867996+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:17.558008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.016002+0000","last_change":"2024-09-14T11:32:32.590048+0000","last_active":"2024-09-14T11:56:24.016002+0000","last_peered":"2024-09-14T11:56:24.016002+0000","last_clean":"2024-09-14T11:56:24.016002+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:56:24.016002+0000","last_undegraded":"2024-09-14T11:56:24.016002+0000","last_fullsized":"2024-09-14T11:56:24.016002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:10.124434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868576+0000","last_change":"2024-09-14T11:32:29.557361+0000","last_active":"2024-09-14T11:56:18.868576+0000","last_peered":"2024-09-14T11:56:18.868576+0000","last_clean":"2024-09-14T11:56:18.868576+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:56:18.868576+0000","last_undegraded":"2024-09-14T11:56:18.868576+0000","last_fullsized":"2024-09-14T11:56:18.868576+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:06.391010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863103+0000","last_change":"2024-09-14T11:30:45.189776+0000","last_active":"2024-09-14T11:55:33.863103+0000","last_peered":"2024-09-14T11:55:33.863103+0000","last_clean":"2024-09-14T11:55:33.863103+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:55:33.863103+0000","last_undegraded":"2024-09-14T11:55:33.863103+0000","last_fullsized":"2024-09-14T11:55:33.863103+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:07.248111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867381+0000","last_change":"2024-09-14T11:43:35.605135+0000","last_active":"2024-09-14T11:54:58.867381+0000","last_peered":"2024-09-14T11:54:58.867381+0000","last_clean":"2024-09-14T11:54:58.867381+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:54:58.867381+0000","last_undegraded":"2024-09-14T11:54:58.867381+0000","last_fullsized":"2024-09-14T11:54:58.867381+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879560+0000","last_change":"2024-09-14T11:32:32.579119+0000","last_active":"2024-09-14T11:56:23.879560+0000","last_peered":"2024-09-14T11:56:23.879560+0000","last_clean":"2024-09-14T11:56:23.879560+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:56:23.879560+0000","last_undegraded":"2024-09-14T11:56:23.879560+0000","last_fullsized":"2024-09-14T11:56:23.879560+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:39.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.874789+0000","last_change":"2024-09-14T11:32:29.558623+0000","last_active":"2024-09-14T11:56:20.874789+0000","last_peered":"2024-09-14T11:56:20.874789+0000","last_clean":"2024-09-14T11:56:20.874789+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:56:20.874789+0000","last_undegraded":"2024-09-14T11:56:20.874789+0000","last_fullsized":"2024-09-14T11:56:20.874789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:00.753847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.547369+0000","last_change":"2024-09-14T11:30:45.184693+0000","last_active":"2024-09-14T11:55:02.547369+0000","last_peered":"2024-09-14T11:55:02.547369+0000","last_clean":"2024-09-14T11:55:02.547369+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:55:02.547369+0000","last_undegraded":"2024-09-14T11:55:02.547369+0000","last_fullsized":"2024-09-14T11:55:02.547369+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:26.556025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866795+0000","last_change":"2024-09-14T11:43:35.606592+0000","last_active":"2024-09-14T11:54:53.866795+0000","last_peered":"2024-09-14T11:54:53.866795+0000","last_clean":"2024-09-14T11:54:53.866795+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:54:53.866795+0000","last_undegraded":"2024-09-14T11:54:53.866795+0000","last_fullsized":"2024-09-14T11:54:53.866795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:47.717972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864758+0000","last_change":"2024-09-14T11:32:32.582791+0000","last_active":"2024-09-14T11:55:05.864758+0000","last_peered":"2024-09-14T11:55:05.864758+0000","last_clean":"2024-09-14T11:55:05.864758+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:55:05.864758+0000","last_undegraded":"2024-09-14T11:55:05.864758+0000","last_fullsized":"2024-09-14T11:55:05.864758+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.426108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.869202+0000","last_change":"2024-09-14T11:32:29.556753+0000","last_active":"2024-09-14T11:56:23.869202+0000","last_peered":"2024-09-14T11:56:23.869202+0000","last_clean":"2024-09-14T11:56:23.869202+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:56:23.869202+0000","last_undegraded":"2024-09-14T11:56:23.869202+0000","last_fullsized":"2024-09-14T11:56:23.869202+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:34.099936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.865798+0000","last_change":"2024-09-14T11:30:45.185455+0000","last_active":"2024-09-14T11:55:59.865798+0000","last_peered":"2024-09-14T11:55:59.865798+0000","last_clean":"2024-09-14T11:55:59.865798+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:55:59.865798+0000","last_undegraded":"2024-09-14T11:55:59.865798+0000","last_fullsized":"2024-09-14T11:55:59.865798+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:25.948213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.858467+0000","last_change":"2024-09-14T11:43:35.603825+0000","last_active":"2024-09-14T11:54:53.858467+0000","last_peered":"2024-09-14T11:54:53.858467+0000","last_clean":"2024-09-14T11:54:53.858467+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:54:53.858467+0000","last_undegraded":"2024-09-14T11:54:53.858467+0000","last_fullsized":"2024-09-14T11:54:53.858467+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:22.239624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880311+0000","last_change":"2024-09-14T11:32:32.590037+0000","last_active":"2024-09-14T11:56:28.880311+0000","last_peered":"2024-09-14T11:56:28.880311+0000","last_clean":"2024-09-14T11:56:28.880311+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:56:28.880311+0000","last_undegraded":"2024-09-14T11:56:28.880311+0000","last_fullsized":"2024-09-14T11:56:28.880311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:48.742115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004361+0000","last_change":"2024-09-14T11:32:29.552051+0000","last_active":"2024-09-14T11:54:59.004361+0000","last_peered":"2024-09-14T11:54:59.004361+0000","last_clean":"2024-09-14T11:54:59.004361+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:54:59.004361+0000","last_undegraded":"2024-09-14T11:54:59.004361+0000","last_fullsized":"2024-09-14T11:54:59.004361+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.824552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945791+0000","last_change":"2024-09-14T11:30:45.183254+0000","last_active":"2024-09-14T11:54:38.945791+0000","last_peered":"2024-09-14T11:54:38.945791+0000","last_clean":"2024-09-14T11:54:38.945791+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:54:38.945791+0000","last_undegraded":"2024-09-14T11:54:38.945791+0000","last_fullsized":"2024-09-14T11:54:38.945791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:04.016656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877254+0000","last_change":"2024-09-14T11:43:35.604116+0000","last_active":"2024-09-14T11:56:08.877254+0000","last_peered":"2024-09-14T11:56:08.877254+0000","last_clean":"2024-09-14T11:56:08.877254+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:56:08.877254+0000","last_undegraded":"2024-09-14T11:56:08.877254+0000","last_fullsized":"2024-09-14T11:56:08.877254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:16.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863176+0000","last_change":"2024-09-14T11:32:32.583981+0000","last_active":"2024-09-14T11:55:33.863176+0000","last_peered":"2024-09-14T11:55:33.863176+0000","last_clean":"2024-09-14T11:55:33.863176+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:55:33.863176+0000","last_undegraded":"2024-09-14T11:55:33.863176+0000","last_fullsized":"2024-09-14T11:55:33.863176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:37.109384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870848+0000","last_change":"2024-09-14T11:32:29.553611+0000","last_active":"2024-09-14T11:55:23.870848+0000","last_peered":"2024-09-14T11:55:23.870848+0000","last_clean":"2024-09-14T11:55:23.870848+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:55:23.870848+0000","last_undegraded":"2024-09-14T11:55:23.870848+0000","last_fullsized":"2024-09-14T11:55:23.870848+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:23.400420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.064541+0000","last_change":"2024-09-14T11:30:45.182248+0000","last_active":"2024-09-14T11:55:02.064541+0000","last_peered":"2024-09-14T11:55:02.064541+0000","last_clean":"2024-09-14T11:55:02.064541+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:55:02.064541+0000","last_undegraded":"2024-09-14T11:55:02.064541+0000","last_fullsized":"2024-09-14T11:55:02.064541+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:12.204716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877270+0000","last_change":"2024-09-14T11:43:35.603484+0000","last_active":"2024-09-14T11:56:08.877270+0000","last_peered":"2024-09-14T11:56:08.877270+0000","last_clean":"2024-09-14T11:56:08.877270+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:56:08.877270+0000","last_undegraded":"2024-09-14T11:56:08.877270+0000","last_fullsized":"2024-09-14T11:56:08.877270+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.596092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'1","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.862484+0000","last_change":"2024-09-14T11:32:32.575572+0000","last_active":"2024-09-14T11:55:28.862484+0000","last_peered":"2024-09-14T11:55:28.862484+0000","last_clean":"2024-09-14T11:55:28.862484+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:55:28.862484+0000","last_undegraded":"2024-09-14T11:55:28.862484+0000","last_fullsized":"2024-09-14T11:55:28.862484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:01.425017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.861591+0000","last_change":"2024-09-14T11:32:29.551182+0000","last_active":"2024-09-14T11:55:28.861591+0000","last_peered":"2024-09-14T11:55:28.861591+0000","last_clean":"2024-09-14T11:55:28.861591+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:55:28.861591+0000","last_undegraded":"2024-09-14T11:55:28.861591+0000","last_fullsized":"2024-09-14T11:55:28.861591+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.092021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945893+0000","last_change":"2024-09-14T11:30:45.184179+0000","last_active":"2024-09-14T11:54:38.945893+0000","last_peered":"2024-09-14T11:54:38.945893+0000","last_clean":"2024-09-14T11:54:38.945893+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:54:38.945893+0000","last_undegraded":"2024-09-14T11:54:38.945893+0000","last_fullsized":"2024-09-14T11:54:38.945893+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.455784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869499+0000","last_change":"2024-09-14T11:43:35.607506+0000","last_active":"2024-09-14T11:55:40.869499+0000","last_peered":"2024-09-14T11:55:40.869499+0000","last_clean":"2024-09-14T11:55:40.869499+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:55:40.869499+0000","last_undegraded":"2024-09-14T11:55:40.869499+0000","last_fullsized":"2024-09-14T11:55:40.869499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:13.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879696+0000","last_change":"2024-09-14T11:32:32.583839+0000","last_active":"2024-09-14T11:56:23.879696+0000","last_peered":"2024-09-14T11:56:23.879696+0000","last_clean":"2024-09-14T11:56:23.879696+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:56:23.879696+0000","last_undegraded":"2024-09-14T11:56:23.879696+0000","last_fullsized":"2024-09-14T11:56:23.879696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:03.004208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.878633+0000","last_change":"2024-09-14T11:32:29.554290+0000","last_active":"2024-09-14T11:56:18.878633+0000","last_peered":"2024-09-14T11:56:18.878633+0000","last_clean":"2024-09-14T11:56:18.878633+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:56:18.878633+0000","last_undegraded":"2024-09-14T11:56:18.878633+0000","last_fullsized":"2024-09-14T11:56:18.878633+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:54.635912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":64,"num_write":3,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.875265+0000","last_change":"2024-09-14T11:30:45.188717+0000","last_active":"2024-09-14T11:55:53.875265+0000","last_peered":"2024-09-14T11:55:53.875265+0000","last_clean":"2024-09-14T11:55:53.875265+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:55:53.875265+0000","last_undegraded":"2024-09-14T11:55:53.875265+0000","last_fullsized":"2024-09-14T11:55:53.875265+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:22.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013869+0000","last_change":"2024-09-14T11:43:35.604229+0000","last_active":"2024-09-14T11:56:09.013869+0000","last_peered":"2024-09-14T11:56:09.013869+0000","last_clean":"2024-09-14T11:56:09.013869+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:56:09.013869+0000","last_undegraded":"2024-09-14T11:56:09.013869+0000","last_fullsized":"2024-09-14T11:56:09.013869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:36.198961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.016119+0000","last_change":"2024-09-14T11:32:32.579628+0000","last_active":"2024-09-14T11:56:24.016119+0000","last_peered":"2024-09-14T11:56:24.016119+0000","last_clean":"2024-09-14T11:56:24.016119+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:56:24.016119+0000","last_undegraded":"2024-09-14T11:56:24.016119+0000","last_fullsized":"2024-09-14T11:56:24.016119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:15.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.878920+0000","last_change":"2024-09-14T11:32:29.555597+0000","last_active":"2024-09-14T11:56:18.878920+0000","last_peered":"2024-09-14T11:56:18.878920+0000","last_clean":"2024-09-14T11:56:18.878920+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:56:18.878920+0000","last_undegraded":"2024-09-14T11:56:18.878920+0000","last_fullsized":"2024-09-14T11:56:18.878920+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:41.029993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870178+0000","last_change":"2024-09-14T11:30:45.176934+0000","last_active":"2024-09-14T11:55:45.870178+0000","last_peered":"2024-09-14T11:55:45.870178+0000","last_clean":"2024-09-14T11:55:45.870178+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:55:45.870178+0000","last_undegraded":"2024-09-14T11:55:45.870178+0000","last_fullsized":"2024-09-14T11:55:45.870178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:07.587565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.855078+0000","last_change":"2024-09-14T11:43:35.606492+0000","last_active":"2024-09-14T11:54:28.855078+0000","last_peered":"2024-09-14T11:54:28.855078+0000","last_clean":"2024-09-14T11:54:28.855078+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:54:28.855078+0000","last_undegraded":"2024-09-14T11:54:28.855078+0000","last_fullsized":"2024-09-14T11:54:28.855078+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:37.980270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.868028+0000","last_change":"2024-09-14T11:32:32.587253+0000","last_active":"2024-09-14T11:55:30.868028+0000","last_peered":"2024-09-14T11:55:30.868028+0000","last_clean":"2024-09-14T11:55:30.868028+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:55:30.868028+0000","last_undegraded":"2024-09-14T11:55:30.868028+0000","last_fullsized":"2024-09-14T11:55:30.868028+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:48.236842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.881108+0000","last_change":"2024-09-14T11:32:29.554686+0000","last_active":"2024-09-14T11:56:33.881108+0000","last_peered":"2024-09-14T11:56:33.881108+0000","last_clean":"2024-09-14T11:56:33.881108+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:56:33.881108+0000","last_undegraded":"2024-09-14T11:56:33.881108+0000","last_fullsized":"2024-09-14T11:56:33.881108+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:47.349081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874577+0000","last_change":"2024-09-14T11:30:45.181837+0000","last_active":"2024-09-14T11:55:48.874577+0000","last_peered":"2024-09-14T11:55:48.874577+0000","last_clean":"2024-09-14T11:55:48.874577+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:55:48.874577+0000","last_undegraded":"2024-09-14T11:55:48.874577+0000","last_fullsized":"2024-09-14T11:55:48.874577+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:59.286638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.855431+0000","last_change":"2024-09-14T11:43:35.601443+0000","last_active":"2024-09-14T11:54:28.855431+0000","last_peered":"2024-09-14T11:54:28.855431+0000","last_clean":"2024-09-14T11:54:28.855431+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:54:28.855431+0000","last_undegraded":"2024-09-14T11:54:28.855431+0000","last_fullsized":"2024-09-14T11:54:28.855431+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.372764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882441+0000","last_change":"2024-09-14T11:32:32.587278+0000","last_active":"2024-09-14T11:56:43.882441+0000","last_peered":"2024-09-14T11:56:43.882441+0000","last_clean":"2024-09-14T11:56:43.882441+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:56:43.882441+0000","last_undegraded":"2024-09-14T11:56:43.882441+0000","last_fullsized":"2024-09-14T11:56:43.882441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.322094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870808+0000","last_change":"2024-09-14T11:32:29.548859+0000","last_active":"2024-09-14T11:55:23.870808+0000","last_peered":"2024-09-14T11:55:23.870808+0000","last_clean":"2024-09-14T11:55:23.870808+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:55:23.870808+0000","last_undegraded":"2024-09-14T11:55:23.870808+0000","last_fullsized":"2024-09-14T11:55:23.870808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:45.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":210,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011327+0000","last_change":"2024-09-14T11:30:45.187608+0000","last_active":"2024-09-14T11:55:49.011327+0000","last_peered":"2024-09-14T11:55:49.011327+0000","last_clean":"2024-09-14T11:55:49.011327+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:55:49.011327+0000","last_undegraded":"2024-09-14T11:55:49.011327+0000","last_fullsized":"2024-09-14T11:55:49.011327+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:16.607409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.867231+0000","last_change":"2024-09-14T11:43:35.605855+0000","last_active":"2024-09-14T11:56:08.867231+0000","last_peered":"2024-09-14T11:56:08.867231+0000","last_clean":"2024-09-14T11:56:08.867231+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:56:08.867231+0000","last_undegraded":"2024-09-14T11:56:08.867231+0000","last_fullsized":"2024-09-14T11:56:08.867231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:26.463408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'2","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.951981+0000","last_change":"2024-09-14T11:32:32.590849+0000","last_active":"2024-09-14T11:55:28.951981+0000","last_peered":"2024-09-14T11:55:28.951981+0000","last_clean":"2024-09-14T11:55:28.951981+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:55:28.951981+0000","last_undegraded":"2024-09-14T11:55:28.951981+0000","last_fullsized":"2024-09-14T11:55:28.951981+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:53.175496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108940,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2166,"num_write":2,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'6","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:25.867386+0000","last_change":"2024-09-14T11:32:29.553146+0000","last_active":"2024-09-14T11:55:25.867386+0000","last_peered":"2024-09-14T11:55:25.867386+0000","last_clean":"2024-09-14T11:55:25.867386+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:55:25.867386+0000","last_undegraded":"2024-09-14T11:55:25.867386+0000","last_fullsized":"2024-09-14T11:55:25.867386+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:39.348345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":87,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954727+0000","last_change":"2024-09-14T11:30:45.183295+0000","last_active":"2024-09-14T11:55:48.954727+0000","last_peered":"2024-09-14T11:55:48.954727+0000","last_clean":"2024-09-14T11:55:48.954727+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:55:48.954727+0000","last_undegraded":"2024-09-14T11:55:48.954727+0000","last_fullsized":"2024-09-14T11:55:48.954727+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:30.030410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.878101+0000","last_change":"2024-09-14T11:43:35.604955+0000","last_active":"2024-09-14T11:56:13.878101+0000","last_peered":"2024-09-14T11:56:13.878101+0000","last_clean":"2024-09-14T11:56:13.878101+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:56:13.878101+0000","last_undegraded":"2024-09-14T11:56:13.878101+0000","last_fullsized":"2024-09-14T11:56:13.878101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.840822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'13","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:29.008243+0000","last_change":"2024-09-14T11:32:32.584702+0000","last_active":"2024-09-14T11:55:29.008243+0000","last_peered":"2024-09-14T11:55:29.008243+0000","last_clean":"2024-09-14T11:55:29.008243+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:55:29.008243+0000","last_undegraded":"2024-09-14T11:55:29.008243+0000","last_fullsized":"2024-09-14T11:55:29.008243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:19.580871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19460,"num_write":23,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951168+0000","last_change":"2024-09-14T11:32:29.553252+0000","last_active":"2024-09-14T11:55:23.951168+0000","last_peered":"2024-09-14T11:55:23.951168+0000","last_clean":"2024-09-14T11:55:23.951168+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:55:23.951168+0000","last_undegraded":"2024-09-14T11:55:23.951168+0000","last_fullsized":"2024-09-14T11:55:23.951168+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:40.879039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:20.521654+0000","last_change":"2024-09-14T11:30:45.183283+0000","last_active":"2024-09-14T11:55:20.521654+0000","last_peered":"2024-09-14T11:55:20.521654+0000","last_clean":"2024-09-14T11:55:20.521654+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:55:20.521654+0000","last_undegraded":"2024-09-14T11:55:20.521654+0000","last_fullsized":"2024-09-14T11:55:20.521654+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:00.428598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'194","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.556201+0000","last_change":"2024-09-14T11:15:32.311949+0000","last_active":"2024-09-14T11:55:17.556201+0000","last_peered":"2024-09-14T11:55:17.556201+0000","last_clean":"2024-09-14T11:55:17.556201+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:55:17.556201+0000","last_undegraded":"2024-09-14T11:55:17.556201+0000","last_fullsized":"2024-09-14T11:55:17.556201+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:25.643807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9487068,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":68162,"num_write":953,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'445","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465587+0000","last_change":"2024-09-14T11:15:34.326897+0000","last_active":"2024-09-14T11:56:38.465587+0000","last_peered":"2024-09-14T11:56:38.465587+0000","last_clean":"2024-09-14T11:56:38.465587+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:56:38.465587+0000","last_undegraded":"2024-09-14T11:56:38.465587+0000","last_fullsized":"2024-09-14T11:56:38.465587+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:44.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'194","reported_seq":838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865508+0000","last_change":"2024-09-14T11:15:32.317583+0000","last_active":"2024-09-14T11:55:10.865508+0000","last_peered":"2024-09-14T11:55:10.865508+0000","last_clean":"2024-09-14T11:55:10.865508+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:55:10.865508+0000","last_undegraded":"2024-09-14T11:55:10.865508+0000","last_fullsized":"2024-09-14T11:55:10.865508+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:37.196534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11154863,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":84673,"num_write":938,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998595+0000","last_change":"2024-09-14T11:15:34.330220+0000","last_active":"2024-09-14T11:56:36.998595+0000","last_peered":"2024-09-14T11:56:36.998595+0000","last_clean":"2024-09-14T11:56:36.998595+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:56:36.998595+0000","last_undegraded":"2024-09-14T11:56:36.998595+0000","last_fullsized":"2024-09-14T11:56:36.998595+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:39.172882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'212","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.074819+0000","last_change":"2024-09-14T11:15:32.302813+0000","last_active":"2024-09-14T11:56:39.074819+0000","last_peered":"2024-09-14T11:56:39.074819+0000","last_clean":"2024-09-14T11:56:39.074819+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:56:39.074819+0000","last_undegraded":"2024-09-14T11:56:39.074819+0000","last_fullsized":"2024-09-14T11:56:39.074819+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:48.865990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":1085,"num_write":1014,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'743","reported_seq":2196,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815132+0000","last_change":"2024-09-14T11:15:34.316987+0000","last_active":"2024-09-14T11:56:31.815132+0000","last_peered":"2024-09-14T11:56:31.815132+0000","last_clean":"2024-09-14T11:56:31.815132+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:56:31.815132+0000","last_undegraded":"2024-09-14T11:56:31.815132+0000","last_fullsized":"2024-09-14T11:56:31.815132+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:20.185745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'233","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.967008+0000","last_change":"2024-09-14T11:15:32.322744+0000","last_active":"2024-09-14T11:55:55.967008+0000","last_peered":"2024-09-14T11:55:55.967008+0000","last_clean":"2024-09-14T11:55:55.967008+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:55:55.967008+0000","last_undegraded":"2024-09-14T11:55:55.967008+0000","last_fullsized":"2024-09-14T11:55:55.967008+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:12.738315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957164,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":528,"num_read_kb":30923,"num_write":1125,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2085,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136947+0000","last_change":"2024-09-14T11:15:34.323811+0000","last_active":"2024-09-14T11:56:39.136947+0000","last_peered":"2024-09-14T11:56:39.136947+0000","last_clean":"2024-09-14T11:56:39.136947+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:56:39.136947+0000","last_undegraded":"2024-09-14T11:56:39.136947+0000","last_fullsized":"2024-09-14T11:56:39.136947+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.122736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'216","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872289+0000","last_change":"2024-09-14T11:15:32.313227+0000","last_active":"2024-09-14T11:55:33.872289+0000","last_peered":"2024-09-14T11:55:33.872289+0000","last_clean":"2024-09-14T11:55:33.872289+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:55:33.872289+0000","last_undegraded":"2024-09-14T11:55:33.872289+0000","last_fullsized":"2024-09-14T11:55:33.872289+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:24.665300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'966","reported_seq":2607,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518596+0000","last_change":"2024-09-14T11:15:34.323939+0000","last_active":"2024-09-14T11:56:33.518596+0000","last_peered":"2024-09-14T11:56:33.518596+0000","last_clean":"2024-09-14T11:56:33.518596+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:56:33.518596+0000","last_undegraded":"2024-09-14T11:56:33.518596+0000","last_fullsized":"2024-09-14T11:56:33.518596+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:54.340034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'178","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.486361+0000","last_change":"2024-09-14T11:15:32.323327+0000","last_active":"2024-09-14T11:56:28.486361+0000","last_peered":"2024-09-14T11:56:28.486361+0000","last_clean":"2024-09-14T11:56:28.486361+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:56:28.486361+0000","last_undegraded":"2024-09-14T11:56:28.486361+0000","last_fullsized":"2024-09-14T11:56:28.486361+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:45.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4279447,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":540,"num_read_kb":10177,"num_write":895,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466977+0000","last_change":"2024-09-14T11:15:34.316280+0000","last_active":"2024-09-14T11:58:14.466977+0000","last_peered":"2024-09-14T11:58:14.466977+0000","last_clean":"2024-09-14T11:58:14.466977+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:58:14.466977+0000","last_undegraded":"2024-09-14T11:58:14.466977+0000","last_fullsized":"2024-09-14T11:58:14.466977+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:00.310713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'189","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.439143+0000","last_change":"2024-09-14T11:15:32.317672+0000","last_active":"2024-09-14T11:56:22.439143+0000","last_peered":"2024-09-14T11:56:22.439143+0000","last_clean":"2024-09-14T11:56:22.439143+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:56:22.439143+0000","last_undegraded":"2024-09-14T11:56:22.439143+0000","last_fullsized":"2024-09-14T11:56:22.439143+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:04.495027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9687544,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":12539,"num_write":920,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'490","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465061+0000","last_change":"2024-09-14T11:15:34.328589+0000","last_active":"2024-09-14T11:56:38.465061+0000","last_peered":"2024-09-14T11:56:38.465061+0000","last_clean":"2024-09-14T11:56:38.465061+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:56:38.465061+0000","last_undegraded":"2024-09-14T11:56:38.465061+0000","last_fullsized":"2024-09-14T11:56:38.465061+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.473320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'213","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.120521+0000","last_change":"2024-09-14T11:15:32.320364+0000","last_active":"2024-09-14T11:55:48.120521+0000","last_peered":"2024-09-14T11:55:48.120521+0000","last_clean":"2024-09-14T11:55:48.120521+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:55:48.120521+0000","last_undegraded":"2024-09-14T11:55:48.120521+0000","last_fullsized":"2024-09-14T11:55:48.120521+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:11.338356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4594609,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":31152,"num_write":976,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'593","reported_seq":2457,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882772+0000","last_change":"2024-09-14T11:16:07.517907+0000","last_active":"2024-09-14T11:56:54.882772+0000","last_peered":"2024-09-14T11:56:54.882772+0000","last_clean":"2024-09-14T11:56:54.882772+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:56:54.882772+0000","last_undegraded":"2024-09-14T11:56:54.882772+0000","last_fullsized":"2024-09-14T11:56:54.882772+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:13.243462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466795+0000","last_change":"2024-09-14T11:15:34.313439+0000","last_active":"2024-09-14T11:58:14.466795+0000","last_peered":"2024-09-14T11:58:14.466795+0000","last_clean":"2024-09-14T11:58:14.466795+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:58:14.466795+0000","last_undegraded":"2024-09-14T11:58:14.466795+0000","last_fullsized":"2024-09-14T11:58:14.466795+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:34.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'221","reported_seq":838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.617964+0000","last_change":"2024-09-14T11:15:32.319484+0000","last_active":"2024-09-14T11:56:35.617964+0000","last_peered":"2024-09-14T11:56:35.617964+0000","last_clean":"2024-09-14T11:56:35.617964+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:56:35.617964+0000","last_undegraded":"2024-09-14T11:56:35.617964+0000","last_fullsized":"2024-09-14T11:56:35.617964+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:12.735898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4728445,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":556,"num_read_kb":8015,"num_write":1055,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'455","reported_seq":2042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.991606+0000","last_change":"2024-09-14T11:15:34.330160+0000","last_active":"2024-09-14T11:56:56.991606+0000","last_peered":"2024-09-14T11:56:56.991606+0000","last_clean":"2024-09-14T11:56:56.991606+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:56:56.991606+0000","last_undegraded":"2024-09-14T11:56:56.991606+0000","last_fullsized":"2024-09-14T11:56:56.991606+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:22.426308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'220","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.751609+0000","last_change":"2024-09-14T11:15:32.315600+0000","last_active":"2024-09-14T11:56:31.751609+0000","last_peered":"2024-09-14T11:56:31.751609+0000","last_clean":"2024-09-14T11:56:31.751609+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:56:31.751609+0000","last_undegraded":"2024-09-14T11:56:31.751609+0000","last_fullsized":"2024-09-14T11:56:31.751609+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:22.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":24963,"num_write":1048,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'441","reported_seq":1986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.890926+0000","last_change":"2024-09-14T11:15:34.326565+0000","last_active":"2024-09-14T11:57:43.890926+0000","last_peered":"2024-09-14T11:57:43.890926+0000","last_clean":"2024-09-14T11:57:43.890926+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:57:43.890926+0000","last_undegraded":"2024-09-14T11:57:43.890926+0000","last_fullsized":"2024-09-14T11:57:43.890926+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:36.647727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'205","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.932757+0000","last_change":"2024-09-14T11:15:32.315148+0000","last_active":"2024-09-14T11:56:36.932757+0000","last_peered":"2024-09-14T11:56:36.932757+0000","last_clean":"2024-09-14T11:56:36.932757+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:56:36.932757+0000","last_undegraded":"2024-09-14T11:56:36.932757+0000","last_fullsized":"2024-09-14T11:56:36.932757+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:49.800357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274173,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17257,"num_write":953,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'393","reported_seq":1858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465278+0000","last_change":"2024-09-14T11:15:34.323271+0000","last_active":"2024-09-14T11:56:38.465278+0000","last_peered":"2024-09-14T11:56:38.465278+0000","last_clean":"2024-09-14T11:56:38.465278+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:56:38.465278+0000","last_undegraded":"2024-09-14T11:56:38.465278+0000","last_fullsized":"2024-09-14T11:56:38.465278+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:05.710670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'250","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.153294+0000","last_change":"2024-09-14T11:15:32.313147+0000","last_active":"2024-09-14T11:56:20.153294+0000","last_peered":"2024-09-14T11:56:20.153294+0000","last_clean":"2024-09-14T11:56:20.153294+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:56:20.153294+0000","last_undegraded":"2024-09-14T11:56:20.153294+0000","last_fullsized":"2024-09-14T11:56:20.153294+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:40.375363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8378626,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":644,"num_read_kb":20644,"num_write":1060,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.129016+0000","last_change":"2024-09-14T11:15:34.315634+0000","last_active":"2024-09-14T11:56:39.129016+0000","last_peered":"2024-09-14T11:56:39.129016+0000","last_clean":"2024-09-14T11:56:39.129016+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:56:39.129016+0000","last_undegraded":"2024-09-14T11:56:39.129016+0000","last_fullsized":"2024-09-14T11:56:39.129016+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'282","reported_seq":1022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.080467+0000","last_change":"2024-09-14T11:15:32.317614+0000","last_active":"2024-09-14T11:56:52.080467+0000","last_peered":"2024-09-14T11:56:52.080467+0000","last_clean":"2024-09-14T11:56:52.080467+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:56:52.080467+0000","last_undegraded":"2024-09-14T11:56:52.080467+0000","last_fullsized":"2024-09-14T11:56:52.080467+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:00.703910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14529092,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1010,"num_read_kb":39546,"num_write":1286,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'571","reported_seq":2414,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456133+0000","last_change":"2024-09-14T11:15:34.328085+0000","last_active":"2024-09-14T11:58:14.456133+0000","last_peered":"2024-09-14T11:58:14.456133+0000","last_clean":"2024-09-14T11:58:14.456133+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:58:14.456133+0000","last_undegraded":"2024-09-14T11:58:14.456133+0000","last_fullsized":"2024-09-14T11:58:14.456133+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:40.805688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'227","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.457817+0000","last_change":"2024-09-14T11:15:32.309339+0000","last_active":"2024-09-14T11:58:13.457817+0000","last_peered":"2024-09-14T11:58:13.457817+0000","last_clean":"2024-09-14T11:58:13.457817+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:58:13.457817+0000","last_undegraded":"2024-09-14T11:58:13.457817+0000","last_fullsized":"2024-09-14T11:58:13.457817+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:16.044046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9003847,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":31277,"num_write":1073,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.583992+0000","last_change":"2024-09-14T11:15:42.348963+0000","last_active":"2024-09-14T11:56:57.583992+0000","last_peered":"2024-09-14T11:56:57.583992+0000","last_clean":"2024-09-14T11:56:57.583992+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:56:57.583992+0000","last_undegraded":"2024-09-14T11:56:57.583992+0000","last_fullsized":"2024-09-14T11:56:57.583992+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:41.155224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'823","reported_seq":2528,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883828+0000","last_change":"2024-09-14T11:15:34.329854+0000","last_active":"2024-09-14T11:56:54.883828+0000","last_peered":"2024-09-14T11:56:54.883828+0000","last_clean":"2024-09-14T11:56:54.883828+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:56:54.883828+0000","last_undegraded":"2024-09-14T11:56:54.883828+0000","last_fullsized":"2024-09-14T11:56:54.883828+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:48.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'194","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.175364+0000","last_change":"2024-09-14T11:15:32.318773+0000","last_active":"2024-09-14T11:56:12.175364+0000","last_peered":"2024-09-14T11:56:12.175364+0000","last_clean":"2024-09-14T11:56:12.175364+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:56:12.175364+0000","last_undegraded":"2024-09-14T11:56:12.175364+0000","last_fullsized":"2024-09-14T11:56:12.175364+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:41.470746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314134,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":881,"num_read_kb":29517,"num_write":950,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861599+0000","last_change":"2024-09-14T11:15:36.329405+0000","last_active":"2024-09-14T11:54:18.861599+0000","last_peered":"2024-09-14T11:54:18.861599+0000","last_clean":"2024-09-14T11:54:18.861599+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:54:18.861599+0000","last_undegraded":"2024-09-14T11:54:18.861599+0000","last_fullsized":"2024-09-14T11:54:18.861599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.437495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'196","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.823610+0000","last_change":"2024-09-14T11:15:38.337357+0000","last_active":"2024-09-14T11:56:54.823610+0000","last_peered":"2024-09-14T11:56:54.823610+0000","last_clean":"2024-09-14T11:56:54.823610+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:56:54.823610+0000","last_undegraded":"2024-09-14T11:56:54.823610+0000","last_fullsized":"2024-09-14T11:56:54.823610+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.259312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":248,"num_write":148,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.862314+0000","last_change":"2024-09-14T11:15:40.343299+0000","last_active":"2024-09-14T11:54:23.862314+0000","last_peered":"2024-09-14T11:54:23.862314+0000","last_clean":"2024-09-14T11:54:23.862314+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:54:23.862314+0000","last_undegraded":"2024-09-14T11:54:23.862314+0000","last_fullsized":"2024-09-14T11:54:23.862314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:21.470841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2483","reported_seq":4315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884659+0000","last_change":"2024-09-14T11:15:42.346740+0000","last_active":"2024-09-14T11:56:58.884659+0000","last_peered":"2024-09-14T11:56:58.884659+0000","last_clean":"2024-09-14T11:56:58.884659+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:56:58.884659+0000","last_undegraded":"2024-09-14T11:56:58.884659+0000","last_fullsized":"2024-09-14T11:56:58.884659+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":2400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:08.150839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'431","reported_seq":2262,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.519771+0000","last_change":"2024-09-14T11:15:34.327076+0000","last_active":"2024-09-14T11:56:57.519771+0000","last_peered":"2024-09-14T11:56:57.519771+0000","last_clean":"2024-09-14T11:56:57.519771+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:56:57.519771+0000","last_undegraded":"2024-09-14T11:56:57.519771+0000","last_fullsized":"2024-09-14T11:56:57.519771+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:08.246401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'262","reported_seq":952,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.022548+0000","last_change":"2024-09-14T11:15:32.308280+0000","last_active":"2024-09-14T11:55:18.022548+0000","last_peered":"2024-09-14T11:55:18.022548+0000","last_clean":"2024-09-14T11:55:18.022548+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:55:18.022548+0000","last_undegraded":"2024-09-14T11:55:18.022548+0000","last_fullsized":"2024-09-14T11:55:18.022548+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:16.723135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6141367,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":737,"num_read_kb":16466,"num_write":1197,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.872400+0000","last_change":"2024-09-14T11:15:36.334689+0000","last_active":"2024-09-14T11:55:28.872400+0000","last_peered":"2024-09-14T11:55:28.872400+0000","last_clean":"2024-09-14T11:55:28.872400+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:55:28.872400+0000","last_undegraded":"2024-09-14T11:55:28.872400+0000","last_fullsized":"2024-09-14T11:55:28.872400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.914528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'91","reported_seq":605,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.185623+0000","last_change":"2024-09-14T11:15:38.334852+0000","last_active":"2024-09-14T11:55:48.185623+0000","last_peered":"2024-09-14T11:55:48.185623+0000","last_clean":"2024-09-14T11:55:48.185623+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:55:48.185623+0000","last_undegraded":"2024-09-14T11:55:48.185623+0000","last_fullsized":"2024-09-14T11:55:48.185623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:06.733877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.000326+0000","last_change":"2024-09-14T11:15:40.346053+0000","last_active":"2024-09-14T11:54:24.000326+0000","last_peered":"2024-09-14T11:54:24.000326+0000","last_clean":"2024-09-14T11:54:24.000326+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:54:24.000326+0000","last_undegraded":"2024-09-14T11:54:24.000326+0000","last_fullsized":"2024-09-14T11:54:24.000326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.054969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'107","reported_seq":595,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.810718+0000","last_change":"2024-09-14T11:15:42.347308+0000","last_active":"2024-09-14T11:56:31.810718+0000","last_peered":"2024-09-14T11:56:31.810718+0000","last_clean":"2024-09-14T11:56:31.810718+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:56:31.810718+0000","last_undegraded":"2024-09-14T11:56:31.810718+0000","last_fullsized":"2024-09-14T11:56:31.810718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:53.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'424","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883698+0000","last_change":"2024-09-14T11:15:34.328884+0000","last_active":"2024-09-14T11:56:54.883698+0000","last_peered":"2024-09-14T11:56:54.883698+0000","last_clean":"2024-09-14T11:56:54.883698+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:56:54.883698+0000","last_undegraded":"2024-09-14T11:56:54.883698+0000","last_fullsized":"2024-09-14T11:56:54.883698+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'186","reported_seq":796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:47.557485+0000","last_change":"2024-09-14T11:15:32.316916+0000","last_active":"2024-09-14T11:55:47.557485+0000","last_peered":"2024-09-14T11:55:47.557485+0000","last_clean":"2024-09-14T11:55:47.557485+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:55:47.557485+0000","last_undegraded":"2024-09-14T11:55:47.557485+0000","last_fullsized":"2024-09-14T11:55:47.557485+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:45.239724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":30179,"num_write":920,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"36'3","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.319326+0000","last_change":"2024-09-14T11:15:36.333013+0000","last_active":"2024-09-14T11:58:15.319326+0000","last_peered":"2024-09-14T11:58:15.319326+0000","last_clean":"2024-09-14T11:58:15.319326+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:58:15.319326+0000","last_undegraded":"2024-09-14T11:58:15.319326+0000","last_fullsized":"2024-09-14T11:58:15.319326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.296621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'115","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.680045+0000","last_change":"2024-09-14T11:15:38.337017+0000","last_active":"2024-09-14T11:56:32.680045+0000","last_peered":"2024-09-14T11:56:32.680045+0000","last_clean":"2024-09-14T11:56:32.680045+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:56:32.680045+0000","last_undegraded":"2024-09-14T11:56:32.680045+0000","last_fullsized":"2024-09-14T11:56:32.680045+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.412101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'748","reported_seq":2522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842710+0000","last_change":"2024-09-14T11:15:40.343642+0000","last_active":"2024-09-14T11:58:15.842710+0000","last_peered":"2024-09-14T11:58:15.842710+0000","last_clean":"2024-09-14T11:58:15.842710+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:58:15.842710+0000","last_undegraded":"2024-09-14T11:58:15.842710+0000","last_fullsized":"2024-09-14T11:58:15.842710+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.527132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'193","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.636145+0000","last_change":"2024-09-14T11:15:42.341730+0000","last_active":"2024-09-14T11:56:57.636145+0000","last_peered":"2024-09-14T11:56:57.636145+0000","last_clean":"2024-09-14T11:56:57.636145+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:56:57.636145+0000","last_undegraded":"2024-09-14T11:56:57.636145+0000","last_fullsized":"2024-09-14T11:56:57.636145+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.359150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1027","reported_seq":2587,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.126763+0000","last_change":"2024-09-14T11:15:34.325968+0000","last_active":"2024-09-14T11:56:39.126763+0000","last_peered":"2024-09-14T11:56:39.126763+0000","last_clean":"2024-09-14T11:56:39.126763+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:56:39.126763+0000","last_undegraded":"2024-09-14T11:56:39.126763+0000","last_fullsized":"2024-09-14T11:56:39.126763+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:31.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'192","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.932639+0000","last_change":"2024-09-14T11:15:32.317790+0000","last_active":"2024-09-14T11:56:16.932639+0000","last_peered":"2024-09-14T11:56:16.932639+0000","last_clean":"2024-09-14T11:56:16.932639+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:56:16.932639+0000","last_undegraded":"2024-09-14T11:56:16.932639+0000","last_fullsized":"2024-09-14T11:56:16.932639+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:32.748526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421713,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":5281,"num_write":855,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861627+0000","last_change":"2024-09-14T11:15:36.330106+0000","last_active":"2024-09-14T11:54:18.861627+0000","last_peered":"2024-09-14T11:54:18.861627+0000","last_clean":"2024-09-14T11:54:18.861627+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:54:18.861627+0000","last_undegraded":"2024-09-14T11:54:18.861627+0000","last_fullsized":"2024-09-14T11:54:18.861627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:38.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'119","reported_seq":671,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882554+0000","last_change":"2024-09-14T11:15:38.337426+0000","last_active":"2024-09-14T11:56:43.882554+0000","last_peered":"2024-09-14T11:56:43.882554+0000","last_clean":"2024-09-14T11:56:43.882554+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:56:43.882554+0000","last_undegraded":"2024-09-14T11:56:43.882554+0000","last_fullsized":"2024-09-14T11:56:43.882554+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:10.689123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":161,"num_write":72,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'809","reported_seq":2224,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.843154+0000","last_change":"2024-09-14T11:15:40.349078+0000","last_active":"2024-09-14T11:58:15.843154+0000","last_peered":"2024-09-14T11:58:15.843154+0000","last_clean":"2024-09-14T11:58:15.843154+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:58:15.843154+0000","last_undegraded":"2024-09-14T11:58:15.843154+0000","last_fullsized":"2024-09-14T11:58:15.843154+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:29.118650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'734","reported_seq":2277,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465422+0000","last_change":"2024-09-14T11:15:34.326626+0000","last_active":"2024-09-14T11:56:38.465422+0000","last_peered":"2024-09-14T11:56:38.465422+0000","last_clean":"2024-09-14T11:56:38.465422+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:56:38.465422+0000","last_undegraded":"2024-09-14T11:56:38.465422+0000","last_fullsized":"2024-09-14T11:56:38.465422+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:29.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'202","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.925790+0000","last_change":"2024-09-14T11:15:32.318817+0000","last_active":"2024-09-14T11:58:06.925790+0000","last_peered":"2024-09-14T11:58:06.925790+0000","last_clean":"2024-09-14T11:58:06.925790+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:06.925790+0000","last_undegraded":"2024-09-14T11:58:06.925790+0000","last_fullsized":"2024-09-14T11:58:06.925790+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:39.582918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1378406,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":726,"num_read_kb":30459,"num_write":895,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864459+0000","last_change":"2024-09-14T11:15:36.334240+0000","last_active":"2024-09-14T11:54:38.864459+0000","last_peered":"2024-09-14T11:54:38.864459+0000","last_clean":"2024-09-14T11:54:38.864459+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:54:38.864459+0000","last_undegraded":"2024-09-14T11:54:38.864459+0000","last_fullsized":"2024-09-14T11:54:38.864459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:52.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'209","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884714+0000","last_change":"2024-09-14T11:15:38.335040+0000","last_active":"2024-09-14T11:56:58.884714+0000","last_peered":"2024-09-14T11:56:58.884714+0000","last_clean":"2024-09-14T11:56:58.884714+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:56:58.884714+0000","last_undegraded":"2024-09-14T11:56:58.884714+0000","last_fullsized":"2024-09-14T11:56:58.884714+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.960934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14935,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":278,"num_read_kb":338,"num_write":166,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.873529+0000","last_change":"2024-09-14T11:15:40.345833+0000","last_active":"2024-09-14T11:56:10.873529+0000","last_peered":"2024-09-14T11:56:10.873529+0000","last_clean":"2024-09-14T11:56:10.873529+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:56:10.873529+0000","last_undegraded":"2024-09-14T11:56:10.873529+0000","last_fullsized":"2024-09-14T11:56:10.873529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'552","reported_seq":1347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801804+0000","last_change":"2024-09-14T11:15:42.350220+0000","last_active":"2024-09-14T11:58:15.801804+0000","last_peered":"2024-09-14T11:58:15.801804+0000","last_clean":"2024-09-14T11:58:15.801804+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:58:15.801804+0000","last_undegraded":"2024-09-14T11:58:15.801804+0000","last_fullsized":"2024-09-14T11:58:15.801804+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:29.655558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'833","reported_seq":2317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.019226+0000","last_change":"2024-09-14T11:15:34.329906+0000","last_active":"2024-09-14T11:56:44.019226+0000","last_peered":"2024-09-14T11:56:44.019226+0000","last_clean":"2024-09-14T11:56:44.019226+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:56:44.019226+0000","last_undegraded":"2024-09-14T11:56:44.019226+0000","last_fullsized":"2024-09-14T11:56:44.019226+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:09.186132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'283","reported_seq":924,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.876535+0000","last_change":"2024-09-14T11:15:32.321404+0000","last_active":"2024-09-14T11:56:03.876535+0000","last_peered":"2024-09-14T11:56:03.876535+0000","last_clean":"2024-09-14T11:56:03.876535+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:56:03.876535+0000","last_undegraded":"2024-09-14T11:56:03.876535+0000","last_fullsized":"2024-09-14T11:56:03.876535+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:33.160296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5250566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":15958,"num_write":1144,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856235+0000","last_change":"2024-09-14T11:15:36.323224+0000","last_active":"2024-09-14T11:54:38.856235+0000","last_peered":"2024-09-14T11:54:38.856235+0000","last_clean":"2024-09-14T11:54:38.856235+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:54:38.856235+0000","last_undegraded":"2024-09-14T11:54:38.856235+0000","last_fullsized":"2024-09-14T11:54:38.856235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:40.252261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'116","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.766607+0000","last_change":"2024-09-14T11:15:38.336933+0000","last_active":"2024-09-14T11:58:15.766607+0000","last_peered":"2024-09-14T11:58:15.766607+0000","last_clean":"2024-09-14T11:58:15.766607+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:58:15.766607+0000","last_undegraded":"2024-09-14T11:58:15.766607+0000","last_fullsized":"2024-09-14T11:58:15.766607+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.373870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":179,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867935+0000","last_change":"2024-09-14T11:15:40.349051+0000","last_active":"2024-09-14T11:54:53.867935+0000","last_peered":"2024-09-14T11:54:53.867935+0000","last_clean":"2024-09-14T11:54:53.867935+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:54:53.867935+0000","last_undegraded":"2024-09-14T11:54:53.867935+0000","last_fullsized":"2024-09-14T11:54:53.867935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.147760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'124","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.968464+0000","last_change":"2024-09-14T11:15:42.351151+0000","last_active":"2024-09-14T11:57:28.968464+0000","last_peered":"2024-09-14T11:57:28.968464+0000","last_clean":"2024-09-14T11:57:28.968464+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:57:28.968464+0000","last_undegraded":"2024-09-14T11:57:28.968464+0000","last_fullsized":"2024-09-14T11:57:28.968464+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:13.693118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'688","reported_seq":2326,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456533+0000","last_change":"2024-09-14T11:15:34.331821+0000","last_active":"2024-09-14T11:58:14.456533+0000","last_peered":"2024-09-14T11:58:14.456533+0000","last_clean":"2024-09-14T11:58:14.456533+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:58:14.456533+0000","last_undegraded":"2024-09-14T11:58:14.456533+0000","last_fullsized":"2024-09-14T11:58:14.456533+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:17.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'233","reported_seq":862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.451832+0000","last_change":"2024-09-14T11:16:07.518583+0000","last_active":"2024-09-14T11:56:33.451832+0000","last_peered":"2024-09-14T11:56:33.451832+0000","last_clean":"2024-09-14T11:56:33.451832+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:56:33.451832+0000","last_undegraded":"2024-09-14T11:56:33.451832+0000","last_fullsized":"2024-09-14T11:56:33.451832+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:49.410450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":671,"num_read_kb":32200,"num_write":1032,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866558+0000","last_change":"2024-09-14T11:15:36.326783+0000","last_active":"2024-09-14T11:56:08.866558+0000","last_peered":"2024-09-14T11:56:08.866558+0000","last_clean":"2024-09-14T11:56:08.866558+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:56:08.866558+0000","last_undegraded":"2024-09-14T11:56:08.866558+0000","last_fullsized":"2024-09-14T11:56:08.866558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'163","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.883105+0000","last_change":"2024-09-14T11:15:38.339476+0000","last_active":"2024-09-14T11:56:48.883105+0000","last_peered":"2024-09-14T11:56:48.883105+0000","last_clean":"2024-09-14T11:56:48.883105+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:56:48.883105+0000","last_undegraded":"2024-09-14T11:56:48.883105+0000","last_fullsized":"2024-09-14T11:56:48.883105+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:23.876347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22913,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":280,"num_write":118,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'800","reported_seq":4156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842862+0000","last_change":"2024-09-14T11:15:40.344136+0000","last_active":"2024-09-14T11:58:15.842862+0000","last_peered":"2024-09-14T11:58:15.842862+0000","last_clean":"2024-09-14T11:58:15.842862+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:58:15.842862+0000","last_undegraded":"2024-09-14T11:58:15.842862+0000","last_fullsized":"2024-09-14T11:58:15.842862+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:19.808946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'140","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.396582+0000","last_change":"2024-09-14T11:15:42.354873+0000","last_active":"2024-09-14T11:58:14.396582+0000","last_peered":"2024-09-14T11:58:14.396582+0000","last_clean":"2024-09-14T11:58:14.396582+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:58:14.396582+0000","last_undegraded":"2024-09-14T11:58:14.396582+0000","last_fullsized":"2024-09-14T11:58:14.396582+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:42.946889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.123392+0000","last_change":"2024-09-14T11:15:34.330206+0000","last_active":"2024-09-14T11:56:27.123392+0000","last_peered":"2024-09-14T11:56:27.123392+0000","last_clean":"2024-09-14T11:56:27.123392+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:56:27.123392+0000","last_undegraded":"2024-09-14T11:56:27.123392+0000","last_fullsized":"2024-09-14T11:56:27.123392+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:08.630914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'258","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:04.881290+0000","last_change":"2024-09-14T11:16:07.390362+0000","last_active":"2024-09-14T11:58:04.881290+0000","last_peered":"2024-09-14T11:58:04.881290+0000","last_clean":"2024-09-14T11:58:04.881290+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:04.881290+0000","last_undegraded":"2024-09-14T11:58:04.881290+0000","last_fullsized":"2024-09-14T11:58:04.881290+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:12.368811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8039247,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":835,"num_read_kb":40477,"num_write":1084,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856857+0000","last_change":"2024-09-14T11:15:36.330224+0000","last_active":"2024-09-14T11:54:43.856857+0000","last_peered":"2024-09-14T11:54:43.856857+0000","last_clean":"2024-09-14T11:54:43.856857+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:54:43.856857+0000","last_undegraded":"2024-09-14T11:54:43.856857+0000","last_fullsized":"2024-09-14T11:54:43.856857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.235014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'196","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.770042+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:58:15.770042+0000","last_peered":"2024-09-14T11:58:15.770042+0000","last_clean":"2024-09-14T11:58:15.770042+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:58:15.770042+0000","last_undegraded":"2024-09-14T11:58:15.770042+0000","last_fullsized":"2024-09-14T11:58:15.770042+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:38.723325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72046,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":490,"num_write":144,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856808+0000","last_change":"2024-09-14T11:15:40.342222+0000","last_active":"2024-09-14T11:54:43.856808+0000","last_peered":"2024-09-14T11:54:43.856808+0000","last_clean":"2024-09-14T11:54:43.856808+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:54:43.856808+0000","last_undegraded":"2024-09-14T11:54:43.856808+0000","last_fullsized":"2024-09-14T11:54:43.856808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:48.145919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'132","reported_seq":645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:54.698739+0000","last_change":"2024-09-14T11:15:42.350823+0000","last_active":"2024-09-14T11:55:54.698739+0000","last_peered":"2024-09-14T11:55:54.698739+0000","last_clean":"2024-09-14T11:55:54.698739+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:55:54.698739+0000","last_undegraded":"2024-09-14T11:55:54.698739+0000","last_fullsized":"2024-09-14T11:55:54.698739+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:46.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'485","reported_seq":2086,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321026+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:42.583484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'216","reported_seq":916,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877337+0000","last_change":"2024-09-14T11:15:32.318996+0000","last_active":"2024-09-14T11:56:03.877337+0000","last_peered":"2024-09-14T11:56:03.877337+0000","last_clean":"2024-09-14T11:56:03.877337+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:56:03.877337+0000","last_undegraded":"2024-09-14T11:56:03.877337+0000","last_fullsized":"2024-09-14T11:56:03.877337+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:29.686806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24803905,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":665,"num_read_kb":211571,"num_write":947,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866594+0000","last_change":"2024-09-14T11:15:36.334662+0000","last_active":"2024-09-14T11:56:08.866594+0000","last_peered":"2024-09-14T11:56:08.866594+0000","last_clean":"2024-09-14T11:56:08.866594+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:56:08.866594+0000","last_undegraded":"2024-09-14T11:56:08.866594+0000","last_fullsized":"2024-09-14T11:56:08.866594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'139","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.770844+0000","last_change":"2024-09-14T11:15:38.335114+0000","last_active":"2024-09-14T11:58:15.770844+0000","last_peered":"2024-09-14T11:58:15.770844+0000","last_clean":"2024-09-14T11:58:15.770844+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:58:15.770844+0000","last_undegraded":"2024-09-14T11:58:15.770844+0000","last_fullsized":"2024-09-14T11:58:15.770844+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:02.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":262,"num_write":164,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868727+0000","last_change":"2024-09-14T11:15:40.352052+0000","last_active":"2024-09-14T11:56:18.868727+0000","last_peered":"2024-09-14T11:56:18.868727+0000","last_clean":"2024-09-14T11:56:18.868727+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:56:18.868727+0000","last_undegraded":"2024-09-14T11:56:18.868727+0000","last_fullsized":"2024-09-14T11:56:18.868727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:06.160840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'120","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.892807+0000","last_change":"2024-09-14T11:15:42.350884+0000","last_active":"2024-09-14T11:57:53.892807+0000","last_peered":"2024-09-14T11:57:53.892807+0000","last_clean":"2024-09-14T11:57:53.892807+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:57:53.892807+0000","last_undegraded":"2024-09-14T11:57:53.892807+0000","last_fullsized":"2024-09-14T11:57:53.892807+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.299714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'399","reported_seq":2034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.814843+0000","last_change":"2024-09-14T11:15:34.315484+0000","last_active":"2024-09-14T11:56:31.814843+0000","last_peered":"2024-09-14T11:56:31.814843+0000","last_clean":"2024-09-14T11:56:31.814843+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:56:31.814843+0000","last_undegraded":"2024-09-14T11:56:31.814843+0000","last_fullsized":"2024-09-14T11:56:31.814843+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:48.314937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'218","reported_seq":1028,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.985453+0000","last_change":"2024-09-14T11:15:32.316393+0000","last_active":"2024-09-14T11:58:09.985453+0000","last_peered":"2024-09-14T11:58:09.985453+0000","last_clean":"2024-09-14T11:58:09.985453+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:09.985453+0000","last_undegraded":"2024-09-14T11:58:09.985453+0000","last_fullsized":"2024-09-14T11:58:09.985453+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:19.207524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973023,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1174,"num_read_kb":14840,"num_write":1003,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872741+0000","last_change":"2024-09-14T11:15:36.331915+0000","last_active":"2024-09-14T11:56:05.872741+0000","last_peered":"2024-09-14T11:56:05.872741+0000","last_clean":"2024-09-14T11:56:05.872741+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:56:05.872741+0000","last_undegraded":"2024-09-14T11:56:05.872741+0000","last_fullsized":"2024-09-14T11:56:05.872741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:44.896969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'159","reported_seq":734,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.799963+0000","last_change":"2024-09-14T11:15:38.333787+0000","last_active":"2024-09-14T11:58:15.799963+0000","last_peered":"2024-09-14T11:58:15.799963+0000","last_clean":"2024-09-14T11:58:15.799963+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:58:15.799963+0000","last_undegraded":"2024-09-14T11:58:15.799963+0000","last_fullsized":"2024-09-14T11:58:15.799963+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12670,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":287,"num_write":126,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'734","reported_seq":2515,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:16.100715+0000","last_change":"2024-09-14T11:15:40.337972+0000","last_active":"2024-09-14T11:58:16.100715+0000","last_peered":"2024-09-14T11:58:16.100715+0000","last_clean":"2024-09-14T11:58:16.100715+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:58:16.100715+0000","last_undegraded":"2024-09-14T11:58:16.100715+0000","last_fullsized":"2024-09-14T11:58:16.100715+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:41.159033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.461101+0000","last_change":"2024-09-14T11:15:42.355458+0000","last_active":"2024-09-14T11:56:38.461101+0000","last_peered":"2024-09-14T11:56:38.461101+0000","last_clean":"2024-09-14T11:56:38.461101+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:56:38.461101+0000","last_undegraded":"2024-09-14T11:56:38.461101+0000","last_fullsized":"2024-09-14T11:56:38.461101+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:20.221336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1221","reported_seq":2786,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321994+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.102163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'198","reported_seq":814,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.001730+0000","last_change":"2024-09-14T11:15:32.310048+0000","last_active":"2024-09-14T11:54:34.001730+0000","last_peered":"2024-09-14T11:54:34.001730+0000","last_clean":"2024-09-14T11:54:34.001730+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:54:34.001730+0000","last_undegraded":"2024-09-14T11:54:34.001730+0000","last_fullsized":"2024-09-14T11:54:34.001730+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.033083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1757315,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":33043,"num_write":875,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1432,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.748939+0000","last_change":"2024-09-14T11:15:36.330154+0000","last_active":"2024-09-14T11:58:15.748939+0000","last_peered":"2024-09-14T11:58:15.748939+0000","last_clean":"2024-09-14T11:58:15.748939+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:58:15.748939+0000","last_undegraded":"2024-09-14T11:58:15.748939+0000","last_fullsized":"2024-09-14T11:58:15.748939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":947,"num_read_kb":947,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'89","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.878066+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:56:08.878066+0000","last_peered":"2024-09-14T11:56:08.878066+0000","last_clean":"2024-09-14T11:56:08.878066+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:56:08.878066+0000","last_undegraded":"2024-09-14T11:56:08.878066+0000","last_fullsized":"2024-09-14T11:56:08.878066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.353564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'766","reported_seq":2230,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:16.101716+0000","last_change":"2024-09-14T11:15:40.344574+0000","last_active":"2024-09-14T11:58:16.101716+0000","last_peered":"2024-09-14T11:58:16.101716+0000","last_clean":"2024-09-14T11:58:16.101716+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:58:16.101716+0000","last_undegraded":"2024-09-14T11:58:16.101716+0000","last_fullsized":"2024-09-14T11:58:16.101716+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:07.380196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'148","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.994130+0000","last_change":"2024-09-14T11:15:42.354665+0000","last_active":"2024-09-14T11:56:36.994130+0000","last_peered":"2024-09-14T11:56:36.994130+0000","last_clean":"2024-09-14T11:56:36.994130+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:56:36.994130+0000","last_undegraded":"2024-09-14T11:56:36.994130+0000","last_fullsized":"2024-09-14T11:56:36.994130+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:56.500802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'422","reported_seq":2140,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992323+0000","last_change":"2024-09-14T11:15:34.335198+0000","last_active":"2024-09-14T11:56:56.992323+0000","last_peered":"2024-09-14T11:56:56.992323+0000","last_clean":"2024-09-14T11:56:56.992323+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:56:56.992323+0000","last_undegraded":"2024-09-14T11:56:56.992323+0000","last_fullsized":"2024-09-14T11:56:56.992323+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:17.261692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'173","reported_seq":778,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.978158+0000","last_change":"2024-09-14T11:15:32.310770+0000","last_active":"2024-09-14T11:56:17.978158+0000","last_peered":"2024-09-14T11:56:17.978158+0000","last_clean":"2024-09-14T11:56:17.978158+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:56:17.978158+0000","last_undegraded":"2024-09-14T11:56:17.978158+0000","last_fullsized":"2024-09-14T11:56:17.978158+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:39.610888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":26947,"num_write":784,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013965+0000","last_change":"2024-09-14T11:15:36.335046+0000","last_active":"2024-09-14T11:56:09.013965+0000","last_peered":"2024-09-14T11:56:09.013965+0000","last_clean":"2024-09-14T11:56:09.013965+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:56:09.013965+0000","last_undegraded":"2024-09-14T11:56:09.013965+0000","last_fullsized":"2024-09-14T11:56:09.013965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:54.481756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'206","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.785316+0000","last_change":"2024-09-14T11:15:38.333929+0000","last_active":"2024-09-14T11:58:15.785316+0000","last_peered":"2024-09-14T11:58:15.785316+0000","last_clean":"2024-09-14T11:58:15.785316+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:58:15.785316+0000","last_undegraded":"2024-09-14T11:58:15.785316+0000","last_fullsized":"2024-09-14T11:58:15.785316+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.403088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14187,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":887,"num_read_kb":938,"num_write":1414,"num_write_kb":1293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.958089+0000","last_change":"2024-09-14T11:15:40.349110+0000","last_active":"2024-09-14T11:56:13.958089+0000","last_peered":"2024-09-14T11:56:13.958089+0000","last_clean":"2024-09-14T11:56:13.958089+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:56:13.958089+0000","last_undegraded":"2024-09-14T11:56:13.958089+0000","last_fullsized":"2024-09-14T11:56:13.958089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.798885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'145","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.161350+0000","last_change":"2024-09-14T11:15:42.351759+0000","last_active":"2024-09-14T11:55:57.161350+0000","last_peered":"2024-09-14T11:55:57.161350+0000","last_clean":"2024-09-14T11:55:57.161350+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:55:57.161350+0000","last_undegraded":"2024-09-14T11:55:57.161350+0000","last_fullsized":"2024-09-14T11:55:57.161350+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:09.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'800","reported_seq":2315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531202+0000","last_change":"2024-09-14T11:15:34.322606+0000","last_active":"2024-09-14T11:56:57.531202+0000","last_peered":"2024-09-14T11:56:57.531202+0000","last_clean":"2024-09-14T11:56:57.531202+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:56:57.531202+0000","last_undegraded":"2024-09-14T11:56:57.531202+0000","last_fullsized":"2024-09-14T11:56:57.531202+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:47.471242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870764+0000","last_change":"2024-09-14T11:15:15.722374+0000","last_active":"2024-09-14T11:55:23.870764+0000","last_peered":"2024-09-14T11:55:23.870764+0000","last_clean":"2024-09-14T11:55:23.870764+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:55:23.870764+0000","last_undegraded":"2024-09-14T11:55:23.870764+0000","last_fullsized":"2024-09-14T11:55:23.870764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_clean_scrub_stamp":"2024-09-14T11:15:14.033306+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:20.114027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867317+0000","last_change":"2024-09-14T11:15:23.082390+0000","last_active":"2024-09-14T11:54:58.867317+0000","last_peered":"2024-09-14T11:54:58.867317+0000","last_clean":"2024-09-14T11:54:58.867317+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:54:58.867317+0000","last_undegraded":"2024-09-14T11:54:58.867317+0000","last_fullsized":"2024-09-14T11:54:58.867317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:33.700173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'236","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.424746+0000","last_change":"2024-09-14T11:15:32.324361+0000","last_active":"2024-09-14T11:55:24.424746+0000","last_peered":"2024-09-14T11:55:24.424746+0000","last_clean":"2024-09-14T11:55:24.424746+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:55:24.424746+0000","last_undegraded":"2024-09-14T11:55:24.424746+0000","last_fullsized":"2024-09-14T11:55:24.424746+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:30.273764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5200503,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":31904,"num_write":1125,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.869304+0000","last_change":"2024-09-14T11:15:36.333660+0000","last_active":"2024-09-14T11:55:13.869304+0000","last_peered":"2024-09-14T11:55:13.869304+0000","last_clean":"2024-09-14T11:55:13.869304+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:55:13.869304+0000","last_undegraded":"2024-09-14T11:55:13.869304+0000","last_fullsized":"2024-09-14T11:55:13.869304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:23.212696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'293","reported_seq":966,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.787626+0000","last_change":"2024-09-14T11:15:38.335792+0000","last_active":"2024-09-14T11:58:15.787626+0000","last_peered":"2024-09-14T11:58:15.787626+0000","last_clean":"2024-09-14T11:58:15.787626+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:58:15.787626+0000","last_undegraded":"2024-09-14T11:58:15.787626+0000","last_fullsized":"2024-09-14T11:58:15.787626+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:30.822708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48957,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":722,"num_write":488,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.857414+0000","last_change":"2024-09-14T11:15:40.350659+0000","last_active":"2024-09-14T11:54:43.857414+0000","last_peered":"2024-09-14T11:54:43.857414+0000","last_clean":"2024-09-14T11:54:43.857414+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:54:43.857414+0000","last_undegraded":"2024-09-14T11:54:43.857414+0000","last_fullsized":"2024-09-14T11:54:43.857414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:02.205911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'189","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.537414+0000","last_change":"2024-09-14T11:15:42.350534+0000","last_active":"2024-09-14T11:56:57.537414+0000","last_peered":"2024-09-14T11:56:57.537414+0000","last_clean":"2024-09-14T11:56:57.537414+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:56:57.537414+0000","last_undegraded":"2024-09-14T11:56:57.537414+0000","last_fullsized":"2024-09-14T11:56:57.537414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:58.455641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'494","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136421+0000","last_change":"2024-09-14T11:15:34.330808+0000","last_active":"2024-09-14T11:56:39.136421+0000","last_peered":"2024-09-14T11:56:39.136421+0000","last_clean":"2024-09-14T11:56:39.136421+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:56:39.136421+0000","last_undegraded":"2024-09-14T11:56:39.136421+0000","last_fullsized":"2024-09-14T11:56:39.136421+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:23.183357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.871431+0000","last_change":"2024-09-14T11:15:23.927708+0000","last_active":"2024-09-14T11:55:28.871431+0000","last_peered":"2024-09-14T11:55:28.871431+0000","last_clean":"2024-09-14T11:55:28.871431+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:55:28.871431+0000","last_undegraded":"2024-09-14T11:55:28.871431+0000","last_fullsized":"2024-09-14T11:55:28.871431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.482495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'187","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.544588+0000","last_change":"2024-09-14T11:15:32.306329+0000","last_active":"2024-09-14T11:55:59.544588+0000","last_peered":"2024-09-14T11:55:59.544588+0000","last_clean":"2024-09-14T11:55:59.544588+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:55:59.544588+0000","last_undegraded":"2024-09-14T11:55:59.544588+0000","last_fullsized":"2024-09-14T11:55:59.544588+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:59.382027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9103571,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":755,"num_read_kb":134470,"num_write":895,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864617+0000","last_change":"2024-09-14T11:15:36.329488+0000","last_active":"2024-09-14T11:54:38.864617+0000","last_peered":"2024-09-14T11:54:38.864617+0000","last_clean":"2024-09-14T11:54:38.864617+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:54:38.864617+0000","last_undegraded":"2024-09-14T11:54:38.864617+0000","last_fullsized":"2024-09-14T11:54:38.864617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.992710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'841","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842898+0000","last_change":"2024-09-14T11:15:38.335641+0000","last_active":"2024-09-14T11:58:15.842898+0000","last_peered":"2024-09-14T11:58:15.842898+0000","last_clean":"2024-09-14T11:58:15.842898+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:58:15.842898+0000","last_undegraded":"2024-09-14T11:58:15.842898+0000","last_fullsized":"2024-09-14T11:58:15.842898+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:31.939839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1141,"num_read_kb":1308,"num_write":264,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870881+0000","last_change":"2024-09-14T11:15:40.344759+0000","last_active":"2024-09-14T11:55:23.870881+0000","last_peered":"2024-09-14T11:55:23.870881+0000","last_clean":"2024-09-14T11:55:23.870881+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:55:23.870881+0000","last_undegraded":"2024-09-14T11:55:23.870881+0000","last_fullsized":"2024-09-14T11:55:23.870881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.591931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'99","reported_seq":599,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.131967+0000","last_change":"2024-09-14T11:15:42.346979+0000","last_active":"2024-09-14T11:56:39.131967+0000","last_peered":"2024-09-14T11:56:39.131967+0000","last_clean":"2024-09-14T11:56:39.131967+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:56:39.131967+0000","last_undegraded":"2024-09-14T11:56:39.131967+0000","last_fullsized":"2024-09-14T11:56:39.131967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:56.582504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'537","reported_seq":2057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.982239+0000","last_change":"2024-09-14T11:15:34.328947+0000","last_active":"2024-09-14T11:56:56.982239+0000","last_peered":"2024-09-14T11:56:56.982239+0000","last_clean":"2024-09-14T11:56:56.982239+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:56:56.982239+0000","last_undegraded":"2024-09-14T11:56:56.982239+0000","last_fullsized":"2024-09-14T11:56:56.982239+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:22.306344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858408+0000","last_change":"2024-09-14T11:15:23.072067+0000","last_active":"2024-09-14T11:54:58.858408+0000","last_peered":"2024-09-14T11:54:58.858408+0000","last_clean":"2024-09-14T11:54:58.858408+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:54:58.858408+0000","last_undegraded":"2024-09-14T11:54:58.858408+0000","last_fullsized":"2024-09-14T11:54:58.858408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:39.257423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'171","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869519+0000","last_change":"2024-09-14T11:15:32.308521+0000","last_active":"2024-09-14T11:55:40.869519+0000","last_peered":"2024-09-14T11:55:40.869519+0000","last_clean":"2024-09-14T11:55:40.869519+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:55:40.869519+0000","last_undegraded":"2024-09-14T11:55:40.869519+0000","last_fullsized":"2024-09-14T11:55:40.869519+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.589077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11682040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":392,"num_read_kb":27621,"num_write":837,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856296+0000","last_change":"2024-09-14T11:15:36.322255+0000","last_active":"2024-09-14T11:54:38.856296+0000","last_peered":"2024-09-14T11:54:38.856296+0000","last_clean":"2024-09-14T11:54:38.856296+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:54:38.856296+0000","last_undegraded":"2024-09-14T11:54:38.856296+0000","last_fullsized":"2024-09-14T11:54:38.856296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:41.156825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'213","reported_seq":1266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842747+0000","last_change":"2024-09-14T11:15:38.338714+0000","last_active":"2024-09-14T11:58:15.842747+0000","last_peered":"2024-09-14T11:58:15.842747+0000","last_clean":"2024-09-14T11:58:15.842747+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:58:15.842747+0000","last_undegraded":"2024-09-14T11:58:15.842747+0000","last_fullsized":"2024-09-14T11:58:15.842747+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:12.349920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861300+0000","last_change":"2024-09-14T11:15:40.351390+0000","last_active":"2024-09-14T11:55:18.861300+0000","last_peered":"2024-09-14T11:55:18.861300+0000","last_clean":"2024-09-14T11:55:18.861300+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:55:18.861300+0000","last_undegraded":"2024-09-14T11:55:18.861300+0000","last_fullsized":"2024-09-14T11:55:18.861300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.483392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'280","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.803304+0000","last_change":"2024-09-14T11:15:42.351361+0000","last_active":"2024-09-14T11:58:15.803304+0000","last_peered":"2024-09-14T11:58:15.803304+0000","last_clean":"2024-09-14T11:58:15.803304+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:58:15.803304+0000","last_undegraded":"2024-09-14T11:58:15.803304+0000","last_fullsized":"2024-09-14T11:58:15.803304+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'555","reported_seq":2127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.371131+0000","last_change":"2024-09-14T11:15:34.326991+0000","last_active":"2024-09-14T11:56:34.371131+0000","last_peered":"2024-09-14T11:56:34.371131+0000","last_clean":"2024-09-14T11:56:34.371131+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:56:34.371131+0000","last_undegraded":"2024-09-14T11:56:34.371131+0000","last_fullsized":"2024-09-14T11:56:34.371131+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:01.433893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867284+0000","last_change":"2024-09-14T11:15:23.082813+0000","last_active":"2024-09-14T11:54:58.867284+0000","last_peered":"2024-09-14T11:54:58.867284+0000","last_clean":"2024-09-14T11:54:58.867284+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:54:58.867284+0000","last_undegraded":"2024-09-14T11:54:58.867284+0000","last_fullsized":"2024-09-14T11:54:58.867284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:09.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'207","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.421575+0000","last_change":"2024-09-14T11:15:32.304267+0000","last_active":"2024-09-14T11:56:00.421575+0000","last_peered":"2024-09-14T11:56:00.421575+0000","last_clean":"2024-09-14T11:56:00.421575+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:56:00.421575+0000","last_undegraded":"2024-09-14T11:56:00.421575+0000","last_fullsized":"2024-09-14T11:56:00.421575+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:11.058375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7691978,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":485,"num_read_kb":21127,"num_write":1020,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861326+0000","last_change":"2024-09-14T11:15:36.327923+0000","last_active":"2024-09-14T11:55:18.861326+0000","last_peered":"2024-09-14T11:55:18.861326+0000","last_clean":"2024-09-14T11:55:18.861326+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:55:18.861326+0000","last_undegraded":"2024-09-14T11:55:18.861326+0000","last_fullsized":"2024-09-14T11:55:18.861326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:19.678938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'124","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.882670+0000","last_change":"2024-09-14T11:15:38.340290+0000","last_active":"2024-09-14T11:56:48.882670+0000","last_peered":"2024-09-14T11:56:48.882670+0000","last_clean":"2024-09-14T11:56:48.882670+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:56:48.882670+0000","last_undegraded":"2024-09-14T11:56:48.882670+0000","last_fullsized":"2024-09-14T11:56:48.882670+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:51.345233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.946533+0000","last_change":"2024-09-14T11:15:40.343946+0000","last_active":"2024-09-14T11:54:43.946533+0000","last_peered":"2024-09-14T11:54:43.946533+0000","last_clean":"2024-09-14T11:54:43.946533+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:54:43.946533+0000","last_undegraded":"2024-09-14T11:54:43.946533+0000","last_fullsized":"2024-09-14T11:54:43.946533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.497566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'166","reported_seq":727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.995883+0000","last_change":"2024-09-14T11:15:42.351795+0000","last_active":"2024-09-14T11:56:36.995883+0000","last_peered":"2024-09-14T11:56:36.995883+0000","last_clean":"2024-09-14T11:56:36.995883+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:56:36.995883+0000","last_undegraded":"2024-09-14T11:56:36.995883+0000","last_fullsized":"2024-09-14T11:56:36.995883+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:00.523427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'890","reported_seq":2625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531193+0000","last_change":"2024-09-14T11:15:34.330814+0000","last_active":"2024-09-14T11:56:57.531193+0000","last_peered":"2024-09-14T11:56:57.531193+0000","last_clean":"2024-09-14T11:56:57.531193+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:56:57.531193+0000","last_undegraded":"2024-09-14T11:56:57.531193+0000","last_fullsized":"2024-09-14T11:56:57.531193+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:26.576464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'205","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.335228+0000","last_change":"2024-09-14T11:15:32.322181+0000","last_active":"2024-09-14T11:56:29.335228+0000","last_peered":"2024-09-14T11:56:29.335228+0000","last_clean":"2024-09-14T11:56:29.335228+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:56:29.335228+0000","last_undegraded":"2024-09-14T11:56:29.335228+0000","last_fullsized":"2024-09-14T11:56:29.335228+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:25.998267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17058791,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":7241,"num_write":961,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863547+0000","last_change":"2024-09-14T11:15:23.085013+0000","last_active":"2024-09-14T11:54:55.863547+0000","last_peered":"2024-09-14T11:54:55.863547+0000","last_clean":"2024-09-14T11:54:55.863547+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:54:55.863547+0000","last_undegraded":"2024-09-14T11:54:55.863547+0000","last_fullsized":"2024-09-14T11:54:55.863547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:25.505724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.860745+0000","last_change":"2024-09-14T11:15:36.327557+0000","last_active":"2024-09-14T11:55:13.860745+0000","last_peered":"2024-09-14T11:55:13.860745+0000","last_clean":"2024-09-14T11:55:13.860745+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:55:13.860745+0000","last_undegraded":"2024-09-14T11:55:13.860745+0000","last_fullsized":"2024-09-14T11:55:13.860745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:46.694330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'262","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.779630+0000","last_change":"2024-09-14T11:15:38.333171+0000","last_active":"2024-09-14T11:58:15.779630+0000","last_peered":"2024-09-14T11:58:15.779630+0000","last_clean":"2024-09-14T11:58:15.779630+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:58:15.779630+0000","last_undegraded":"2024-09-14T11:58:15.779630+0000","last_fullsized":"2024-09-14T11:58:15.779630+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:45.638370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25607,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":347,"num_read_kb":438,"num_write":196,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.007091+0000","last_change":"2024-09-14T11:15:40.348810+0000","last_active":"2024-09-14T11:55:19.007091+0000","last_peered":"2024-09-14T11:55:19.007091+0000","last_clean":"2024-09-14T11:55:19.007091+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:55:19.007091+0000","last_undegraded":"2024-09-14T11:55:19.007091+0000","last_fullsized":"2024-09-14T11:55:19.007091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:45.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'169","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.464163+0000","last_change":"2024-09-14T11:15:42.354465+0000","last_active":"2024-09-14T11:58:14.464163+0000","last_peered":"2024-09-14T11:58:14.464163+0000","last_clean":"2024-09-14T11:58:14.464163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:58:14.464163+0000","last_undegraded":"2024-09-14T11:58:14.464163+0000","last_fullsized":"2024-09-14T11:58:14.464163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:00.902965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'771","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531136+0000","last_change":"2024-09-14T11:15:34.328838+0000","last_active":"2024-09-14T11:56:57.531136+0000","last_peered":"2024-09-14T11:56:57.531136+0000","last_clean":"2024-09-14T11:56:57.531136+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:56:57.531136+0000","last_undegraded":"2024-09-14T11:56:57.531136+0000","last_fullsized":"2024-09-14T11:56:57.531136+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:06.220137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'258","reported_seq":887,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.768883+0000","last_change":"2024-09-14T11:15:32.309908+0000","last_active":"2024-09-14T11:56:52.768883+0000","last_peered":"2024-09-14T11:56:52.768883+0000","last_clean":"2024-09-14T11:56:52.768883+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:56:52.768883+0000","last_undegraded":"2024-09-14T11:56:52.768883+0000","last_fullsized":"2024-09-14T11:56:52.768883+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:42.117912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14696566,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":40043,"num_write":1038,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867981+0000","last_change":"2024-09-14T11:15:23.927653+0000","last_active":"2024-09-14T11:55:03.867981+0000","last_peered":"2024-09-14T11:55:03.867981+0000","last_clean":"2024-09-14T11:55:03.867981+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:55:03.867981+0000","last_undegraded":"2024-09-14T11:55:03.867981+0000","last_fullsized":"2024-09-14T11:55:03.867981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:15.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"36'4","reported_seq":962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.317972+0000","last_change":"2024-09-14T11:15:36.327972+0000","last_active":"2024-09-14T11:58:15.317972+0000","last_peered":"2024-09-14T11:58:15.317972+0000","last_clean":"2024-09-14T11:58:15.317972+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:58:15.317972+0000","last_undegraded":"2024-09-14T11:58:15.317972+0000","last_fullsized":"2024-09-14T11:58:15.317972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:19.046696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'167","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.919058+0000","last_change":"2024-09-14T11:15:38.327367+0000","last_active":"2024-09-14T11:57:15.919058+0000","last_peered":"2024-09-14T11:57:15.919058+0000","last_clean":"2024-09-14T11:57:15.919058+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:57:15.919058+0000","last_undegraded":"2024-09-14T11:57:15.919058+0000","last_fullsized":"2024-09-14T11:57:15.919058+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:37.848547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'795","reported_seq":4695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842667+0000","last_change":"2024-09-14T11:15:40.337171+0000","last_active":"2024-09-14T11:58:15.842667+0000","last_peered":"2024-09-14T11:58:15.842667+0000","last_clean":"2024-09-14T11:58:15.842667+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:58:15.842667+0000","last_undegraded":"2024-09-14T11:58:15.842667+0000","last_fullsized":"2024-09-14T11:58:15.842667+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.203863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'132","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.805016+0000","last_change":"2024-09-14T11:15:42.349144+0000","last_active":"2024-09-14T11:58:15.805016+0000","last_peered":"2024-09-14T11:58:15.805016+0000","last_clean":"2024-09-14T11:58:15.805016+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:58:15.805016+0000","last_undegraded":"2024-09-14T11:58:15.805016+0000","last_fullsized":"2024-09-14T11:58:15.805016+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:09.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'891","reported_seq":2471,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.891391+0000","last_change":"2024-09-14T11:15:34.334008+0000","last_active":"2024-09-14T11:57:43.891391+0000","last_peered":"2024-09-14T11:57:43.891391+0000","last_clean":"2024-09-14T11:57:43.891391+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:57:43.891391+0000","last_undegraded":"2024-09-14T11:57:43.891391+0000","last_fullsized":"2024-09-14T11:57:43.891391+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.699506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'239","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.255976+0000","last_change":"2024-09-14T11:15:32.315658+0000","last_active":"2024-09-14T11:55:19.255976+0000","last_peered":"2024-09-14T11:55:19.255976+0000","last_clean":"2024-09-14T11:55:19.255976+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:55:19.255976+0000","last_undegraded":"2024-09-14T11:55:19.255976+0000","last_fullsized":"2024-09-14T11:55:19.255976+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:05.378692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7981226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":686,"num_read_kb":25317,"num_write":1127,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.875825+0000","last_change":"2024-09-14T11:15:23.084925+0000","last_active":"2024-09-14T11:56:30.875825+0000","last_peered":"2024-09-14T11:56:30.875825+0000","last_clean":"2024-09-14T11:56:30.875825+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:56:30.875825+0000","last_undegraded":"2024-09-14T11:56:30.875825+0000","last_fullsized":"2024-09-14T11:56:30.875825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.357227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:14.006501+0000","last_change":"2024-09-14T11:15:36.331117+0000","last_active":"2024-09-14T11:55:14.006501+0000","last_peered":"2024-09-14T11:55:14.006501+0000","last_clean":"2024-09-14T11:55:14.006501+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:55:14.006501+0000","last_undegraded":"2024-09-14T11:55:14.006501+0000","last_fullsized":"2024-09-14T11:55:14.006501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:51.839727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'111","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.942678+0000","last_change":"2024-09-14T11:15:38.337313+0000","last_active":"2024-09-14T11:56:30.942678+0000","last_peered":"2024-09-14T11:56:30.942678+0000","last_clean":"2024-09-14T11:56:30.942678+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:56:30.942678+0000","last_undegraded":"2024-09-14T11:56:30.942678+0000","last_fullsized":"2024-09-14T11:56:30.942678+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:15.549271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'809","reported_seq":2427,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842929+0000","last_change":"2024-09-14T11:15:40.353831+0000","last_active":"2024-09-14T11:58:15.842929+0000","last_peered":"2024-09-14T11:58:15.842929+0000","last_clean":"2024-09-14T11:58:15.842929+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:58:15.842929+0000","last_undegraded":"2024-09-14T11:58:15.842929+0000","last_fullsized":"2024-09-14T11:58:15.842929+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:41.935731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'282","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.867897+0000","last_change":"2024-09-14T11:15:42.349524+0000","last_active":"2024-09-14T11:56:13.867897+0000","last_peered":"2024-09-14T11:56:13.867897+0000","last_clean":"2024-09-14T11:56:13.867897+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:56:13.867897+0000","last_undegraded":"2024-09-14T11:56:13.867897+0000","last_fullsized":"2024-09-14T11:56:13.867897+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:39.795329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'401","reported_seq":1934,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882633+0000","last_change":"2024-09-14T11:15:34.326976+0000","last_active":"2024-09-14T11:56:54.882633+0000","last_peered":"2024-09-14T11:56:54.882633+0000","last_clean":"2024-09-14T11:56:54.882633+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:56:54.882633+0000","last_undegraded":"2024-09-14T11:56:54.882633+0000","last_fullsized":"2024-09-14T11:56:54.882633+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:16.837130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'210","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.422593+0000","last_change":"2024-09-14T11:15:32.314679+0000","last_active":"2024-09-14T11:55:24.422593+0000","last_peered":"2024-09-14T11:55:24.422593+0000","last_clean":"2024-09-14T11:55:24.422593+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:55:24.422593+0000","last_undegraded":"2024-09-14T11:55:24.422593+0000","last_fullsized":"2024-09-14T11:55:24.422593+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:39.815598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4535993,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":11357,"num_write":1010,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.960844+0000","last_change":"2024-09-14T11:15:23.927661+0000","last_active":"2024-09-14T11:56:33.960844+0000","last_peered":"2024-09-14T11:56:33.960844+0000","last_clean":"2024-09-14T11:56:33.960844+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:56:33.960844+0000","last_undegraded":"2024-09-14T11:56:33.960844+0000","last_fullsized":"2024-09-14T11:56:33.960844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:47.701947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875423+0000","last_change":"2024-09-14T11:15:36.331051+0000","last_active":"2024-09-14T11:55:48.875423+0000","last_peered":"2024-09-14T11:55:48.875423+0000","last_clean":"2024-09-14T11:55:48.875423+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:55:48.875423+0000","last_undegraded":"2024-09-14T11:55:48.875423+0000","last_fullsized":"2024-09-14T11:55:48.875423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:18.610941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'295","reported_seq":988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.776029+0000","last_change":"2024-09-14T11:15:38.337405+0000","last_active":"2024-09-14T11:58:15.776029+0000","last_peered":"2024-09-14T11:58:15.776029+0000","last_clean":"2024-09-14T11:58:15.776029+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:58:15.776029+0000","last_undegraded":"2024-09-14T11:58:15.776029+0000","last_fullsized":"2024-09-14T11:58:15.776029+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:37.729796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37514,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":628,"num_write":218,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870986+0000","last_change":"2024-09-14T11:15:40.349294+0000","last_active":"2024-09-14T11:55:18.870986+0000","last_peered":"2024-09-14T11:55:18.870986+0000","last_clean":"2024-09-14T11:55:18.870986+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:55:18.870986+0000","last_undegraded":"2024-09-14T11:55:18.870986+0000","last_fullsized":"2024-09-14T11:55:18.870986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:06.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'134","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.668467+0000","last_change":"2024-09-14T11:15:42.351815+0000","last_active":"2024-09-14T11:56:19.668467+0000","last_peered":"2024-09-14T11:56:19.668467+0000","last_clean":"2024-09-14T11:56:19.668467+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:56:19.668467+0000","last_undegraded":"2024-09-14T11:56:19.668467+0000","last_fullsized":"2024-09-14T11:56:19.668467+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:31.950118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'146","reported_seq":688,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.639329+0000","last_change":"2024-09-14T11:15:42.348937+0000","last_active":"2024-09-14T11:56:57.639329+0000","last_peered":"2024-09-14T11:56:57.639329+0000","last_clean":"2024-09-14T11:56:57.639329+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:56:57.639329+0000","last_undegraded":"2024-09-14T11:56:57.639329+0000","last_fullsized":"2024-09-14T11:56:57.639329+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'563","reported_seq":2425,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.458556+0000","last_change":"2024-09-14T11:15:34.319146+0000","last_active":"2024-09-14T11:58:14.458556+0000","last_peered":"2024-09-14T11:58:14.458556+0000","last_clean":"2024-09-14T11:58:14.458556+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:58:14.458556+0000","last_undegraded":"2024-09-14T11:58:14.458556+0000","last_fullsized":"2024-09-14T11:58:14.458556+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:44.411480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'198","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.821360+0000","last_change":"2024-09-14T11:15:32.313281+0000","last_active":"2024-09-14T11:56:54.821360+0000","last_peered":"2024-09-14T11:56:54.821360+0000","last_clean":"2024-09-14T11:56:54.821360+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:56:54.821360+0000","last_undegraded":"2024-09-14T11:56:54.821360+0000","last_fullsized":"2024-09-14T11:56:54.821360+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:47.748935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352987,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":19870,"num_write":900,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866061+0000","last_change":"2024-09-14T11:15:36.335097+0000","last_active":"2024-09-14T11:55:15.866061+0000","last_peered":"2024-09-14T11:55:15.866061+0000","last_clean":"2024-09-14T11:55:15.866061+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:55:15.866061+0000","last_undegraded":"2024-09-14T11:55:15.866061+0000","last_fullsized":"2024-09-14T11:55:15.866061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:16.648545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'153","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890794+0000","last_change":"2024-09-14T11:15:38.334700+0000","last_active":"2024-09-14T11:57:38.890794+0000","last_peered":"2024-09-14T11:57:38.890794+0000","last_clean":"2024-09-14T11:57:38.890794+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:57:38.890794+0000","last_undegraded":"2024-09-14T11:57:38.890794+0000","last_fullsized":"2024-09-14T11:57:38.890794+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:17.379507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11421,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":185,"num_read_kb":246,"num_write":110,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.871577+0000","last_change":"2024-09-14T11:15:40.349844+0000","last_active":"2024-09-14T11:55:23.871577+0000","last_peered":"2024-09-14T11:55:23.871577+0000","last_clean":"2024-09-14T11:55:23.871577+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:55:23.871577+0000","last_undegraded":"2024-09-14T11:55:23.871577+0000","last_fullsized":"2024-09-14T11:55:23.871577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:12.340019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.002060+0000","last_change":"2024-09-14T11:15:42.351873+0000","last_active":"2024-09-14T11:56:57.002060+0000","last_peered":"2024-09-14T11:56:57.002060+0000","last_clean":"2024-09-14T11:56:57.002060+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:56:57.002060+0000","last_undegraded":"2024-09-14T11:56:57.002060+0000","last_fullsized":"2024-09-14T11:56:57.002060+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.030349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1370","reported_seq":3005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.687050+0000","last_change":"2024-09-14T11:15:34.330128+0000","last_active":"2024-09-14T11:56:35.687050+0000","last_peered":"2024-09-14T11:56:35.687050+0000","last_clean":"2024-09-14T11:56:35.687050+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:56:35.687050+0000","last_undegraded":"2024-09-14T11:56:35.687050+0000","last_fullsized":"2024-09-14T11:56:35.687050+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.528231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'161","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.340997+0000","last_change":"2024-09-14T11:15:32.321575+0000","last_active":"2024-09-14T11:56:00.340997+0000","last_peered":"2024-09-14T11:56:00.340997+0000","last_clean":"2024-09-14T11:56:00.340997+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:56:00.340997+0000","last_undegraded":"2024-09-14T11:56:00.340997+0000","last_fullsized":"2024-09-14T11:56:00.340997+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:37.366540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21298259,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":349,"num_read_kb":34031,"num_write":730,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.871010+0000","last_change":"2024-09-14T11:15:36.330880+0000","last_active":"2024-09-14T11:55:18.871010+0000","last_peered":"2024-09-14T11:55:18.871010+0000","last_clean":"2024-09-14T11:55:18.871010+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:55:18.871010+0000","last_undegraded":"2024-09-14T11:55:18.871010+0000","last_fullsized":"2024-09-14T11:55:18.871010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:31.962906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'43","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.223600+0000","last_change":"2024-09-14T11:15:38.332435+0000","last_active":"2024-09-14T11:56:30.223600+0000","last_peered":"2024-09-14T11:56:30.223600+0000","last_clean":"2024-09-14T11:56:30.223600+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:56:30.223600+0000","last_undegraded":"2024-09-14T11:56:30.223600+0000","last_fullsized":"2024-09-14T11:56:30.223600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:58.253268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870821+0000","last_change":"2024-09-14T11:15:40.344174+0000","last_active":"2024-09-14T11:55:23.870821+0000","last_peered":"2024-09-14T11:55:23.870821+0000","last_clean":"2024-09-14T11:55:23.870821+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:55:23.870821+0000","last_undegraded":"2024-09-14T11:55:23.870821+0000","last_fullsized":"2024-09-14T11:55:23.870821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:53.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'215","reported_seq":729,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.995205+0000","last_change":"2024-09-14T11:15:42.348738+0000","last_active":"2024-09-14T11:56:56.995205+0000","last_peered":"2024-09-14T11:56:56.995205+0000","last_clean":"2024-09-14T11:56:56.995205+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:56:56.995205+0000","last_undegraded":"2024-09-14T11:56:56.995205+0000","last_fullsized":"2024-09-14T11:56:56.995205+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:07.647856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'455","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.674512+0000","last_change":"2024-09-14T11:15:34.322075+0000","last_active":"2024-09-14T11:56:19.674512+0000","last_peered":"2024-09-14T11:56:19.674512+0000","last_clean":"2024-09-14T11:56:19.674512+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:56:19.674512+0000","last_undegraded":"2024-09-14T11:56:19.674512+0000","last_fullsized":"2024-09-14T11:56:19.674512+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:01.128060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'345","reported_seq":989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.613050+0000","last_change":"2024-09-14T11:16:07.497232+0000","last_active":"2024-09-14T11:56:32.613050+0000","last_peered":"2024-09-14T11:56:32.613050+0000","last_clean":"2024-09-14T11:56:32.613050+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:56:32.613050+0000","last_undegraded":"2024-09-14T11:56:32.613050+0000","last_fullsized":"2024-09-14T11:56:32.613050+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:57.221580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8346231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":976,"num_read_kb":18899,"num_write":1297,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870031+0000","last_change":"2024-09-14T11:15:36.339369+0000","last_active":"2024-09-14T11:55:18.870031+0000","last_peered":"2024-09-14T11:55:18.870031+0000","last_clean":"2024-09-14T11:55:18.870031+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:55:18.870031+0000","last_undegraded":"2024-09-14T11:55:18.870031+0000","last_fullsized":"2024-09-14T11:55:18.870031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:43.628492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'155","reported_seq":734,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890822+0000","last_change":"2024-09-14T11:15:38.334637+0000","last_active":"2024-09-14T11:57:38.890822+0000","last_peered":"2024-09-14T11:57:38.890822+0000","last_clean":"2024-09-14T11:57:38.890822+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:57:38.890822+0000","last_undegraded":"2024-09-14T11:57:38.890822+0000","last_fullsized":"2024-09-14T11:57:38.890822+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:56.809543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9202,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":247,"num_write":110,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951144+0000","last_change":"2024-09-14T11:15:40.343098+0000","last_active":"2024-09-14T11:55:23.951144+0000","last_peered":"2024-09-14T11:55:23.951144+0000","last_clean":"2024-09-14T11:55:23.951144+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:55:23.951144+0000","last_undegraded":"2024-09-14T11:55:23.951144+0000","last_fullsized":"2024-09-14T11:55:23.951144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.732839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'115","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.989039+0000","last_change":"2024-09-14T11:15:42.348868+0000","last_active":"2024-09-14T11:56:56.989039+0000","last_peered":"2024-09-14T11:56:56.989039+0000","last_clean":"2024-09-14T11:56:56.989039+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:56:56.989039+0000","last_undegraded":"2024-09-14T11:56:56.989039+0000","last_fullsized":"2024-09-14T11:56:56.989039+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.040910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'810","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.890119+0000","last_change":"2024-09-14T11:15:34.332878+0000","last_active":"2024-09-14T11:57:33.890119+0000","last_peered":"2024-09-14T11:57:33.890119+0000","last_clean":"2024-09-14T11:57:33.890119+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:57:33.890119+0000","last_undegraded":"2024-09-14T11:57:33.890119+0000","last_fullsized":"2024-09-14T11:57:33.890119+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:47.822581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'259","reported_seq":864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:21.550580+0000","last_change":"2024-09-14T11:15:32.313576+0000","last_active":"2024-09-14T11:55:21.550580+0000","last_peered":"2024-09-14T11:55:21.550580+0000","last_clean":"2024-09-14T11:55:21.550580+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:55:21.550580+0000","last_undegraded":"2024-09-14T11:55:21.550580+0000","last_fullsized":"2024-09-14T11:55:21.550580+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:01.256758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924463,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":14443,"num_write":1154,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.950374+0000","last_change":"2024-09-14T11:15:36.330819+0000","last_active":"2024-09-14T11:55:18.950374+0000","last_peered":"2024-09-14T11:55:18.950374+0000","last_clean":"2024-09-14T11:55:18.950374+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:55:18.950374+0000","last_undegraded":"2024-09-14T11:55:18.950374+0000","last_fullsized":"2024-09-14T11:55:18.950374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:42.392337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'132","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890163+0000","last_change":"2024-09-14T11:15:38.338705+0000","last_active":"2024-09-14T11:57:38.890163+0000","last_peered":"2024-09-14T11:57:38.890163+0000","last_clean":"2024-09-14T11:57:38.890163+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:57:38.890163+0000","last_undegraded":"2024-09-14T11:57:38.890163+0000","last_fullsized":"2024-09-14T11:57:38.890163+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:13.916538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":330,"num_write":102,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861871+0000","last_change":"2024-09-14T11:15:40.351822+0000","last_active":"2024-09-14T11:55:23.861871+0000","last_peered":"2024-09-14T11:55:23.861871+0000","last_clean":"2024-09-14T11:55:23.861871+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:55:23.861871+0000","last_undegraded":"2024-09-14T11:55:23.861871+0000","last_fullsized":"2024-09-14T11:55:23.861871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'849","reported_seq":2468,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.966335+0000","last_change":"2024-09-14T11:15:34.327038+0000","last_active":"2024-09-14T11:57:13.966335+0000","last_peered":"2024-09-14T11:57:13.966335+0000","last_clean":"2024-09-14T11:57:13.966335+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:57:13.966335+0000","last_undegraded":"2024-09-14T11:57:13.966335+0000","last_fullsized":"2024-09-14T11:57:13.966335+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:27.678371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'190","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.588372+0000","last_change":"2024-09-14T11:15:32.318761+0000","last_active":"2024-09-14T11:56:00.588372+0000","last_peered":"2024-09-14T11:56:00.588372+0000","last_clean":"2024-09-14T11:56:00.588372+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:56:00.588372+0000","last_undegraded":"2024-09-14T11:56:00.588372+0000","last_fullsized":"2024-09-14T11:56:00.588372+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:06.906697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10691710,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":38160,"num_write":901,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864502+0000","last_change":"2024-09-14T11:15:36.334440+0000","last_active":"2024-09-14T11:55:43.864502+0000","last_peered":"2024-09-14T11:55:43.864502+0000","last_clean":"2024-09-14T11:55:43.864502+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:55:43.864502+0000","last_undegraded":"2024-09-14T11:55:43.864502+0000","last_fullsized":"2024-09-14T11:55:43.864502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:33.779211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'191","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.772385+0000","last_change":"2024-09-14T11:15:38.334848+0000","last_active":"2024-09-14T11:58:15.772385+0000","last_peered":"2024-09-14T11:58:15.772385+0000","last_clean":"2024-09-14T11:58:15.772385+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:58:15.772385+0000","last_undegraded":"2024-09-14T11:58:15.772385+0000","last_fullsized":"2024-09-14T11:58:15.772385+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25104,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":274,"num_read_kb":349,"num_write":172,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.873860+0000","last_change":"2024-09-14T11:15:40.348746+0000","last_active":"2024-09-14T11:55:43.873860+0000","last_peered":"2024-09-14T11:55:43.873860+0000","last_clean":"2024-09-14T11:55:43.873860+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:55:43.873860+0000","last_undegraded":"2024-09-14T11:55:43.873860+0000","last_fullsized":"2024-09-14T11:55:43.873860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:48.113026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'159","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.879691+0000","last_change":"2024-09-14T11:15:42.352372+0000","last_active":"2024-09-14T11:55:59.879691+0000","last_peered":"2024-09-14T11:55:59.879691+0000","last_clean":"2024-09-14T11:55:59.879691+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:55:59.879691+0000","last_undegraded":"2024-09-14T11:55:59.879691+0000","last_fullsized":"2024-09-14T11:55:59.879691+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:49.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":1996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530068+0000","last_change":"2024-09-14T11:15:34.318828+0000","last_active":"2024-09-14T11:56:57.530068+0000","last_peered":"2024-09-14T11:56:57.530068+0000","last_clean":"2024-09-14T11:56:57.530068+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:56:57.530068+0000","last_undegraded":"2024-09-14T11:56:57.530068+0000","last_fullsized":"2024-09-14T11:56:57.530068+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:26.298183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'217","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.230535+0000","last_change":"2024-09-14T11:15:32.312194+0000","last_active":"2024-09-14T11:55:55.230535+0000","last_peered":"2024-09-14T11:55:55.230535+0000","last_clean":"2024-09-14T11:55:55.230535+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:55:55.230535+0000","last_undegraded":"2024-09-14T11:55:55.230535+0000","last_fullsized":"2024-09-14T11:55:55.230535+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.459882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423889,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":11796,"num_write":1006,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.949977+0000","last_change":"2024-09-14T11:15:36.330927+0000","last_active":"2024-09-14T11:55:13.949977+0000","last_peered":"2024-09-14T11:55:13.949977+0000","last_clean":"2024-09-14T11:55:13.949977+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:55:13.949977+0000","last_undegraded":"2024-09-14T11:55:13.949977+0000","last_fullsized":"2024-09-14T11:55:13.949977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:56.526006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'153","reported_seq":720,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.894696+0000","last_change":"2024-09-14T11:15:38.341444+0000","last_active":"2024-09-14T11:58:08.894696+0000","last_peered":"2024-09-14T11:58:08.894696+0000","last_clean":"2024-09-14T11:58:08.894696+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:58:08.894696+0000","last_undegraded":"2024-09-14T11:58:08.894696+0000","last_fullsized":"2024-09-14T11:58:08.894696+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:11.384017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10257,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":257,"num_write":128,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869587+0000","last_change":"2024-09-14T11:15:40.346858+0000","last_active":"2024-09-14T11:55:40.869587+0000","last_peered":"2024-09-14T11:55:40.869587+0000","last_clean":"2024-09-14T11:55:40.869587+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:55:40.869587+0000","last_undegraded":"2024-09-14T11:55:40.869587+0000","last_fullsized":"2024-09-14T11:55:40.869587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:12.423799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'255","reported_seq":1118,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.480297+0000","last_change":"2024-09-14T11:15:42.347978+0000","last_active":"2024-09-14T11:56:55.480297+0000","last_peered":"2024-09-14T11:56:55.480297+0000","last_clean":"2024-09-14T11:56:55.480297+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:56:55.480297+0000","last_undegraded":"2024-09-14T11:56:55.480297+0000","last_fullsized":"2024-09-14T11:56:55.480297+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:59.600834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'851","reported_seq":2419,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518009+0000","last_change":"2024-09-14T11:15:34.327867+0000","last_active":"2024-09-14T11:56:33.518009+0000","last_peered":"2024-09-14T11:56:33.518009+0000","last_clean":"2024-09-14T11:56:33.518009+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:56:33.518009+0000","last_undegraded":"2024-09-14T11:56:33.518009+0000","last_fullsized":"2024-09-14T11:56:33.518009+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:01.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'194","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.009084+0000","last_change":"2024-09-14T11:15:32.312185+0000","last_active":"2024-09-14T11:55:34.009084+0000","last_peered":"2024-09-14T11:55:34.009084+0000","last_clean":"2024-09-14T11:55:34.009084+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:55:34.009084+0000","last_undegraded":"2024-09-14T11:55:34.009084+0000","last_fullsized":"2024-09-14T11:55:34.009084+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:40.741870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.009957+0000","last_change":"2024-09-14T11:15:36.330057+0000","last_active":"2024-09-14T11:55:39.009957+0000","last_peered":"2024-09-14T11:55:39.009957+0000","last_clean":"2024-09-14T11:55:39.009957+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:55:39.009957+0000","last_undegraded":"2024-09-14T11:55:39.009957+0000","last_fullsized":"2024-09-14T11:55:39.009957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.691223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'127","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.886603+0000","last_change":"2024-09-14T11:15:38.336865+0000","last_active":"2024-09-14T11:57:18.886603+0000","last_peered":"2024-09-14T11:57:18.886603+0000","last_clean":"2024-09-14T11:57:18.886603+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:57:18.886603+0000","last_undegraded":"2024-09-14T11:57:18.886603+0000","last_fullsized":"2024-09-14T11:57:18.886603+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:20.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10212,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":241,"num_write":96,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870237+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:55:45.870237+0000","last_peered":"2024-09-14T11:55:45.870237+0000","last_clean":"2024-09-14T11:55:45.870237+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:55:45.870237+0000","last_undegraded":"2024-09-14T11:55:45.870237+0000","last_fullsized":"2024-09-14T11:55:45.870237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.612855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'145","reported_seq":635,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801285+0000","last_change":"2024-09-14T11:15:42.348516+0000","last_active":"2024-09-14T11:58:15.801285+0000","last_peered":"2024-09-14T11:58:15.801285+0000","last_clean":"2024-09-14T11:58:15.801285+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:58:15.801285+0000","last_undegraded":"2024-09-14T11:58:15.801285+0000","last_fullsized":"2024-09-14T11:58:15.801285+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:57.841456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'425","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.459589+0000","last_change":"2024-09-14T11:16:07.518584+0000","last_active":"2024-09-14T11:58:14.459589+0000","last_peered":"2024-09-14T11:58:14.459589+0000","last_clean":"2024-09-14T11:58:14.459589+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:14.459589+0000","last_undegraded":"2024-09-14T11:58:14.459589+0000","last_fullsized":"2024-09-14T11:58:14.459589+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:45.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'214","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.307617+0000","last_change":"2024-09-14T11:15:32.310716+0000","last_active":"2024-09-14T11:56:21.307617+0000","last_peered":"2024-09-14T11:56:21.307617+0000","last_clean":"2024-09-14T11:56:21.307617+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:56:21.307617+0000","last_undegraded":"2024-09-14T11:56:21.307617+0000","last_fullsized":"2024-09-14T11:56:21.307617+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:42.627407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5299376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":514,"num_read_kb":12620,"num_write":950,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:35.868896+0000","last_change":"2024-09-14T11:15:36.330575+0000","last_active":"2024-09-14T11:55:35.868896+0000","last_peered":"2024-09-14T11:55:35.868896+0000","last_clean":"2024-09-14T11:55:35.868896+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:55:35.868896+0000","last_undegraded":"2024-09-14T11:55:35.868896+0000","last_fullsized":"2024-09-14T11:55:35.868896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:23.577919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'99","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.374104+0000","last_change":"2024-09-14T11:15:38.335710+0000","last_active":"2024-09-14T11:56:21.374104+0000","last_peered":"2024-09-14T11:56:21.374104+0000","last_clean":"2024-09-14T11:56:21.374104+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:56:21.374104+0000","last_undegraded":"2024-09-14T11:56:21.374104+0000","last_fullsized":"2024-09-14T11:56:21.374104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:16.942605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'766","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842678+0000","last_change":"2024-09-14T11:15:40.347027+0000","last_active":"2024-09-14T11:58:15.842678+0000","last_peered":"2024-09-14T11:58:15.842678+0000","last_clean":"2024-09-14T11:58:15.842678+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:58:15.842678+0000","last_undegraded":"2024-09-14T11:58:15.842678+0000","last_fullsized":"2024-09-14T11:58:15.842678+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.157408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":604,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.934707+0000","last_change":"2024-09-14T11:15:42.350291+0000","last_active":"2024-09-14T11:56:30.934707+0000","last_peered":"2024-09-14T11:56:30.934707+0000","last_clean":"2024-09-14T11:56:30.934707+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:56:30.934707+0000","last_undegraded":"2024-09-14T11:56:30.934707+0000","last_fullsized":"2024-09-14T11:56:30.934707+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.774415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'894","reported_seq":2466,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.677671+0000","last_change":"2024-09-14T11:15:34.322958+0000","last_active":"2024-09-14T11:56:32.677671+0000","last_peered":"2024-09-14T11:56:32.677671+0000","last_clean":"2024-09-14T11:56:32.677671+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:56:32.677671+0000","last_undegraded":"2024-09-14T11:56:32.677671+0000","last_fullsized":"2024-09-14T11:56:32.677671+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'208","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:06.727058+0000","last_change":"2024-09-14T11:15:32.310372+0000","last_active":"2024-09-14T11:56:06.727058+0000","last_peered":"2024-09-14T11:56:06.727058+0000","last_clean":"2024-09-14T11:56:06.727058+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:56:06.727058+0000","last_undegraded":"2024-09-14T11:56:06.727058+0000","last_fullsized":"2024-09-14T11:56:06.727058+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:20.309040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7368312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":924,"num_read_kb":28634,"num_write":965,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872979+0000","last_change":"2024-09-14T11:15:36.334783+0000","last_active":"2024-09-14T11:55:38.872979+0000","last_peered":"2024-09-14T11:55:38.872979+0000","last_clean":"2024-09-14T11:55:38.872979+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:55:38.872979+0000","last_undegraded":"2024-09-14T11:55:38.872979+0000","last_fullsized":"2024-09-14T11:55:38.872979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:31.368261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'152","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.884022+0000","last_change":"2024-09-14T11:15:38.333129+0000","last_active":"2024-09-14T11:56:53.884022+0000","last_peered":"2024-09-14T11:56:53.884022+0000","last_clean":"2024-09-14T11:56:53.884022+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:56:53.884022+0000","last_undegraded":"2024-09-14T11:56:53.884022+0000","last_fullsized":"2024-09-14T11:56:53.884022+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:23.609841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13591,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":260,"num_write":110,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.854707+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:54:23.854707+0000","last_peered":"2024-09-14T11:54:23.854707+0000","last_clean":"2024-09-14T11:54:23.854707+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:54:23.854707+0000","last_undegraded":"2024-09-14T11:54:23.854707+0000","last_fullsized":"2024-09-14T11:54:23.854707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:23.255804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'105","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513654+0000","last_change":"2024-09-14T11:15:42.354717+0000","last_active":"2024-09-14T11:56:33.513654+0000","last_peered":"2024-09-14T11:56:33.513654+0000","last_clean":"2024-09-14T11:56:33.513654+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:56:33.513654+0000","last_undegraded":"2024-09-14T11:56:33.513654+0000","last_fullsized":"2024-09-14T11:56:33.513654+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:10.490861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'654","reported_seq":2517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456955+0000","last_change":"2024-09-14T11:15:34.319956+0000","last_active":"2024-09-14T11:58:14.456955+0000","last_peered":"2024-09-14T11:58:14.456955+0000","last_clean":"2024-09-14T11:58:14.456955+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:58:14.456955+0000","last_undegraded":"2024-09-14T11:58:14.456955+0000","last_fullsized":"2024-09-14T11:58:14.456955+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:38.765206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'192","reported_seq":798,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.683000+0000","last_change":"2024-09-14T11:15:32.311339+0000","last_active":"2024-09-14T11:56:37.683000+0000","last_peered":"2024-09-14T11:56:37.683000+0000","last_clean":"2024-09-14T11:56:37.683000+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:56:37.683000+0000","last_undegraded":"2024-09-14T11:56:37.683000+0000","last_fullsized":"2024-09-14T11:56:37.683000+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:40.088024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8864078,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":24057,"num_write":873,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872982+0000","last_change":"2024-09-14T11:15:36.323716+0000","last_active":"2024-09-14T11:55:38.872982+0000","last_peered":"2024-09-14T11:55:38.872982+0000","last_clean":"2024-09-14T11:55:38.872982+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:55:38.872982+0000","last_undegraded":"2024-09-14T11:55:38.872982+0000","last_fullsized":"2024-09-14T11:55:38.872982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:05.232742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'142","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.871358+0000","last_change":"2024-09-14T11:15:38.333174+0000","last_active":"2024-09-14T11:56:43.871358+0000","last_peered":"2024-09-14T11:56:43.871358+0000","last_clean":"2024-09-14T11:56:43.871358+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:56:43.871358+0000","last_undegraded":"2024-09-14T11:56:43.871358+0000","last_fullsized":"2024-09-14T11:56:43.871358+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:29.536985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":240,"num_write":96,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944488+0000","last_change":"2024-09-14T11:15:40.344604+0000","last_active":"2024-09-14T11:54:28.944488+0000","last_peered":"2024-09-14T11:54:28.944488+0000","last_clean":"2024-09-14T11:54:28.944488+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:54:28.944488+0000","last_undegraded":"2024-09-14T11:54:28.944488+0000","last_fullsized":"2024-09-14T11:54:28.944488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:07.536782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'141","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.134030+0000","last_change":"2024-09-14T11:15:42.348390+0000","last_active":"2024-09-14T11:56:39.134030+0000","last_peered":"2024-09-14T11:56:39.134030+0000","last_clean":"2024-09-14T11:56:39.134030+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:56:39.134030+0000","last_undegraded":"2024-09-14T11:56:39.134030+0000","last_fullsized":"2024-09-14T11:56:39.134030+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:35.472396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'745","reported_seq":2355,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.981012+0000","last_change":"2024-09-14T11:15:34.323276+0000","last_active":"2024-09-14T11:56:56.981012+0000","last_peered":"2024-09-14T11:56:56.981012+0000","last_clean":"2024-09-14T11:56:56.981012+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:56:56.981012+0000","last_undegraded":"2024-09-14T11:56:56.981012+0000","last_fullsized":"2024-09-14T11:56:56.981012+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:11.314085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'236","reported_seq":987,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874920+0000","last_change":"2024-09-14T11:15:32.314412+0000","last_active":"2024-09-14T11:55:43.874920+0000","last_peered":"2024-09-14T11:55:43.874920+0000","last_clean":"2024-09-14T11:55:43.874920+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:55:43.874920+0000","last_undegraded":"2024-09-14T11:55:43.874920+0000","last_fullsized":"2024-09-14T11:55:43.874920+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:54.314072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7372429,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":845,"num_read_kb":149417,"num_write":1042,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999537+0000","last_change":"2024-09-14T11:15:36.334370+0000","last_active":"2024-09-14T11:54:18.999537+0000","last_peered":"2024-09-14T11:54:18.999537+0000","last_clean":"2024-09-14T11:54:18.999537+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:54:18.999537+0000","last_undegraded":"2024-09-14T11:54:18.999537+0000","last_fullsized":"2024-09-14T11:54:18.999537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:16.183616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'94","reported_seq":641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.894830+0000","last_change":"2024-09-14T11:15:38.339773+0000","last_active":"2024-09-14T11:58:08.894830+0000","last_peered":"2024-09-14T11:58:08.894830+0000","last_clean":"2024-09-14T11:58:08.894830+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:58:08.894830+0000","last_undegraded":"2024-09-14T11:58:08.894830+0000","last_fullsized":"2024-09-14T11:58:08.894830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.547669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":164,"num_write":52,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.010579+0000","last_change":"2024-09-14T11:15:40.345970+0000","last_active":"2024-09-14T11:55:44.010579+0000","last_peered":"2024-09-14T11:55:44.010579+0000","last_clean":"2024-09-14T11:55:44.010579+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:55:44.010579+0000","last_undegraded":"2024-09-14T11:55:44.010579+0000","last_fullsized":"2024-09-14T11:55:44.010579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.446853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'154","reported_seq":1252,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.149214+0000","last_change":"2024-09-14T11:15:42.354185+0000","last_active":"2024-09-14T11:56:55.149214+0000","last_peered":"2024-09-14T11:56:55.149214+0000","last_clean":"2024-09-14T11:56:55.149214+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:56:55.149214+0000","last_undegraded":"2024-09-14T11:56:55.149214+0000","last_fullsized":"2024-09-14T11:56:55.149214+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:00.385532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'446","reported_seq":1936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.748803+0000","last_change":"2024-09-14T11:15:34.320209+0000","last_active":"2024-09-14T11:56:37.748803+0000","last_peered":"2024-09-14T11:56:37.748803+0000","last_clean":"2024-09-14T11:56:37.748803+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:56:37.748803+0000","last_undegraded":"2024-09-14T11:56:37.748803+0000","last_fullsized":"2024-09-14T11:56:37.748803+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:44.754267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'202","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.455627+0000","last_change":"2024-09-14T11:15:32.314784+0000","last_active":"2024-09-14T11:56:13.455627+0000","last_peered":"2024-09-14T11:56:13.455627+0000","last_clean":"2024-09-14T11:56:13.455627+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:56:13.455627+0000","last_undegraded":"2024-09-14T11:56:13.455627+0000","last_fullsized":"2024-09-14T11:56:13.455627+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.987083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079014,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":525,"num_read_kb":36694,"num_write":983,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.858535+0000","last_change":"2024-09-14T11:15:36.334335+0000","last_active":"2024-09-14T11:54:20.858535+0000","last_peered":"2024-09-14T11:54:20.858535+0000","last_clean":"2024-09-14T11:54:20.858535+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:54:20.858535+0000","last_undegraded":"2024-09-14T11:54:20.858535+0000","last_fullsized":"2024-09-14T11:54:20.858535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:15.469593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'144","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.031982+0000","last_change":"2024-09-14T11:15:38.340747+0000","last_active":"2024-09-14T11:58:09.031982+0000","last_peered":"2024-09-14T11:58:09.031982+0000","last_clean":"2024-09-14T11:58:09.031982+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:58:09.031982+0000","last_undegraded":"2024-09-14T11:58:09.031982+0000","last_fullsized":"2024-09-14T11:58:09.031982+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:13.972291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":256,"num_write":112,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864425+0000","last_change":"2024-09-14T11:15:40.351076+0000","last_active":"2024-09-14T11:55:43.864425+0000","last_peered":"2024-09-14T11:55:43.864425+0000","last_clean":"2024-09-14T11:55:43.864425+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:55:43.864425+0000","last_undegraded":"2024-09-14T11:55:43.864425+0000","last_fullsized":"2024-09-14T11:55:43.864425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:55.409953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'93","reported_seq":570,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.455750+0000","last_change":"2024-09-14T11:15:42.354581+0000","last_active":"2024-09-14T11:58:14.455750+0000","last_peered":"2024-09-14T11:58:14.455750+0000","last_clean":"2024-09-14T11:58:14.455750+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:58:14.455750+0000","last_undegraded":"2024-09-14T11:58:14.455750+0000","last_fullsized":"2024-09-14T11:58:14.455750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:56.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'422","reported_seq":1871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.440972+0000","last_change":"2024-09-14T11:15:34.326286+0000","last_active":"2024-09-14T11:56:24.440972+0000","last_peered":"2024-09-14T11:56:24.440972+0000","last_clean":"2024-09-14T11:56:24.440972+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:56:24.440972+0000","last_undegraded":"2024-09-14T11:56:24.440972+0000","last_fullsized":"2024-09-14T11:56:24.440972+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:42.344126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'187","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.949331+0000","last_change":"2024-09-14T11:15:32.318065+0000","last_active":"2024-09-14T11:55:08.949331+0000","last_peered":"2024-09-14T11:55:08.949331+0000","last_clean":"2024-09-14T11:55:08.949331+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:55:08.949331+0000","last_undegraded":"2024-09-14T11:55:08.949331+0000","last_fullsized":"2024-09-14T11:55:08.949331+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:17.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1219547,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":66072,"num_write":888,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.217987+0000","last_change":"2024-09-14T11:15:34.326738+0000","last_active":"2024-09-14T11:56:20.217987+0000","last_peered":"2024-09-14T11:56:20.217987+0000","last_clean":"2024-09-14T11:56:20.217987+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:56:20.217987+0000","last_undegraded":"2024-09-14T11:56:20.217987+0000","last_fullsized":"2024-09-14T11:56:20.217987+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:19.559783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'205","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.769120+0000","last_change":"2024-09-14T11:16:07.388971+0000","last_active":"2024-09-14T11:56:52.769120+0000","last_peered":"2024-09-14T11:56:52.769120+0000","last_clean":"2024-09-14T11:56:52.769120+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:56:52.769120+0000","last_undegraded":"2024-09-14T11:56:52.769120+0000","last_fullsized":"2024-09-14T11:56:52.769120+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:24.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874406,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":30107,"num_write":963,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'535","reported_seq":2201,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.748702+0000","last_change":"2024-09-14T11:15:34.327112+0000","last_active":"2024-09-14T11:56:37.748702+0000","last_peered":"2024-09-14T11:56:37.748702+0000","last_clean":"2024-09-14T11:56:37.748702+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:56:37.748702+0000","last_undegraded":"2024-09-14T11:56:37.748702+0000","last_fullsized":"2024-09-14T11:56:37.748702+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:38.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'178","reported_seq":758,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:56.061418+0000","last_change":"2024-09-14T11:15:32.322695+0000","last_active":"2024-09-14T11:55:56.061418+0000","last_peered":"2024-09-14T11:55:56.061418+0000","last_clean":"2024-09-14T11:55:56.061418+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:55:56.061418+0000","last_undegraded":"2024-09-14T11:55:56.061418+0000","last_fullsized":"2024-09-14T11:55:56.061418+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:51.640989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4543689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":13678,"num_write":820,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'686","reported_seq":2125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815081+0000","last_change":"2024-09-14T11:15:34.326696+0000","last_active":"2024-09-14T11:56:31.815081+0000","last_peered":"2024-09-14T11:56:31.815081+0000","last_clean":"2024-09-14T11:56:31.815081+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:56:31.815081+0000","last_undegraded":"2024-09-14T11:56:31.815081+0000","last_fullsized":"2024-09-14T11:56:31.815081+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:33.740522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'218","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.306735+0000","last_change":"2024-09-14T11:15:32.316203+0000","last_active":"2024-09-14T11:56:34.306735+0000","last_peered":"2024-09-14T11:56:34.306735+0000","last_clean":"2024-09-14T11:56:34.306735+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:56:34.306735+0000","last_undegraded":"2024-09-14T11:56:34.306735+0000","last_fullsized":"2024-09-14T11:56:34.306735+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:22.666605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6140506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":667,"num_read_kb":8461,"num_write":1061,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'577","reported_seq":2174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.999003+0000","last_change":"2024-09-14T11:15:34.321891+0000","last_active":"2024-09-14T11:56:36.999003+0000","last_peered":"2024-09-14T11:56:36.999003+0000","last_clean":"2024-09-14T11:56:36.999003+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:56:36.999003+0000","last_undegraded":"2024-09-14T11:56:36.999003+0000","last_fullsized":"2024-09-14T11:56:36.999003+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:57.912381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'249","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.079998+0000","last_change":"2024-09-14T11:15:32.318820+0000","last_active":"2024-09-14T11:56:52.079998+0000","last_peered":"2024-09-14T11:56:52.079998+0000","last_clean":"2024-09-14T11:56:52.079998+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:56:52.079998+0000","last_undegraded":"2024-09-14T11:56:52.079998+0000","last_fullsized":"2024-09-14T11:56:52.079998+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:03.579946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20178710,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":615,"num_read_kb":65552,"num_write":1151,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1210","reported_seq":2813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.749031+0000","last_change":"2024-09-14T11:15:34.321918+0000","last_active":"2024-09-14T11:56:37.749031+0000","last_peered":"2024-09-14T11:56:37.749031+0000","last_clean":"2024-09-14T11:56:37.749031+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:56:37.749031+0000","last_undegraded":"2024-09-14T11:56:37.749031+0000","last_fullsized":"2024-09-14T11:56:37.749031+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:50.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'189","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:16.645586+0000","last_change":"2024-09-14T11:15:32.315289+0000","last_active":"2024-09-14T11:55:16.645586+0000","last_peered":"2024-09-14T11:55:16.645586+0000","last_clean":"2024-09-14T11:55:16.645586+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:55:16.645586+0000","last_undegraded":"2024-09-14T11:55:16.645586+0000","last_fullsized":"2024-09-14T11:55:16.645586+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.565051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9439257,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":18861,"num_write":889,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'487","reported_seq":2135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.885876+0000","last_change":"2024-09-14T11:15:34.331577+0000","last_active":"2024-09-14T11:57:13.885876+0000","last_peered":"2024-09-14T11:57:13.885876+0000","last_clean":"2024-09-14T11:57:13.885876+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:57:13.885876+0000","last_undegraded":"2024-09-14T11:57:13.885876+0000","last_fullsized":"2024-09-14T11:57:13.885876+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:11.178476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'180","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.655711+0000","last_change":"2024-09-14T11:15:32.316992+0000","last_active":"2024-09-14T11:56:27.655711+0000","last_peered":"2024-09-14T11:56:27.655711+0000","last_clean":"2024-09-14T11:56:27.655711+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:56:27.655711+0000","last_undegraded":"2024-09-14T11:56:27.655711+0000","last_fullsized":"2024-09-14T11:56:27.655711+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:26.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1732164,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":3776,"num_write":814,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'438","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992326+0000","last_change":"2024-09-14T11:15:34.320939+0000","last_active":"2024-09-14T11:56:56.992326+0000","last_peered":"2024-09-14T11:56:56.992326+0000","last_clean":"2024-09-14T11:56:56.992326+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:56:56.992326+0000","last_undegraded":"2024-09-14T11:56:56.992326+0000","last_fullsized":"2024-09-14T11:56:56.992326+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:48.296671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'266","reported_seq":914,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:47.024102+0000","last_change":"2024-09-14T11:15:32.313940+0000","last_active":"2024-09-14T11:55:47.024102+0000","last_peered":"2024-09-14T11:55:47.024102+0000","last_clean":"2024-09-14T11:55:47.024102+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:55:47.024102+0000","last_undegraded":"2024-09-14T11:55:47.024102+0000","last_fullsized":"2024-09-14T11:55:47.024102+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:20.479935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7395300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":36414,"num_write":1097,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'491","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815278+0000","last_change":"2024-09-14T11:15:34.329614+0000","last_active":"2024-09-14T11:56:31.815278+0000","last_peered":"2024-09-14T11:56:31.815278+0000","last_clean":"2024-09-14T11:56:31.815278+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:56:31.815278+0000","last_undegraded":"2024-09-14T11:56:31.815278+0000","last_fullsized":"2024-09-14T11:56:31.815278+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:54.327097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'273","reported_seq":919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.153726+0000","last_change":"2024-09-14T11:15:32.315107+0000","last_active":"2024-09-14T11:56:30.153726+0000","last_peered":"2024-09-14T11:56:30.153726+0000","last_clean":"2024-09-14T11:56:30.153726+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:56:30.153726+0000","last_undegraded":"2024-09-14T11:56:30.153726+0000","last_fullsized":"2024-09-14T11:56:30.153726+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:38.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10535606,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":57959,"num_write":1164,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'745","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.401835+0000","last_change":"2024-09-14T11:15:34.315526+0000","last_active":"2024-09-14T11:56:29.401835+0000","last_peered":"2024-09-14T11:56:29.401835+0000","last_clean":"2024-09-14T11:56:29.401835+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:56:29.401835+0000","last_undegraded":"2024-09-14T11:56:29.401835+0000","last_fullsized":"2024-09-14T11:56:29.401835+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:14.858173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'196","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877283+0000","last_change":"2024-09-14T11:15:32.314904+0000","last_active":"2024-09-14T11:56:03.877283+0000","last_peered":"2024-09-14T11:56:03.877283+0000","last_clean":"2024-09-14T11:56:03.877283+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:56:03.877283+0000","last_undegraded":"2024-09-14T11:56:03.877283+0000","last_fullsized":"2024-09-14T11:56:03.877283+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:26.432997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6318765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":507,"num_read_kb":27346,"num_write":949,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518380+0000","last_change":"2024-09-14T11:15:34.319049+0000","last_active":"2024-09-14T11:56:33.518380+0000","last_peered":"2024-09-14T11:56:33.518380+0000","last_clean":"2024-09-14T11:56:33.518380+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:56:33.518380+0000","last_undegraded":"2024-09-14T11:56:33.518380+0000","last_fullsized":"2024-09-14T11:56:33.518380+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:49.759336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'210","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.403461+0000","last_change":"2024-09-14T11:15:32.323060+0000","last_active":"2024-09-14T11:56:38.403461+0000","last_peered":"2024-09-14T11:56:38.403461+0000","last_clean":"2024-09-14T11:56:38.403461+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:56:38.403461+0000","last_undegraded":"2024-09-14T11:56:38.403461+0000","last_fullsized":"2024-09-14T11:56:38.403461+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:45.398432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9461002,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":6791,"num_write":1018,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1091","reported_seq":2577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465397+0000","last_change":"2024-09-14T11:15:34.322193+0000","last_active":"2024-09-14T11:56:38.465397+0000","last_peered":"2024-09-14T11:56:38.465397+0000","last_clean":"2024-09-14T11:56:38.465397+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:56:38.465397+0000","last_undegraded":"2024-09-14T11:56:38.465397+0000","last_fullsized":"2024-09-14T11:56:38.465397+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":1000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:22.542879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.866601+0000","last_change":"2024-09-14T11:15:32.310112+0000","last_active":"2024-09-14T11:56:03.866601+0000","last_peered":"2024-09-14T11:56:03.866601+0000","last_clean":"2024-09-14T11:56:03.866601+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:56:03.866601+0000","last_undegraded":"2024-09-14T11:56:03.866601+0000","last_fullsized":"2024-09-14T11:56:03.866601+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:07.469578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291482,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":8671,"num_write":965,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'890","reported_seq":2796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530140+0000","last_change":"2024-09-14T11:15:34.324712+0000","last_active":"2024-09-14T11:56:57.530140+0000","last_peered":"2024-09-14T11:56:57.530140+0000","last_clean":"2024-09-14T11:56:57.530140+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:56:57.530140+0000","last_undegraded":"2024-09-14T11:56:57.530140+0000","last_fullsized":"2024-09-14T11:56:57.530140+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.495184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'210","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.956619+0000","last_change":"2024-09-14T11:15:32.318750+0000","last_active":"2024-09-14T11:56:03.956619+0000","last_peered":"2024-09-14T11:56:03.956619+0000","last_clean":"2024-09-14T11:56:03.956619+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:56:03.956619+0000","last_undegraded":"2024-09-14T11:56:03.956619+0000","last_fullsized":"2024-09-14T11:56:03.956619+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.743260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":9098,"num_write":1055,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.467024+0000","last_change":"2024-09-14T11:15:34.332778+0000","last_active":"2024-09-14T11:58:14.467024+0000","last_peered":"2024-09-14T11:58:14.467024+0000","last_clean":"2024-09-14T11:58:14.467024+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:58:14.467024+0000","last_undegraded":"2024-09-14T11:58:14.467024+0000","last_fullsized":"2024-09-14T11:58:14.467024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:54.250812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'219","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877344+0000","last_change":"2024-09-14T11:15:32.312591+0000","last_active":"2024-09-14T11:56:08.877344+0000","last_peered":"2024-09-14T11:56:08.877344+0000","last_clean":"2024-09-14T11:56:08.877344+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:56:08.877344+0000","last_undegraded":"2024-09-14T11:56:08.877344+0000","last_fullsized":"2024-09-14T11:56:08.877344+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:10.213620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5597074,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":650,"num_read_kb":2234,"num_write":1091,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1087","reported_seq":2853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466283+0000","last_change":"2024-09-14T11:15:34.328111+0000","last_active":"2024-09-14T11:58:14.466283+0000","last_peered":"2024-09-14T11:58:14.466283+0000","last_clean":"2024-09-14T11:58:14.466283+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:58:14.466283+0000","last_undegraded":"2024-09-14T11:58:14.466283+0000","last_fullsized":"2024-09-14T11:58:14.466283+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":1000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:12.718283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'208","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.084352+0000","last_change":"2024-09-14T11:15:32.313441+0000","last_active":"2024-09-14T11:55:59.084352+0000","last_peered":"2024-09-14T11:55:59.084352+0000","last_clean":"2024-09-14T11:55:59.084352+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:55:59.084352+0000","last_undegraded":"2024-09-14T11:55:59.084352+0000","last_fullsized":"2024-09-14T11:55:59.084352+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:11.822923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194329,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":34303,"num_write":986,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998517+0000","last_change":"2024-09-14T11:15:34.327960+0000","last_active":"2024-09-14T11:56:36.998517+0000","last_peered":"2024-09-14T11:56:36.998517+0000","last_clean":"2024-09-14T11:56:36.998517+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:56:36.998517+0000","last_undegraded":"2024-09-14T11:56:36.998517+0000","last_fullsized":"2024-09-14T11:56:36.998517+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:15.598992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'248","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.644775+0000","last_change":"2024-09-14T11:15:32.319862+0000","last_active":"2024-09-14T11:55:59.644775+0000","last_peered":"2024-09-14T11:55:59.644775+0000","last_clean":"2024-09-14T11:55:59.644775+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:55:59.644775+0000","last_undegraded":"2024-09-14T11:55:59.644775+0000","last_fullsized":"2024-09-14T11:55:59.644775+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:02.612992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242961,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":43532,"num_write":1119,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'181","reported_seq":779,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.921103+0000","last_change":"2024-09-14T11:15:32.313012+0000","last_active":"2024-09-14T11:55:55.921103+0000","last_peered":"2024-09-14T11:55:55.921103+0000","last_clean":"2024-09-14T11:55:55.921103+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:55:55.921103+0000","last_undegraded":"2024-09-14T11:55:55.921103+0000","last_fullsized":"2024-09-14T11:55:55.921103+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:04.134671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7369327,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":446,"num_read_kb":29604,"num_write":899,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'412","reported_seq":1879,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136779+0000","last_change":"2024-09-14T11:15:34.329317+0000","last_active":"2024-09-14T11:56:39.136779+0000","last_peered":"2024-09-14T11:56:39.136779+0000","last_clean":"2024-09-14T11:56:39.136779+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:56:39.136779+0000","last_undegraded":"2024-09-14T11:56:39.136779+0000","last_fullsized":"2024-09-14T11:56:39.136779+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:48.380875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'275","reported_seq":1047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.046588+0000","last_change":"2024-09-14T11:15:32.312792+0000","last_active":"2024-09-14T11:55:58.046588+0000","last_peered":"2024-09-14T11:55:58.046588+0000","last_clean":"2024-09-14T11:55:58.046588+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:55:58.046588+0000","last_undegraded":"2024-09-14T11:55:58.046588+0000","last_fullsized":"2024-09-14T11:55:58.046588+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.357853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5951631,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1006,"num_read_kb":66938,"num_write":1370,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'573","reported_seq":2170,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.863303+0000","last_change":"2024-09-14T11:15:34.326395+0000","last_active":"2024-09-14T11:57:45.863303+0000","last_peered":"2024-09-14T11:57:45.863303+0000","last_clean":"2024-09-14T11:57:45.863303+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:57:45.863303+0000","last_undegraded":"2024-09-14T11:57:45.863303+0000","last_fullsized":"2024-09-14T11:57:45.863303+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:54.259695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":627,"ondisk_log_size":627,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":498831,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8040,"num_read_kb":9895,"num_write":5491,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":761856,"data_stored":249734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1889,"ondisk_log_size":1889,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2384,"num_read_kb":2846,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4076,"ondisk_log_size":4076,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":464712376,"num_objects":477,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":477,"num_whiteouts":0,"num_read":38553,"num_read_kb":2111644,"num_write":64115,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":931250176,"data_stored":929424752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4363,"ondisk_log_size":4363,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72500675,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":137,"num_read_kb":180487,"num_write":158,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145006592,"data_stored":145001350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72500675,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":134,"num_read_kb":169164,"num_write":158,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145006592,"data_stored":145001350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509967,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375884,"kb_used_data":155900,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93995956,"statfs":{"total":96636764160,"available":96251858944,"internally_reserved":0,"allocated":159641600,"data_stored":157815266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509967,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309688,"kb_used_data":89704,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94062152,"statfs":{"total":96636764160,"available":96319643648,"internally_reserved":0,"allocated":91856896,"data_stored":90219580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509968,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229120,"kb_used_data":139696,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94142720,"statfs":{"total":96636764160,"available":96402145280,"internally_reserved":0,"allocated":143048704,"data_stored":141168794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509967,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240900,"kb_used_data":165300,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94130940,"statfs":{"total":96636764160,"available":96390082560,"internally_reserved":0,"allocated":169267200,"data_stored":167511993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509969,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":445588,"kb_used_data":215876,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93926252,"statfs":{"total":96636764160,"available":96180482048,"internally_reserved":0,"allocated":221057024,"data_stored":219210462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509967,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183136,"kb_used_data":115856,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94188704,"statfs":{"total":96636764160,"available":96449232896,"internally_reserved":0,"allocated":118636544,"data_stored":117025884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509965,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412228,"kb_used_data":182516,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93959612,"statfs":{"total":96636764160,"available":96214642688,"internally_reserved":0,"allocated":186896384,"data_stored":185041393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575374,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279104,"kb_used_data":157744,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94092736,"statfs":{"total":96636764160,"available":96350961664,"internally_reserved":0,"allocated":161529856,"data_stored":159871804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136409088,"data_stored":136109756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102232064,"data_stored":102093234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80318464,"data_stored":80187460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":193044480,"data_stored":192754866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118382592,"data_stored":118092216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":114061312,"data_stored":113775120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71327744,"data_stored":71195635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":115474432,"data_stored":115216465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":35768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":39296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":12957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":42327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":8255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":54512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":19841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":36778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3207168,"data_stored":3206092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27324416,"data_stored":27323340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10534912,"data_stored":10534182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21082112,"data_stored":21080306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":6351820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:49.665 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:58:49.665 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:58:50.034 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:58:50.036 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1564,"stamp":"2024-09-14T11:58:48.781510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":610820012,"num_objects":993,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":295489,"num_read_kb":2699435,"num_write":146111,"num_write_kb":2447707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14023,"ondisk_log_size":14023,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2475648,"kb_used_data":1222592,"kb_used_omap":12,"kb_used_meta":1252915,"kb_avail":752499072,"statfs":{"total":773094113280,"available":770559049728,"internally_reserved":0,"allocated":1251934208,"data_stored":1237865176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1282985520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005035"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877231+0000","last_change":"2024-09-14T11:43:35.602913+0000","last_active":"2024-09-14T11:56:08.877231+0000","last_peered":"2024-09-14T11:56:08.877231+0000","last_clean":"2024-09-14T11:56:08.877231+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:56:08.877231+0000","last_undegraded":"2024-09-14T11:56:08.877231+0000","last_fullsized":"2024-09-14T11:56:08.877231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:06.258234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867970+0000","last_change":"2024-09-14T11:32:32.583802+0000","last_active":"2024-09-14T11:55:03.867970+0000","last_peered":"2024-09-14T11:55:03.867970+0000","last_clean":"2024-09-14T11:55:03.867970+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:55:03.867970+0000","last_undegraded":"2024-09-14T11:55:03.867970+0000","last_fullsized":"2024-09-14T11:55:03.867970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:58.807468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.868463+0000","last_change":"2024-09-14T11:32:29.554679+0000","last_active":"2024-09-14T11:54:58.868463+0000","last_peered":"2024-09-14T11:54:58.868463+0000","last_clean":"2024-09-14T11:54:58.868463+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:54:58.868463+0000","last_undegraded":"2024-09-14T11:54:58.868463+0000","last_fullsized":"2024-09-14T11:54:58.868463+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:20.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.865041+0000","last_change":"2024-09-14T11:30:45.179357+0000","last_active":"2024-09-14T11:55:48.865041+0000","last_peered":"2024-09-14T11:55:48.865041+0000","last_clean":"2024-09-14T11:55:48.865041+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:55:48.865041+0000","last_undegraded":"2024-09-14T11:55:48.865041+0000","last_fullsized":"2024-09-14T11:55:48.865041+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:03.066351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866530+0000","last_change":"2024-09-14T11:43:35.602901+0000","last_active":"2024-09-14T11:56:08.866530+0000","last_peered":"2024-09-14T11:56:08.866530+0000","last_clean":"2024-09-14T11:56:08.866530+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:56:08.866530+0000","last_undegraded":"2024-09-14T11:56:08.866530+0000","last_fullsized":"2024-09-14T11:56:08.866530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:07.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:04.005187+0000","last_change":"2024-09-14T11:32:32.582294+0000","last_active":"2024-09-14T11:55:04.005187+0000","last_peered":"2024-09-14T11:55:04.005187+0000","last_clean":"2024-09-14T11:55:04.005187+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:55:04.005187+0000","last_undegraded":"2024-09-14T11:55:04.005187+0000","last_fullsized":"2024-09-14T11:55:04.005187+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.399340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.864287+0000","last_change":"2024-09-14T11:32:29.558121+0000","last_active":"2024-09-14T11:55:00.864287+0000","last_peered":"2024-09-14T11:55:00.864287+0000","last_clean":"2024-09-14T11:55:00.864287+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:55:00.864287+0000","last_undegraded":"2024-09-14T11:55:00.864287+0000","last_fullsized":"2024-09-14T11:55:00.864287+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:52.777925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.438178+0000","last_change":"2024-09-14T11:30:45.185345+0000","last_active":"2024-09-14T11:56:00.438178+0000","last_peered":"2024-09-14T11:56:00.438178+0000","last_clean":"2024-09-14T11:56:00.438178+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:56:00.438178+0000","last_undegraded":"2024-09-14T11:56:00.438178+0000","last_fullsized":"2024-09-14T11:56:00.438178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:42.584514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.954160+0000","last_change":"2024-09-14T11:43:35.597712+0000","last_active":"2024-09-14T11:55:43.954160+0000","last_peered":"2024-09-14T11:55:43.954160+0000","last_clean":"2024-09-14T11:55:43.954160+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:55:43.954160+0000","last_undegraded":"2024-09-14T11:55:43.954160+0000","last_fullsized":"2024-09-14T11:55:43.954160+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:12.892547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'6","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.862548+0000","last_change":"2024-09-14T11:32:32.578401+0000","last_active":"2024-09-14T11:55:28.862548+0000","last_peered":"2024-09-14T11:55:28.862548+0000","last_clean":"2024-09-14T11:55:28.862548+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:55:28.862548+0000","last_undegraded":"2024-09-14T11:55:28.862548+0000","last_fullsized":"2024-09-14T11:55:28.862548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:07.530877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":13314,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.868976+0000","last_change":"2024-09-14T11:32:29.550110+0000","last_active":"2024-09-14T11:56:33.868976+0000","last_peered":"2024-09-14T11:56:33.868976+0000","last_clean":"2024-09-14T11:56:33.868976+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:56:33.868976+0000","last_undegraded":"2024-09-14T11:56:33.868976+0000","last_fullsized":"2024-09-14T11:56:33.868976+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:36.277584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.864987+0000","last_change":"2024-09-14T11:30:45.186185+0000","last_active":"2024-09-14T11:55:48.864987+0000","last_peered":"2024-09-14T11:55:48.864987+0000","last_clean":"2024-09-14T11:55:48.864987+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:55:48.864987+0000","last_undegraded":"2024-09-14T11:55:48.864987+0000","last_fullsized":"2024-09-14T11:55:48.864987+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.774513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875479+0000","last_change":"2024-09-14T11:43:35.603929+0000","last_active":"2024-09-14T11:55:48.875479+0000","last_peered":"2024-09-14T11:55:48.875479+0000","last_clean":"2024-09-14T11:55:48.875479+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:55:48.875479+0000","last_undegraded":"2024-09-14T11:55:48.875479+0000","last_fullsized":"2024-09-14T11:55:48.875479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:33.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'3","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882072+0000","last_change":"2024-09-14T11:32:32.589192+0000","last_active":"2024-09-14T11:56:43.882072+0000","last_peered":"2024-09-14T11:56:43.882072+0000","last_clean":"2024-09-14T11:56:43.882072+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:56:43.882072+0000","last_undegraded":"2024-09-14T11:56:43.882072+0000","last_fullsized":"2024-09-14T11:56:43.882072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:52.225210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":3,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.007703+0000","last_change":"2024-09-14T11:32:29.549479+0000","last_active":"2024-09-14T11:55:24.007703+0000","last_peered":"2024-09-14T11:55:24.007703+0000","last_clean":"2024-09-14T11:55:24.007703+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:55:24.007703+0000","last_undegraded":"2024-09-14T11:55:24.007703+0000","last_fullsized":"2024-09-14T11:55:24.007703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:56.796049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875525+0000","last_change":"2024-09-14T11:30:45.187877+0000","last_active":"2024-09-14T11:55:48.875525+0000","last_peered":"2024-09-14T11:55:48.875525+0000","last_clean":"2024-09-14T11:55:48.875525+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:55:48.875525+0000","last_undegraded":"2024-09-14T11:55:48.875525+0000","last_fullsized":"2024-09-14T11:55:48.875525+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:40.426491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874894+0000","last_change":"2024-09-14T11:43:35.601032+0000","last_active":"2024-09-14T11:55:43.874894+0000","last_peered":"2024-09-14T11:55:43.874894+0000","last_clean":"2024-09-14T11:55:43.874894+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:55:43.874894+0000","last_undegraded":"2024-09-14T11:55:43.874894+0000","last_fullsized":"2024-09-14T11:55:43.874894+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.697673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.863023+0000","last_change":"2024-09-14T11:33:08.805104+0000","last_active":"2024-09-14T11:54:28.863023+0000","last_peered":"2024-09-14T11:54:28.863023+0000","last_clean":"2024-09-14T11:54:28.863023+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:54:28.863023+0000","last_undegraded":"2024-09-14T11:54:28.863023+0000","last_fullsized":"2024-09-14T11:54:28.863023+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:03.683048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'6","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.853295+0000","last_change":"2024-09-14T11:32:29.558168+0000","last_active":"2024-09-14T11:54:13.853295+0000","last_peered":"2024-09-14T11:54:13.853295+0000","last_clean":"2024-09-14T11:54:13.853295+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:54:13.853295+0000","last_undegraded":"2024-09-14T11:54:13.853295+0000","last_fullsized":"2024-09-14T11:54:13.853295+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:28.837548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875505+0000","last_change":"2024-09-14T11:30:45.184142+0000","last_active":"2024-09-14T11:55:48.875505+0000","last_peered":"2024-09-14T11:55:48.875505+0000","last_clean":"2024-09-14T11:55:48.875505+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:55:48.875505+0000","last_undegraded":"2024-09-14T11:55:48.875505+0000","last_fullsized":"2024-09-14T11:55:48.875505+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:48.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872788+0000","last_change":"2024-09-14T11:43:35.605737+0000","last_active":"2024-09-14T11:56:05.872788+0000","last_peered":"2024-09-14T11:56:05.872788+0000","last_clean":"2024-09-14T11:56:05.872788+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:56:05.872788+0000","last_undegraded":"2024-09-14T11:56:05.872788+0000","last_fullsized":"2024-09-14T11:56:05.872788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'1","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.942976+0000","last_change":"2024-09-14T11:32:32.582277+0000","last_active":"2024-09-14T11:54:18.942976+0000","last_peered":"2024-09-14T11:54:18.942976+0000","last_clean":"2024-09-14T11:54:18.942976+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:54:18.942976+0000","last_undegraded":"2024-09-14T11:54:18.942976+0000","last_fullsized":"2024-09-14T11:54:18.942976+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.963034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'1","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.998852+0000","last_change":"2024-09-14T11:32:29.550064+0000","last_active":"2024-09-14T11:54:13.998852+0000","last_peered":"2024-09-14T11:54:13.998852+0000","last_clean":"2024-09-14T11:54:13.998852+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:54:13.998852+0000","last_undegraded":"2024-09-14T11:54:13.998852+0000","last_fullsized":"2024-09-14T11:54:13.998852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:24.276918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954746+0000","last_change":"2024-09-14T11:30:45.178964+0000","last_active":"2024-09-14T11:55:48.954746+0000","last_peered":"2024-09-14T11:55:48.954746+0000","last_clean":"2024-09-14T11:55:48.954746+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:55:48.954746+0000","last_undegraded":"2024-09-14T11:55:48.954746+0000","last_fullsized":"2024-09-14T11:55:48.954746+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:14.255189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877316+0000","last_change":"2024-09-14T11:43:35.605759+0000","last_active":"2024-09-14T11:56:08.877316+0000","last_peered":"2024-09-14T11:56:08.877316+0000","last_clean":"2024-09-14T11:56:08.877316+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:56:08.877316+0000","last_undegraded":"2024-09-14T11:56:08.877316+0000","last_fullsized":"2024-09-14T11:56:08.877316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.948842+0000","last_change":"2024-09-14T11:32:32.580274+0000","last_active":"2024-09-14T11:55:03.948842+0000","last_peered":"2024-09-14T11:55:03.948842+0000","last_clean":"2024-09-14T11:55:03.948842+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:55:03.948842+0000","last_undegraded":"2024-09-14T11:55:03.948842+0000","last_fullsized":"2024-09-14T11:55:03.948842+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:14.222467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004336+0000","last_change":"2024-09-14T11:32:29.555376+0000","last_active":"2024-09-14T11:54:59.004336+0000","last_peered":"2024-09-14T11:54:59.004336+0000","last_clean":"2024-09-14T11:54:59.004336+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:54:59.004336+0000","last_undegraded":"2024-09-14T11:54:59.004336+0000","last_fullsized":"2024-09-14T11:54:59.004336+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.859610+0000","last_change":"2024-09-14T11:30:45.175070+0000","last_active":"2024-09-14T11:55:03.859610+0000","last_peered":"2024-09-14T11:55:03.859610+0000","last_clean":"2024-09-14T11:55:03.859610+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:55:03.859610+0000","last_undegraded":"2024-09-14T11:55:03.859610+0000","last_fullsized":"2024-09-14T11:55:03.859610+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.836949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877363+0000","last_change":"2024-09-14T11:43:35.607526+0000","last_active":"2024-09-14T11:56:08.877363+0000","last_peered":"2024-09-14T11:56:08.877363+0000","last_clean":"2024-09-14T11:56:08.877363+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:56:08.877363+0000","last_undegraded":"2024-09-14T11:56:08.877363+0000","last_fullsized":"2024-09-14T11:56:08.877363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.745235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869068+0000","last_change":"2024-09-14T11:32:32.587761+0000","last_active":"2024-09-14T11:55:03.869068+0000","last_peered":"2024-09-14T11:55:03.869068+0000","last_clean":"2024-09-14T11:55:03.869068+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:55:03.869068+0000","last_undegraded":"2024-09-14T11:55:03.869068+0000","last_fullsized":"2024-09-14T11:55:03.869068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:27.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859019+0000","last_change":"2024-09-14T11:32:29.555600+0000","last_active":"2024-09-14T11:54:58.859019+0000","last_peered":"2024-09-14T11:54:58.859019+0000","last_clean":"2024-09-14T11:54:58.859019+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:54:58.859019+0000","last_undegraded":"2024-09-14T11:54:58.859019+0000","last_fullsized":"2024-09-14T11:54:58.859019+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.338753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863479+0000","last_change":"2024-09-14T11:30:45.182076+0000","last_active":"2024-09-14T11:54:55.863479+0000","last_peered":"2024-09-14T11:54:55.863479+0000","last_clean":"2024-09-14T11:54:55.863479+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:54:55.863479+0000","last_undegraded":"2024-09-14T11:54:55.863479+0000","last_fullsized":"2024-09-14T11:54:55.863479+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:51.625984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866051+0000","last_change":"2024-09-14T11:43:35.603298+0000","last_active":"2024-09-14T11:55:15.866051+0000","last_peered":"2024-09-14T11:55:15.866051+0000","last_clean":"2024-09-14T11:55:15.866051+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:55:15.866051+0000","last_undegraded":"2024-09-14T11:55:15.866051+0000","last_fullsized":"2024-09-14T11:55:15.866051+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.863213+0000","last_change":"2024-09-14T11:32:32.585885+0000","last_active":"2024-09-14T11:54:18.863213+0000","last_peered":"2024-09-14T11:54:18.863213+0000","last_clean":"2024-09-14T11:54:18.863213+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:54:18.863213+0000","last_undegraded":"2024-09-14T11:54:18.863213+0000","last_fullsized":"2024-09-14T11:54:18.863213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:13.003196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.875756+0000","last_change":"2024-09-14T11:32:29.556257+0000","last_active":"2024-09-14T11:55:58.875756+0000","last_peered":"2024-09-14T11:55:58.875756+0000","last_clean":"2024-09-14T11:55:58.875756+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:55:58.875756+0000","last_undegraded":"2024-09-14T11:55:58.875756+0000","last_fullsized":"2024-09-14T11:55:58.875756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:03.738228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859107+0000","last_change":"2024-09-14T11:30:45.181226+0000","last_active":"2024-09-14T11:54:58.859107+0000","last_peered":"2024-09-14T11:54:58.859107+0000","last_clean":"2024-09-14T11:54:58.859107+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:54:58.859107+0000","last_undegraded":"2024-09-14T11:54:58.859107+0000","last_fullsized":"2024-09-14T11:54:58.859107+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:13.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.860482+0000","last_change":"2024-09-14T11:43:35.601936+0000","last_active":"2024-09-14T11:55:18.860482+0000","last_peered":"2024-09-14T11:55:18.860482+0000","last_clean":"2024-09-14T11:55:18.860482+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:55:18.860482+0000","last_undegraded":"2024-09-14T11:55:18.860482+0000","last_fullsized":"2024-09-14T11:55:18.860482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:28.098855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877364+0000","last_change":"2024-09-14T11:32:32.588409+0000","last_active":"2024-09-14T11:56:03.877364+0000","last_peered":"2024-09-14T11:56:03.877364+0000","last_clean":"2024-09-14T11:56:03.877364+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:56:03.877364+0000","last_undegraded":"2024-09-14T11:56:03.877364+0000","last_fullsized":"2024-09-14T11:56:03.877364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:05.997127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.860625+0000","last_change":"2024-09-14T11:32:29.554191+0000","last_active":"2024-09-14T11:54:13.860625+0000","last_peered":"2024-09-14T11:54:13.860625+0000","last_clean":"2024-09-14T11:54:13.860625+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:54:13.860625+0000","last_undegraded":"2024-09-14T11:54:13.860625+0000","last_fullsized":"2024-09-14T11:54:13.860625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4123,"num_write":3,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.870574+0000","last_change":"2024-09-14T11:30:45.186297+0000","last_active":"2024-09-14T11:55:59.870574+0000","last_peered":"2024-09-14T11:55:59.870574+0000","last_clean":"2024-09-14T11:55:59.870574+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:55:59.870574+0000","last_undegraded":"2024-09-14T11:55:59.870574+0000","last_fullsized":"2024-09-14T11:55:59.870574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.503260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869999+0000","last_change":"2024-09-14T11:43:35.602751+0000","last_active":"2024-09-14T11:55:18.869999+0000","last_peered":"2024-09-14T11:55:18.869999+0000","last_clean":"2024-09-14T11:55:18.869999+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:55:18.869999+0000","last_undegraded":"2024-09-14T11:55:18.869999+0000","last_fullsized":"2024-09-14T11:55:18.869999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:27.871586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'1","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.863266+0000","last_change":"2024-09-14T11:32:32.582994+0000","last_active":"2024-09-14T11:54:18.863266+0000","last_peered":"2024-09-14T11:54:18.863266+0000","last_clean":"2024-09-14T11:54:18.863266+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:54:18.863266+0000","last_undegraded":"2024-09-14T11:54:18.863266+0000","last_fullsized":"2024-09-14T11:54:18.863266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:49.256978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'3","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.852923+0000","last_change":"2024-09-14T11:32:29.544034+0000","last_active":"2024-09-14T11:54:13.852923+0000","last_peered":"2024-09-14T11:54:13.852923+0000","last_clean":"2024-09-14T11:54:13.852923+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:54:13.852923+0000","last_undegraded":"2024-09-14T11:54:13.852923+0000","last_fullsized":"2024-09-14T11:54:13.852923+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858457+0000","last_change":"2024-09-14T11:30:45.184378+0000","last_active":"2024-09-14T11:54:58.858457+0000","last_peered":"2024-09-14T11:54:58.858457+0000","last_clean":"2024-09-14T11:54:58.858457+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:54:58.858457+0000","last_undegraded":"2024-09-14T11:54:58.858457+0000","last_fullsized":"2024-09-14T11:54:58.858457+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:03.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869969+0000","last_change":"2024-09-14T11:43:35.601578+0000","last_active":"2024-09-14T11:55:18.869969+0000","last_peered":"2024-09-14T11:55:18.869969+0000","last_clean":"2024-09-14T11:55:18.869969+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:55:18.869969+0000","last_undegraded":"2024-09-14T11:55:18.869969+0000","last_fullsized":"2024-09-14T11:55:18.869969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:45.561461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999626+0000","last_change":"2024-09-14T11:32:32.581631+0000","last_active":"2024-09-14T11:54:18.999626+0000","last_peered":"2024-09-14T11:54:18.999626+0000","last_clean":"2024-09-14T11:54:18.999626+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:54:18.999626+0000","last_undegraded":"2024-09-14T11:54:18.999626+0000","last_fullsized":"2024-09-14T11:54:18.999626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:08.950123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.853433+0000","last_change":"2024-09-14T11:32:29.550009+0000","last_active":"2024-09-14T11:54:13.853433+0000","last_peered":"2024-09-14T11:54:13.853433+0000","last_clean":"2024-09-14T11:54:13.853433+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:54:13.853433+0000","last_undegraded":"2024-09-14T11:54:13.853433+0000","last_fullsized":"2024-09-14T11:54:13.853433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:07.302819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":768,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.860570+0000","last_change":"2024-09-14T11:30:45.185397+0000","last_active":"2024-09-14T11:54:13.860570+0000","last_peered":"2024-09-14T11:54:13.860570+0000","last_clean":"2024-09-14T11:54:13.860570+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:54:13.860570+0000","last_undegraded":"2024-09-14T11:54:13.860570+0000","last_fullsized":"2024-09-14T11:54:13.860570+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:30.178621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874909+0000","last_change":"2024-09-14T11:43:35.603719+0000","last_active":"2024-09-14T11:55:43.874909+0000","last_peered":"2024-09-14T11:55:43.874909+0000","last_clean":"2024-09-14T11:55:43.874909+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:55:43.874909+0000","last_undegraded":"2024-09-14T11:55:43.874909+0000","last_fullsized":"2024-09-14T11:55:43.874909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:21.587122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'3","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.871640+0000","last_change":"2024-09-14T11:32:32.583371+0000","last_active":"2024-09-14T11:55:55.871640+0000","last_peered":"2024-09-14T11:55:55.871640+0000","last_clean":"2024-09-14T11:55:55.871640+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:55:55.871640+0000","last_undegraded":"2024-09-14T11:55:55.871640+0000","last_fullsized":"2024-09-14T11:55:55.871640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:26.139200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'6","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011289+0000","last_change":"2024-09-14T11:32:29.556494+0000","last_active":"2024-09-14T11:55:49.011289+0000","last_peered":"2024-09-14T11:55:49.011289+0000","last_clean":"2024-09-14T11:55:49.011289+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:55:49.011289+0000","last_undegraded":"2024-09-14T11:55:49.011289+0000","last_fullsized":"2024-09-14T11:55:49.011289+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:44.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7227,"num_write":11,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":173,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.859808+0000","last_change":"2024-09-14T11:30:45.184935+0000","last_active":"2024-09-14T11:54:08.859808+0000","last_peered":"2024-09-14T11:54:08.859808+0000","last_clean":"2024-09-14T11:54:08.859808+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:54:08.859808+0000","last_undegraded":"2024-09-14T11:54:08.859808+0000","last_fullsized":"2024-09-14T11:54:08.859808+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:16.452875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864520+0000","last_change":"2024-09-14T11:43:35.606065+0000","last_active":"2024-09-14T11:55:43.864520+0000","last_peered":"2024-09-14T11:55:43.864520+0000","last_clean":"2024-09-14T11:55:43.864520+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:55:43.864520+0000","last_undegraded":"2024-09-14T11:55:43.864520+0000","last_fullsized":"2024-09-14T11:55:43.864520+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:45.826564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'5","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.871596+0000","last_change":"2024-09-14T11:32:32.581191+0000","last_active":"2024-09-14T11:55:55.871596+0000","last_peered":"2024-09-14T11:55:55.871596+0000","last_clean":"2024-09-14T11:55:55.871596+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:55:55.871596+0000","last_undegraded":"2024-09-14T11:55:55.871596+0000","last_fullsized":"2024-09-14T11:55:55.871596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:56.670374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875460+0000","last_change":"2024-09-14T11:32:29.543122+0000","last_active":"2024-09-14T11:55:48.875460+0000","last_peered":"2024-09-14T11:55:48.875460+0000","last_clean":"2024-09-14T11:55:48.875460+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:55:48.875460+0000","last_undegraded":"2024-09-14T11:55:48.875460+0000","last_fullsized":"2024-09-14T11:55:48.875460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:34.079866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.657310+0000","last_change":"2024-09-14T11:30:45.187136+0000","last_active":"2024-09-14T11:55:59.657310+0000","last_peered":"2024-09-14T11:55:59.657310+0000","last_clean":"2024-09-14T11:55:59.657310+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:55:59.657310+0000","last_undegraded":"2024-09-14T11:55:59.657310+0000","last_fullsized":"2024-09-14T11:55:59.657310+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:42.845918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861900+0000","last_change":"2024-09-14T11:43:35.608421+0000","last_active":"2024-09-14T11:55:23.861900+0000","last_peered":"2024-09-14T11:55:23.861900+0000","last_clean":"2024-09-14T11:55:23.861900+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:55:23.861900+0000","last_undegraded":"2024-09-14T11:55:23.861900+0000","last_fullsized":"2024-09-14T11:55:23.861900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:33.729484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.876137+0000","last_change":"2024-09-14T11:32:32.590267+0000","last_active":"2024-09-14T11:55:53.876137+0000","last_peered":"2024-09-14T11:55:53.876137+0000","last_clean":"2024-09-14T11:55:53.876137+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:55:53.876137+0000","last_undegraded":"2024-09-14T11:55:53.876137+0000","last_fullsized":"2024-09-14T11:55:53.876137+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.861311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954756+0000","last_change":"2024-09-14T11:32:29.557676+0000","last_active":"2024-09-14T11:55:48.954756+0000","last_peered":"2024-09-14T11:55:48.954756+0000","last_clean":"2024-09-14T11:55:48.954756+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:55:48.954756+0000","last_undegraded":"2024-09-14T11:55:48.954756+0000","last_fullsized":"2024-09-14T11:55:48.954756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:16.569296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.998083+0000","last_change":"2024-09-14T11:30:45.183316+0000","last_active":"2024-09-14T11:54:08.998083+0000","last_peered":"2024-09-14T11:54:08.998083+0000","last_clean":"2024-09-14T11:54:08.998083+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:54:08.998083+0000","last_undegraded":"2024-09-14T11:54:08.998083+0000","last_fullsized":"2024-09-14T11:54:08.998083+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:21.498493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874873+0000","last_change":"2024-09-14T11:43:35.603573+0000","last_active":"2024-09-14T11:55:43.874873+0000","last_peered":"2024-09-14T11:55:43.874873+0000","last_clean":"2024-09-14T11:55:43.874873+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:55:43.874873+0000","last_undegraded":"2024-09-14T11:55:43.874873+0000","last_fullsized":"2024-09-14T11:55:43.874873+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:21.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.955285+0000","last_change":"2024-09-14T11:32:32.583874+0000","last_active":"2024-09-14T11:55:53.955285+0000","last_peered":"2024-09-14T11:55:53.955285+0000","last_clean":"2024-09-14T11:55:53.955285+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:55:53.955285+0000","last_undegraded":"2024-09-14T11:55:53.955285+0000","last_fullsized":"2024-09-14T11:55:53.955285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.827399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874557+0000","last_change":"2024-09-14T11:32:29.557054+0000","last_active":"2024-09-14T11:55:48.874557+0000","last_peered":"2024-09-14T11:55:48.874557+0000","last_clean":"2024-09-14T11:55:48.874557+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:55:48.874557+0000","last_undegraded":"2024-09-14T11:55:48.874557+0000","last_fullsized":"2024-09-14T11:55:48.874557+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:17.332064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.797072+0000","last_change":"2024-09-14T11:30:45.188008+0000","last_active":"2024-09-14T11:55:24.797072+0000","last_peered":"2024-09-14T11:55:24.797072+0000","last_clean":"2024-09-14T11:55:24.797072+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:55:24.797072+0000","last_undegraded":"2024-09-14T11:55:24.797072+0000","last_fullsized":"2024-09-14T11:55:24.797072+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:10.454288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.855636+0000","last_change":"2024-09-14T11:43:35.601146+0000","last_active":"2024-09-14T11:54:33.855636+0000","last_peered":"2024-09-14T11:54:33.855636+0000","last_clean":"2024-09-14T11:54:33.855636+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:54:33.855636+0000","last_undegraded":"2024-09-14T11:54:33.855636+0000","last_fullsized":"2024-09-14T11:54:33.855636+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:58.732885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869141+0000","last_change":"2024-09-14T11:32:32.585896+0000","last_active":"2024-09-14T11:55:03.869141+0000","last_peered":"2024-09-14T11:55:03.869141+0000","last_clean":"2024-09-14T11:55:03.869141+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:55:03.869141+0000","last_undegraded":"2024-09-14T11:55:03.869141+0000","last_fullsized":"2024-09-14T11:55:03.869141+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:46.169476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867339+0000","last_change":"2024-09-14T11:32:29.550392+0000","last_active":"2024-09-14T11:54:58.867339+0000","last_peered":"2024-09-14T11:54:58.867339+0000","last_clean":"2024-09-14T11:54:58.867339+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:54:58.867339+0000","last_undegraded":"2024-09-14T11:54:58.867339+0000","last_fullsized":"2024-09-14T11:54:58.867339+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.897313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":98,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874939+0000","last_change":"2024-09-14T11:30:45.187527+0000","last_active":"2024-09-14T11:55:43.874939+0000","last_peered":"2024-09-14T11:55:43.874939+0000","last_clean":"2024-09-14T11:55:43.874939+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:55:43.874939+0000","last_undegraded":"2024-09-14T11:55:43.874939+0000","last_fullsized":"2024-09-14T11:55:43.874939+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:10.115937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866776+0000","last_change":"2024-09-14T11:43:35.607758+0000","last_active":"2024-09-14T11:54:53.866776+0000","last_peered":"2024-09-14T11:54:53.866776+0000","last_clean":"2024-09-14T11:54:53.866776+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:54:53.866776+0000","last_undegraded":"2024-09-14T11:54:53.866776+0000","last_fullsized":"2024-09-14T11:54:53.866776+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:25.238514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869108+0000","last_change":"2024-09-14T11:32:32.589816+0000","last_active":"2024-09-14T11:55:03.869108+0000","last_peered":"2024-09-14T11:55:03.869108+0000","last_clean":"2024-09-14T11:55:03.869108+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:55:03.869108+0000","last_undegraded":"2024-09-14T11:55:03.869108+0000","last_fullsized":"2024-09-14T11:55:03.869108+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:48.593038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858469+0000","last_change":"2024-09-14T11:32:29.550400+0000","last_active":"2024-09-14T11:54:58.858469+0000","last_peered":"2024-09-14T11:54:58.858469+0000","last_clean":"2024-09-14T11:54:58.858469+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:54:58.858469+0000","last_undegraded":"2024-09-14T11:54:58.858469+0000","last_fullsized":"2024-09-14T11:54:58.858469+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:37.276571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872259+0000","last_change":"2024-09-14T11:30:45.175794+0000","last_active":"2024-09-14T11:55:33.872259+0000","last_peered":"2024-09-14T11:55:33.872259+0000","last_clean":"2024-09-14T11:55:33.872259+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:55:33.872259+0000","last_undegraded":"2024-09-14T11:55:33.872259+0000","last_fullsized":"2024-09-14T11:55:33.872259+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:12.580971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944465+0000","last_change":"2024-09-14T11:43:35.603624+0000","last_active":"2024-09-14T11:54:28.944465+0000","last_peered":"2024-09-14T11:54:28.944465+0000","last_clean":"2024-09-14T11:54:28.944465+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:54:28.944465+0000","last_undegraded":"2024-09-14T11:54:28.944465+0000","last_fullsized":"2024-09-14T11:54:28.944465+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:06.649979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865526+0000","last_change":"2024-09-14T11:32:32.582078+0000","last_active":"2024-09-14T11:55:10.865526+0000","last_peered":"2024-09-14T11:55:10.865526+0000","last_clean":"2024-09-14T11:55:10.865526+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:55:10.865526+0000","last_undegraded":"2024-09-14T11:55:10.865526+0000","last_fullsized":"2024-09-14T11:55:10.865526+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.729935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859071+0000","last_change":"2024-09-14T11:32:29.556788+0000","last_active":"2024-09-14T11:54:58.859071+0000","last_peered":"2024-09-14T11:54:58.859071+0000","last_clean":"2024-09-14T11:54:58.859071+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:54:58.859071+0000","last_undegraded":"2024-09-14T11:54:58.859071+0000","last_fullsized":"2024-09-14T11:54:58.859071+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:25.298432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.952685+0000","last_change":"2024-09-14T11:30:45.181601+0000","last_active":"2024-09-14T11:55:33.952685+0000","last_peered":"2024-09-14T11:55:33.952685+0000","last_clean":"2024-09-14T11:55:33.952685+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:55:33.952685+0000","last_undegraded":"2024-09-14T11:55:33.952685+0000","last_fullsized":"2024-09-14T11:55:33.952685+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.863012+0000","last_change":"2024-09-14T11:43:35.603524+0000","last_active":"2024-09-14T11:54:28.863012+0000","last_peered":"2024-09-14T11:54:28.863012+0000","last_clean":"2024-09-14T11:54:28.863012+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:54:28.863012+0000","last_undegraded":"2024-09-14T11:54:28.863012+0000","last_fullsized":"2024-09-14T11:54:28.863012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:22.177315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869154+0000","last_change":"2024-09-14T11:32:32.588422+0000","last_active":"2024-09-14T11:55:03.869154+0000","last_peered":"2024-09-14T11:55:03.869154+0000","last_clean":"2024-09-14T11:55:03.869154+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:55:03.869154+0000","last_undegraded":"2024-09-14T11:55:03.869154+0000","last_fullsized":"2024-09-14T11:55:03.869154+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.486355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864803+0000","last_change":"2024-09-14T11:32:29.558855+0000","last_active":"2024-09-14T11:55:05.864803+0000","last_peered":"2024-09-14T11:55:05.864803+0000","last_clean":"2024-09-14T11:55:05.864803+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:55:05.864803+0000","last_undegraded":"2024-09-14T11:55:05.864803+0000","last_fullsized":"2024-09-14T11:55:05.864803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.718076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":172,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.862421+0000","last_change":"2024-09-14T11:30:45.186320+0000","last_active":"2024-09-14T11:55:33.862421+0000","last_peered":"2024-09-14T11:55:33.862421+0000","last_clean":"2024-09-14T11:55:33.862421+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:55:33.862421+0000","last_undegraded":"2024-09-14T11:55:33.862421+0000","last_fullsized":"2024-09-14T11:55:33.862421+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:02.402885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867996+0000","last_change":"2024-09-14T11:43:35.607826+0000","last_active":"2024-09-14T11:54:53.867996+0000","last_peered":"2024-09-14T11:54:53.867996+0000","last_clean":"2024-09-14T11:54:53.867996+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:54:53.867996+0000","last_undegraded":"2024-09-14T11:54:53.867996+0000","last_fullsized":"2024-09-14T11:54:53.867996+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:17.558008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.016002+0000","last_change":"2024-09-14T11:32:32.590048+0000","last_active":"2024-09-14T11:56:24.016002+0000","last_peered":"2024-09-14T11:56:24.016002+0000","last_clean":"2024-09-14T11:56:24.016002+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:56:24.016002+0000","last_undegraded":"2024-09-14T11:56:24.016002+0000","last_fullsized":"2024-09-14T11:56:24.016002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:10.124434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868576+0000","last_change":"2024-09-14T11:32:29.557361+0000","last_active":"2024-09-14T11:56:18.868576+0000","last_peered":"2024-09-14T11:56:18.868576+0000","last_clean":"2024-09-14T11:56:18.868576+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:56:18.868576+0000","last_undegraded":"2024-09-14T11:56:18.868576+0000","last_fullsized":"2024-09-14T11:56:18.868576+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:06.391010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863103+0000","last_change":"2024-09-14T11:30:45.189776+0000","last_active":"2024-09-14T11:55:33.863103+0000","last_peered":"2024-09-14T11:55:33.863103+0000","last_clean":"2024-09-14T11:55:33.863103+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:55:33.863103+0000","last_undegraded":"2024-09-14T11:55:33.863103+0000","last_fullsized":"2024-09-14T11:55:33.863103+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:07.248111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867381+0000","last_change":"2024-09-14T11:43:35.605135+0000","last_active":"2024-09-14T11:54:58.867381+0000","last_peered":"2024-09-14T11:54:58.867381+0000","last_clean":"2024-09-14T11:54:58.867381+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:54:58.867381+0000","last_undegraded":"2024-09-14T11:54:58.867381+0000","last_fullsized":"2024-09-14T11:54:58.867381+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879560+0000","last_change":"2024-09-14T11:32:32.579119+0000","last_active":"2024-09-14T11:56:23.879560+0000","last_peered":"2024-09-14T11:56:23.879560+0000","last_clean":"2024-09-14T11:56:23.879560+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:56:23.879560+0000","last_undegraded":"2024-09-14T11:56:23.879560+0000","last_fullsized":"2024-09-14T11:56:23.879560+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:39.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.874789+0000","last_change":"2024-09-14T11:32:29.558623+0000","last_active":"2024-09-14T11:56:20.874789+0000","last_peered":"2024-09-14T11:56:20.874789+0000","last_clean":"2024-09-14T11:56:20.874789+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:56:20.874789+0000","last_undegraded":"2024-09-14T11:56:20.874789+0000","last_fullsized":"2024-09-14T11:56:20.874789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:00.753847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.547369+0000","last_change":"2024-09-14T11:30:45.184693+0000","last_active":"2024-09-14T11:55:02.547369+0000","last_peered":"2024-09-14T11:55:02.547369+0000","last_clean":"2024-09-14T11:55:02.547369+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:55:02.547369+0000","last_undegraded":"2024-09-14T11:55:02.547369+0000","last_fullsized":"2024-09-14T11:55:02.547369+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:26.556025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866795+0000","last_change":"2024-09-14T11:43:35.606592+0000","last_active":"2024-09-14T11:54:53.866795+0000","last_peered":"2024-09-14T11:54:53.866795+0000","last_clean":"2024-09-14T11:54:53.866795+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:54:53.866795+0000","last_undegraded":"2024-09-14T11:54:53.866795+0000","last_fullsized":"2024-09-14T11:54:53.866795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:47.717972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864758+0000","last_change":"2024-09-14T11:32:32.582791+0000","last_active":"2024-09-14T11:55:05.864758+0000","last_peered":"2024-09-14T11:55:05.864758+0000","last_clean":"2024-09-14T11:55:05.864758+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:55:05.864758+0000","last_undegraded":"2024-09-14T11:55:05.864758+0000","last_fullsized":"2024-09-14T11:55:05.864758+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.426108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.869202+0000","last_change":"2024-09-14T11:32:29.556753+0000","last_active":"2024-09-14T11:56:23.869202+0000","last_peered":"2024-09-14T11:56:23.869202+0000","last_clean":"2024-09-14T11:56:23.869202+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:56:23.869202+0000","last_undegraded":"2024-09-14T11:56:23.869202+0000","last_fullsized":"2024-09-14T11:56:23.869202+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:34.099936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.865798+0000","last_change":"2024-09-14T11:30:45.185455+0000","last_active":"2024-09-14T11:55:59.865798+0000","last_peered":"2024-09-14T11:55:59.865798+0000","last_clean":"2024-09-14T11:55:59.865798+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:55:59.865798+0000","last_undegraded":"2024-09-14T11:55:59.865798+0000","last_fullsized":"2024-09-14T11:55:59.865798+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:25.948213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.858467+0000","last_change":"2024-09-14T11:43:35.603825+0000","last_active":"2024-09-14T11:54:53.858467+0000","last_peered":"2024-09-14T11:54:53.858467+0000","last_clean":"2024-09-14T11:54:53.858467+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:54:53.858467+0000","last_undegraded":"2024-09-14T11:54:53.858467+0000","last_fullsized":"2024-09-14T11:54:53.858467+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:22.239624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880311+0000","last_change":"2024-09-14T11:32:32.590037+0000","last_active":"2024-09-14T11:56:28.880311+0000","last_peered":"2024-09-14T11:56:28.880311+0000","last_clean":"2024-09-14T11:56:28.880311+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:56:28.880311+0000","last_undegraded":"2024-09-14T11:56:28.880311+0000","last_fullsized":"2024-09-14T11:56:28.880311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:48.742115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004361+0000","last_change":"2024-09-14T11:32:29.552051+0000","last_active":"2024-09-14T11:54:59.004361+0000","last_peered":"2024-09-14T11:54:59.004361+0000","last_clean":"2024-09-14T11:54:59.004361+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:54:59.004361+0000","last_undegraded":"2024-09-14T11:54:59.004361+0000","last_fullsized":"2024-09-14T11:54:59.004361+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.824552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945791+0000","last_change":"2024-09-14T11:30:45.183254+0000","last_active":"2024-09-14T11:54:38.945791+0000","last_peered":"2024-09-14T11:54:38.945791+0000","last_clean":"2024-09-14T11:54:38.945791+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:54:38.945791+0000","last_undegraded":"2024-09-14T11:54:38.945791+0000","last_fullsized":"2024-09-14T11:54:38.945791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:04.016656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877254+0000","last_change":"2024-09-14T11:43:35.604116+0000","last_active":"2024-09-14T11:56:08.877254+0000","last_peered":"2024-09-14T11:56:08.877254+0000","last_clean":"2024-09-14T11:56:08.877254+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:56:08.877254+0000","last_undegraded":"2024-09-14T11:56:08.877254+0000","last_fullsized":"2024-09-14T11:56:08.877254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:16.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863176+0000","last_change":"2024-09-14T11:32:32.583981+0000","last_active":"2024-09-14T11:55:33.863176+0000","last_peered":"2024-09-14T11:55:33.863176+0000","last_clean":"2024-09-14T11:55:33.863176+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:55:33.863176+0000","last_undegraded":"2024-09-14T11:55:33.863176+0000","last_fullsized":"2024-09-14T11:55:33.863176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:37.109384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870848+0000","last_change":"2024-09-14T11:32:29.553611+0000","last_active":"2024-09-14T11:55:23.870848+0000","last_peered":"2024-09-14T11:55:23.870848+0000","last_clean":"2024-09-14T11:55:23.870848+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:55:23.870848+0000","last_undegraded":"2024-09-14T11:55:23.870848+0000","last_fullsized":"2024-09-14T11:55:23.870848+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:23.400420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.064541+0000","last_change":"2024-09-14T11:30:45.182248+0000","last_active":"2024-09-14T11:55:02.064541+0000","last_peered":"2024-09-14T11:55:02.064541+0000","last_clean":"2024-09-14T11:55:02.064541+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:55:02.064541+0000","last_undegraded":"2024-09-14T11:55:02.064541+0000","last_fullsized":"2024-09-14T11:55:02.064541+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:12.204716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877270+0000","last_change":"2024-09-14T11:43:35.603484+0000","last_active":"2024-09-14T11:56:08.877270+0000","last_peered":"2024-09-14T11:56:08.877270+0000","last_clean":"2024-09-14T11:56:08.877270+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:56:08.877270+0000","last_undegraded":"2024-09-14T11:56:08.877270+0000","last_fullsized":"2024-09-14T11:56:08.877270+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.596092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'1","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.862484+0000","last_change":"2024-09-14T11:32:32.575572+0000","last_active":"2024-09-14T11:55:28.862484+0000","last_peered":"2024-09-14T11:55:28.862484+0000","last_clean":"2024-09-14T11:55:28.862484+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:55:28.862484+0000","last_undegraded":"2024-09-14T11:55:28.862484+0000","last_fullsized":"2024-09-14T11:55:28.862484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:01.425017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.861591+0000","last_change":"2024-09-14T11:32:29.551182+0000","last_active":"2024-09-14T11:55:28.861591+0000","last_peered":"2024-09-14T11:55:28.861591+0000","last_clean":"2024-09-14T11:55:28.861591+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:55:28.861591+0000","last_undegraded":"2024-09-14T11:55:28.861591+0000","last_fullsized":"2024-09-14T11:55:28.861591+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.092021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945893+0000","last_change":"2024-09-14T11:30:45.184179+0000","last_active":"2024-09-14T11:54:38.945893+0000","last_peered":"2024-09-14T11:54:38.945893+0000","last_clean":"2024-09-14T11:54:38.945893+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:54:38.945893+0000","last_undegraded":"2024-09-14T11:54:38.945893+0000","last_fullsized":"2024-09-14T11:54:38.945893+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.455784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869499+0000","last_change":"2024-09-14T11:43:35.607506+0000","last_active":"2024-09-14T11:55:40.869499+0000","last_peered":"2024-09-14T11:55:40.869499+0000","last_clean":"2024-09-14T11:55:40.869499+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:55:40.869499+0000","last_undegraded":"2024-09-14T11:55:40.869499+0000","last_fullsized":"2024-09-14T11:55:40.869499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:13.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879696+0000","last_change":"2024-09-14T11:32:32.583839+0000","last_active":"2024-09-14T11:56:23.879696+0000","last_peered":"2024-09-14T11:56:23.879696+0000","last_clean":"2024-09-14T11:56:23.879696+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:56:23.879696+0000","last_undegraded":"2024-09-14T11:56:23.879696+0000","last_fullsized":"2024-09-14T11:56:23.879696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:03.004208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.878633+0000","last_change":"2024-09-14T11:32:29.554290+0000","last_active":"2024-09-14T11:56:18.878633+0000","last_peered":"2024-09-14T11:56:18.878633+0000","last_clean":"2024-09-14T11:56:18.878633+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:56:18.878633+0000","last_undegraded":"2024-09-14T11:56:18.878633+0000","last_fullsized":"2024-09-14T11:56:18.878633+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:54.635912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":64,"num_write":3,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.875265+0000","last_change":"2024-09-14T11:30:45.188717+0000","last_active":"2024-09-14T11:55:53.875265+0000","last_peered":"2024-09-14T11:55:53.875265+0000","last_clean":"2024-09-14T11:55:53.875265+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:55:53.875265+0000","last_undegraded":"2024-09-14T11:55:53.875265+0000","last_fullsized":"2024-09-14T11:55:53.875265+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:22.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013869+0000","last_change":"2024-09-14T11:43:35.604229+0000","last_active":"2024-09-14T11:56:09.013869+0000","last_peered":"2024-09-14T11:56:09.013869+0000","last_clean":"2024-09-14T11:56:09.013869+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:56:09.013869+0000","last_undegraded":"2024-09-14T11:56:09.013869+0000","last_fullsized":"2024-09-14T11:56:09.013869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:36.198961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.016119+0000","last_change":"2024-09-14T11:32:32.579628+0000","last_active":"2024-09-14T11:56:24.016119+0000","last_peered":"2024-09-14T11:56:24.016119+0000","last_clean":"2024-09-14T11:56:24.016119+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:56:24.016119+0000","last_undegraded":"2024-09-14T11:56:24.016119+0000","last_fullsized":"2024-09-14T11:56:24.016119+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:15.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'1","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.878920+0000","last_change":"2024-09-14T11:32:29.555597+0000","last_active":"2024-09-14T11:56:18.878920+0000","last_peered":"2024-09-14T11:56:18.878920+0000","last_clean":"2024-09-14T11:56:18.878920+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:56:18.878920+0000","last_undegraded":"2024-09-14T11:56:18.878920+0000","last_fullsized":"2024-09-14T11:56:18.878920+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:41.029993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870178+0000","last_change":"2024-09-14T11:30:45.176934+0000","last_active":"2024-09-14T11:55:45.870178+0000","last_peered":"2024-09-14T11:55:45.870178+0000","last_clean":"2024-09-14T11:55:45.870178+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:55:45.870178+0000","last_undegraded":"2024-09-14T11:55:45.870178+0000","last_fullsized":"2024-09-14T11:55:45.870178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:07.587565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.855078+0000","last_change":"2024-09-14T11:43:35.606492+0000","last_active":"2024-09-14T11:54:28.855078+0000","last_peered":"2024-09-14T11:54:28.855078+0000","last_clean":"2024-09-14T11:54:28.855078+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:54:28.855078+0000","last_undegraded":"2024-09-14T11:54:28.855078+0000","last_fullsized":"2024-09-14T11:54:28.855078+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:37.980270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.868028+0000","last_change":"2024-09-14T11:32:32.587253+0000","last_active":"2024-09-14T11:55:30.868028+0000","last_peered":"2024-09-14T11:55:30.868028+0000","last_clean":"2024-09-14T11:55:30.868028+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:55:30.868028+0000","last_undegraded":"2024-09-14T11:55:30.868028+0000","last_fullsized":"2024-09-14T11:55:30.868028+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:48.236842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'1","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.881108+0000","last_change":"2024-09-14T11:32:29.554686+0000","last_active":"2024-09-14T11:56:33.881108+0000","last_peered":"2024-09-14T11:56:33.881108+0000","last_clean":"2024-09-14T11:56:33.881108+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:56:33.881108+0000","last_undegraded":"2024-09-14T11:56:33.881108+0000","last_fullsized":"2024-09-14T11:56:33.881108+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:47.349081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874577+0000","last_change":"2024-09-14T11:30:45.181837+0000","last_active":"2024-09-14T11:55:48.874577+0000","last_peered":"2024-09-14T11:55:48.874577+0000","last_clean":"2024-09-14T11:55:48.874577+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:55:48.874577+0000","last_undegraded":"2024-09-14T11:55:48.874577+0000","last_fullsized":"2024-09-14T11:55:48.874577+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:59.286638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.855431+0000","last_change":"2024-09-14T11:43:35.601443+0000","last_active":"2024-09-14T11:54:28.855431+0000","last_peered":"2024-09-14T11:54:28.855431+0000","last_clean":"2024-09-14T11:54:28.855431+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:54:28.855431+0000","last_undegraded":"2024-09-14T11:54:28.855431+0000","last_fullsized":"2024-09-14T11:54:28.855431+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.372764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882441+0000","last_change":"2024-09-14T11:32:32.587278+0000","last_active":"2024-09-14T11:56:43.882441+0000","last_peered":"2024-09-14T11:56:43.882441+0000","last_clean":"2024-09-14T11:56:43.882441+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:56:43.882441+0000","last_undegraded":"2024-09-14T11:56:43.882441+0000","last_fullsized":"2024-09-14T11:56:43.882441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.322094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870808+0000","last_change":"2024-09-14T11:32:29.548859+0000","last_active":"2024-09-14T11:55:23.870808+0000","last_peered":"2024-09-14T11:55:23.870808+0000","last_clean":"2024-09-14T11:55:23.870808+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:55:23.870808+0000","last_undegraded":"2024-09-14T11:55:23.870808+0000","last_fullsized":"2024-09-14T11:55:23.870808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:45.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":210,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011327+0000","last_change":"2024-09-14T11:30:45.187608+0000","last_active":"2024-09-14T11:55:49.011327+0000","last_peered":"2024-09-14T11:55:49.011327+0000","last_clean":"2024-09-14T11:55:49.011327+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:55:49.011327+0000","last_undegraded":"2024-09-14T11:55:49.011327+0000","last_fullsized":"2024-09-14T11:55:49.011327+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:16.607409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.867231+0000","last_change":"2024-09-14T11:43:35.605855+0000","last_active":"2024-09-14T11:56:08.867231+0000","last_peered":"2024-09-14T11:56:08.867231+0000","last_clean":"2024-09-14T11:56:08.867231+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:56:08.867231+0000","last_undegraded":"2024-09-14T11:56:08.867231+0000","last_fullsized":"2024-09-14T11:56:08.867231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:26.463408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'2","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.951981+0000","last_change":"2024-09-14T11:32:32.590849+0000","last_active":"2024-09-14T11:55:28.951981+0000","last_peered":"2024-09-14T11:55:28.951981+0000","last_clean":"2024-09-14T11:55:28.951981+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:55:28.951981+0000","last_undegraded":"2024-09-14T11:55:28.951981+0000","last_fullsized":"2024-09-14T11:55:28.951981+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:53.175496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108940,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2166,"num_write":2,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'6","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:25.867386+0000","last_change":"2024-09-14T11:32:29.553146+0000","last_active":"2024-09-14T11:55:25.867386+0000","last_peered":"2024-09-14T11:55:25.867386+0000","last_clean":"2024-09-14T11:55:25.867386+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:55:25.867386+0000","last_undegraded":"2024-09-14T11:55:25.867386+0000","last_fullsized":"2024-09-14T11:55:25.867386+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:39.348345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":11,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":87,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954727+0000","last_change":"2024-09-14T11:30:45.183295+0000","last_active":"2024-09-14T11:55:48.954727+0000","last_peered":"2024-09-14T11:55:48.954727+0000","last_clean":"2024-09-14T11:55:48.954727+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:55:48.954727+0000","last_undegraded":"2024-09-14T11:55:48.954727+0000","last_fullsized":"2024-09-14T11:55:48.954727+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:30.030410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.878101+0000","last_change":"2024-09-14T11:43:35.604955+0000","last_active":"2024-09-14T11:56:13.878101+0000","last_peered":"2024-09-14T11:56:13.878101+0000","last_clean":"2024-09-14T11:56:13.878101+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:56:13.878101+0000","last_undegraded":"2024-09-14T11:56:13.878101+0000","last_fullsized":"2024-09-14T11:56:13.878101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.840822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'13","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:29.008243+0000","last_change":"2024-09-14T11:32:32.584702+0000","last_active":"2024-09-14T11:55:29.008243+0000","last_peered":"2024-09-14T11:55:29.008243+0000","last_clean":"2024-09-14T11:55:29.008243+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:55:29.008243+0000","last_undegraded":"2024-09-14T11:55:29.008243+0000","last_fullsized":"2024-09-14T11:55:29.008243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:19.580871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19460,"num_write":23,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951168+0000","last_change":"2024-09-14T11:32:29.553252+0000","last_active":"2024-09-14T11:55:23.951168+0000","last_peered":"2024-09-14T11:55:23.951168+0000","last_clean":"2024-09-14T11:55:23.951168+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:55:23.951168+0000","last_undegraded":"2024-09-14T11:55:23.951168+0000","last_fullsized":"2024-09-14T11:55:23.951168+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:40.879039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:20.521654+0000","last_change":"2024-09-14T11:30:45.183283+0000","last_active":"2024-09-14T11:55:20.521654+0000","last_peered":"2024-09-14T11:55:20.521654+0000","last_clean":"2024-09-14T11:55:20.521654+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:55:20.521654+0000","last_undegraded":"2024-09-14T11:55:20.521654+0000","last_fullsized":"2024-09-14T11:55:20.521654+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:00.428598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'194","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.556201+0000","last_change":"2024-09-14T11:15:32.311949+0000","last_active":"2024-09-14T11:55:17.556201+0000","last_peered":"2024-09-14T11:55:17.556201+0000","last_clean":"2024-09-14T11:55:17.556201+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:55:17.556201+0000","last_undegraded":"2024-09-14T11:55:17.556201+0000","last_fullsized":"2024-09-14T11:55:17.556201+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:25.643807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9487068,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":497,"num_read_kb":68162,"num_write":953,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'445","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465587+0000","last_change":"2024-09-14T11:15:34.326897+0000","last_active":"2024-09-14T11:56:38.465587+0000","last_peered":"2024-09-14T11:56:38.465587+0000","last_clean":"2024-09-14T11:56:38.465587+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:56:38.465587+0000","last_undegraded":"2024-09-14T11:56:38.465587+0000","last_fullsized":"2024-09-14T11:56:38.465587+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:44.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'194","reported_seq":838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865508+0000","last_change":"2024-09-14T11:15:32.317583+0000","last_active":"2024-09-14T11:55:10.865508+0000","last_peered":"2024-09-14T11:55:10.865508+0000","last_clean":"2024-09-14T11:55:10.865508+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:55:10.865508+0000","last_undegraded":"2024-09-14T11:55:10.865508+0000","last_fullsized":"2024-09-14T11:55:10.865508+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:37.196534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11154863,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":84673,"num_write":938,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998595+0000","last_change":"2024-09-14T11:15:34.330220+0000","last_active":"2024-09-14T11:56:36.998595+0000","last_peered":"2024-09-14T11:56:36.998595+0000","last_clean":"2024-09-14T11:56:36.998595+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:56:36.998595+0000","last_undegraded":"2024-09-14T11:56:36.998595+0000","last_fullsized":"2024-09-14T11:56:36.998595+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:39.172882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'212","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.074819+0000","last_change":"2024-09-14T11:15:32.302813+0000","last_active":"2024-09-14T11:56:39.074819+0000","last_peered":"2024-09-14T11:56:39.074819+0000","last_clean":"2024-09-14T11:56:39.074819+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:56:39.074819+0000","last_undegraded":"2024-09-14T11:56:39.074819+0000","last_fullsized":"2024-09-14T11:56:39.074819+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:48.865990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":1085,"num_write":1014,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'743","reported_seq":2196,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815132+0000","last_change":"2024-09-14T11:15:34.316987+0000","last_active":"2024-09-14T11:56:31.815132+0000","last_peered":"2024-09-14T11:56:31.815132+0000","last_clean":"2024-09-14T11:56:31.815132+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:56:31.815132+0000","last_undegraded":"2024-09-14T11:56:31.815132+0000","last_fullsized":"2024-09-14T11:56:31.815132+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:20.185745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'233","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.967008+0000","last_change":"2024-09-14T11:15:32.322744+0000","last_active":"2024-09-14T11:55:55.967008+0000","last_peered":"2024-09-14T11:55:55.967008+0000","last_clean":"2024-09-14T11:55:55.967008+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:55:55.967008+0000","last_undegraded":"2024-09-14T11:55:55.967008+0000","last_fullsized":"2024-09-14T11:55:55.967008+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:12.738315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957164,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":528,"num_read_kb":30923,"num_write":1125,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2085,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136947+0000","last_change":"2024-09-14T11:15:34.323811+0000","last_active":"2024-09-14T11:56:39.136947+0000","last_peered":"2024-09-14T11:56:39.136947+0000","last_clean":"2024-09-14T11:56:39.136947+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:56:39.136947+0000","last_undegraded":"2024-09-14T11:56:39.136947+0000","last_fullsized":"2024-09-14T11:56:39.136947+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.122736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'216","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872289+0000","last_change":"2024-09-14T11:15:32.313227+0000","last_active":"2024-09-14T11:55:33.872289+0000","last_peered":"2024-09-14T11:55:33.872289+0000","last_clean":"2024-09-14T11:55:33.872289+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:55:33.872289+0000","last_undegraded":"2024-09-14T11:55:33.872289+0000","last_fullsized":"2024-09-14T11:55:33.872289+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:24.665300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'966","reported_seq":2607,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518596+0000","last_change":"2024-09-14T11:15:34.323939+0000","last_active":"2024-09-14T11:56:33.518596+0000","last_peered":"2024-09-14T11:56:33.518596+0000","last_clean":"2024-09-14T11:56:33.518596+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:56:33.518596+0000","last_undegraded":"2024-09-14T11:56:33.518596+0000","last_fullsized":"2024-09-14T11:56:33.518596+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:54.340034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'178","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.486361+0000","last_change":"2024-09-14T11:15:32.323327+0000","last_active":"2024-09-14T11:56:28.486361+0000","last_peered":"2024-09-14T11:56:28.486361+0000","last_clean":"2024-09-14T11:56:28.486361+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:56:28.486361+0000","last_undegraded":"2024-09-14T11:56:28.486361+0000","last_fullsized":"2024-09-14T11:56:28.486361+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:45.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4279447,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":540,"num_read_kb":10177,"num_write":895,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466977+0000","last_change":"2024-09-14T11:15:34.316280+0000","last_active":"2024-09-14T11:58:14.466977+0000","last_peered":"2024-09-14T11:58:14.466977+0000","last_clean":"2024-09-14T11:58:14.466977+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:58:14.466977+0000","last_undegraded":"2024-09-14T11:58:14.466977+0000","last_fullsized":"2024-09-14T11:58:14.466977+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:00.310713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'189","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.439143+0000","last_change":"2024-09-14T11:15:32.317672+0000","last_active":"2024-09-14T11:56:22.439143+0000","last_peered":"2024-09-14T11:56:22.439143+0000","last_clean":"2024-09-14T11:56:22.439143+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:56:22.439143+0000","last_undegraded":"2024-09-14T11:56:22.439143+0000","last_fullsized":"2024-09-14T11:56:22.439143+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:04.495027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9687544,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":530,"num_read_kb":12539,"num_write":920,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'490","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465061+0000","last_change":"2024-09-14T11:15:34.328589+0000","last_active":"2024-09-14T11:56:38.465061+0000","last_peered":"2024-09-14T11:56:38.465061+0000","last_clean":"2024-09-14T11:56:38.465061+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:56:38.465061+0000","last_undegraded":"2024-09-14T11:56:38.465061+0000","last_fullsized":"2024-09-14T11:56:38.465061+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.473320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'213","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.120521+0000","last_change":"2024-09-14T11:15:32.320364+0000","last_active":"2024-09-14T11:55:48.120521+0000","last_peered":"2024-09-14T11:55:48.120521+0000","last_clean":"2024-09-14T11:55:48.120521+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:55:48.120521+0000","last_undegraded":"2024-09-14T11:55:48.120521+0000","last_fullsized":"2024-09-14T11:55:48.120521+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:11.338356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4594609,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":31152,"num_write":976,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'593","reported_seq":2457,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882772+0000","last_change":"2024-09-14T11:16:07.517907+0000","last_active":"2024-09-14T11:56:54.882772+0000","last_peered":"2024-09-14T11:56:54.882772+0000","last_clean":"2024-09-14T11:56:54.882772+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:56:54.882772+0000","last_undegraded":"2024-09-14T11:56:54.882772+0000","last_fullsized":"2024-09-14T11:56:54.882772+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:13.243462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466795+0000","last_change":"2024-09-14T11:15:34.313439+0000","last_active":"2024-09-14T11:58:14.466795+0000","last_peered":"2024-09-14T11:58:14.466795+0000","last_clean":"2024-09-14T11:58:14.466795+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:58:14.466795+0000","last_undegraded":"2024-09-14T11:58:14.466795+0000","last_fullsized":"2024-09-14T11:58:14.466795+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:34.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'221","reported_seq":838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.617964+0000","last_change":"2024-09-14T11:15:32.319484+0000","last_active":"2024-09-14T11:56:35.617964+0000","last_peered":"2024-09-14T11:56:35.617964+0000","last_clean":"2024-09-14T11:56:35.617964+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:56:35.617964+0000","last_undegraded":"2024-09-14T11:56:35.617964+0000","last_fullsized":"2024-09-14T11:56:35.617964+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:12.735898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4728445,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":556,"num_read_kb":8015,"num_write":1055,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'455","reported_seq":2042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.991606+0000","last_change":"2024-09-14T11:15:34.330160+0000","last_active":"2024-09-14T11:56:56.991606+0000","last_peered":"2024-09-14T11:56:56.991606+0000","last_clean":"2024-09-14T11:56:56.991606+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:56:56.991606+0000","last_undegraded":"2024-09-14T11:56:56.991606+0000","last_fullsized":"2024-09-14T11:56:56.991606+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:22.426308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'220","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.751609+0000","last_change":"2024-09-14T11:15:32.315600+0000","last_active":"2024-09-14T11:56:31.751609+0000","last_peered":"2024-09-14T11:56:31.751609+0000","last_clean":"2024-09-14T11:56:31.751609+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:56:31.751609+0000","last_undegraded":"2024-09-14T11:56:31.751609+0000","last_fullsized":"2024-09-14T11:56:31.751609+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:22.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":24963,"num_write":1048,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'441","reported_seq":1986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.890926+0000","last_change":"2024-09-14T11:15:34.326565+0000","last_active":"2024-09-14T11:57:43.890926+0000","last_peered":"2024-09-14T11:57:43.890926+0000","last_clean":"2024-09-14T11:57:43.890926+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:57:43.890926+0000","last_undegraded":"2024-09-14T11:57:43.890926+0000","last_fullsized":"2024-09-14T11:57:43.890926+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:36.647727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'205","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.932757+0000","last_change":"2024-09-14T11:15:32.315148+0000","last_active":"2024-09-14T11:56:36.932757+0000","last_peered":"2024-09-14T11:56:36.932757+0000","last_clean":"2024-09-14T11:56:36.932757+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:56:36.932757+0000","last_undegraded":"2024-09-14T11:56:36.932757+0000","last_fullsized":"2024-09-14T11:56:36.932757+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:49.800357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274173,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17257,"num_write":953,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'393","reported_seq":1858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465278+0000","last_change":"2024-09-14T11:15:34.323271+0000","last_active":"2024-09-14T11:56:38.465278+0000","last_peered":"2024-09-14T11:56:38.465278+0000","last_clean":"2024-09-14T11:56:38.465278+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:56:38.465278+0000","last_undegraded":"2024-09-14T11:56:38.465278+0000","last_fullsized":"2024-09-14T11:56:38.465278+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:05.710670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'250","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.153294+0000","last_change":"2024-09-14T11:15:32.313147+0000","last_active":"2024-09-14T11:56:20.153294+0000","last_peered":"2024-09-14T11:56:20.153294+0000","last_clean":"2024-09-14T11:56:20.153294+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:56:20.153294+0000","last_undegraded":"2024-09-14T11:56:20.153294+0000","last_fullsized":"2024-09-14T11:56:20.153294+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:40.375363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8378626,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":644,"num_read_kb":20644,"num_write":1060,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.129016+0000","last_change":"2024-09-14T11:15:34.315634+0000","last_active":"2024-09-14T11:56:39.129016+0000","last_peered":"2024-09-14T11:56:39.129016+0000","last_clean":"2024-09-14T11:56:39.129016+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:56:39.129016+0000","last_undegraded":"2024-09-14T11:56:39.129016+0000","last_fullsized":"2024-09-14T11:56:39.129016+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'282","reported_seq":1022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.080467+0000","last_change":"2024-09-14T11:15:32.317614+0000","last_active":"2024-09-14T11:56:52.080467+0000","last_peered":"2024-09-14T11:56:52.080467+0000","last_clean":"2024-09-14T11:56:52.080467+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:56:52.080467+0000","last_undegraded":"2024-09-14T11:56:52.080467+0000","last_fullsized":"2024-09-14T11:56:52.080467+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:00.703910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14529092,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1010,"num_read_kb":39546,"num_write":1286,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'571","reported_seq":2414,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456133+0000","last_change":"2024-09-14T11:15:34.328085+0000","last_active":"2024-09-14T11:58:14.456133+0000","last_peered":"2024-09-14T11:58:14.456133+0000","last_clean":"2024-09-14T11:58:14.456133+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:58:14.456133+0000","last_undegraded":"2024-09-14T11:58:14.456133+0000","last_fullsized":"2024-09-14T11:58:14.456133+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:40.805688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'227","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.457817+0000","last_change":"2024-09-14T11:15:32.309339+0000","last_active":"2024-09-14T11:58:13.457817+0000","last_peered":"2024-09-14T11:58:13.457817+0000","last_clean":"2024-09-14T11:58:13.457817+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:58:13.457817+0000","last_undegraded":"2024-09-14T11:58:13.457817+0000","last_fullsized":"2024-09-14T11:58:13.457817+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:16.044046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9003847,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":31277,"num_write":1073,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.583992+0000","last_change":"2024-09-14T11:15:42.348963+0000","last_active":"2024-09-14T11:56:57.583992+0000","last_peered":"2024-09-14T11:56:57.583992+0000","last_clean":"2024-09-14T11:56:57.583992+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:56:57.583992+0000","last_undegraded":"2024-09-14T11:56:57.583992+0000","last_fullsized":"2024-09-14T11:56:57.583992+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:41.155224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'823","reported_seq":2528,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883828+0000","last_change":"2024-09-14T11:15:34.329854+0000","last_active":"2024-09-14T11:56:54.883828+0000","last_peered":"2024-09-14T11:56:54.883828+0000","last_clean":"2024-09-14T11:56:54.883828+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:56:54.883828+0000","last_undegraded":"2024-09-14T11:56:54.883828+0000","last_fullsized":"2024-09-14T11:56:54.883828+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:48.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'194","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.175364+0000","last_change":"2024-09-14T11:15:32.318773+0000","last_active":"2024-09-14T11:56:12.175364+0000","last_peered":"2024-09-14T11:56:12.175364+0000","last_clean":"2024-09-14T11:56:12.175364+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:56:12.175364+0000","last_undegraded":"2024-09-14T11:56:12.175364+0000","last_fullsized":"2024-09-14T11:56:12.175364+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:41.470746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314134,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":881,"num_read_kb":29517,"num_write":950,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861599+0000","last_change":"2024-09-14T11:15:36.329405+0000","last_active":"2024-09-14T11:54:18.861599+0000","last_peered":"2024-09-14T11:54:18.861599+0000","last_clean":"2024-09-14T11:54:18.861599+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:54:18.861599+0000","last_undegraded":"2024-09-14T11:54:18.861599+0000","last_fullsized":"2024-09-14T11:54:18.861599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.437495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'196","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.823610+0000","last_change":"2024-09-14T11:15:38.337357+0000","last_active":"2024-09-14T11:56:54.823610+0000","last_peered":"2024-09-14T11:56:54.823610+0000","last_clean":"2024-09-14T11:56:54.823610+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:56:54.823610+0000","last_undegraded":"2024-09-14T11:56:54.823610+0000","last_fullsized":"2024-09-14T11:56:54.823610+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.259312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":248,"num_write":148,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.862314+0000","last_change":"2024-09-14T11:15:40.343299+0000","last_active":"2024-09-14T11:54:23.862314+0000","last_peered":"2024-09-14T11:54:23.862314+0000","last_clean":"2024-09-14T11:54:23.862314+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:54:23.862314+0000","last_undegraded":"2024-09-14T11:54:23.862314+0000","last_fullsized":"2024-09-14T11:54:23.862314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:21.470841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2483","reported_seq":4315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884659+0000","last_change":"2024-09-14T11:15:42.346740+0000","last_active":"2024-09-14T11:56:58.884659+0000","last_peered":"2024-09-14T11:56:58.884659+0000","last_clean":"2024-09-14T11:56:58.884659+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:56:58.884659+0000","last_undegraded":"2024-09-14T11:56:58.884659+0000","last_fullsized":"2024-09-14T11:56:58.884659+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":2400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:08.150839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'431","reported_seq":2262,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.519771+0000","last_change":"2024-09-14T11:15:34.327076+0000","last_active":"2024-09-14T11:56:57.519771+0000","last_peered":"2024-09-14T11:56:57.519771+0000","last_clean":"2024-09-14T11:56:57.519771+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:56:57.519771+0000","last_undegraded":"2024-09-14T11:56:57.519771+0000","last_fullsized":"2024-09-14T11:56:57.519771+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:08.246401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'262","reported_seq":952,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.022548+0000","last_change":"2024-09-14T11:15:32.308280+0000","last_active":"2024-09-14T11:55:18.022548+0000","last_peered":"2024-09-14T11:55:18.022548+0000","last_clean":"2024-09-14T11:55:18.022548+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:55:18.022548+0000","last_undegraded":"2024-09-14T11:55:18.022548+0000","last_fullsized":"2024-09-14T11:55:18.022548+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:16.723135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6141367,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":737,"num_read_kb":16466,"num_write":1197,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.872400+0000","last_change":"2024-09-14T11:15:36.334689+0000","last_active":"2024-09-14T11:55:28.872400+0000","last_peered":"2024-09-14T11:55:28.872400+0000","last_clean":"2024-09-14T11:55:28.872400+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:55:28.872400+0000","last_undegraded":"2024-09-14T11:55:28.872400+0000","last_fullsized":"2024-09-14T11:55:28.872400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.914528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'91","reported_seq":605,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.185623+0000","last_change":"2024-09-14T11:15:38.334852+0000","last_active":"2024-09-14T11:55:48.185623+0000","last_peered":"2024-09-14T11:55:48.185623+0000","last_clean":"2024-09-14T11:55:48.185623+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:55:48.185623+0000","last_undegraded":"2024-09-14T11:55:48.185623+0000","last_fullsized":"2024-09-14T11:55:48.185623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:06.733877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.000326+0000","last_change":"2024-09-14T11:15:40.346053+0000","last_active":"2024-09-14T11:54:24.000326+0000","last_peered":"2024-09-14T11:54:24.000326+0000","last_clean":"2024-09-14T11:54:24.000326+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:54:24.000326+0000","last_undegraded":"2024-09-14T11:54:24.000326+0000","last_fullsized":"2024-09-14T11:54:24.000326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.054969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'107","reported_seq":595,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.810718+0000","last_change":"2024-09-14T11:15:42.347308+0000","last_active":"2024-09-14T11:56:31.810718+0000","last_peered":"2024-09-14T11:56:31.810718+0000","last_clean":"2024-09-14T11:56:31.810718+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:56:31.810718+0000","last_undegraded":"2024-09-14T11:56:31.810718+0000","last_fullsized":"2024-09-14T11:56:31.810718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:53.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'424","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883698+0000","last_change":"2024-09-14T11:15:34.328884+0000","last_active":"2024-09-14T11:56:54.883698+0000","last_peered":"2024-09-14T11:56:54.883698+0000","last_clean":"2024-09-14T11:56:54.883698+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:56:54.883698+0000","last_undegraded":"2024-09-14T11:56:54.883698+0000","last_fullsized":"2024-09-14T11:56:54.883698+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'186","reported_seq":796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:47.557485+0000","last_change":"2024-09-14T11:15:32.316916+0000","last_active":"2024-09-14T11:55:47.557485+0000","last_peered":"2024-09-14T11:55:47.557485+0000","last_clean":"2024-09-14T11:55:47.557485+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:55:47.557485+0000","last_undegraded":"2024-09-14T11:55:47.557485+0000","last_fullsized":"2024-09-14T11:55:47.557485+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:45.239724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":30179,"num_write":920,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"36'3","reported_seq":967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.319326+0000","last_change":"2024-09-14T11:15:36.333013+0000","last_active":"2024-09-14T11:58:15.319326+0000","last_peered":"2024-09-14T11:58:15.319326+0000","last_clean":"2024-09-14T11:58:15.319326+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:58:15.319326+0000","last_undegraded":"2024-09-14T11:58:15.319326+0000","last_fullsized":"2024-09-14T11:58:15.319326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.296621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'115","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.680045+0000","last_change":"2024-09-14T11:15:38.337017+0000","last_active":"2024-09-14T11:56:32.680045+0000","last_peered":"2024-09-14T11:56:32.680045+0000","last_clean":"2024-09-14T11:56:32.680045+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:56:32.680045+0000","last_undegraded":"2024-09-14T11:56:32.680045+0000","last_fullsized":"2024-09-14T11:56:32.680045+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.412101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'748","reported_seq":2522,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842710+0000","last_change":"2024-09-14T11:15:40.343642+0000","last_active":"2024-09-14T11:58:15.842710+0000","last_peered":"2024-09-14T11:58:15.842710+0000","last_clean":"2024-09-14T11:58:15.842710+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:58:15.842710+0000","last_undegraded":"2024-09-14T11:58:15.842710+0000","last_fullsized":"2024-09-14T11:58:15.842710+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.527132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'193","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.636145+0000","last_change":"2024-09-14T11:15:42.341730+0000","last_active":"2024-09-14T11:56:57.636145+0000","last_peered":"2024-09-14T11:56:57.636145+0000","last_clean":"2024-09-14T11:56:57.636145+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:56:57.636145+0000","last_undegraded":"2024-09-14T11:56:57.636145+0000","last_fullsized":"2024-09-14T11:56:57.636145+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.359150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1027","reported_seq":2587,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.126763+0000","last_change":"2024-09-14T11:15:34.325968+0000","last_active":"2024-09-14T11:56:39.126763+0000","last_peered":"2024-09-14T11:56:39.126763+0000","last_clean":"2024-09-14T11:56:39.126763+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:56:39.126763+0000","last_undegraded":"2024-09-14T11:56:39.126763+0000","last_fullsized":"2024-09-14T11:56:39.126763+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:31.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'192","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.932639+0000","last_change":"2024-09-14T11:15:32.317790+0000","last_active":"2024-09-14T11:56:16.932639+0000","last_peered":"2024-09-14T11:56:16.932639+0000","last_clean":"2024-09-14T11:56:16.932639+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:56:16.932639+0000","last_undegraded":"2024-09-14T11:56:16.932639+0000","last_fullsized":"2024-09-14T11:56:16.932639+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:32.748526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421713,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":5281,"num_write":855,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861627+0000","last_change":"2024-09-14T11:15:36.330106+0000","last_active":"2024-09-14T11:54:18.861627+0000","last_peered":"2024-09-14T11:54:18.861627+0000","last_clean":"2024-09-14T11:54:18.861627+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:54:18.861627+0000","last_undegraded":"2024-09-14T11:54:18.861627+0000","last_fullsized":"2024-09-14T11:54:18.861627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:38.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'119","reported_seq":671,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882554+0000","last_change":"2024-09-14T11:15:38.337426+0000","last_active":"2024-09-14T11:56:43.882554+0000","last_peered":"2024-09-14T11:56:43.882554+0000","last_clean":"2024-09-14T11:56:43.882554+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:56:43.882554+0000","last_undegraded":"2024-09-14T11:56:43.882554+0000","last_fullsized":"2024-09-14T11:56:43.882554+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:10.689123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13331,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":161,"num_write":72,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'809","reported_seq":2224,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.843154+0000","last_change":"2024-09-14T11:15:40.349078+0000","last_active":"2024-09-14T11:58:15.843154+0000","last_peered":"2024-09-14T11:58:15.843154+0000","last_clean":"2024-09-14T11:58:15.843154+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:58:15.843154+0000","last_undegraded":"2024-09-14T11:58:15.843154+0000","last_fullsized":"2024-09-14T11:58:15.843154+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:29.118650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'734","reported_seq":2277,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465422+0000","last_change":"2024-09-14T11:15:34.326626+0000","last_active":"2024-09-14T11:56:38.465422+0000","last_peered":"2024-09-14T11:56:38.465422+0000","last_clean":"2024-09-14T11:56:38.465422+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:56:38.465422+0000","last_undegraded":"2024-09-14T11:56:38.465422+0000","last_fullsized":"2024-09-14T11:56:38.465422+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:29.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'202","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.925790+0000","last_change":"2024-09-14T11:15:32.318817+0000","last_active":"2024-09-14T11:58:06.925790+0000","last_peered":"2024-09-14T11:58:06.925790+0000","last_clean":"2024-09-14T11:58:06.925790+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:06.925790+0000","last_undegraded":"2024-09-14T11:58:06.925790+0000","last_fullsized":"2024-09-14T11:58:06.925790+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:39.582918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1378406,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":726,"num_read_kb":30459,"num_write":895,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864459+0000","last_change":"2024-09-14T11:15:36.334240+0000","last_active":"2024-09-14T11:54:38.864459+0000","last_peered":"2024-09-14T11:54:38.864459+0000","last_clean":"2024-09-14T11:54:38.864459+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:54:38.864459+0000","last_undegraded":"2024-09-14T11:54:38.864459+0000","last_fullsized":"2024-09-14T11:54:38.864459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:52.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'209","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884714+0000","last_change":"2024-09-14T11:15:38.335040+0000","last_active":"2024-09-14T11:56:58.884714+0000","last_peered":"2024-09-14T11:56:58.884714+0000","last_clean":"2024-09-14T11:56:58.884714+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:56:58.884714+0000","last_undegraded":"2024-09-14T11:56:58.884714+0000","last_fullsized":"2024-09-14T11:56:58.884714+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.960934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14935,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":278,"num_read_kb":338,"num_write":166,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.873529+0000","last_change":"2024-09-14T11:15:40.345833+0000","last_active":"2024-09-14T11:56:10.873529+0000","last_peered":"2024-09-14T11:56:10.873529+0000","last_clean":"2024-09-14T11:56:10.873529+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:56:10.873529+0000","last_undegraded":"2024-09-14T11:56:10.873529+0000","last_fullsized":"2024-09-14T11:56:10.873529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'552","reported_seq":1347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801804+0000","last_change":"2024-09-14T11:15:42.350220+0000","last_active":"2024-09-14T11:58:15.801804+0000","last_peered":"2024-09-14T11:58:15.801804+0000","last_clean":"2024-09-14T11:58:15.801804+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:58:15.801804+0000","last_undegraded":"2024-09-14T11:58:15.801804+0000","last_fullsized":"2024-09-14T11:58:15.801804+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:29.655558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'833","reported_seq":2317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.019226+0000","last_change":"2024-09-14T11:15:34.329906+0000","last_active":"2024-09-14T11:56:44.019226+0000","last_peered":"2024-09-14T11:56:44.019226+0000","last_clean":"2024-09-14T11:56:44.019226+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:56:44.019226+0000","last_undegraded":"2024-09-14T11:56:44.019226+0000","last_fullsized":"2024-09-14T11:56:44.019226+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:09.186132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'283","reported_seq":924,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.876535+0000","last_change":"2024-09-14T11:15:32.321404+0000","last_active":"2024-09-14T11:56:03.876535+0000","last_peered":"2024-09-14T11:56:03.876535+0000","last_clean":"2024-09-14T11:56:03.876535+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:56:03.876535+0000","last_undegraded":"2024-09-14T11:56:03.876535+0000","last_fullsized":"2024-09-14T11:56:03.876535+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:33.160296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5250566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":725,"num_read_kb":15958,"num_write":1144,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856235+0000","last_change":"2024-09-14T11:15:36.323224+0000","last_active":"2024-09-14T11:54:38.856235+0000","last_peered":"2024-09-14T11:54:38.856235+0000","last_clean":"2024-09-14T11:54:38.856235+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:54:38.856235+0000","last_undegraded":"2024-09-14T11:54:38.856235+0000","last_fullsized":"2024-09-14T11:54:38.856235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:40.252261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'116","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.766607+0000","last_change":"2024-09-14T11:15:38.336933+0000","last_active":"2024-09-14T11:58:15.766607+0000","last_peered":"2024-09-14T11:58:15.766607+0000","last_clean":"2024-09-14T11:58:15.766607+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:58:15.766607+0000","last_undegraded":"2024-09-14T11:58:15.766607+0000","last_fullsized":"2024-09-14T11:58:15.766607+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.373870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":179,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867935+0000","last_change":"2024-09-14T11:15:40.349051+0000","last_active":"2024-09-14T11:54:53.867935+0000","last_peered":"2024-09-14T11:54:53.867935+0000","last_clean":"2024-09-14T11:54:53.867935+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:54:53.867935+0000","last_undegraded":"2024-09-14T11:54:53.867935+0000","last_fullsized":"2024-09-14T11:54:53.867935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.147760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'124","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.968464+0000","last_change":"2024-09-14T11:15:42.351151+0000","last_active":"2024-09-14T11:57:28.968464+0000","last_peered":"2024-09-14T11:57:28.968464+0000","last_clean":"2024-09-14T11:57:28.968464+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:57:28.968464+0000","last_undegraded":"2024-09-14T11:57:28.968464+0000","last_fullsized":"2024-09-14T11:57:28.968464+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:13.693118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'688","reported_seq":2326,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456533+0000","last_change":"2024-09-14T11:15:34.331821+0000","last_active":"2024-09-14T11:58:14.456533+0000","last_peered":"2024-09-14T11:58:14.456533+0000","last_clean":"2024-09-14T11:58:14.456533+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:58:14.456533+0000","last_undegraded":"2024-09-14T11:58:14.456533+0000","last_fullsized":"2024-09-14T11:58:14.456533+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:17.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'233","reported_seq":862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.451832+0000","last_change":"2024-09-14T11:16:07.518583+0000","last_active":"2024-09-14T11:56:33.451832+0000","last_peered":"2024-09-14T11:56:33.451832+0000","last_clean":"2024-09-14T11:56:33.451832+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:56:33.451832+0000","last_undegraded":"2024-09-14T11:56:33.451832+0000","last_fullsized":"2024-09-14T11:56:33.451832+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:49.410450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":671,"num_read_kb":32200,"num_write":1032,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866558+0000","last_change":"2024-09-14T11:15:36.326783+0000","last_active":"2024-09-14T11:56:08.866558+0000","last_peered":"2024-09-14T11:56:08.866558+0000","last_clean":"2024-09-14T11:56:08.866558+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:56:08.866558+0000","last_undegraded":"2024-09-14T11:56:08.866558+0000","last_fullsized":"2024-09-14T11:56:08.866558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'163","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.883105+0000","last_change":"2024-09-14T11:15:38.339476+0000","last_active":"2024-09-14T11:56:48.883105+0000","last_peered":"2024-09-14T11:56:48.883105+0000","last_clean":"2024-09-14T11:56:48.883105+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:56:48.883105+0000","last_undegraded":"2024-09-14T11:56:48.883105+0000","last_fullsized":"2024-09-14T11:56:48.883105+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:23.876347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22913,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":280,"num_write":118,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'800","reported_seq":4156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842862+0000","last_change":"2024-09-14T11:15:40.344136+0000","last_active":"2024-09-14T11:58:15.842862+0000","last_peered":"2024-09-14T11:58:15.842862+0000","last_clean":"2024-09-14T11:58:15.842862+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:58:15.842862+0000","last_undegraded":"2024-09-14T11:58:15.842862+0000","last_fullsized":"2024-09-14T11:58:15.842862+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:19.808946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'140","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.396582+0000","last_change":"2024-09-14T11:15:42.354873+0000","last_active":"2024-09-14T11:58:14.396582+0000","last_peered":"2024-09-14T11:58:14.396582+0000","last_clean":"2024-09-14T11:58:14.396582+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:58:14.396582+0000","last_undegraded":"2024-09-14T11:58:14.396582+0000","last_fullsized":"2024-09-14T11:58:14.396582+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:42.946889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.123392+0000","last_change":"2024-09-14T11:15:34.330206+0000","last_active":"2024-09-14T11:56:27.123392+0000","last_peered":"2024-09-14T11:56:27.123392+0000","last_clean":"2024-09-14T11:56:27.123392+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:56:27.123392+0000","last_undegraded":"2024-09-14T11:56:27.123392+0000","last_fullsized":"2024-09-14T11:56:27.123392+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:08.630914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'258","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:04.881290+0000","last_change":"2024-09-14T11:16:07.390362+0000","last_active":"2024-09-14T11:58:04.881290+0000","last_peered":"2024-09-14T11:58:04.881290+0000","last_clean":"2024-09-14T11:58:04.881290+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:04.881290+0000","last_undegraded":"2024-09-14T11:58:04.881290+0000","last_fullsized":"2024-09-14T11:58:04.881290+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:12.368811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8039247,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":835,"num_read_kb":40477,"num_write":1084,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856857+0000","last_change":"2024-09-14T11:15:36.330224+0000","last_active":"2024-09-14T11:54:43.856857+0000","last_peered":"2024-09-14T11:54:43.856857+0000","last_clean":"2024-09-14T11:54:43.856857+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:54:43.856857+0000","last_undegraded":"2024-09-14T11:54:43.856857+0000","last_fullsized":"2024-09-14T11:54:43.856857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.235014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'196","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.770042+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:58:15.770042+0000","last_peered":"2024-09-14T11:58:15.770042+0000","last_clean":"2024-09-14T11:58:15.770042+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:58:15.770042+0000","last_undegraded":"2024-09-14T11:58:15.770042+0000","last_fullsized":"2024-09-14T11:58:15.770042+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:38.723325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72046,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":490,"num_write":144,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856808+0000","last_change":"2024-09-14T11:15:40.342222+0000","last_active":"2024-09-14T11:54:43.856808+0000","last_peered":"2024-09-14T11:54:43.856808+0000","last_clean":"2024-09-14T11:54:43.856808+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:54:43.856808+0000","last_undegraded":"2024-09-14T11:54:43.856808+0000","last_fullsized":"2024-09-14T11:54:43.856808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:48.145919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'132","reported_seq":645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:54.698739+0000","last_change":"2024-09-14T11:15:42.350823+0000","last_active":"2024-09-14T11:55:54.698739+0000","last_peered":"2024-09-14T11:55:54.698739+0000","last_clean":"2024-09-14T11:55:54.698739+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:55:54.698739+0000","last_undegraded":"2024-09-14T11:55:54.698739+0000","last_fullsized":"2024-09-14T11:55:54.698739+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:46.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'485","reported_seq":2086,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321026+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:42.583484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'216","reported_seq":916,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877337+0000","last_change":"2024-09-14T11:15:32.318996+0000","last_active":"2024-09-14T11:56:03.877337+0000","last_peered":"2024-09-14T11:56:03.877337+0000","last_clean":"2024-09-14T11:56:03.877337+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:56:03.877337+0000","last_undegraded":"2024-09-14T11:56:03.877337+0000","last_fullsized":"2024-09-14T11:56:03.877337+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:29.686806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24803905,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":665,"num_read_kb":211571,"num_write":947,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866594+0000","last_change":"2024-09-14T11:15:36.334662+0000","last_active":"2024-09-14T11:56:08.866594+0000","last_peered":"2024-09-14T11:56:08.866594+0000","last_clean":"2024-09-14T11:56:08.866594+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:56:08.866594+0000","last_undegraded":"2024-09-14T11:56:08.866594+0000","last_fullsized":"2024-09-14T11:56:08.866594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'139","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.770844+0000","last_change":"2024-09-14T11:15:38.335114+0000","last_active":"2024-09-14T11:58:15.770844+0000","last_peered":"2024-09-14T11:58:15.770844+0000","last_clean":"2024-09-14T11:58:15.770844+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:58:15.770844+0000","last_undegraded":"2024-09-14T11:58:15.770844+0000","last_fullsized":"2024-09-14T11:58:15.770844+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:02.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":205,"num_read_kb":262,"num_write":164,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868727+0000","last_change":"2024-09-14T11:15:40.352052+0000","last_active":"2024-09-14T11:56:18.868727+0000","last_peered":"2024-09-14T11:56:18.868727+0000","last_clean":"2024-09-14T11:56:18.868727+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:56:18.868727+0000","last_undegraded":"2024-09-14T11:56:18.868727+0000","last_fullsized":"2024-09-14T11:56:18.868727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:06.160840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'120","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.892807+0000","last_change":"2024-09-14T11:15:42.350884+0000","last_active":"2024-09-14T11:57:53.892807+0000","last_peered":"2024-09-14T11:57:53.892807+0000","last_clean":"2024-09-14T11:57:53.892807+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:57:53.892807+0000","last_undegraded":"2024-09-14T11:57:53.892807+0000","last_fullsized":"2024-09-14T11:57:53.892807+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.299714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'399","reported_seq":2034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.814843+0000","last_change":"2024-09-14T11:15:34.315484+0000","last_active":"2024-09-14T11:56:31.814843+0000","last_peered":"2024-09-14T11:56:31.814843+0000","last_clean":"2024-09-14T11:56:31.814843+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:56:31.814843+0000","last_undegraded":"2024-09-14T11:56:31.814843+0000","last_fullsized":"2024-09-14T11:56:31.814843+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:48.314937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'218","reported_seq":1028,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.985453+0000","last_change":"2024-09-14T11:15:32.316393+0000","last_active":"2024-09-14T11:58:09.985453+0000","last_peered":"2024-09-14T11:58:09.985453+0000","last_clean":"2024-09-14T11:58:09.985453+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:09.985453+0000","last_undegraded":"2024-09-14T11:58:09.985453+0000","last_fullsized":"2024-09-14T11:58:09.985453+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:19.207524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6973023,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1174,"num_read_kb":14840,"num_write":1003,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872741+0000","last_change":"2024-09-14T11:15:36.331915+0000","last_active":"2024-09-14T11:56:05.872741+0000","last_peered":"2024-09-14T11:56:05.872741+0000","last_clean":"2024-09-14T11:56:05.872741+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:56:05.872741+0000","last_undegraded":"2024-09-14T11:56:05.872741+0000","last_fullsized":"2024-09-14T11:56:05.872741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:44.896969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'159","reported_seq":734,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.799963+0000","last_change":"2024-09-14T11:15:38.333787+0000","last_active":"2024-09-14T11:58:15.799963+0000","last_peered":"2024-09-14T11:58:15.799963+0000","last_clean":"2024-09-14T11:58:15.799963+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:58:15.799963+0000","last_undegraded":"2024-09-14T11:58:15.799963+0000","last_fullsized":"2024-09-14T11:58:15.799963+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12670,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":287,"num_write":126,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'734","reported_seq":2515,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:16.100715+0000","last_change":"2024-09-14T11:15:40.337972+0000","last_active":"2024-09-14T11:58:16.100715+0000","last_peered":"2024-09-14T11:58:16.100715+0000","last_clean":"2024-09-14T11:58:16.100715+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:58:16.100715+0000","last_undegraded":"2024-09-14T11:58:16.100715+0000","last_fullsized":"2024-09-14T11:58:16.100715+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:41.159033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.461101+0000","last_change":"2024-09-14T11:15:42.355458+0000","last_active":"2024-09-14T11:56:38.461101+0000","last_peered":"2024-09-14T11:56:38.461101+0000","last_clean":"2024-09-14T11:56:38.461101+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:56:38.461101+0000","last_undegraded":"2024-09-14T11:56:38.461101+0000","last_fullsized":"2024-09-14T11:56:38.461101+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:20.221336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1221","reported_seq":2786,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321994+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.102163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'198","reported_seq":814,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.001730+0000","last_change":"2024-09-14T11:15:32.310048+0000","last_active":"2024-09-14T11:54:34.001730+0000","last_peered":"2024-09-14T11:54:34.001730+0000","last_clean":"2024-09-14T11:54:34.001730+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:54:34.001730+0000","last_undegraded":"2024-09-14T11:54:34.001730+0000","last_fullsized":"2024-09-14T11:54:34.001730+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.033083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1757315,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":468,"num_read_kb":33043,"num_write":875,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1432,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.748939+0000","last_change":"2024-09-14T11:15:36.330154+0000","last_active":"2024-09-14T11:58:15.748939+0000","last_peered":"2024-09-14T11:58:15.748939+0000","last_clean":"2024-09-14T11:58:15.748939+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:58:15.748939+0000","last_undegraded":"2024-09-14T11:58:15.748939+0000","last_fullsized":"2024-09-14T11:58:15.748939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":947,"num_read_kb":947,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'89","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.878066+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:56:08.878066+0000","last_peered":"2024-09-14T11:56:08.878066+0000","last_clean":"2024-09-14T11:56:08.878066+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:56:08.878066+0000","last_undegraded":"2024-09-14T11:56:08.878066+0000","last_fullsized":"2024-09-14T11:56:08.878066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.353564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'766","reported_seq":2230,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:16.101716+0000","last_change":"2024-09-14T11:15:40.344574+0000","last_active":"2024-09-14T11:58:16.101716+0000","last_peered":"2024-09-14T11:58:16.101716+0000","last_clean":"2024-09-14T11:58:16.101716+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:58:16.101716+0000","last_undegraded":"2024-09-14T11:58:16.101716+0000","last_fullsized":"2024-09-14T11:58:16.101716+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:07.380196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'148","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.994130+0000","last_change":"2024-09-14T11:15:42.354665+0000","last_active":"2024-09-14T11:56:36.994130+0000","last_peered":"2024-09-14T11:56:36.994130+0000","last_clean":"2024-09-14T11:56:36.994130+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:56:36.994130+0000","last_undegraded":"2024-09-14T11:56:36.994130+0000","last_fullsized":"2024-09-14T11:56:36.994130+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:56.500802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'422","reported_seq":2140,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992323+0000","last_change":"2024-09-14T11:15:34.335198+0000","last_active":"2024-09-14T11:56:56.992323+0000","last_peered":"2024-09-14T11:56:56.992323+0000","last_clean":"2024-09-14T11:56:56.992323+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:56:56.992323+0000","last_undegraded":"2024-09-14T11:56:56.992323+0000","last_fullsized":"2024-09-14T11:56:56.992323+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:17.261692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'173","reported_seq":778,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.978158+0000","last_change":"2024-09-14T11:15:32.310770+0000","last_active":"2024-09-14T11:56:17.978158+0000","last_peered":"2024-09-14T11:56:17.978158+0000","last_clean":"2024-09-14T11:56:17.978158+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:56:17.978158+0000","last_undegraded":"2024-09-14T11:56:17.978158+0000","last_fullsized":"2024-09-14T11:56:17.978158+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:39.610888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":457,"num_read_kb":26947,"num_write":784,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013965+0000","last_change":"2024-09-14T11:15:36.335046+0000","last_active":"2024-09-14T11:56:09.013965+0000","last_peered":"2024-09-14T11:56:09.013965+0000","last_clean":"2024-09-14T11:56:09.013965+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:56:09.013965+0000","last_undegraded":"2024-09-14T11:56:09.013965+0000","last_fullsized":"2024-09-14T11:56:09.013965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:54.481756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'206","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.785316+0000","last_change":"2024-09-14T11:15:38.333929+0000","last_active":"2024-09-14T11:58:15.785316+0000","last_peered":"2024-09-14T11:58:15.785316+0000","last_clean":"2024-09-14T11:58:15.785316+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:58:15.785316+0000","last_undegraded":"2024-09-14T11:58:15.785316+0000","last_fullsized":"2024-09-14T11:58:15.785316+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.403088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14187,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":887,"num_read_kb":938,"num_write":1414,"num_write_kb":1293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.958089+0000","last_change":"2024-09-14T11:15:40.349110+0000","last_active":"2024-09-14T11:56:13.958089+0000","last_peered":"2024-09-14T11:56:13.958089+0000","last_clean":"2024-09-14T11:56:13.958089+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:56:13.958089+0000","last_undegraded":"2024-09-14T11:56:13.958089+0000","last_fullsized":"2024-09-14T11:56:13.958089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.798885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'145","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.161350+0000","last_change":"2024-09-14T11:15:42.351759+0000","last_active":"2024-09-14T11:55:57.161350+0000","last_peered":"2024-09-14T11:55:57.161350+0000","last_clean":"2024-09-14T11:55:57.161350+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:55:57.161350+0000","last_undegraded":"2024-09-14T11:55:57.161350+0000","last_fullsized":"2024-09-14T11:55:57.161350+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:09.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'800","reported_seq":2315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531202+0000","last_change":"2024-09-14T11:15:34.322606+0000","last_active":"2024-09-14T11:56:57.531202+0000","last_peered":"2024-09-14T11:56:57.531202+0000","last_clean":"2024-09-14T11:56:57.531202+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:56:57.531202+0000","last_undegraded":"2024-09-14T11:56:57.531202+0000","last_fullsized":"2024-09-14T11:56:57.531202+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:47.471242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870764+0000","last_change":"2024-09-14T11:15:15.722374+0000","last_active":"2024-09-14T11:55:23.870764+0000","last_peered":"2024-09-14T11:55:23.870764+0000","last_clean":"2024-09-14T11:55:23.870764+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:55:23.870764+0000","last_undegraded":"2024-09-14T11:55:23.870764+0000","last_fullsized":"2024-09-14T11:55:23.870764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_clean_scrub_stamp":"2024-09-14T11:15:14.033306+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:20.114027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867317+0000","last_change":"2024-09-14T11:15:23.082390+0000","last_active":"2024-09-14T11:54:58.867317+0000","last_peered":"2024-09-14T11:54:58.867317+0000","last_clean":"2024-09-14T11:54:58.867317+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:54:58.867317+0000","last_undegraded":"2024-09-14T11:54:58.867317+0000","last_fullsized":"2024-09-14T11:54:58.867317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:33.700173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'236","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.424746+0000","last_change":"2024-09-14T11:15:32.324361+0000","last_active":"2024-09-14T11:55:24.424746+0000","last_peered":"2024-09-14T11:55:24.424746+0000","last_clean":"2024-09-14T11:55:24.424746+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:55:24.424746+0000","last_undegraded":"2024-09-14T11:55:24.424746+0000","last_fullsized":"2024-09-14T11:55:24.424746+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:30.273764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5200503,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":31904,"num_write":1125,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.869304+0000","last_change":"2024-09-14T11:15:36.333660+0000","last_active":"2024-09-14T11:55:13.869304+0000","last_peered":"2024-09-14T11:55:13.869304+0000","last_clean":"2024-09-14T11:55:13.869304+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:55:13.869304+0000","last_undegraded":"2024-09-14T11:55:13.869304+0000","last_fullsized":"2024-09-14T11:55:13.869304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:23.212696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'293","reported_seq":966,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.787626+0000","last_change":"2024-09-14T11:15:38.335792+0000","last_active":"2024-09-14T11:58:15.787626+0000","last_peered":"2024-09-14T11:58:15.787626+0000","last_clean":"2024-09-14T11:58:15.787626+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:58:15.787626+0000","last_undegraded":"2024-09-14T11:58:15.787626+0000","last_fullsized":"2024-09-14T11:58:15.787626+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:30.822708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48957,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":722,"num_write":488,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.857414+0000","last_change":"2024-09-14T11:15:40.350659+0000","last_active":"2024-09-14T11:54:43.857414+0000","last_peered":"2024-09-14T11:54:43.857414+0000","last_clean":"2024-09-14T11:54:43.857414+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:54:43.857414+0000","last_undegraded":"2024-09-14T11:54:43.857414+0000","last_fullsized":"2024-09-14T11:54:43.857414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:02.205911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'189","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.537414+0000","last_change":"2024-09-14T11:15:42.350534+0000","last_active":"2024-09-14T11:56:57.537414+0000","last_peered":"2024-09-14T11:56:57.537414+0000","last_clean":"2024-09-14T11:56:57.537414+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:56:57.537414+0000","last_undegraded":"2024-09-14T11:56:57.537414+0000","last_fullsized":"2024-09-14T11:56:57.537414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:58.455641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'494","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136421+0000","last_change":"2024-09-14T11:15:34.330808+0000","last_active":"2024-09-14T11:56:39.136421+0000","last_peered":"2024-09-14T11:56:39.136421+0000","last_clean":"2024-09-14T11:56:39.136421+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:56:39.136421+0000","last_undegraded":"2024-09-14T11:56:39.136421+0000","last_fullsized":"2024-09-14T11:56:39.136421+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:23.183357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.871431+0000","last_change":"2024-09-14T11:15:23.927708+0000","last_active":"2024-09-14T11:55:28.871431+0000","last_peered":"2024-09-14T11:55:28.871431+0000","last_clean":"2024-09-14T11:55:28.871431+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:55:28.871431+0000","last_undegraded":"2024-09-14T11:55:28.871431+0000","last_fullsized":"2024-09-14T11:55:28.871431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.482495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'187","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.544588+0000","last_change":"2024-09-14T11:15:32.306329+0000","last_active":"2024-09-14T11:55:59.544588+0000","last_peered":"2024-09-14T11:55:59.544588+0000","last_clean":"2024-09-14T11:55:59.544588+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:55:59.544588+0000","last_undegraded":"2024-09-14T11:55:59.544588+0000","last_fullsized":"2024-09-14T11:55:59.544588+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:59.382027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9103571,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":755,"num_read_kb":134470,"num_write":895,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864617+0000","last_change":"2024-09-14T11:15:36.329488+0000","last_active":"2024-09-14T11:54:38.864617+0000","last_peered":"2024-09-14T11:54:38.864617+0000","last_clean":"2024-09-14T11:54:38.864617+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:54:38.864617+0000","last_undegraded":"2024-09-14T11:54:38.864617+0000","last_fullsized":"2024-09-14T11:54:38.864617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.992710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'841","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842898+0000","last_change":"2024-09-14T11:15:38.335641+0000","last_active":"2024-09-14T11:58:15.842898+0000","last_peered":"2024-09-14T11:58:15.842898+0000","last_clean":"2024-09-14T11:58:15.842898+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:58:15.842898+0000","last_undegraded":"2024-09-14T11:58:15.842898+0000","last_fullsized":"2024-09-14T11:58:15.842898+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:31.939839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1141,"num_read_kb":1308,"num_write":264,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870881+0000","last_change":"2024-09-14T11:15:40.344759+0000","last_active":"2024-09-14T11:55:23.870881+0000","last_peered":"2024-09-14T11:55:23.870881+0000","last_clean":"2024-09-14T11:55:23.870881+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:55:23.870881+0000","last_undegraded":"2024-09-14T11:55:23.870881+0000","last_fullsized":"2024-09-14T11:55:23.870881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.591931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'99","reported_seq":599,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.131967+0000","last_change":"2024-09-14T11:15:42.346979+0000","last_active":"2024-09-14T11:56:39.131967+0000","last_peered":"2024-09-14T11:56:39.131967+0000","last_clean":"2024-09-14T11:56:39.131967+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:56:39.131967+0000","last_undegraded":"2024-09-14T11:56:39.131967+0000","last_fullsized":"2024-09-14T11:56:39.131967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:56.582504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'537","reported_seq":2057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.982239+0000","last_change":"2024-09-14T11:15:34.328947+0000","last_active":"2024-09-14T11:56:56.982239+0000","last_peered":"2024-09-14T11:56:56.982239+0000","last_clean":"2024-09-14T11:56:56.982239+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:56:56.982239+0000","last_undegraded":"2024-09-14T11:56:56.982239+0000","last_fullsized":"2024-09-14T11:56:56.982239+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:22.306344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858408+0000","last_change":"2024-09-14T11:15:23.072067+0000","last_active":"2024-09-14T11:54:58.858408+0000","last_peered":"2024-09-14T11:54:58.858408+0000","last_clean":"2024-09-14T11:54:58.858408+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:54:58.858408+0000","last_undegraded":"2024-09-14T11:54:58.858408+0000","last_fullsized":"2024-09-14T11:54:58.858408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:39.257423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'171","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869519+0000","last_change":"2024-09-14T11:15:32.308521+0000","last_active":"2024-09-14T11:55:40.869519+0000","last_peered":"2024-09-14T11:55:40.869519+0000","last_clean":"2024-09-14T11:55:40.869519+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:55:40.869519+0000","last_undegraded":"2024-09-14T11:55:40.869519+0000","last_fullsized":"2024-09-14T11:55:40.869519+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.589077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11682040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":392,"num_read_kb":27621,"num_write":837,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856296+0000","last_change":"2024-09-14T11:15:36.322255+0000","last_active":"2024-09-14T11:54:38.856296+0000","last_peered":"2024-09-14T11:54:38.856296+0000","last_clean":"2024-09-14T11:54:38.856296+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:54:38.856296+0000","last_undegraded":"2024-09-14T11:54:38.856296+0000","last_fullsized":"2024-09-14T11:54:38.856296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:41.156825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'213","reported_seq":1266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842747+0000","last_change":"2024-09-14T11:15:38.338714+0000","last_active":"2024-09-14T11:58:15.842747+0000","last_peered":"2024-09-14T11:58:15.842747+0000","last_clean":"2024-09-14T11:58:15.842747+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:58:15.842747+0000","last_undegraded":"2024-09-14T11:58:15.842747+0000","last_fullsized":"2024-09-14T11:58:15.842747+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:12.349920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861300+0000","last_change":"2024-09-14T11:15:40.351390+0000","last_active":"2024-09-14T11:55:18.861300+0000","last_peered":"2024-09-14T11:55:18.861300+0000","last_clean":"2024-09-14T11:55:18.861300+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:55:18.861300+0000","last_undegraded":"2024-09-14T11:55:18.861300+0000","last_fullsized":"2024-09-14T11:55:18.861300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.483392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'280","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.803304+0000","last_change":"2024-09-14T11:15:42.351361+0000","last_active":"2024-09-14T11:58:15.803304+0000","last_peered":"2024-09-14T11:58:15.803304+0000","last_clean":"2024-09-14T11:58:15.803304+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:58:15.803304+0000","last_undegraded":"2024-09-14T11:58:15.803304+0000","last_fullsized":"2024-09-14T11:58:15.803304+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'555","reported_seq":2127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.371131+0000","last_change":"2024-09-14T11:15:34.326991+0000","last_active":"2024-09-14T11:56:34.371131+0000","last_peered":"2024-09-14T11:56:34.371131+0000","last_clean":"2024-09-14T11:56:34.371131+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:56:34.371131+0000","last_undegraded":"2024-09-14T11:56:34.371131+0000","last_fullsized":"2024-09-14T11:56:34.371131+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:01.433893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867284+0000","last_change":"2024-09-14T11:15:23.082813+0000","last_active":"2024-09-14T11:54:58.867284+0000","last_peered":"2024-09-14T11:54:58.867284+0000","last_clean":"2024-09-14T11:54:58.867284+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:54:58.867284+0000","last_undegraded":"2024-09-14T11:54:58.867284+0000","last_fullsized":"2024-09-14T11:54:58.867284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:09.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'207","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.421575+0000","last_change":"2024-09-14T11:15:32.304267+0000","last_active":"2024-09-14T11:56:00.421575+0000","last_peered":"2024-09-14T11:56:00.421575+0000","last_clean":"2024-09-14T11:56:00.421575+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:56:00.421575+0000","last_undegraded":"2024-09-14T11:56:00.421575+0000","last_fullsized":"2024-09-14T11:56:00.421575+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:11.058375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7691978,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":485,"num_read_kb":21127,"num_write":1020,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861326+0000","last_change":"2024-09-14T11:15:36.327923+0000","last_active":"2024-09-14T11:55:18.861326+0000","last_peered":"2024-09-14T11:55:18.861326+0000","last_clean":"2024-09-14T11:55:18.861326+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:55:18.861326+0000","last_undegraded":"2024-09-14T11:55:18.861326+0000","last_fullsized":"2024-09-14T11:55:18.861326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:19.678938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'124","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.882670+0000","last_change":"2024-09-14T11:15:38.340290+0000","last_active":"2024-09-14T11:56:48.882670+0000","last_peered":"2024-09-14T11:56:48.882670+0000","last_clean":"2024-09-14T11:56:48.882670+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:56:48.882670+0000","last_undegraded":"2024-09-14T11:56:48.882670+0000","last_fullsized":"2024-09-14T11:56:48.882670+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:51.345233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.946533+0000","last_change":"2024-09-14T11:15:40.343946+0000","last_active":"2024-09-14T11:54:43.946533+0000","last_peered":"2024-09-14T11:54:43.946533+0000","last_clean":"2024-09-14T11:54:43.946533+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:54:43.946533+0000","last_undegraded":"2024-09-14T11:54:43.946533+0000","last_fullsized":"2024-09-14T11:54:43.946533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.497566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'166","reported_seq":727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.995883+0000","last_change":"2024-09-14T11:15:42.351795+0000","last_active":"2024-09-14T11:56:36.995883+0000","last_peered":"2024-09-14T11:56:36.995883+0000","last_clean":"2024-09-14T11:56:36.995883+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:56:36.995883+0000","last_undegraded":"2024-09-14T11:56:36.995883+0000","last_fullsized":"2024-09-14T11:56:36.995883+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:00.523427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'890","reported_seq":2625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531193+0000","last_change":"2024-09-14T11:15:34.330814+0000","last_active":"2024-09-14T11:56:57.531193+0000","last_peered":"2024-09-14T11:56:57.531193+0000","last_clean":"2024-09-14T11:56:57.531193+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:56:57.531193+0000","last_undegraded":"2024-09-14T11:56:57.531193+0000","last_fullsized":"2024-09-14T11:56:57.531193+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:26.576464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'205","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.335228+0000","last_change":"2024-09-14T11:15:32.322181+0000","last_active":"2024-09-14T11:56:29.335228+0000","last_peered":"2024-09-14T11:56:29.335228+0000","last_clean":"2024-09-14T11:56:29.335228+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:56:29.335228+0000","last_undegraded":"2024-09-14T11:56:29.335228+0000","last_fullsized":"2024-09-14T11:56:29.335228+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:25.998267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17058791,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":7241,"num_write":961,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863547+0000","last_change":"2024-09-14T11:15:23.085013+0000","last_active":"2024-09-14T11:54:55.863547+0000","last_peered":"2024-09-14T11:54:55.863547+0000","last_clean":"2024-09-14T11:54:55.863547+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:54:55.863547+0000","last_undegraded":"2024-09-14T11:54:55.863547+0000","last_fullsized":"2024-09-14T11:54:55.863547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:25.505724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.860745+0000","last_change":"2024-09-14T11:15:36.327557+0000","last_active":"2024-09-14T11:55:13.860745+0000","last_peered":"2024-09-14T11:55:13.860745+0000","last_clean":"2024-09-14T11:55:13.860745+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:55:13.860745+0000","last_undegraded":"2024-09-14T11:55:13.860745+0000","last_fullsized":"2024-09-14T11:55:13.860745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:46.694330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'262","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.779630+0000","last_change":"2024-09-14T11:15:38.333171+0000","last_active":"2024-09-14T11:58:15.779630+0000","last_peered":"2024-09-14T11:58:15.779630+0000","last_clean":"2024-09-14T11:58:15.779630+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:58:15.779630+0000","last_undegraded":"2024-09-14T11:58:15.779630+0000","last_fullsized":"2024-09-14T11:58:15.779630+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:45.638370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25607,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":347,"num_read_kb":438,"num_write":196,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.007091+0000","last_change":"2024-09-14T11:15:40.348810+0000","last_active":"2024-09-14T11:55:19.007091+0000","last_peered":"2024-09-14T11:55:19.007091+0000","last_clean":"2024-09-14T11:55:19.007091+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:55:19.007091+0000","last_undegraded":"2024-09-14T11:55:19.007091+0000","last_fullsized":"2024-09-14T11:55:19.007091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:45.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'169","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.464163+0000","last_change":"2024-09-14T11:15:42.354465+0000","last_active":"2024-09-14T11:58:14.464163+0000","last_peered":"2024-09-14T11:58:14.464163+0000","last_clean":"2024-09-14T11:58:14.464163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:58:14.464163+0000","last_undegraded":"2024-09-14T11:58:14.464163+0000","last_fullsized":"2024-09-14T11:58:14.464163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:00.902965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'771","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531136+0000","last_change":"2024-09-14T11:15:34.328838+0000","last_active":"2024-09-14T11:56:57.531136+0000","last_peered":"2024-09-14T11:56:57.531136+0000","last_clean":"2024-09-14T11:56:57.531136+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:56:57.531136+0000","last_undegraded":"2024-09-14T11:56:57.531136+0000","last_fullsized":"2024-09-14T11:56:57.531136+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:06.220137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'258","reported_seq":887,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.768883+0000","last_change":"2024-09-14T11:15:32.309908+0000","last_active":"2024-09-14T11:56:52.768883+0000","last_peered":"2024-09-14T11:56:52.768883+0000","last_clean":"2024-09-14T11:56:52.768883+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:56:52.768883+0000","last_undegraded":"2024-09-14T11:56:52.768883+0000","last_fullsized":"2024-09-14T11:56:52.768883+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:42.117912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14696566,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":581,"num_read_kb":40043,"num_write":1038,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867981+0000","last_change":"2024-09-14T11:15:23.927653+0000","last_active":"2024-09-14T11:55:03.867981+0000","last_peered":"2024-09-14T11:55:03.867981+0000","last_clean":"2024-09-14T11:55:03.867981+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:55:03.867981+0000","last_undegraded":"2024-09-14T11:55:03.867981+0000","last_fullsized":"2024-09-14T11:55:03.867981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:15.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"36'4","reported_seq":962,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.317972+0000","last_change":"2024-09-14T11:15:36.327972+0000","last_active":"2024-09-14T11:58:15.317972+0000","last_peered":"2024-09-14T11:58:15.317972+0000","last_clean":"2024-09-14T11:58:15.317972+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:58:15.317972+0000","last_undegraded":"2024-09-14T11:58:15.317972+0000","last_fullsized":"2024-09-14T11:58:15.317972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:19.046696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'167","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.919058+0000","last_change":"2024-09-14T11:15:38.327367+0000","last_active":"2024-09-14T11:57:15.919058+0000","last_peered":"2024-09-14T11:57:15.919058+0000","last_clean":"2024-09-14T11:57:15.919058+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:57:15.919058+0000","last_undegraded":"2024-09-14T11:57:15.919058+0000","last_fullsized":"2024-09-14T11:57:15.919058+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:37.848547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'795","reported_seq":4695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842667+0000","last_change":"2024-09-14T11:15:40.337171+0000","last_active":"2024-09-14T11:58:15.842667+0000","last_peered":"2024-09-14T11:58:15.842667+0000","last_clean":"2024-09-14T11:58:15.842667+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:58:15.842667+0000","last_undegraded":"2024-09-14T11:58:15.842667+0000","last_fullsized":"2024-09-14T11:58:15.842667+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.203863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'132","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.805016+0000","last_change":"2024-09-14T11:15:42.349144+0000","last_active":"2024-09-14T11:58:15.805016+0000","last_peered":"2024-09-14T11:58:15.805016+0000","last_clean":"2024-09-14T11:58:15.805016+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:58:15.805016+0000","last_undegraded":"2024-09-14T11:58:15.805016+0000","last_fullsized":"2024-09-14T11:58:15.805016+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:09.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'891","reported_seq":2471,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.891391+0000","last_change":"2024-09-14T11:15:34.334008+0000","last_active":"2024-09-14T11:57:43.891391+0000","last_peered":"2024-09-14T11:57:43.891391+0000","last_clean":"2024-09-14T11:57:43.891391+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:57:43.891391+0000","last_undegraded":"2024-09-14T11:57:43.891391+0000","last_fullsized":"2024-09-14T11:57:43.891391+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.699506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'239","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.255976+0000","last_change":"2024-09-14T11:15:32.315658+0000","last_active":"2024-09-14T11:55:19.255976+0000","last_peered":"2024-09-14T11:55:19.255976+0000","last_clean":"2024-09-14T11:55:19.255976+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:55:19.255976+0000","last_undegraded":"2024-09-14T11:55:19.255976+0000","last_fullsized":"2024-09-14T11:55:19.255976+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:05.378692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7981226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":686,"num_read_kb":25317,"num_write":1127,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.875825+0000","last_change":"2024-09-14T11:15:23.084925+0000","last_active":"2024-09-14T11:56:30.875825+0000","last_peered":"2024-09-14T11:56:30.875825+0000","last_clean":"2024-09-14T11:56:30.875825+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:56:30.875825+0000","last_undegraded":"2024-09-14T11:56:30.875825+0000","last_fullsized":"2024-09-14T11:56:30.875825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.357227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:14.006501+0000","last_change":"2024-09-14T11:15:36.331117+0000","last_active":"2024-09-14T11:55:14.006501+0000","last_peered":"2024-09-14T11:55:14.006501+0000","last_clean":"2024-09-14T11:55:14.006501+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:55:14.006501+0000","last_undegraded":"2024-09-14T11:55:14.006501+0000","last_fullsized":"2024-09-14T11:55:14.006501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:51.839727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'111","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.942678+0000","last_change":"2024-09-14T11:15:38.337313+0000","last_active":"2024-09-14T11:56:30.942678+0000","last_peered":"2024-09-14T11:56:30.942678+0000","last_clean":"2024-09-14T11:56:30.942678+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:56:30.942678+0000","last_undegraded":"2024-09-14T11:56:30.942678+0000","last_fullsized":"2024-09-14T11:56:30.942678+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:15.549271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'809","reported_seq":2427,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842929+0000","last_change":"2024-09-14T11:15:40.353831+0000","last_active":"2024-09-14T11:58:15.842929+0000","last_peered":"2024-09-14T11:58:15.842929+0000","last_clean":"2024-09-14T11:58:15.842929+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:58:15.842929+0000","last_undegraded":"2024-09-14T11:58:15.842929+0000","last_fullsized":"2024-09-14T11:58:15.842929+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:41.935731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'282","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.867897+0000","last_change":"2024-09-14T11:15:42.349524+0000","last_active":"2024-09-14T11:56:13.867897+0000","last_peered":"2024-09-14T11:56:13.867897+0000","last_clean":"2024-09-14T11:56:13.867897+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:56:13.867897+0000","last_undegraded":"2024-09-14T11:56:13.867897+0000","last_fullsized":"2024-09-14T11:56:13.867897+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:39.795329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'401","reported_seq":1934,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882633+0000","last_change":"2024-09-14T11:15:34.326976+0000","last_active":"2024-09-14T11:56:54.882633+0000","last_peered":"2024-09-14T11:56:54.882633+0000","last_clean":"2024-09-14T11:56:54.882633+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:56:54.882633+0000","last_undegraded":"2024-09-14T11:56:54.882633+0000","last_fullsized":"2024-09-14T11:56:54.882633+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:16.837130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'210","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:24.422593+0000","last_change":"2024-09-14T11:15:32.314679+0000","last_active":"2024-09-14T11:55:24.422593+0000","last_peered":"2024-09-14T11:55:24.422593+0000","last_clean":"2024-09-14T11:55:24.422593+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:55:24.422593+0000","last_undegraded":"2024-09-14T11:55:24.422593+0000","last_fullsized":"2024-09-14T11:55:24.422593+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:39.815598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4535993,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":11357,"num_write":1010,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.960844+0000","last_change":"2024-09-14T11:15:23.927661+0000","last_active":"2024-09-14T11:56:33.960844+0000","last_peered":"2024-09-14T11:56:33.960844+0000","last_clean":"2024-09-14T11:56:33.960844+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:56:33.960844+0000","last_undegraded":"2024-09-14T11:56:33.960844+0000","last_fullsized":"2024-09-14T11:56:33.960844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:47.701947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875423+0000","last_change":"2024-09-14T11:15:36.331051+0000","last_active":"2024-09-14T11:55:48.875423+0000","last_peered":"2024-09-14T11:55:48.875423+0000","last_clean":"2024-09-14T11:55:48.875423+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:55:48.875423+0000","last_undegraded":"2024-09-14T11:55:48.875423+0000","last_fullsized":"2024-09-14T11:55:48.875423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:18.610941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'295","reported_seq":988,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.776029+0000","last_change":"2024-09-14T11:15:38.337405+0000","last_active":"2024-09-14T11:58:15.776029+0000","last_peered":"2024-09-14T11:58:15.776029+0000","last_clean":"2024-09-14T11:58:15.776029+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:58:15.776029+0000","last_undegraded":"2024-09-14T11:58:15.776029+0000","last_fullsized":"2024-09-14T11:58:15.776029+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:37.729796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37514,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":628,"num_write":218,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870986+0000","last_change":"2024-09-14T11:15:40.349294+0000","last_active":"2024-09-14T11:55:18.870986+0000","last_peered":"2024-09-14T11:55:18.870986+0000","last_clean":"2024-09-14T11:55:18.870986+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:55:18.870986+0000","last_undegraded":"2024-09-14T11:55:18.870986+0000","last_fullsized":"2024-09-14T11:55:18.870986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:06.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'134","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.668467+0000","last_change":"2024-09-14T11:15:42.351815+0000","last_active":"2024-09-14T11:56:19.668467+0000","last_peered":"2024-09-14T11:56:19.668467+0000","last_clean":"2024-09-14T11:56:19.668467+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:56:19.668467+0000","last_undegraded":"2024-09-14T11:56:19.668467+0000","last_fullsized":"2024-09-14T11:56:19.668467+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:31.950118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'146","reported_seq":688,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.639329+0000","last_change":"2024-09-14T11:15:42.348937+0000","last_active":"2024-09-14T11:56:57.639329+0000","last_peered":"2024-09-14T11:56:57.639329+0000","last_clean":"2024-09-14T11:56:57.639329+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:56:57.639329+0000","last_undegraded":"2024-09-14T11:56:57.639329+0000","last_fullsized":"2024-09-14T11:56:57.639329+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'563","reported_seq":2425,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.458556+0000","last_change":"2024-09-14T11:15:34.319146+0000","last_active":"2024-09-14T11:58:14.458556+0000","last_peered":"2024-09-14T11:58:14.458556+0000","last_clean":"2024-09-14T11:58:14.458556+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:58:14.458556+0000","last_undegraded":"2024-09-14T11:58:14.458556+0000","last_fullsized":"2024-09-14T11:58:14.458556+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:44.411480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'198","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.821360+0000","last_change":"2024-09-14T11:15:32.313281+0000","last_active":"2024-09-14T11:56:54.821360+0000","last_peered":"2024-09-14T11:56:54.821360+0000","last_clean":"2024-09-14T11:56:54.821360+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:56:54.821360+0000","last_undegraded":"2024-09-14T11:56:54.821360+0000","last_fullsized":"2024-09-14T11:56:54.821360+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:47.748935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352987,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":19870,"num_write":900,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866061+0000","last_change":"2024-09-14T11:15:36.335097+0000","last_active":"2024-09-14T11:55:15.866061+0000","last_peered":"2024-09-14T11:55:15.866061+0000","last_clean":"2024-09-14T11:55:15.866061+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:55:15.866061+0000","last_undegraded":"2024-09-14T11:55:15.866061+0000","last_fullsized":"2024-09-14T11:55:15.866061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:16.648545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'153","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890794+0000","last_change":"2024-09-14T11:15:38.334700+0000","last_active":"2024-09-14T11:57:38.890794+0000","last_peered":"2024-09-14T11:57:38.890794+0000","last_clean":"2024-09-14T11:57:38.890794+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:57:38.890794+0000","last_undegraded":"2024-09-14T11:57:38.890794+0000","last_fullsized":"2024-09-14T11:57:38.890794+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:17.379507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11421,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":185,"num_read_kb":246,"num_write":110,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.871577+0000","last_change":"2024-09-14T11:15:40.349844+0000","last_active":"2024-09-14T11:55:23.871577+0000","last_peered":"2024-09-14T11:55:23.871577+0000","last_clean":"2024-09-14T11:55:23.871577+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:55:23.871577+0000","last_undegraded":"2024-09-14T11:55:23.871577+0000","last_fullsized":"2024-09-14T11:55:23.871577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:12.340019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.002060+0000","last_change":"2024-09-14T11:15:42.351873+0000","last_active":"2024-09-14T11:56:57.002060+0000","last_peered":"2024-09-14T11:56:57.002060+0000","last_clean":"2024-09-14T11:56:57.002060+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:56:57.002060+0000","last_undegraded":"2024-09-14T11:56:57.002060+0000","last_fullsized":"2024-09-14T11:56:57.002060+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.030349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1370","reported_seq":3005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.687050+0000","last_change":"2024-09-14T11:15:34.330128+0000","last_active":"2024-09-14T11:56:35.687050+0000","last_peered":"2024-09-14T11:56:35.687050+0000","last_clean":"2024-09-14T11:56:35.687050+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:56:35.687050+0000","last_undegraded":"2024-09-14T11:56:35.687050+0000","last_fullsized":"2024-09-14T11:56:35.687050+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.528231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'161","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.340997+0000","last_change":"2024-09-14T11:15:32.321575+0000","last_active":"2024-09-14T11:56:00.340997+0000","last_peered":"2024-09-14T11:56:00.340997+0000","last_clean":"2024-09-14T11:56:00.340997+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:56:00.340997+0000","last_undegraded":"2024-09-14T11:56:00.340997+0000","last_fullsized":"2024-09-14T11:56:00.340997+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:37.366540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21298259,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":349,"num_read_kb":34031,"num_write":730,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.871010+0000","last_change":"2024-09-14T11:15:36.330880+0000","last_active":"2024-09-14T11:55:18.871010+0000","last_peered":"2024-09-14T11:55:18.871010+0000","last_clean":"2024-09-14T11:55:18.871010+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:55:18.871010+0000","last_undegraded":"2024-09-14T11:55:18.871010+0000","last_fullsized":"2024-09-14T11:55:18.871010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:31.962906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'43","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.223600+0000","last_change":"2024-09-14T11:15:38.332435+0000","last_active":"2024-09-14T11:56:30.223600+0000","last_peered":"2024-09-14T11:56:30.223600+0000","last_clean":"2024-09-14T11:56:30.223600+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:56:30.223600+0000","last_undegraded":"2024-09-14T11:56:30.223600+0000","last_fullsized":"2024-09-14T11:56:30.223600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:58.253268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870821+0000","last_change":"2024-09-14T11:15:40.344174+0000","last_active":"2024-09-14T11:55:23.870821+0000","last_peered":"2024-09-14T11:55:23.870821+0000","last_clean":"2024-09-14T11:55:23.870821+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:55:23.870821+0000","last_undegraded":"2024-09-14T11:55:23.870821+0000","last_fullsized":"2024-09-14T11:55:23.870821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:53.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'215","reported_seq":729,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.995205+0000","last_change":"2024-09-14T11:15:42.348738+0000","last_active":"2024-09-14T11:56:56.995205+0000","last_peered":"2024-09-14T11:56:56.995205+0000","last_clean":"2024-09-14T11:56:56.995205+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:56:56.995205+0000","last_undegraded":"2024-09-14T11:56:56.995205+0000","last_fullsized":"2024-09-14T11:56:56.995205+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:07.647856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'455","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.674512+0000","last_change":"2024-09-14T11:15:34.322075+0000","last_active":"2024-09-14T11:56:19.674512+0000","last_peered":"2024-09-14T11:56:19.674512+0000","last_clean":"2024-09-14T11:56:19.674512+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:56:19.674512+0000","last_undegraded":"2024-09-14T11:56:19.674512+0000","last_fullsized":"2024-09-14T11:56:19.674512+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:01.128060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'345","reported_seq":989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.613050+0000","last_change":"2024-09-14T11:16:07.497232+0000","last_active":"2024-09-14T11:56:32.613050+0000","last_peered":"2024-09-14T11:56:32.613050+0000","last_clean":"2024-09-14T11:56:32.613050+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:56:32.613050+0000","last_undegraded":"2024-09-14T11:56:32.613050+0000","last_fullsized":"2024-09-14T11:56:32.613050+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:57.221580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8346231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":976,"num_read_kb":18899,"num_write":1297,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870031+0000","last_change":"2024-09-14T11:15:36.339369+0000","last_active":"2024-09-14T11:55:18.870031+0000","last_peered":"2024-09-14T11:55:18.870031+0000","last_clean":"2024-09-14T11:55:18.870031+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:55:18.870031+0000","last_undegraded":"2024-09-14T11:55:18.870031+0000","last_fullsized":"2024-09-14T11:55:18.870031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:43.628492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'155","reported_seq":734,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890822+0000","last_change":"2024-09-14T11:15:38.334637+0000","last_active":"2024-09-14T11:57:38.890822+0000","last_peered":"2024-09-14T11:57:38.890822+0000","last_clean":"2024-09-14T11:57:38.890822+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:57:38.890822+0000","last_undegraded":"2024-09-14T11:57:38.890822+0000","last_fullsized":"2024-09-14T11:57:38.890822+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:56.809543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9202,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":247,"num_write":110,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951144+0000","last_change":"2024-09-14T11:15:40.343098+0000","last_active":"2024-09-14T11:55:23.951144+0000","last_peered":"2024-09-14T11:55:23.951144+0000","last_clean":"2024-09-14T11:55:23.951144+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:55:23.951144+0000","last_undegraded":"2024-09-14T11:55:23.951144+0000","last_fullsized":"2024-09-14T11:55:23.951144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.732839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'115","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.989039+0000","last_change":"2024-09-14T11:15:42.348868+0000","last_active":"2024-09-14T11:56:56.989039+0000","last_peered":"2024-09-14T11:56:56.989039+0000","last_clean":"2024-09-14T11:56:56.989039+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:56:56.989039+0000","last_undegraded":"2024-09-14T11:56:56.989039+0000","last_fullsized":"2024-09-14T11:56:56.989039+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.040910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'810","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.890119+0000","last_change":"2024-09-14T11:15:34.332878+0000","last_active":"2024-09-14T11:57:33.890119+0000","last_peered":"2024-09-14T11:57:33.890119+0000","last_clean":"2024-09-14T11:57:33.890119+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:57:33.890119+0000","last_undegraded":"2024-09-14T11:57:33.890119+0000","last_fullsized":"2024-09-14T11:57:33.890119+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:47.822581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'259","reported_seq":864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:21.550580+0000","last_change":"2024-09-14T11:15:32.313576+0000","last_active":"2024-09-14T11:55:21.550580+0000","last_peered":"2024-09-14T11:55:21.550580+0000","last_clean":"2024-09-14T11:55:21.550580+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:55:21.550580+0000","last_undegraded":"2024-09-14T11:55:21.550580+0000","last_fullsized":"2024-09-14T11:55:21.550580+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:01.256758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924463,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":14443,"num_write":1154,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.950374+0000","last_change":"2024-09-14T11:15:36.330819+0000","last_active":"2024-09-14T11:55:18.950374+0000","last_peered":"2024-09-14T11:55:18.950374+0000","last_clean":"2024-09-14T11:55:18.950374+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:55:18.950374+0000","last_undegraded":"2024-09-14T11:55:18.950374+0000","last_fullsized":"2024-09-14T11:55:18.950374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:42.392337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'132","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:38.890163+0000","last_change":"2024-09-14T11:15:38.338705+0000","last_active":"2024-09-14T11:57:38.890163+0000","last_peered":"2024-09-14T11:57:38.890163+0000","last_clean":"2024-09-14T11:57:38.890163+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:57:38.890163+0000","last_undegraded":"2024-09-14T11:57:38.890163+0000","last_fullsized":"2024-09-14T11:57:38.890163+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:13.916538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":330,"num_write":102,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861871+0000","last_change":"2024-09-14T11:15:40.351822+0000","last_active":"2024-09-14T11:55:23.861871+0000","last_peered":"2024-09-14T11:55:23.861871+0000","last_clean":"2024-09-14T11:55:23.861871+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:55:23.861871+0000","last_undegraded":"2024-09-14T11:55:23.861871+0000","last_fullsized":"2024-09-14T11:55:23.861871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'849","reported_seq":2468,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.966335+0000","last_change":"2024-09-14T11:15:34.327038+0000","last_active":"2024-09-14T11:57:13.966335+0000","last_peered":"2024-09-14T11:57:13.966335+0000","last_clean":"2024-09-14T11:57:13.966335+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:57:13.966335+0000","last_undegraded":"2024-09-14T11:57:13.966335+0000","last_fullsized":"2024-09-14T11:57:13.966335+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:27.678371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'190","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.588372+0000","last_change":"2024-09-14T11:15:32.318761+0000","last_active":"2024-09-14T11:56:00.588372+0000","last_peered":"2024-09-14T11:56:00.588372+0000","last_clean":"2024-09-14T11:56:00.588372+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:56:00.588372+0000","last_undegraded":"2024-09-14T11:56:00.588372+0000","last_fullsized":"2024-09-14T11:56:00.588372+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:06.906697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10691710,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":38160,"num_write":901,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864502+0000","last_change":"2024-09-14T11:15:36.334440+0000","last_active":"2024-09-14T11:55:43.864502+0000","last_peered":"2024-09-14T11:55:43.864502+0000","last_clean":"2024-09-14T11:55:43.864502+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:55:43.864502+0000","last_undegraded":"2024-09-14T11:55:43.864502+0000","last_fullsized":"2024-09-14T11:55:43.864502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:33.779211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'191","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.772385+0000","last_change":"2024-09-14T11:15:38.334848+0000","last_active":"2024-09-14T11:58:15.772385+0000","last_peered":"2024-09-14T11:58:15.772385+0000","last_clean":"2024-09-14T11:58:15.772385+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:58:15.772385+0000","last_undegraded":"2024-09-14T11:58:15.772385+0000","last_fullsized":"2024-09-14T11:58:15.772385+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25104,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":274,"num_read_kb":349,"num_write":172,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.873860+0000","last_change":"2024-09-14T11:15:40.348746+0000","last_active":"2024-09-14T11:55:43.873860+0000","last_peered":"2024-09-14T11:55:43.873860+0000","last_clean":"2024-09-14T11:55:43.873860+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:55:43.873860+0000","last_undegraded":"2024-09-14T11:55:43.873860+0000","last_fullsized":"2024-09-14T11:55:43.873860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:48.113026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'159","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.879691+0000","last_change":"2024-09-14T11:15:42.352372+0000","last_active":"2024-09-14T11:55:59.879691+0000","last_peered":"2024-09-14T11:55:59.879691+0000","last_clean":"2024-09-14T11:55:59.879691+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:55:59.879691+0000","last_undegraded":"2024-09-14T11:55:59.879691+0000","last_fullsized":"2024-09-14T11:55:59.879691+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:49.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":1996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530068+0000","last_change":"2024-09-14T11:15:34.318828+0000","last_active":"2024-09-14T11:56:57.530068+0000","last_peered":"2024-09-14T11:56:57.530068+0000","last_clean":"2024-09-14T11:56:57.530068+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:56:57.530068+0000","last_undegraded":"2024-09-14T11:56:57.530068+0000","last_fullsized":"2024-09-14T11:56:57.530068+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:26.298183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'217","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.230535+0000","last_change":"2024-09-14T11:15:32.312194+0000","last_active":"2024-09-14T11:55:55.230535+0000","last_peered":"2024-09-14T11:55:55.230535+0000","last_clean":"2024-09-14T11:55:55.230535+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:55:55.230535+0000","last_undegraded":"2024-09-14T11:55:55.230535+0000","last_fullsized":"2024-09-14T11:55:55.230535+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.459882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2423889,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":11796,"num_write":1006,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.949977+0000","last_change":"2024-09-14T11:15:36.330927+0000","last_active":"2024-09-14T11:55:13.949977+0000","last_peered":"2024-09-14T11:55:13.949977+0000","last_clean":"2024-09-14T11:55:13.949977+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:55:13.949977+0000","last_undegraded":"2024-09-14T11:55:13.949977+0000","last_fullsized":"2024-09-14T11:55:13.949977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:56.526006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'153","reported_seq":720,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.894696+0000","last_change":"2024-09-14T11:15:38.341444+0000","last_active":"2024-09-14T11:58:08.894696+0000","last_peered":"2024-09-14T11:58:08.894696+0000","last_clean":"2024-09-14T11:58:08.894696+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:58:08.894696+0000","last_undegraded":"2024-09-14T11:58:08.894696+0000","last_fullsized":"2024-09-14T11:58:08.894696+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:11.384017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10257,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":257,"num_write":128,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869587+0000","last_change":"2024-09-14T11:15:40.346858+0000","last_active":"2024-09-14T11:55:40.869587+0000","last_peered":"2024-09-14T11:55:40.869587+0000","last_clean":"2024-09-14T11:55:40.869587+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:55:40.869587+0000","last_undegraded":"2024-09-14T11:55:40.869587+0000","last_fullsized":"2024-09-14T11:55:40.869587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:12.423799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'255","reported_seq":1118,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.480297+0000","last_change":"2024-09-14T11:15:42.347978+0000","last_active":"2024-09-14T11:56:55.480297+0000","last_peered":"2024-09-14T11:56:55.480297+0000","last_clean":"2024-09-14T11:56:55.480297+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:56:55.480297+0000","last_undegraded":"2024-09-14T11:56:55.480297+0000","last_fullsized":"2024-09-14T11:56:55.480297+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:59.600834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'851","reported_seq":2419,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518009+0000","last_change":"2024-09-14T11:15:34.327867+0000","last_active":"2024-09-14T11:56:33.518009+0000","last_peered":"2024-09-14T11:56:33.518009+0000","last_clean":"2024-09-14T11:56:33.518009+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:56:33.518009+0000","last_undegraded":"2024-09-14T11:56:33.518009+0000","last_fullsized":"2024-09-14T11:56:33.518009+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:01.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'194","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.009084+0000","last_change":"2024-09-14T11:15:32.312185+0000","last_active":"2024-09-14T11:55:34.009084+0000","last_peered":"2024-09-14T11:55:34.009084+0000","last_clean":"2024-09-14T11:55:34.009084+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:55:34.009084+0000","last_undegraded":"2024-09-14T11:55:34.009084+0000","last_fullsized":"2024-09-14T11:55:34.009084+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:40.741870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.009957+0000","last_change":"2024-09-14T11:15:36.330057+0000","last_active":"2024-09-14T11:55:39.009957+0000","last_peered":"2024-09-14T11:55:39.009957+0000","last_clean":"2024-09-14T11:55:39.009957+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:55:39.009957+0000","last_undegraded":"2024-09-14T11:55:39.009957+0000","last_fullsized":"2024-09-14T11:55:39.009957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.691223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'127","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.886603+0000","last_change":"2024-09-14T11:15:38.336865+0000","last_active":"2024-09-14T11:57:18.886603+0000","last_peered":"2024-09-14T11:57:18.886603+0000","last_clean":"2024-09-14T11:57:18.886603+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:57:18.886603+0000","last_undegraded":"2024-09-14T11:57:18.886603+0000","last_fullsized":"2024-09-14T11:57:18.886603+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:20.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10212,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":241,"num_write":96,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870237+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:55:45.870237+0000","last_peered":"2024-09-14T11:55:45.870237+0000","last_clean":"2024-09-14T11:55:45.870237+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:55:45.870237+0000","last_undegraded":"2024-09-14T11:55:45.870237+0000","last_fullsized":"2024-09-14T11:55:45.870237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.612855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'145","reported_seq":635,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801285+0000","last_change":"2024-09-14T11:15:42.348516+0000","last_active":"2024-09-14T11:58:15.801285+0000","last_peered":"2024-09-14T11:58:15.801285+0000","last_clean":"2024-09-14T11:58:15.801285+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:58:15.801285+0000","last_undegraded":"2024-09-14T11:58:15.801285+0000","last_fullsized":"2024-09-14T11:58:15.801285+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:57.841456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'425","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.459589+0000","last_change":"2024-09-14T11:16:07.518584+0000","last_active":"2024-09-14T11:58:14.459589+0000","last_peered":"2024-09-14T11:58:14.459589+0000","last_clean":"2024-09-14T11:58:14.459589+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:14.459589+0000","last_undegraded":"2024-09-14T11:58:14.459589+0000","last_fullsized":"2024-09-14T11:58:14.459589+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:45.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'214","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.307617+0000","last_change":"2024-09-14T11:15:32.310716+0000","last_active":"2024-09-14T11:56:21.307617+0000","last_peered":"2024-09-14T11:56:21.307617+0000","last_clean":"2024-09-14T11:56:21.307617+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:56:21.307617+0000","last_undegraded":"2024-09-14T11:56:21.307617+0000","last_fullsized":"2024-09-14T11:56:21.307617+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:42.627407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5299376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":514,"num_read_kb":12620,"num_write":950,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:35.868896+0000","last_change":"2024-09-14T11:15:36.330575+0000","last_active":"2024-09-14T11:55:35.868896+0000","last_peered":"2024-09-14T11:55:35.868896+0000","last_clean":"2024-09-14T11:55:35.868896+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:55:35.868896+0000","last_undegraded":"2024-09-14T11:55:35.868896+0000","last_fullsized":"2024-09-14T11:55:35.868896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:23.577919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'99","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.374104+0000","last_change":"2024-09-14T11:15:38.335710+0000","last_active":"2024-09-14T11:56:21.374104+0000","last_peered":"2024-09-14T11:56:21.374104+0000","last_clean":"2024-09-14T11:56:21.374104+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:56:21.374104+0000","last_undegraded":"2024-09-14T11:56:21.374104+0000","last_fullsized":"2024-09-14T11:56:21.374104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:16.942605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'766","reported_seq":2177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842678+0000","last_change":"2024-09-14T11:15:40.347027+0000","last_active":"2024-09-14T11:58:15.842678+0000","last_peered":"2024-09-14T11:58:15.842678+0000","last_clean":"2024-09-14T11:58:15.842678+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:58:15.842678+0000","last_undegraded":"2024-09-14T11:58:15.842678+0000","last_fullsized":"2024-09-14T11:58:15.842678+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.157408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":604,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.934707+0000","last_change":"2024-09-14T11:15:42.350291+0000","last_active":"2024-09-14T11:56:30.934707+0000","last_peered":"2024-09-14T11:56:30.934707+0000","last_clean":"2024-09-14T11:56:30.934707+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:56:30.934707+0000","last_undegraded":"2024-09-14T11:56:30.934707+0000","last_fullsized":"2024-09-14T11:56:30.934707+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.774415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'894","reported_seq":2466,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.677671+0000","last_change":"2024-09-14T11:15:34.322958+0000","last_active":"2024-09-14T11:56:32.677671+0000","last_peered":"2024-09-14T11:56:32.677671+0000","last_clean":"2024-09-14T11:56:32.677671+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:56:32.677671+0000","last_undegraded":"2024-09-14T11:56:32.677671+0000","last_fullsized":"2024-09-14T11:56:32.677671+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'208","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:06.727058+0000","last_change":"2024-09-14T11:15:32.310372+0000","last_active":"2024-09-14T11:56:06.727058+0000","last_peered":"2024-09-14T11:56:06.727058+0000","last_clean":"2024-09-14T11:56:06.727058+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:56:06.727058+0000","last_undegraded":"2024-09-14T11:56:06.727058+0000","last_fullsized":"2024-09-14T11:56:06.727058+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:20.309040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7368312,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":924,"num_read_kb":28634,"num_write":965,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872979+0000","last_change":"2024-09-14T11:15:36.334783+0000","last_active":"2024-09-14T11:55:38.872979+0000","last_peered":"2024-09-14T11:55:38.872979+0000","last_clean":"2024-09-14T11:55:38.872979+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:55:38.872979+0000","last_undegraded":"2024-09-14T11:55:38.872979+0000","last_fullsized":"2024-09-14T11:55:38.872979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:31.368261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'152","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.884022+0000","last_change":"2024-09-14T11:15:38.333129+0000","last_active":"2024-09-14T11:56:53.884022+0000","last_peered":"2024-09-14T11:56:53.884022+0000","last_clean":"2024-09-14T11:56:53.884022+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:56:53.884022+0000","last_undegraded":"2024-09-14T11:56:53.884022+0000","last_fullsized":"2024-09-14T11:56:53.884022+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:23.609841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13591,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":260,"num_write":110,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.854707+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:54:23.854707+0000","last_peered":"2024-09-14T11:54:23.854707+0000","last_clean":"2024-09-14T11:54:23.854707+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:54:23.854707+0000","last_undegraded":"2024-09-14T11:54:23.854707+0000","last_fullsized":"2024-09-14T11:54:23.854707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:23.255804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'105","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513654+0000","last_change":"2024-09-14T11:15:42.354717+0000","last_active":"2024-09-14T11:56:33.513654+0000","last_peered":"2024-09-14T11:56:33.513654+0000","last_clean":"2024-09-14T11:56:33.513654+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:56:33.513654+0000","last_undegraded":"2024-09-14T11:56:33.513654+0000","last_fullsized":"2024-09-14T11:56:33.513654+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:10.490861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'654","reported_seq":2517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456955+0000","last_change":"2024-09-14T11:15:34.319956+0000","last_active":"2024-09-14T11:58:14.456955+0000","last_peered":"2024-09-14T11:58:14.456955+0000","last_clean":"2024-09-14T11:58:14.456955+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:58:14.456955+0000","last_undegraded":"2024-09-14T11:58:14.456955+0000","last_fullsized":"2024-09-14T11:58:14.456955+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:38.765206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'192","reported_seq":798,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.683000+0000","last_change":"2024-09-14T11:15:32.311339+0000","last_active":"2024-09-14T11:56:37.683000+0000","last_peered":"2024-09-14T11:56:37.683000+0000","last_clean":"2024-09-14T11:56:37.683000+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:56:37.683000+0000","last_undegraded":"2024-09-14T11:56:37.683000+0000","last_fullsized":"2024-09-14T11:56:37.683000+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:40.088024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8864078,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":483,"num_read_kb":24057,"num_write":873,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872982+0000","last_change":"2024-09-14T11:15:36.323716+0000","last_active":"2024-09-14T11:55:38.872982+0000","last_peered":"2024-09-14T11:55:38.872982+0000","last_clean":"2024-09-14T11:55:38.872982+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:55:38.872982+0000","last_undegraded":"2024-09-14T11:55:38.872982+0000","last_fullsized":"2024-09-14T11:55:38.872982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:05.232742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'142","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.871358+0000","last_change":"2024-09-14T11:15:38.333174+0000","last_active":"2024-09-14T11:56:43.871358+0000","last_peered":"2024-09-14T11:56:43.871358+0000","last_clean":"2024-09-14T11:56:43.871358+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:56:43.871358+0000","last_undegraded":"2024-09-14T11:56:43.871358+0000","last_fullsized":"2024-09-14T11:56:43.871358+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:29.536985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":240,"num_write":96,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944488+0000","last_change":"2024-09-14T11:15:40.344604+0000","last_active":"2024-09-14T11:54:28.944488+0000","last_peered":"2024-09-14T11:54:28.944488+0000","last_clean":"2024-09-14T11:54:28.944488+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:54:28.944488+0000","last_undegraded":"2024-09-14T11:54:28.944488+0000","last_fullsized":"2024-09-14T11:54:28.944488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:07.536782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'141","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.134030+0000","last_change":"2024-09-14T11:15:42.348390+0000","last_active":"2024-09-14T11:56:39.134030+0000","last_peered":"2024-09-14T11:56:39.134030+0000","last_clean":"2024-09-14T11:56:39.134030+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:56:39.134030+0000","last_undegraded":"2024-09-14T11:56:39.134030+0000","last_fullsized":"2024-09-14T11:56:39.134030+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:35.472396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'745","reported_seq":2355,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.981012+0000","last_change":"2024-09-14T11:15:34.323276+0000","last_active":"2024-09-14T11:56:56.981012+0000","last_peered":"2024-09-14T11:56:56.981012+0000","last_clean":"2024-09-14T11:56:56.981012+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:56:56.981012+0000","last_undegraded":"2024-09-14T11:56:56.981012+0000","last_fullsized":"2024-09-14T11:56:56.981012+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:11.314085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'236","reported_seq":987,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874920+0000","last_change":"2024-09-14T11:15:32.314412+0000","last_active":"2024-09-14T11:55:43.874920+0000","last_peered":"2024-09-14T11:55:43.874920+0000","last_clean":"2024-09-14T11:55:43.874920+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:55:43.874920+0000","last_undegraded":"2024-09-14T11:55:43.874920+0000","last_fullsized":"2024-09-14T11:55:43.874920+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:54.314072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7372429,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":845,"num_read_kb":149417,"num_write":1042,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999537+0000","last_change":"2024-09-14T11:15:36.334370+0000","last_active":"2024-09-14T11:54:18.999537+0000","last_peered":"2024-09-14T11:54:18.999537+0000","last_clean":"2024-09-14T11:54:18.999537+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:54:18.999537+0000","last_undegraded":"2024-09-14T11:54:18.999537+0000","last_fullsized":"2024-09-14T11:54:18.999537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:16.183616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'94","reported_seq":641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.894830+0000","last_change":"2024-09-14T11:15:38.339773+0000","last_active":"2024-09-14T11:58:08.894830+0000","last_peered":"2024-09-14T11:58:08.894830+0000","last_clean":"2024-09-14T11:58:08.894830+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:58:08.894830+0000","last_undegraded":"2024-09-14T11:58:08.894830+0000","last_fullsized":"2024-09-14T11:58:08.894830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.547669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11302,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":164,"num_write":52,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.010579+0000","last_change":"2024-09-14T11:15:40.345970+0000","last_active":"2024-09-14T11:55:44.010579+0000","last_peered":"2024-09-14T11:55:44.010579+0000","last_clean":"2024-09-14T11:55:44.010579+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:55:44.010579+0000","last_undegraded":"2024-09-14T11:55:44.010579+0000","last_fullsized":"2024-09-14T11:55:44.010579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.446853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'154","reported_seq":1252,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.149214+0000","last_change":"2024-09-14T11:15:42.354185+0000","last_active":"2024-09-14T11:56:55.149214+0000","last_peered":"2024-09-14T11:56:55.149214+0000","last_clean":"2024-09-14T11:56:55.149214+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:56:55.149214+0000","last_undegraded":"2024-09-14T11:56:55.149214+0000","last_fullsized":"2024-09-14T11:56:55.149214+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:00.385532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'446","reported_seq":1936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.748803+0000","last_change":"2024-09-14T11:15:34.320209+0000","last_active":"2024-09-14T11:56:37.748803+0000","last_peered":"2024-09-14T11:56:37.748803+0000","last_clean":"2024-09-14T11:56:37.748803+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:56:37.748803+0000","last_undegraded":"2024-09-14T11:56:37.748803+0000","last_fullsized":"2024-09-14T11:56:37.748803+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:44.754267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'202","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.455627+0000","last_change":"2024-09-14T11:15:32.314784+0000","last_active":"2024-09-14T11:56:13.455627+0000","last_peered":"2024-09-14T11:56:13.455627+0000","last_clean":"2024-09-14T11:56:13.455627+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:56:13.455627+0000","last_undegraded":"2024-09-14T11:56:13.455627+0000","last_fullsized":"2024-09-14T11:56:13.455627+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.987083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079014,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":525,"num_read_kb":36694,"num_write":983,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.858535+0000","last_change":"2024-09-14T11:15:36.334335+0000","last_active":"2024-09-14T11:54:20.858535+0000","last_peered":"2024-09-14T11:54:20.858535+0000","last_clean":"2024-09-14T11:54:20.858535+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:54:20.858535+0000","last_undegraded":"2024-09-14T11:54:20.858535+0000","last_fullsized":"2024-09-14T11:54:20.858535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:15.469593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'144","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.031982+0000","last_change":"2024-09-14T11:15:38.340747+0000","last_active":"2024-09-14T11:58:09.031982+0000","last_peered":"2024-09-14T11:58:09.031982+0000","last_clean":"2024-09-14T11:58:09.031982+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:58:09.031982+0000","last_undegraded":"2024-09-14T11:58:09.031982+0000","last_fullsized":"2024-09-14T11:58:09.031982+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:13.972291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":256,"num_write":112,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864425+0000","last_change":"2024-09-14T11:15:40.351076+0000","last_active":"2024-09-14T11:55:43.864425+0000","last_peered":"2024-09-14T11:55:43.864425+0000","last_clean":"2024-09-14T11:55:43.864425+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:55:43.864425+0000","last_undegraded":"2024-09-14T11:55:43.864425+0000","last_fullsized":"2024-09-14T11:55:43.864425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:55.409953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'93","reported_seq":570,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.455750+0000","last_change":"2024-09-14T11:15:42.354581+0000","last_active":"2024-09-14T11:58:14.455750+0000","last_peered":"2024-09-14T11:58:14.455750+0000","last_clean":"2024-09-14T11:58:14.455750+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:58:14.455750+0000","last_undegraded":"2024-09-14T11:58:14.455750+0000","last_fullsized":"2024-09-14T11:58:14.455750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:56.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'422","reported_seq":1871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.440972+0000","last_change":"2024-09-14T11:15:34.326286+0000","last_active":"2024-09-14T11:56:24.440972+0000","last_peered":"2024-09-14T11:56:24.440972+0000","last_clean":"2024-09-14T11:56:24.440972+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:56:24.440972+0000","last_undegraded":"2024-09-14T11:56:24.440972+0000","last_fullsized":"2024-09-14T11:56:24.440972+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:42.344126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'187","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.949331+0000","last_change":"2024-09-14T11:15:32.318065+0000","last_active":"2024-09-14T11:55:08.949331+0000","last_peered":"2024-09-14T11:55:08.949331+0000","last_clean":"2024-09-14T11:55:08.949331+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:55:08.949331+0000","last_undegraded":"2024-09-14T11:55:08.949331+0000","last_fullsized":"2024-09-14T11:55:08.949331+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:17.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1219547,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":66072,"num_write":888,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.217987+0000","last_change":"2024-09-14T11:15:34.326738+0000","last_active":"2024-09-14T11:56:20.217987+0000","last_peered":"2024-09-14T11:56:20.217987+0000","last_clean":"2024-09-14T11:56:20.217987+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:56:20.217987+0000","last_undegraded":"2024-09-14T11:56:20.217987+0000","last_fullsized":"2024-09-14T11:56:20.217987+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:19.559783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'205","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.769120+0000","last_change":"2024-09-14T11:16:07.388971+0000","last_active":"2024-09-14T11:56:52.769120+0000","last_peered":"2024-09-14T11:56:52.769120+0000","last_clean":"2024-09-14T11:56:52.769120+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:56:52.769120+0000","last_undegraded":"2024-09-14T11:56:52.769120+0000","last_fullsized":"2024-09-14T11:56:52.769120+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:24.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874406,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":30107,"num_write":963,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'535","reported_seq":2201,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.748702+0000","last_change":"2024-09-14T11:15:34.327112+0000","last_active":"2024-09-14T11:56:37.748702+0000","last_peered":"2024-09-14T11:56:37.748702+0000","last_clean":"2024-09-14T11:56:37.748702+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:56:37.748702+0000","last_undegraded":"2024-09-14T11:56:37.748702+0000","last_fullsized":"2024-09-14T11:56:37.748702+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:38.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'178","reported_seq":758,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:56.061418+0000","last_change":"2024-09-14T11:15:32.322695+0000","last_active":"2024-09-14T11:55:56.061418+0000","last_peered":"2024-09-14T11:55:56.061418+0000","last_clean":"2024-09-14T11:55:56.061418+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:55:56.061418+0000","last_undegraded":"2024-09-14T11:55:56.061418+0000","last_fullsized":"2024-09-14T11:55:56.061418+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:51.640989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4543689,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":391,"num_read_kb":13678,"num_write":820,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'686","reported_seq":2125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815081+0000","last_change":"2024-09-14T11:15:34.326696+0000","last_active":"2024-09-14T11:56:31.815081+0000","last_peered":"2024-09-14T11:56:31.815081+0000","last_clean":"2024-09-14T11:56:31.815081+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:56:31.815081+0000","last_undegraded":"2024-09-14T11:56:31.815081+0000","last_fullsized":"2024-09-14T11:56:31.815081+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:33.740522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'218","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.306735+0000","last_change":"2024-09-14T11:15:32.316203+0000","last_active":"2024-09-14T11:56:34.306735+0000","last_peered":"2024-09-14T11:56:34.306735+0000","last_clean":"2024-09-14T11:56:34.306735+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:56:34.306735+0000","last_undegraded":"2024-09-14T11:56:34.306735+0000","last_fullsized":"2024-09-14T11:56:34.306735+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:22.666605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6140506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":667,"num_read_kb":8461,"num_write":1061,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'577","reported_seq":2174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.999003+0000","last_change":"2024-09-14T11:15:34.321891+0000","last_active":"2024-09-14T11:56:36.999003+0000","last_peered":"2024-09-14T11:56:36.999003+0000","last_clean":"2024-09-14T11:56:36.999003+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:56:36.999003+0000","last_undegraded":"2024-09-14T11:56:36.999003+0000","last_fullsized":"2024-09-14T11:56:36.999003+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:57.912381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'249","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.079998+0000","last_change":"2024-09-14T11:15:32.318820+0000","last_active":"2024-09-14T11:56:52.079998+0000","last_peered":"2024-09-14T11:56:52.079998+0000","last_clean":"2024-09-14T11:56:52.079998+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:56:52.079998+0000","last_undegraded":"2024-09-14T11:56:52.079998+0000","last_fullsized":"2024-09-14T11:56:52.079998+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:03.579946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20178710,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":615,"num_read_kb":65552,"num_write":1151,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1210","reported_seq":2813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.749031+0000","last_change":"2024-09-14T11:15:34.321918+0000","last_active":"2024-09-14T11:56:37.749031+0000","last_peered":"2024-09-14T11:56:37.749031+0000","last_clean":"2024-09-14T11:56:37.749031+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:56:37.749031+0000","last_undegraded":"2024-09-14T11:56:37.749031+0000","last_fullsized":"2024-09-14T11:56:37.749031+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:50.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'189","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:16.645586+0000","last_change":"2024-09-14T11:15:32.315289+0000","last_active":"2024-09-14T11:55:16.645586+0000","last_peered":"2024-09-14T11:55:16.645586+0000","last_clean":"2024-09-14T11:55:16.645586+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:55:16.645586+0000","last_undegraded":"2024-09-14T11:55:16.645586+0000","last_fullsized":"2024-09-14T11:55:16.645586+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.565051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9439257,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":505,"num_read_kb":18861,"num_write":889,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'487","reported_seq":2135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.885876+0000","last_change":"2024-09-14T11:15:34.331577+0000","last_active":"2024-09-14T11:57:13.885876+0000","last_peered":"2024-09-14T11:57:13.885876+0000","last_clean":"2024-09-14T11:57:13.885876+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:57:13.885876+0000","last_undegraded":"2024-09-14T11:57:13.885876+0000","last_fullsized":"2024-09-14T11:57:13.885876+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:11.178476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'180","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.655711+0000","last_change":"2024-09-14T11:15:32.316992+0000","last_active":"2024-09-14T11:56:27.655711+0000","last_peered":"2024-09-14T11:56:27.655711+0000","last_clean":"2024-09-14T11:56:27.655711+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:56:27.655711+0000","last_undegraded":"2024-09-14T11:56:27.655711+0000","last_fullsized":"2024-09-14T11:56:27.655711+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:26.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1732164,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":3776,"num_write":814,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'438","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992326+0000","last_change":"2024-09-14T11:15:34.320939+0000","last_active":"2024-09-14T11:56:56.992326+0000","last_peered":"2024-09-14T11:56:56.992326+0000","last_clean":"2024-09-14T11:56:56.992326+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:56:56.992326+0000","last_undegraded":"2024-09-14T11:56:56.992326+0000","last_fullsized":"2024-09-14T11:56:56.992326+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:48.296671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'266","reported_seq":914,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:47.024102+0000","last_change":"2024-09-14T11:15:32.313940+0000","last_active":"2024-09-14T11:55:47.024102+0000","last_peered":"2024-09-14T11:55:47.024102+0000","last_clean":"2024-09-14T11:55:47.024102+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:55:47.024102+0000","last_undegraded":"2024-09-14T11:55:47.024102+0000","last_fullsized":"2024-09-14T11:55:47.024102+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:20.479935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7395300,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":36414,"num_write":1097,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'491","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815278+0000","last_change":"2024-09-14T11:15:34.329614+0000","last_active":"2024-09-14T11:56:31.815278+0000","last_peered":"2024-09-14T11:56:31.815278+0000","last_clean":"2024-09-14T11:56:31.815278+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:56:31.815278+0000","last_undegraded":"2024-09-14T11:56:31.815278+0000","last_fullsized":"2024-09-14T11:56:31.815278+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:54.327097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'273","reported_seq":919,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.153726+0000","last_change":"2024-09-14T11:15:32.315107+0000","last_active":"2024-09-14T11:56:30.153726+0000","last_peered":"2024-09-14T11:56:30.153726+0000","last_clean":"2024-09-14T11:56:30.153726+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:56:30.153726+0000","last_undegraded":"2024-09-14T11:56:30.153726+0000","last_fullsized":"2024-09-14T11:56:30.153726+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:38.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10535606,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":717,"num_read_kb":57959,"num_write":1164,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'745","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.401835+0000","last_change":"2024-09-14T11:15:34.315526+0000","last_active":"2024-09-14T11:56:29.401835+0000","last_peered":"2024-09-14T11:56:29.401835+0000","last_clean":"2024-09-14T11:56:29.401835+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:56:29.401835+0000","last_undegraded":"2024-09-14T11:56:29.401835+0000","last_fullsized":"2024-09-14T11:56:29.401835+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:14.858173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'196","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877283+0000","last_change":"2024-09-14T11:15:32.314904+0000","last_active":"2024-09-14T11:56:03.877283+0000","last_peered":"2024-09-14T11:56:03.877283+0000","last_clean":"2024-09-14T11:56:03.877283+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:56:03.877283+0000","last_undegraded":"2024-09-14T11:56:03.877283+0000","last_fullsized":"2024-09-14T11:56:03.877283+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:26.432997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6318765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":507,"num_read_kb":27346,"num_write":949,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518380+0000","last_change":"2024-09-14T11:15:34.319049+0000","last_active":"2024-09-14T11:56:33.518380+0000","last_peered":"2024-09-14T11:56:33.518380+0000","last_clean":"2024-09-14T11:56:33.518380+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:56:33.518380+0000","last_undegraded":"2024-09-14T11:56:33.518380+0000","last_fullsized":"2024-09-14T11:56:33.518380+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:49.759336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'210","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.403461+0000","last_change":"2024-09-14T11:15:32.323060+0000","last_active":"2024-09-14T11:56:38.403461+0000","last_peered":"2024-09-14T11:56:38.403461+0000","last_clean":"2024-09-14T11:56:38.403461+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:56:38.403461+0000","last_undegraded":"2024-09-14T11:56:38.403461+0000","last_fullsized":"2024-09-14T11:56:38.403461+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:45.398432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9461002,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":6791,"num_write":1018,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1091","reported_seq":2577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465397+0000","last_change":"2024-09-14T11:15:34.322193+0000","last_active":"2024-09-14T11:56:38.465397+0000","last_peered":"2024-09-14T11:56:38.465397+0000","last_clean":"2024-09-14T11:56:38.465397+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:56:38.465397+0000","last_undegraded":"2024-09-14T11:56:38.465397+0000","last_fullsized":"2024-09-14T11:56:38.465397+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":1000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:22.542879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.866601+0000","last_change":"2024-09-14T11:15:32.310112+0000","last_active":"2024-09-14T11:56:03.866601+0000","last_peered":"2024-09-14T11:56:03.866601+0000","last_clean":"2024-09-14T11:56:03.866601+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:56:03.866601+0000","last_undegraded":"2024-09-14T11:56:03.866601+0000","last_fullsized":"2024-09-14T11:56:03.866601+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:07.469578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291482,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":8671,"num_write":965,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'890","reported_seq":2796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530140+0000","last_change":"2024-09-14T11:15:34.324712+0000","last_active":"2024-09-14T11:56:57.530140+0000","last_peered":"2024-09-14T11:56:57.530140+0000","last_clean":"2024-09-14T11:56:57.530140+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:56:57.530140+0000","last_undegraded":"2024-09-14T11:56:57.530140+0000","last_fullsized":"2024-09-14T11:56:57.530140+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.495184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'210","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.956619+0000","last_change":"2024-09-14T11:15:32.318750+0000","last_active":"2024-09-14T11:56:03.956619+0000","last_peered":"2024-09-14T11:56:03.956619+0000","last_clean":"2024-09-14T11:56:03.956619+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:56:03.956619+0000","last_undegraded":"2024-09-14T11:56:03.956619+0000","last_fullsized":"2024-09-14T11:56:03.956619+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.743260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":9098,"num_write":1055,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.467024+0000","last_change":"2024-09-14T11:15:34.332778+0000","last_active":"2024-09-14T11:58:14.467024+0000","last_peered":"2024-09-14T11:58:14.467024+0000","last_clean":"2024-09-14T11:58:14.467024+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:58:14.467024+0000","last_undegraded":"2024-09-14T11:58:14.467024+0000","last_fullsized":"2024-09-14T11:58:14.467024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:54.250812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'219","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877344+0000","last_change":"2024-09-14T11:15:32.312591+0000","last_active":"2024-09-14T11:56:08.877344+0000","last_peered":"2024-09-14T11:56:08.877344+0000","last_clean":"2024-09-14T11:56:08.877344+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:56:08.877344+0000","last_undegraded":"2024-09-14T11:56:08.877344+0000","last_fullsized":"2024-09-14T11:56:08.877344+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:10.213620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5597074,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":650,"num_read_kb":2234,"num_write":1091,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1087","reported_seq":2853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466283+0000","last_change":"2024-09-14T11:15:34.328111+0000","last_active":"2024-09-14T11:58:14.466283+0000","last_peered":"2024-09-14T11:58:14.466283+0000","last_clean":"2024-09-14T11:58:14.466283+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:58:14.466283+0000","last_undegraded":"2024-09-14T11:58:14.466283+0000","last_fullsized":"2024-09-14T11:58:14.466283+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":1000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:12.718283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'208","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.084352+0000","last_change":"2024-09-14T11:15:32.313441+0000","last_active":"2024-09-14T11:55:59.084352+0000","last_peered":"2024-09-14T11:55:59.084352+0000","last_clean":"2024-09-14T11:55:59.084352+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:55:59.084352+0000","last_undegraded":"2024-09-14T11:55:59.084352+0000","last_fullsized":"2024-09-14T11:55:59.084352+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:11.822923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194329,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":34303,"num_write":986,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998517+0000","last_change":"2024-09-14T11:15:34.327960+0000","last_active":"2024-09-14T11:56:36.998517+0000","last_peered":"2024-09-14T11:56:36.998517+0000","last_clean":"2024-09-14T11:56:36.998517+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:56:36.998517+0000","last_undegraded":"2024-09-14T11:56:36.998517+0000","last_fullsized":"2024-09-14T11:56:36.998517+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:15.598992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'248","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.644775+0000","last_change":"2024-09-14T11:15:32.319862+0000","last_active":"2024-09-14T11:55:59.644775+0000","last_peered":"2024-09-14T11:55:59.644775+0000","last_clean":"2024-09-14T11:55:59.644775+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:55:59.644775+0000","last_undegraded":"2024-09-14T11:55:59.644775+0000","last_fullsized":"2024-09-14T11:55:59.644775+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:02.612992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242961,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":43532,"num_write":1119,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'181","reported_seq":779,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:55.921103+0000","last_change":"2024-09-14T11:15:32.313012+0000","last_active":"2024-09-14T11:55:55.921103+0000","last_peered":"2024-09-14T11:55:55.921103+0000","last_clean":"2024-09-14T11:55:55.921103+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:55:55.921103+0000","last_undegraded":"2024-09-14T11:55:55.921103+0000","last_fullsized":"2024-09-14T11:55:55.921103+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:04.134671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7369327,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":446,"num_read_kb":29604,"num_write":899,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'412","reported_seq":1879,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136779+0000","last_change":"2024-09-14T11:15:34.329317+0000","last_active":"2024-09-14T11:56:39.136779+0000","last_peered":"2024-09-14T11:56:39.136779+0000","last_clean":"2024-09-14T11:56:39.136779+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:56:39.136779+0000","last_undegraded":"2024-09-14T11:56:39.136779+0000","last_fullsized":"2024-09-14T11:56:39.136779+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:48.380875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'275","reported_seq":1047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.046588+0000","last_change":"2024-09-14T11:15:32.312792+0000","last_active":"2024-09-14T11:55:58.046588+0000","last_peered":"2024-09-14T11:55:58.046588+0000","last_clean":"2024-09-14T11:55:58.046588+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:55:58.046588+0000","last_undegraded":"2024-09-14T11:55:58.046588+0000","last_fullsized":"2024-09-14T11:55:58.046588+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.357853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5951631,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1006,"num_read_kb":66938,"num_write":1370,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'573","reported_seq":2170,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.863303+0000","last_change":"2024-09-14T11:15:34.326395+0000","last_active":"2024-09-14T11:57:45.863303+0000","last_peered":"2024-09-14T11:57:45.863303+0000","last_clean":"2024-09-14T11:57:45.863303+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:57:45.863303+0000","last_undegraded":"2024-09-14T11:57:45.863303+0000","last_fullsized":"2024-09-14T11:57:45.863303+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:54.259695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":627,"ondisk_log_size":627,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":498831,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8040,"num_read_kb":9895,"num_write":5491,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":761856,"data_stored":249734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1889,"ondisk_log_size":1889,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2384,"num_read_kb":2846,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4076,"ondisk_log_size":4076,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":464712376,"num_objects":477,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":477,"num_whiteouts":0,"num_read":38553,"num_read_kb":2111644,"num_write":64115,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":931250176,"data_stored":929424752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4363,"ondisk_log_size":4363,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72500675,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":137,"num_read_kb":180487,"num_write":158,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145006592,"data_stored":145001350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72500675,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":134,"num_read_kb":169164,"num_write":158,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145006592,"data_stored":145001350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509967,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375884,"kb_used_data":155900,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93995956,"statfs":{"total":96636764160,"available":96251858944,"internally_reserved":0,"allocated":159641600,"data_stored":157815266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509967,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309688,"kb_used_data":89704,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94062152,"statfs":{"total":96636764160,"available":96319643648,"internally_reserved":0,"allocated":91856896,"data_stored":90219580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509968,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229120,"kb_used_data":139696,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94142720,"statfs":{"total":96636764160,"available":96402145280,"internally_reserved":0,"allocated":143048704,"data_stored":141168794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509967,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240900,"kb_used_data":165300,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94130940,"statfs":{"total":96636764160,"available":96390082560,"internally_reserved":0,"allocated":169267200,"data_stored":167511993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509969,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":445588,"kb_used_data":215876,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93926252,"statfs":{"total":96636764160,"available":96180482048,"internally_reserved":0,"allocated":221057024,"data_stored":219210462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509967,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183136,"kb_used_data":115856,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94188704,"statfs":{"total":96636764160,"available":96449232896,"internally_reserved":0,"allocated":118636544,"data_stored":117025884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509965,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412228,"kb_used_data":182516,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93959612,"statfs":{"total":96636764160,"available":96214642688,"internally_reserved":0,"allocated":186896384,"data_stored":185041393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575374,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279104,"kb_used_data":157744,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94092736,"statfs":{"total":96636764160,"available":96350961664,"internally_reserved":0,"allocated":161529856,"data_stored":159871804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136409088,"data_stored":136109756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102232064,"data_stored":102093234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80318464,"data_stored":80187460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":193044480,"data_stored":192754866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118382592,"data_stored":118092216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":114061312,"data_stored":113775120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71327744,"data_stored":71195635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":115474432,"data_stored":115216465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":35768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":39296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":12957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":42327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":8255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":54512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":19841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":36778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3207168,"data_stored":3206092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27324416,"data_stored":27323340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10534912,"data_stored":10534182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":25205969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21082112,"data_stored":21080306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19963904,"data_stored":19963089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":6351820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:50.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:58:50.385 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:58:50.385 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":262,"fsid":"3191632e-7a9b-4e48-9872-c4da022399f4","created":"2024-09-14T11:15:01.483350+0000","modified":"2024-09-14T11:43:36.596957+0000","last_up_change":"2024-09-14T11:15:13.031058+0000","last_in_change":"2024-09-14T11:15:03.903527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:15:13.785417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:15:19.772518+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:15:31.141582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:15:32.656612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:15:34.480097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:15:36.394686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:15:38.344735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:15:40.413735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:30:43.328865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"251","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:32:27.969334+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:32:31.409599+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:43:34.270317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9b06921-3a5a-4b73-8300-c634ce4f76a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6817","nonce":2474842914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6819","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6821","nonce":2474842914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6830","nonce":2474842914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6823","nonce":2474842914},{"type":"v1","addr":"172.21.15.7:6825","nonce":2474842914}]},"public_addr":"172.21.15.7:6817/2474842914","cluster_addr":"172.21.15.7:6821/2474842914","heartbeat_back_addr":"172.21.15.7:6830/2474842914","heartbeat_front_addr":"172.21.15.7:6825/2474842914","state":["exists","up"]},{"osd":1,"uuid":"a57fac7b-95a0-4b30-8ed7-07f3550085e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6801","nonce":3296984494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6803","nonce":3296984494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6807","nonce":3296984494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":3296984494},{"type":"v1","addr":"172.21.15.7:6805","nonce":3296984494}]},"public_addr":"172.21.15.7:6801/3296984494","cluster_addr":"172.21.15.7:6803/3296984494","heartbeat_back_addr":"172.21.15.7:6807/3296984494","heartbeat_front_addr":"172.21.15.7:6805/3296984494","state":["exists","up"]},{"osd":2,"uuid":"8fedc24b-fce6-473c-8bbf-adb45d26c422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6820","nonce":2124660824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6824","nonce":2124660824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6829","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6831","nonce":2124660824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2124660824},{"type":"v1","addr":"172.21.15.7:6827","nonce":2124660824}]},"public_addr":"172.21.15.7:6820/2124660824","cluster_addr":"172.21.15.7:6824/2124660824","heartbeat_back_addr":"172.21.15.7:6831/2124660824","heartbeat_front_addr":"172.21.15.7:6827/2124660824","state":["exists","up"]},{"osd":3,"uuid":"85a0433f-7d76-47ab-8c54-9c6c23d97266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6809","nonce":3803654234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6811","nonce":3803654234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6815","nonce":3803654234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3803654234},{"type":"v1","addr":"172.21.15.7:6813","nonce":3803654234}]},"public_addr":"172.21.15.7:6809/3803654234","cluster_addr":"172.21.15.7:6811/3803654234","heartbeat_back_addr":"172.21.15.7:6815/3803654234","heartbeat_front_addr":"172.21.15.7:6813/3803654234","state":["exists","up"]},{"osd":4,"uuid":"fb43b2a1-f7ab-4f36-983d-9e670254aad6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6809","nonce":2808372927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6811","nonce":2808372927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6815","nonce":2808372927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2808372927},{"type":"v1","addr":"172.21.15.189:6813","nonce":2808372927}]},"public_addr":"172.21.15.189:6809/2808372927","cluster_addr":"172.21.15.189:6811/2808372927","heartbeat_back_addr":"172.21.15.189:6815/2808372927","heartbeat_front_addr":"172.21.15.189:6813/2808372927","state":["exists","up"]},{"osd":5,"uuid":"a95c54bf-8518-4383-89e7-4c0a7ef64f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6817","nonce":1502257343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6819","nonce":1502257343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6823","nonce":1502257343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":1502257343},{"type":"v1","addr":"172.21.15.189:6821","nonce":1502257343}]},"public_addr":"172.21.15.189:6817/1502257343","cluster_addr":"172.21.15.189:6819/1502257343","heartbeat_back_addr":"172.21.15.189:6823/1502257343","heartbeat_front_addr":"172.21.15.189:6821/1502257343","state":["exists","up"]},{"osd":6,"uuid":"e13cf82c-fd2a-4b30-94e0-f064900f9364","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6825","nonce":3886110165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6827","nonce":3886110165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6831","nonce":3886110165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3886110165},{"type":"v1","addr":"172.21.15.189:6829","nonce":3886110165}]},"public_addr":"172.21.15.189:6825/3886110165","cluster_addr":"172.21.15.189:6827/3886110165","heartbeat_back_addr":"172.21.15.189:6831/3886110165","heartbeat_front_addr":"172.21.15.189:6829/3886110165","state":["exists","up"]},{"osd":7,"uuid":"6d19b2cb-bf45-42ea-ac07-94e8eecc7a43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6801","nonce":1267134272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6803","nonce":1267134272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6807","nonce":1267134272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1267134272},{"type":"v1","addr":"172.21.15.189:6805","nonce":1267134272}]},"public_addr":"172.21.15.189:6801/1267134272","cluster_addr":"172.21.15.189:6803/1267134272","heartbeat_back_addr":"172.21.15.189:6807/1267134272","heartbeat_front_addr":"172.21.15.189:6805/1267134272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.709651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.683781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.695823+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.235680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.460457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:09.956182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:11.027782+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:15:10.177660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":1},{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]},{"pgid":"67.19","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:58:51.399 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T11:58:51.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:51.556 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:51.556 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:51.556 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:51.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T11:58:51.884 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T11:58:51.898 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T11:58:51.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:52.040 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:52.040 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:52.041 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:52.051 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T11:58:52.366 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T11:58:52.379 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T11:58:52.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:52.523 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:52.523 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:52.523 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:52.534 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T11:58:52.848 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T11:58:52.862 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T11:58:52.862 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:53.205 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:53.206 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:53.206 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:53.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T11:58:53.531 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T11:58:53.545 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T11:58:53.546 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:53.689 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:53.689 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:53.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T11:58:54.019 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T11:58:54.032 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T11:58:54.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:54.175 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:54.175 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:54.175 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:54.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T11:58:54.504 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T11:58:54.518 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T11:58:54.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:54.661 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:54.661 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:54.661 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:54.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T11:58:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T11:58:55.005 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T11:58:55.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:55.147 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-14T11:58:55.147 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:55.147 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-14T11:58:55.158 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T11:58:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T11:58:55.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:55.828 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:58:55.842 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:58:55.844 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1567,"stamp":"2024-09-14T11:58:54.784052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43821918,"num_objects":628,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":628,"num_whiteouts":0,"num_read":296215,"num_read_kb":2700212,"num_write":146664,"num_write_kb":2447739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13512,"ondisk_log_size":13512,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1367480,"kb_used_data":114136,"kb_used_omap":12,"kb_used_meta":1252915,"kb_avail":753607240,"statfs":{"total":773094113280,"available":771693813760,"internally_reserved":0,"allocated":116875264,"data_stored":103868988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1282985520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-566998094,"num_objects":-365,"num_object_clones":0,"num_object_copies":-730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-365,"num_whiteouts":0,"num_read":726,"num_read_kb":777,"num_write":553,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005073"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877231+0000","last_change":"2024-09-14T11:43:35.602913+0000","last_active":"2024-09-14T11:56:08.877231+0000","last_peered":"2024-09-14T11:56:08.877231+0000","last_clean":"2024-09-14T11:56:08.877231+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:56:08.877231+0000","last_undegraded":"2024-09-14T11:56:08.877231+0000","last_fullsized":"2024-09-14T11:56:08.877231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:06.258234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867970+0000","last_change":"2024-09-14T11:32:32.583802+0000","last_active":"2024-09-14T11:55:03.867970+0000","last_peered":"2024-09-14T11:55:03.867970+0000","last_clean":"2024-09-14T11:55:03.867970+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:55:03.867970+0000","last_undegraded":"2024-09-14T11:55:03.867970+0000","last_fullsized":"2024-09-14T11:55:03.867970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:58.807468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.889529+0000","last_change":"2024-09-14T11:32:29.554679+0000","last_active":"2024-09-14T11:57:28.889529+0000","last_peered":"2024-09-14T11:57:28.889529+0000","last_clean":"2024-09-14T11:57:28.889529+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:57:28.889529+0000","last_undegraded":"2024-09-14T11:57:28.889529+0000","last_fullsized":"2024-09-14T11:57:28.889529+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:20.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.865041+0000","last_change":"2024-09-14T11:30:45.179357+0000","last_active":"2024-09-14T11:55:48.865041+0000","last_peered":"2024-09-14T11:55:48.865041+0000","last_clean":"2024-09-14T11:55:48.865041+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:55:48.865041+0000","last_undegraded":"2024-09-14T11:55:48.865041+0000","last_fullsized":"2024-09-14T11:55:48.865041+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:03.066351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866530+0000","last_change":"2024-09-14T11:43:35.602901+0000","last_active":"2024-09-14T11:56:08.866530+0000","last_peered":"2024-09-14T11:56:08.866530+0000","last_clean":"2024-09-14T11:56:08.866530+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:56:08.866530+0000","last_undegraded":"2024-09-14T11:56:08.866530+0000","last_fullsized":"2024-09-14T11:56:08.866530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:07.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'6","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.413106+0000","last_change":"2024-09-14T11:32:32.582294+0000","last_active":"2024-09-14T11:58:47.413106+0000","last_peered":"2024-09-14T11:58:47.413106+0000","last_clean":"2024-09-14T11:58:47.413106+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:58:47.413106+0000","last_undegraded":"2024-09-14T11:58:47.413106+0000","last_fullsized":"2024-09-14T11:58:47.413106+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.399340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.864287+0000","last_change":"2024-09-14T11:32:29.558121+0000","last_active":"2024-09-14T11:55:00.864287+0000","last_peered":"2024-09-14T11:55:00.864287+0000","last_clean":"2024-09-14T11:55:00.864287+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:55:00.864287+0000","last_undegraded":"2024-09-14T11:55:00.864287+0000","last_fullsized":"2024-09-14T11:55:00.864287+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:52.777925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":212,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.871178+0000","last_change":"2024-09-14T11:30:45.185345+0000","last_active":"2024-09-14T11:56:53.871178+0000","last_peered":"2024-09-14T11:56:53.871178+0000","last_clean":"2024-09-14T11:56:53.871178+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:56:53.871178+0000","last_undegraded":"2024-09-14T11:56:53.871178+0000","last_fullsized":"2024-09-14T11:56:53.871178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.954160+0000","last_change":"2024-09-14T11:43:35.597712+0000","last_active":"2024-09-14T11:55:43.954160+0000","last_peered":"2024-09-14T11:55:43.954160+0000","last_clean":"2024-09-14T11:55:43.954160+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:55:43.954160+0000","last_undegraded":"2024-09-14T11:55:43.954160+0000","last_fullsized":"2024-09-14T11:55:43.954160+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:12.892547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'8","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.241902+0000","last_change":"2024-09-14T11:32:32.578401+0000","last_active":"2024-09-14T11:58:47.241902+0000","last_peered":"2024-09-14T11:58:47.241902+0000","last_clean":"2024-09-14T11:58:47.241902+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:58:47.241902+0000","last_undegraded":"2024-09-14T11:58:47.241902+0000","last_fullsized":"2024-09-14T11:58:47.241902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:07.530877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13314,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.377588+0000","last_change":"2024-09-14T11:32:29.550110+0000","last_active":"2024-09-14T11:58:47.377588+0000","last_peered":"2024-09-14T11:58:47.377588+0000","last_clean":"2024-09-14T11:58:47.377588+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:58:47.377588+0000","last_undegraded":"2024-09-14T11:58:47.377588+0000","last_fullsized":"2024-09-14T11:58:47.377588+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:36.277584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.864987+0000","last_change":"2024-09-14T11:30:45.186185+0000","last_active":"2024-09-14T11:55:48.864987+0000","last_peered":"2024-09-14T11:55:48.864987+0000","last_clean":"2024-09-14T11:55:48.864987+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:55:48.864987+0000","last_undegraded":"2024-09-14T11:55:48.864987+0000","last_fullsized":"2024-09-14T11:55:48.864987+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.774513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875479+0000","last_change":"2024-09-14T11:43:35.603929+0000","last_active":"2024-09-14T11:55:48.875479+0000","last_peered":"2024-09-14T11:55:48.875479+0000","last_clean":"2024-09-14T11:55:48.875479+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:55:48.875479+0000","last_undegraded":"2024-09-14T11:55:48.875479+0000","last_fullsized":"2024-09-14T11:55:48.875479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:33.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.899916+0000","last_change":"2024-09-14T11:32:32.589192+0000","last_active":"2024-09-14T11:58:43.899916+0000","last_peered":"2024-09-14T11:58:43.899916+0000","last_clean":"2024-09-14T11:58:43.899916+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:58:43.899916+0000","last_undegraded":"2024-09-14T11:58:43.899916+0000","last_fullsized":"2024-09-14T11:58:43.899916+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:52.225210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.233103+0000","last_change":"2024-09-14T11:32:29.549479+0000","last_active":"2024-09-14T11:58:47.233103+0000","last_peered":"2024-09-14T11:58:47.233103+0000","last_clean":"2024-09-14T11:58:47.233103+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:58:47.233103+0000","last_undegraded":"2024-09-14T11:58:47.233103+0000","last_fullsized":"2024-09-14T11:58:47.233103+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:56.796049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875525+0000","last_change":"2024-09-14T11:30:45.187877+0000","last_active":"2024-09-14T11:55:48.875525+0000","last_peered":"2024-09-14T11:55:48.875525+0000","last_clean":"2024-09-14T11:55:48.875525+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:55:48.875525+0000","last_undegraded":"2024-09-14T11:55:48.875525+0000","last_fullsized":"2024-09-14T11:55:48.875525+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:40.426491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874894+0000","last_change":"2024-09-14T11:43:35.601032+0000","last_active":"2024-09-14T11:55:43.874894+0000","last_peered":"2024-09-14T11:55:43.874894+0000","last_clean":"2024-09-14T11:55:43.874894+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:55:43.874894+0000","last_undegraded":"2024-09-14T11:55:43.874894+0000","last_fullsized":"2024-09-14T11:55:43.874894+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.697673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'4","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.297049+0000","last_change":"2024-09-14T11:33:08.805104+0000","last_active":"2024-09-14T11:58:47.297049+0000","last_peered":"2024-09-14T11:58:47.297049+0000","last_clean":"2024-09-14T11:58:47.297049+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:58:47.297049+0000","last_undegraded":"2024-09-14T11:58:47.297049+0000","last_fullsized":"2024-09-14T11:58:47.297049+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:03.683048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'8","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.377304+0000","last_change":"2024-09-14T11:32:29.558168+0000","last_active":"2024-09-14T11:58:47.377304+0000","last_peered":"2024-09-14T11:58:47.377304+0000","last_clean":"2024-09-14T11:58:47.377304+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:58:47.377304+0000","last_undegraded":"2024-09-14T11:58:47.377304+0000","last_fullsized":"2024-09-14T11:58:47.377304+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:28.837548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875505+0000","last_change":"2024-09-14T11:30:45.184142+0000","last_active":"2024-09-14T11:55:48.875505+0000","last_peered":"2024-09-14T11:55:48.875505+0000","last_clean":"2024-09-14T11:55:48.875505+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:55:48.875505+0000","last_undegraded":"2024-09-14T11:55:48.875505+0000","last_fullsized":"2024-09-14T11:55:48.875505+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:48.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872788+0000","last_change":"2024-09-14T11:43:35.605737+0000","last_active":"2024-09-14T11:56:05.872788+0000","last_peered":"2024-09-14T11:56:05.872788+0000","last_clean":"2024-09-14T11:56:05.872788+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:56:05.872788+0000","last_undegraded":"2024-09-14T11:56:05.872788+0000","last_fullsized":"2024-09-14T11:56:05.872788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'2","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.962196+0000","last_change":"2024-09-14T11:32:32.582277+0000","last_active":"2024-09-14T11:56:43.962196+0000","last_peered":"2024-09-14T11:56:43.962196+0000","last_clean":"2024-09-14T11:56:43.962196+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:56:43.962196+0000","last_undegraded":"2024-09-14T11:56:43.962196+0000","last_fullsized":"2024-09-14T11:56:43.962196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.963034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.018222+0000","last_change":"2024-09-14T11:32:29.550064+0000","last_active":"2024-09-14T11:56:39.018222+0000","last_peered":"2024-09-14T11:56:39.018222+0000","last_clean":"2024-09-14T11:56:39.018222+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:56:39.018222+0000","last_undegraded":"2024-09-14T11:56:39.018222+0000","last_fullsized":"2024-09-14T11:56:39.018222+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:24.276918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954746+0000","last_change":"2024-09-14T11:30:45.178964+0000","last_active":"2024-09-14T11:55:48.954746+0000","last_peered":"2024-09-14T11:55:48.954746+0000","last_clean":"2024-09-14T11:55:48.954746+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:55:48.954746+0000","last_undegraded":"2024-09-14T11:55:48.954746+0000","last_fullsized":"2024-09-14T11:55:48.954746+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:14.255189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877316+0000","last_change":"2024-09-14T11:43:35.605759+0000","last_active":"2024-09-14T11:56:08.877316+0000","last_peered":"2024-09-14T11:56:08.877316+0000","last_clean":"2024-09-14T11:56:08.877316+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:56:08.877316+0000","last_undegraded":"2024-09-14T11:56:08.877316+0000","last_fullsized":"2024-09-14T11:56:08.877316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.948842+0000","last_change":"2024-09-14T11:32:32.580274+0000","last_active":"2024-09-14T11:55:03.948842+0000","last_peered":"2024-09-14T11:55:03.948842+0000","last_clean":"2024-09-14T11:55:03.948842+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:55:03.948842+0000","last_undegraded":"2024-09-14T11:55:03.948842+0000","last_fullsized":"2024-09-14T11:55:03.948842+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:14.222467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004336+0000","last_change":"2024-09-14T11:32:29.555376+0000","last_active":"2024-09-14T11:54:59.004336+0000","last_peered":"2024-09-14T11:54:59.004336+0000","last_clean":"2024-09-14T11:54:59.004336+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:54:59.004336+0000","last_undegraded":"2024-09-14T11:54:59.004336+0000","last_fullsized":"2024-09-14T11:54:59.004336+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.859610+0000","last_change":"2024-09-14T11:30:45.175070+0000","last_active":"2024-09-14T11:55:03.859610+0000","last_peered":"2024-09-14T11:55:03.859610+0000","last_clean":"2024-09-14T11:55:03.859610+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:55:03.859610+0000","last_undegraded":"2024-09-14T11:55:03.859610+0000","last_fullsized":"2024-09-14T11:55:03.859610+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.836949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877363+0000","last_change":"2024-09-14T11:43:35.607526+0000","last_active":"2024-09-14T11:56:08.877363+0000","last_peered":"2024-09-14T11:56:08.877363+0000","last_clean":"2024-09-14T11:56:08.877363+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:56:08.877363+0000","last_undegraded":"2024-09-14T11:56:08.877363+0000","last_fullsized":"2024-09-14T11:56:08.877363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.745235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869068+0000","last_change":"2024-09-14T11:32:32.587761+0000","last_active":"2024-09-14T11:55:03.869068+0000","last_peered":"2024-09-14T11:55:03.869068+0000","last_clean":"2024-09-14T11:55:03.869068+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:55:03.869068+0000","last_undegraded":"2024-09-14T11:55:03.869068+0000","last_fullsized":"2024-09-14T11:55:03.869068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:27.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859019+0000","last_change":"2024-09-14T11:32:29.555600+0000","last_active":"2024-09-14T11:54:58.859019+0000","last_peered":"2024-09-14T11:54:58.859019+0000","last_clean":"2024-09-14T11:54:58.859019+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:54:58.859019+0000","last_undegraded":"2024-09-14T11:54:58.859019+0000","last_fullsized":"2024-09-14T11:54:58.859019+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.338753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863479+0000","last_change":"2024-09-14T11:30:45.182076+0000","last_active":"2024-09-14T11:54:55.863479+0000","last_peered":"2024-09-14T11:54:55.863479+0000","last_clean":"2024-09-14T11:54:55.863479+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:54:55.863479+0000","last_undegraded":"2024-09-14T11:54:55.863479+0000","last_fullsized":"2024-09-14T11:54:55.863479+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:51.625984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866051+0000","last_change":"2024-09-14T11:43:35.603298+0000","last_active":"2024-09-14T11:55:15.866051+0000","last_peered":"2024-09-14T11:55:15.866051+0000","last_clean":"2024-09-14T11:55:15.866051+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:55:15.866051+0000","last_undegraded":"2024-09-14T11:55:15.866051+0000","last_fullsized":"2024-09-14T11:55:15.866051+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.863213+0000","last_change":"2024-09-14T11:32:32.585885+0000","last_active":"2024-09-14T11:54:18.863213+0000","last_peered":"2024-09-14T11:54:18.863213+0000","last_clean":"2024-09-14T11:54:18.863213+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:54:18.863213+0000","last_undegraded":"2024-09-14T11:54:18.863213+0000","last_fullsized":"2024-09-14T11:54:18.863213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:13.003196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.875756+0000","last_change":"2024-09-14T11:32:29.556257+0000","last_active":"2024-09-14T11:55:58.875756+0000","last_peered":"2024-09-14T11:55:58.875756+0000","last_clean":"2024-09-14T11:55:58.875756+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:55:58.875756+0000","last_undegraded":"2024-09-14T11:55:58.875756+0000","last_fullsized":"2024-09-14T11:55:58.875756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:03.738228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859107+0000","last_change":"2024-09-14T11:30:45.181226+0000","last_active":"2024-09-14T11:54:58.859107+0000","last_peered":"2024-09-14T11:54:58.859107+0000","last_clean":"2024-09-14T11:54:58.859107+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:54:58.859107+0000","last_undegraded":"2024-09-14T11:54:58.859107+0000","last_fullsized":"2024-09-14T11:54:58.859107+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:13.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.860482+0000","last_change":"2024-09-14T11:43:35.601936+0000","last_active":"2024-09-14T11:55:18.860482+0000","last_peered":"2024-09-14T11:55:18.860482+0000","last_clean":"2024-09-14T11:55:18.860482+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:55:18.860482+0000","last_undegraded":"2024-09-14T11:55:18.860482+0000","last_fullsized":"2024-09-14T11:55:18.860482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:28.098855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877364+0000","last_change":"2024-09-14T11:32:32.588409+0000","last_active":"2024-09-14T11:56:03.877364+0000","last_peered":"2024-09-14T11:56:03.877364+0000","last_clean":"2024-09-14T11:56:03.877364+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:56:03.877364+0000","last_undegraded":"2024-09-14T11:56:03.877364+0000","last_fullsized":"2024-09-14T11:56:03.877364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:05.997127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'4","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.881924+0000","last_change":"2024-09-14T11:32:29.554191+0000","last_active":"2024-09-14T11:56:38.881924+0000","last_peered":"2024-09-14T11:56:38.881924+0000","last_clean":"2024-09-14T11:56:38.881924+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:56:38.881924+0000","last_undegraded":"2024-09-14T11:56:38.881924+0000","last_fullsized":"2024-09-14T11:56:38.881924+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.770813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.870574+0000","last_change":"2024-09-14T11:30:45.186297+0000","last_active":"2024-09-14T11:55:59.870574+0000","last_peered":"2024-09-14T11:55:59.870574+0000","last_clean":"2024-09-14T11:55:59.870574+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:55:59.870574+0000","last_undegraded":"2024-09-14T11:55:59.870574+0000","last_fullsized":"2024-09-14T11:55:59.870574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.503260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869999+0000","last_change":"2024-09-14T11:43:35.602751+0000","last_active":"2024-09-14T11:55:18.869999+0000","last_peered":"2024-09-14T11:55:18.869999+0000","last_clean":"2024-09-14T11:55:18.869999+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:55:18.869999+0000","last_undegraded":"2024-09-14T11:55:18.869999+0000","last_fullsized":"2024-09-14T11:55:18.869999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:27.871586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'2","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882080+0000","last_change":"2024-09-14T11:32:32.582994+0000","last_active":"2024-09-14T11:56:43.882080+0000","last_peered":"2024-09-14T11:56:43.882080+0000","last_clean":"2024-09-14T11:56:43.882080+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:56:43.882080+0000","last_undegraded":"2024-09-14T11:56:43.882080+0000","last_fullsized":"2024-09-14T11:56:43.882080+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:49.256978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.869710+0000","last_change":"2024-09-14T11:32:29.544034+0000","last_active":"2024-09-14T11:56:38.869710+0000","last_peered":"2024-09-14T11:56:38.869710+0000","last_clean":"2024-09-14T11:56:38.869710+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:56:38.869710+0000","last_undegraded":"2024-09-14T11:56:38.869710+0000","last_fullsized":"2024-09-14T11:56:38.869710+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.858457+0000","last_change":"2024-09-14T11:30:45.184378+0000","last_active":"2024-09-14T11:54:58.858457+0000","last_peered":"2024-09-14T11:54:58.858457+0000","last_clean":"2024-09-14T11:54:58.858457+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:54:58.858457+0000","last_undegraded":"2024-09-14T11:54:58.858457+0000","last_fullsized":"2024-09-14T11:54:58.858457+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:03.960690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869969+0000","last_change":"2024-09-14T11:43:35.601578+0000","last_active":"2024-09-14T11:55:18.869969+0000","last_peered":"2024-09-14T11:55:18.869969+0000","last_clean":"2024-09-14T11:55:18.869969+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:55:18.869969+0000","last_undegraded":"2024-09-14T11:55:18.869969+0000","last_fullsized":"2024-09-14T11:55:18.869969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:45.561461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999626+0000","last_change":"2024-09-14T11:32:32.581631+0000","last_active":"2024-09-14T11:54:18.999626+0000","last_peered":"2024-09-14T11:54:18.999626+0000","last_clean":"2024-09-14T11:54:18.999626+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:54:18.999626+0000","last_undegraded":"2024-09-14T11:54:18.999626+0000","last_fullsized":"2024-09-14T11:54:18.999626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:08.950123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.853433+0000","last_change":"2024-09-14T11:32:29.550009+0000","last_active":"2024-09-14T11:54:13.853433+0000","last_peered":"2024-09-14T11:54:13.853433+0000","last_clean":"2024-09-14T11:54:13.853433+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:54:13.853433+0000","last_undegraded":"2024-09-14T11:54:13.853433+0000","last_fullsized":"2024-09-14T11:54:13.853433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:07.302819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.881198+0000","last_change":"2024-09-14T11:30:45.185397+0000","last_active":"2024-09-14T11:56:33.881198+0000","last_peered":"2024-09-14T11:56:33.881198+0000","last_clean":"2024-09-14T11:56:33.881198+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:56:33.881198+0000","last_undegraded":"2024-09-14T11:56:33.881198+0000","last_fullsized":"2024-09-14T11:56:33.881198+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:30.178621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874909+0000","last_change":"2024-09-14T11:43:35.603719+0000","last_active":"2024-09-14T11:55:43.874909+0000","last_peered":"2024-09-14T11:55:43.874909+0000","last_clean":"2024-09-14T11:55:43.874909+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:55:43.874909+0000","last_undegraded":"2024-09-14T11:55:43.874909+0000","last_fullsized":"2024-09-14T11:55:43.874909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:21.587122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'5","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.241182+0000","last_change":"2024-09-14T11:32:32.583371+0000","last_active":"2024-09-14T11:58:47.241182+0000","last_peered":"2024-09-14T11:58:47.241182+0000","last_clean":"2024-09-14T11:58:47.241182+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:58:47.241182+0000","last_undegraded":"2024-09-14T11:58:47.241182+0000","last_fullsized":"2024-09-14T11:58:47.241182+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:26.139200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'7","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.031907+0000","last_change":"2024-09-14T11:32:29.556494+0000","last_active":"2024-09-14T11:58:09.031907+0000","last_peered":"2024-09-14T11:58:09.031907+0000","last_clean":"2024-09-14T11:58:09.031907+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:58:09.031907+0000","last_undegraded":"2024-09-14T11:58:09.031907+0000","last_fullsized":"2024-09-14T11:58:09.031907+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:44.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7227,"num_write":12,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880349+0000","last_change":"2024-09-14T11:30:45.184935+0000","last_active":"2024-09-14T11:56:28.880349+0000","last_peered":"2024-09-14T11:56:28.880349+0000","last_clean":"2024-09-14T11:56:28.880349+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:56:28.880349+0000","last_undegraded":"2024-09-14T11:56:28.880349+0000","last_fullsized":"2024-09-14T11:56:28.880349+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:16.452875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864520+0000","last_change":"2024-09-14T11:43:35.606065+0000","last_active":"2024-09-14T11:55:43.864520+0000","last_peered":"2024-09-14T11:55:43.864520+0000","last_clean":"2024-09-14T11:55:43.864520+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:55:43.864520+0000","last_undegraded":"2024-09-14T11:55:43.864520+0000","last_fullsized":"2024-09-14T11:55:43.864520+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:45.826564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'6","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.888107+0000","last_change":"2024-09-14T11:32:32.581191+0000","last_active":"2024-09-14T11:58:15.888107+0000","last_peered":"2024-09-14T11:58:15.888107+0000","last_clean":"2024-09-14T11:58:15.888107+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:58:15.888107+0000","last_undegraded":"2024-09-14T11:58:15.888107+0000","last_fullsized":"2024-09-14T11:58:15.888107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:56.670374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875460+0000","last_change":"2024-09-14T11:32:29.543122+0000","last_active":"2024-09-14T11:55:48.875460+0000","last_peered":"2024-09-14T11:55:48.875460+0000","last_clean":"2024-09-14T11:55:48.875460+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:55:48.875460+0000","last_undegraded":"2024-09-14T11:55:48.875460+0000","last_fullsized":"2024-09-14T11:55:48.875460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:34.079866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":73,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.869725+0000","last_change":"2024-09-14T11:30:45.187136+0000","last_active":"2024-09-14T11:56:28.869725+0000","last_peered":"2024-09-14T11:56:28.869725+0000","last_clean":"2024-09-14T11:56:28.869725+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:56:28.869725+0000","last_undegraded":"2024-09-14T11:56:28.869725+0000","last_fullsized":"2024-09-14T11:56:28.869725+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:42.845918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861900+0000","last_change":"2024-09-14T11:43:35.608421+0000","last_active":"2024-09-14T11:55:23.861900+0000","last_peered":"2024-09-14T11:55:23.861900+0000","last_clean":"2024-09-14T11:55:23.861900+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:55:23.861900+0000","last_undegraded":"2024-09-14T11:55:23.861900+0000","last_fullsized":"2024-09-14T11:55:23.861900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:33.729484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.895413+0000","last_change":"2024-09-14T11:32:32.590267+0000","last_active":"2024-09-14T11:58:13.895413+0000","last_peered":"2024-09-14T11:58:13.895413+0000","last_clean":"2024-09-14T11:58:13.895413+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:58:13.895413+0000","last_undegraded":"2024-09-14T11:58:13.895413+0000","last_fullsized":"2024-09-14T11:58:13.895413+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.861311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954756+0000","last_change":"2024-09-14T11:32:29.557676+0000","last_active":"2024-09-14T11:55:48.954756+0000","last_peered":"2024-09-14T11:55:48.954756+0000","last_clean":"2024-09-14T11:55:48.954756+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:55:48.954756+0000","last_undegraded":"2024-09-14T11:55:48.954756+0000","last_fullsized":"2024-09-14T11:55:48.954756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:16.569296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.016904+0000","last_change":"2024-09-14T11:30:45.183316+0000","last_active":"2024-09-14T11:56:29.016904+0000","last_peered":"2024-09-14T11:56:29.016904+0000","last_clean":"2024-09-14T11:56:29.016904+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:56:29.016904+0000","last_undegraded":"2024-09-14T11:56:29.016904+0000","last_fullsized":"2024-09-14T11:56:29.016904+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:21.498493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874873+0000","last_change":"2024-09-14T11:43:35.603573+0000","last_active":"2024-09-14T11:55:43.874873+0000","last_peered":"2024-09-14T11:55:43.874873+0000","last_clean":"2024-09-14T11:55:43.874873+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:55:43.874873+0000","last_undegraded":"2024-09-14T11:55:43.874873+0000","last_fullsized":"2024-09-14T11:55:43.874873+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:21.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.955285+0000","last_change":"2024-09-14T11:32:32.583874+0000","last_active":"2024-09-14T11:55:53.955285+0000","last_peered":"2024-09-14T11:55:53.955285+0000","last_clean":"2024-09-14T11:55:53.955285+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:55:53.955285+0000","last_undegraded":"2024-09-14T11:55:53.955285+0000","last_fullsized":"2024-09-14T11:55:53.955285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.827399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874557+0000","last_change":"2024-09-14T11:32:29.557054+0000","last_active":"2024-09-14T11:55:48.874557+0000","last_peered":"2024-09-14T11:55:48.874557+0000","last_clean":"2024-09-14T11:55:48.874557+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:55:48.874557+0000","last_undegraded":"2024-09-14T11:55:48.874557+0000","last_fullsized":"2024-09-14T11:55:48.874557+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:17.332064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880162+0000","last_change":"2024-09-14T11:30:45.188008+0000","last_active":"2024-09-14T11:56:28.880162+0000","last_peered":"2024-09-14T11:56:28.880162+0000","last_clean":"2024-09-14T11:56:28.880162+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:56:28.880162+0000","last_undegraded":"2024-09-14T11:56:28.880162+0000","last_fullsized":"2024-09-14T11:56:28.880162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:10.454288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.870158+0000","last_change":"2024-09-14T11:43:35.601146+0000","last_active":"2024-09-14T11:56:43.870158+0000","last_peered":"2024-09-14T11:56:43.870158+0000","last_clean":"2024-09-14T11:56:43.870158+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:56:43.870158+0000","last_undegraded":"2024-09-14T11:56:43.870158+0000","last_fullsized":"2024-09-14T11:56:43.870158+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869141+0000","last_change":"2024-09-14T11:32:32.585896+0000","last_active":"2024-09-14T11:55:03.869141+0000","last_peered":"2024-09-14T11:55:03.869141+0000","last_clean":"2024-09-14T11:55:03.869141+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:55:03.869141+0000","last_undegraded":"2024-09-14T11:55:03.869141+0000","last_fullsized":"2024-09-14T11:55:03.869141+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:46.169476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867339+0000","last_change":"2024-09-14T11:32:29.550392+0000","last_active":"2024-09-14T11:54:58.867339+0000","last_peered":"2024-09-14T11:54:58.867339+0000","last_clean":"2024-09-14T11:54:58.867339+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:54:58.867339+0000","last_undegraded":"2024-09-14T11:54:58.867339+0000","last_fullsized":"2024-09-14T11:54:58.867339+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.897313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":98,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874939+0000","last_change":"2024-09-14T11:30:45.187527+0000","last_active":"2024-09-14T11:55:43.874939+0000","last_peered":"2024-09-14T11:55:43.874939+0000","last_clean":"2024-09-14T11:55:43.874939+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:55:43.874939+0000","last_undegraded":"2024-09-14T11:55:43.874939+0000","last_fullsized":"2024-09-14T11:55:43.874939+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:10.115937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866776+0000","last_change":"2024-09-14T11:43:35.607758+0000","last_active":"2024-09-14T11:54:53.866776+0000","last_peered":"2024-09-14T11:54:53.866776+0000","last_clean":"2024-09-14T11:54:53.866776+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:54:53.866776+0000","last_undegraded":"2024-09-14T11:54:53.866776+0000","last_fullsized":"2024-09-14T11:54:53.866776+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:25.238514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'4","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.436213+0000","last_change":"2024-09-14T11:32:32.589816+0000","last_active":"2024-09-14T11:58:47.436213+0000","last_peered":"2024-09-14T11:58:47.436213+0000","last_clean":"2024-09-14T11:58:47.436213+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:58:47.436213+0000","last_undegraded":"2024-09-14T11:58:47.436213+0000","last_fullsized":"2024-09-14T11:58:47.436213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:48.593038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'4","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.232631+0000","last_change":"2024-09-14T11:32:29.550400+0000","last_active":"2024-09-14T11:58:47.232631+0000","last_peered":"2024-09-14T11:58:47.232631+0000","last_clean":"2024-09-14T11:58:47.232631+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:58:47.232631+0000","last_undegraded":"2024-09-14T11:58:47.232631+0000","last_fullsized":"2024-09-14T11:58:47.232631+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:37.276571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872259+0000","last_change":"2024-09-14T11:30:45.175794+0000","last_active":"2024-09-14T11:55:33.872259+0000","last_peered":"2024-09-14T11:55:33.872259+0000","last_clean":"2024-09-14T11:55:33.872259+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:55:33.872259+0000","last_undegraded":"2024-09-14T11:55:33.872259+0000","last_fullsized":"2024-09-14T11:55:33.872259+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:12.580971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.961478+0000","last_change":"2024-09-14T11:43:35.603624+0000","last_active":"2024-09-14T11:56:38.961478+0000","last_peered":"2024-09-14T11:56:38.961478+0000","last_clean":"2024-09-14T11:56:38.961478+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:56:38.961478+0000","last_undegraded":"2024-09-14T11:56:38.961478+0000","last_fullsized":"2024-09-14T11:56:38.961478+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:06.649979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865526+0000","last_change":"2024-09-14T11:32:32.582078+0000","last_active":"2024-09-14T11:55:10.865526+0000","last_peered":"2024-09-14T11:55:10.865526+0000","last_clean":"2024-09-14T11:55:10.865526+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:55:10.865526+0000","last_undegraded":"2024-09-14T11:55:10.865526+0000","last_fullsized":"2024-09-14T11:55:10.865526+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.729935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859071+0000","last_change":"2024-09-14T11:32:29.556788+0000","last_active":"2024-09-14T11:54:58.859071+0000","last_peered":"2024-09-14T11:54:58.859071+0000","last_clean":"2024-09-14T11:54:58.859071+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:54:58.859071+0000","last_undegraded":"2024-09-14T11:54:58.859071+0000","last_fullsized":"2024-09-14T11:54:58.859071+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:25.298432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.952685+0000","last_change":"2024-09-14T11:30:45.181601+0000","last_active":"2024-09-14T11:55:33.952685+0000","last_peered":"2024-09-14T11:55:33.952685+0000","last_clean":"2024-09-14T11:55:33.952685+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:55:33.952685+0000","last_undegraded":"2024-09-14T11:55:33.952685+0000","last_fullsized":"2024-09-14T11:55:33.952685+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.881804+0000","last_change":"2024-09-14T11:43:35.603524+0000","last_active":"2024-09-14T11:56:38.881804+0000","last_peered":"2024-09-14T11:56:38.881804+0000","last_clean":"2024-09-14T11:56:38.881804+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:56:38.881804+0000","last_undegraded":"2024-09-14T11:56:38.881804+0000","last_fullsized":"2024-09-14T11:56:38.881804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:22.177315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.886567+0000","last_change":"2024-09-14T11:32:32.588422+0000","last_active":"2024-09-14T11:57:18.886567+0000","last_peered":"2024-09-14T11:57:18.886567+0000","last_clean":"2024-09-14T11:57:18.886567+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:57:18.886567+0000","last_undegraded":"2024-09-14T11:57:18.886567+0000","last_fullsized":"2024-09-14T11:57:18.886567+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.486355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.274746+0000","last_change":"2024-09-14T11:32:29.558855+0000","last_active":"2024-09-14T11:58:47.274746+0000","last_peered":"2024-09-14T11:58:47.274746+0000","last_clean":"2024-09-14T11:58:47.274746+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:58:47.274746+0000","last_undegraded":"2024-09-14T11:58:47.274746+0000","last_fullsized":"2024-09-14T11:58:47.274746+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.718076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":172,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.862421+0000","last_change":"2024-09-14T11:30:45.186320+0000","last_active":"2024-09-14T11:55:33.862421+0000","last_peered":"2024-09-14T11:55:33.862421+0000","last_clean":"2024-09-14T11:55:33.862421+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:55:33.862421+0000","last_undegraded":"2024-09-14T11:55:33.862421+0000","last_fullsized":"2024-09-14T11:55:33.862421+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:02.402885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867996+0000","last_change":"2024-09-14T11:43:35.607826+0000","last_active":"2024-09-14T11:54:53.867996+0000","last_peered":"2024-09-14T11:54:53.867996+0000","last_clean":"2024-09-14T11:54:53.867996+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:54:53.867996+0000","last_undegraded":"2024-09-14T11:54:53.867996+0000","last_fullsized":"2024-09-14T11:54:53.867996+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:17.558008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:34.035624+0000","last_change":"2024-09-14T11:32:32.590048+0000","last_active":"2024-09-14T11:58:34.035624+0000","last_peered":"2024-09-14T11:58:34.035624+0000","last_clean":"2024-09-14T11:58:34.035624+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:58:34.035624+0000","last_undegraded":"2024-09-14T11:58:34.035624+0000","last_fullsized":"2024-09-14T11:58:34.035624+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:10.124434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868576+0000","last_change":"2024-09-14T11:32:29.557361+0000","last_active":"2024-09-14T11:56:18.868576+0000","last_peered":"2024-09-14T11:56:18.868576+0000","last_clean":"2024-09-14T11:56:18.868576+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:56:18.868576+0000","last_undegraded":"2024-09-14T11:56:18.868576+0000","last_fullsized":"2024-09-14T11:56:18.868576+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:06.391010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863103+0000","last_change":"2024-09-14T11:30:45.189776+0000","last_active":"2024-09-14T11:55:33.863103+0000","last_peered":"2024-09-14T11:55:33.863103+0000","last_clean":"2024-09-14T11:55:33.863103+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:55:33.863103+0000","last_undegraded":"2024-09-14T11:55:33.863103+0000","last_fullsized":"2024-09-14T11:55:33.863103+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:07.248111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867381+0000","last_change":"2024-09-14T11:43:35.605135+0000","last_active":"2024-09-14T11:54:58.867381+0000","last_peered":"2024-09-14T11:54:58.867381+0000","last_clean":"2024-09-14T11:54:58.867381+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:54:58.867381+0000","last_undegraded":"2024-09-14T11:54:58.867381+0000","last_fullsized":"2024-09-14T11:54:58.867381+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879560+0000","last_change":"2024-09-14T11:32:32.579119+0000","last_active":"2024-09-14T11:56:23.879560+0000","last_peered":"2024-09-14T11:56:23.879560+0000","last_clean":"2024-09-14T11:56:23.879560+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:56:23.879560+0000","last_undegraded":"2024-09-14T11:56:23.879560+0000","last_fullsized":"2024-09-14T11:56:23.879560+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:39.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.889872+0000","last_change":"2024-09-14T11:32:29.558623+0000","last_active":"2024-09-14T11:58:30.889872+0000","last_peered":"2024-09-14T11:58:30.889872+0000","last_clean":"2024-09-14T11:58:30.889872+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:58:30.889872+0000","last_undegraded":"2024-09-14T11:58:30.889872+0000","last_fullsized":"2024-09-14T11:58:30.889872+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:00.753847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.547369+0000","last_change":"2024-09-14T11:30:45.184693+0000","last_active":"2024-09-14T11:55:02.547369+0000","last_peered":"2024-09-14T11:55:02.547369+0000","last_clean":"2024-09-14T11:55:02.547369+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:55:02.547369+0000","last_undegraded":"2024-09-14T11:55:02.547369+0000","last_fullsized":"2024-09-14T11:55:02.547369+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:26.556025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866795+0000","last_change":"2024-09-14T11:43:35.606592+0000","last_active":"2024-09-14T11:54:53.866795+0000","last_peered":"2024-09-14T11:54:53.866795+0000","last_clean":"2024-09-14T11:54:53.866795+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:54:53.866795+0000","last_undegraded":"2024-09-14T11:54:53.866795+0000","last_fullsized":"2024-09-14T11:54:53.866795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:47.717972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864758+0000","last_change":"2024-09-14T11:32:32.582791+0000","last_active":"2024-09-14T11:55:05.864758+0000","last_peered":"2024-09-14T11:55:05.864758+0000","last_clean":"2024-09-14T11:55:05.864758+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:55:05.864758+0000","last_undegraded":"2024-09-14T11:55:05.864758+0000","last_fullsized":"2024-09-14T11:55:05.864758+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.426108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.885147+0000","last_change":"2024-09-14T11:32:29.556753+0000","last_active":"2024-09-14T11:58:33.885147+0000","last_peered":"2024-09-14T11:58:33.885147+0000","last_clean":"2024-09-14T11:58:33.885147+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:58:33.885147+0000","last_undegraded":"2024-09-14T11:58:33.885147+0000","last_fullsized":"2024-09-14T11:58:33.885147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:34.099936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.865798+0000","last_change":"2024-09-14T11:30:45.185455+0000","last_active":"2024-09-14T11:55:59.865798+0000","last_peered":"2024-09-14T11:55:59.865798+0000","last_clean":"2024-09-14T11:55:59.865798+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:55:59.865798+0000","last_undegraded":"2024-09-14T11:55:59.865798+0000","last_fullsized":"2024-09-14T11:55:59.865798+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:25.948213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.858467+0000","last_change":"2024-09-14T11:43:35.603825+0000","last_active":"2024-09-14T11:54:53.858467+0000","last_peered":"2024-09-14T11:54:53.858467+0000","last_clean":"2024-09-14T11:54:53.858467+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:54:53.858467+0000","last_undegraded":"2024-09-14T11:54:53.858467+0000","last_fullsized":"2024-09-14T11:54:53.858467+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:22.239624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880311+0000","last_change":"2024-09-14T11:32:32.590037+0000","last_active":"2024-09-14T11:56:28.880311+0000","last_peered":"2024-09-14T11:56:28.880311+0000","last_clean":"2024-09-14T11:56:28.880311+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:56:28.880311+0000","last_undegraded":"2024-09-14T11:56:28.880311+0000","last_fullsized":"2024-09-14T11:56:28.880311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:48.742115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.320757+0000","last_change":"2024-09-14T11:32:29.552051+0000","last_active":"2024-09-14T11:58:47.320757+0000","last_peered":"2024-09-14T11:58:47.320757+0000","last_clean":"2024-09-14T11:58:47.320757+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:58:47.320757+0000","last_undegraded":"2024-09-14T11:58:47.320757+0000","last_fullsized":"2024-09-14T11:58:47.320757+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.824552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945791+0000","last_change":"2024-09-14T11:30:45.183254+0000","last_active":"2024-09-14T11:54:38.945791+0000","last_peered":"2024-09-14T11:54:38.945791+0000","last_clean":"2024-09-14T11:54:38.945791+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:54:38.945791+0000","last_undegraded":"2024-09-14T11:54:38.945791+0000","last_fullsized":"2024-09-14T11:54:38.945791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:04.016656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877254+0000","last_change":"2024-09-14T11:43:35.604116+0000","last_active":"2024-09-14T11:56:08.877254+0000","last_peered":"2024-09-14T11:56:08.877254+0000","last_clean":"2024-09-14T11:56:08.877254+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:56:08.877254+0000","last_undegraded":"2024-09-14T11:56:08.877254+0000","last_fullsized":"2024-09-14T11:56:08.877254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:16.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'6","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.393135+0000","last_change":"2024-09-14T11:32:32.583981+0000","last_active":"2024-09-14T11:58:47.393135+0000","last_peered":"2024-09-14T11:58:47.393135+0000","last_clean":"2024-09-14T11:58:47.393135+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:58:47.393135+0000","last_undegraded":"2024-09-14T11:58:47.393135+0000","last_fullsized":"2024-09-14T11:58:47.393135+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:37.109384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'6","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.253435+0000","last_change":"2024-09-14T11:32:29.553611+0000","last_active":"2024-09-14T11:58:47.253435+0000","last_peered":"2024-09-14T11:58:47.253435+0000","last_clean":"2024-09-14T11:58:47.253435+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:58:47.253435+0000","last_undegraded":"2024-09-14T11:58:47.253435+0000","last_fullsized":"2024-09-14T11:58:47.253435+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:23.400420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.064541+0000","last_change":"2024-09-14T11:30:45.182248+0000","last_active":"2024-09-14T11:55:02.064541+0000","last_peered":"2024-09-14T11:55:02.064541+0000","last_clean":"2024-09-14T11:55:02.064541+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:55:02.064541+0000","last_undegraded":"2024-09-14T11:55:02.064541+0000","last_fullsized":"2024-09-14T11:55:02.064541+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:12.204716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877270+0000","last_change":"2024-09-14T11:43:35.603484+0000","last_active":"2024-09-14T11:56:08.877270+0000","last_peered":"2024-09-14T11:56:08.877270+0000","last_clean":"2024-09-14T11:56:08.877270+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:56:08.877270+0000","last_undegraded":"2024-09-14T11:56:08.877270+0000","last_fullsized":"2024-09-14T11:56:08.877270+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.596092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.877440+0000","last_change":"2024-09-14T11:32:32.575572+0000","last_active":"2024-09-14T11:57:33.877440+0000","last_peered":"2024-09-14T11:57:33.877440+0000","last_clean":"2024-09-14T11:57:33.877440+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:57:33.877440+0000","last_undegraded":"2024-09-14T11:57:33.877440+0000","last_fullsized":"2024-09-14T11:57:33.877440+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:01.425017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.861591+0000","last_change":"2024-09-14T11:32:29.551182+0000","last_active":"2024-09-14T11:55:28.861591+0000","last_peered":"2024-09-14T11:55:28.861591+0000","last_clean":"2024-09-14T11:55:28.861591+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:55:28.861591+0000","last_undegraded":"2024-09-14T11:55:28.861591+0000","last_fullsized":"2024-09-14T11:55:28.861591+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.092021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.945893+0000","last_change":"2024-09-14T11:30:45.184179+0000","last_active":"2024-09-14T11:54:38.945893+0000","last_peered":"2024-09-14T11:54:38.945893+0000","last_clean":"2024-09-14T11:54:38.945893+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:54:38.945893+0000","last_undegraded":"2024-09-14T11:54:38.945893+0000","last_fullsized":"2024-09-14T11:54:38.945893+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.455784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869499+0000","last_change":"2024-09-14T11:43:35.607506+0000","last_active":"2024-09-14T11:55:40.869499+0000","last_peered":"2024-09-14T11:55:40.869499+0000","last_clean":"2024-09-14T11:55:40.869499+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:55:40.869499+0000","last_undegraded":"2024-09-14T11:55:40.869499+0000","last_fullsized":"2024-09-14T11:55:40.869499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:13.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'3","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.898896+0000","last_change":"2024-09-14T11:32:32.583839+0000","last_active":"2024-09-14T11:58:33.898896+0000","last_peered":"2024-09-14T11:58:33.898896+0000","last_clean":"2024-09-14T11:58:33.898896+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:58:33.898896+0000","last_undegraded":"2024-09-14T11:58:33.898896+0000","last_fullsized":"2024-09-14T11:58:33.898896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:03.004208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.898100+0000","last_change":"2024-09-14T11:32:29.554290+0000","last_active":"2024-09-14T11:58:28.898100+0000","last_peered":"2024-09-14T11:58:28.898100+0000","last_clean":"2024-09-14T11:58:28.898100+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:58:28.898100+0000","last_undegraded":"2024-09-14T11:58:28.898100+0000","last_fullsized":"2024-09-14T11:58:28.898100+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:54.635912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":64,"num_write":4,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.875265+0000","last_change":"2024-09-14T11:30:45.188717+0000","last_active":"2024-09-14T11:55:53.875265+0000","last_peered":"2024-09-14T11:55:53.875265+0000","last_clean":"2024-09-14T11:55:53.875265+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:55:53.875265+0000","last_undegraded":"2024-09-14T11:55:53.875265+0000","last_fullsized":"2024-09-14T11:55:53.875265+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:22.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013869+0000","last_change":"2024-09-14T11:43:35.604229+0000","last_active":"2024-09-14T11:56:09.013869+0000","last_peered":"2024-09-14T11:56:09.013869+0000","last_clean":"2024-09-14T11:56:09.013869+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:56:09.013869+0000","last_undegraded":"2024-09-14T11:56:09.013869+0000","last_fullsized":"2024-09-14T11:56:09.013869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:36.198961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.251971+0000","last_change":"2024-09-14T11:32:32.579628+0000","last_active":"2024-09-14T11:58:47.251971+0000","last_peered":"2024-09-14T11:58:47.251971+0000","last_clean":"2024-09-14T11:58:47.251971+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:58:47.251971+0000","last_undegraded":"2024-09-14T11:58:47.251971+0000","last_fullsized":"2024-09-14T11:58:47.251971+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:15.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2088,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.898008+0000","last_change":"2024-09-14T11:32:29.555597+0000","last_active":"2024-09-14T11:58:28.898008+0000","last_peered":"2024-09-14T11:58:28.898008+0000","last_clean":"2024-09-14T11:58:28.898008+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:58:28.898008+0000","last_undegraded":"2024-09-14T11:58:28.898008+0000","last_fullsized":"2024-09-14T11:58:28.898008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:41.029993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870178+0000","last_change":"2024-09-14T11:30:45.176934+0000","last_active":"2024-09-14T11:55:45.870178+0000","last_peered":"2024-09-14T11:55:45.870178+0000","last_clean":"2024-09-14T11:55:45.870178+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:55:45.870178+0000","last_undegraded":"2024-09-14T11:55:45.870178+0000","last_fullsized":"2024-09-14T11:55:45.870178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:07.587565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":21,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.869724+0000","last_change":"2024-09-14T11:43:35.606492+0000","last_active":"2024-09-14T11:56:38.869724+0000","last_peered":"2024-09-14T11:56:38.869724+0000","last_clean":"2024-09-14T11:56:38.869724+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:56:38.869724+0000","last_undegraded":"2024-09-14T11:56:38.869724+0000","last_fullsized":"2024-09-14T11:56:38.869724+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:37.980270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.883204+0000","last_change":"2024-09-14T11:32:32.587253+0000","last_active":"2024-09-14T11:57:35.883204+0000","last_peered":"2024-09-14T11:57:35.883204+0000","last_clean":"2024-09-14T11:57:35.883204+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:57:35.883204+0000","last_undegraded":"2024-09-14T11:57:35.883204+0000","last_fullsized":"2024-09-14T11:57:35.883204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:48.236842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.898789+0000","last_change":"2024-09-14T11:32:29.554686+0000","last_active":"2024-09-14T11:58:33.898789+0000","last_peered":"2024-09-14T11:58:33.898789+0000","last_clean":"2024-09-14T11:58:33.898789+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:58:33.898789+0000","last_undegraded":"2024-09-14T11:58:33.898789+0000","last_fullsized":"2024-09-14T11:58:33.898789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:47.349081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874577+0000","last_change":"2024-09-14T11:30:45.181837+0000","last_active":"2024-09-14T11:55:48.874577+0000","last_peered":"2024-09-14T11:55:48.874577+0000","last_clean":"2024-09-14T11:55:48.874577+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:55:48.874577+0000","last_undegraded":"2024-09-14T11:55:48.874577+0000","last_fullsized":"2024-09-14T11:55:48.874577+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:59.286638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.870841+0000","last_change":"2024-09-14T11:43:35.601443+0000","last_active":"2024-09-14T11:56:38.870841+0000","last_peered":"2024-09-14T11:56:38.870841+0000","last_clean":"2024-09-14T11:56:38.870841+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:56:38.870841+0000","last_undegraded":"2024-09-14T11:56:38.870841+0000","last_fullsized":"2024-09-14T11:56:38.870841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.372764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882441+0000","last_change":"2024-09-14T11:32:32.587278+0000","last_active":"2024-09-14T11:56:43.882441+0000","last_peered":"2024-09-14T11:56:43.882441+0000","last_clean":"2024-09-14T11:56:43.882441+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:56:43.882441+0000","last_undegraded":"2024-09-14T11:56:43.882441+0000","last_fullsized":"2024-09-14T11:56:43.882441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.322094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870808+0000","last_change":"2024-09-14T11:32:29.548859+0000","last_active":"2024-09-14T11:55:23.870808+0000","last_peered":"2024-09-14T11:55:23.870808+0000","last_clean":"2024-09-14T11:55:23.870808+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:55:23.870808+0000","last_undegraded":"2024-09-14T11:55:23.870808+0000","last_fullsized":"2024-09-14T11:55:23.870808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:45.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":210,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011327+0000","last_change":"2024-09-14T11:30:45.187608+0000","last_active":"2024-09-14T11:55:49.011327+0000","last_peered":"2024-09-14T11:55:49.011327+0000","last_clean":"2024-09-14T11:55:49.011327+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:55:49.011327+0000","last_undegraded":"2024-09-14T11:55:49.011327+0000","last_fullsized":"2024-09-14T11:55:49.011327+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:16.607409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.867231+0000","last_change":"2024-09-14T11:43:35.605855+0000","last_active":"2024-09-14T11:56:08.867231+0000","last_peered":"2024-09-14T11:56:08.867231+0000","last_clean":"2024-09-14T11:56:08.867231+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:56:08.867231+0000","last_undegraded":"2024-09-14T11:56:08.867231+0000","last_fullsized":"2024-09-14T11:56:08.867231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:26.463408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.232233+0000","last_change":"2024-09-14T11:32:32.590849+0000","last_active":"2024-09-14T11:58:47.232233+0000","last_peered":"2024-09-14T11:58:47.232233+0000","last_clean":"2024-09-14T11:58:47.232233+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:58:47.232233+0000","last_undegraded":"2024-09-14T11:58:47.232233+0000","last_fullsized":"2024-09-14T11:58:47.232233+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:53.175496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2166,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'9","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.401586+0000","last_change":"2024-09-14T11:32:29.553146+0000","last_active":"2024-09-14T11:58:47.401586+0000","last_peered":"2024-09-14T11:58:47.401586+0000","last_clean":"2024-09-14T11:58:47.401586+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:58:47.401586+0000","last_undegraded":"2024-09-14T11:58:47.401586+0000","last_fullsized":"2024-09-14T11:58:47.401586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:39.348345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":87,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954727+0000","last_change":"2024-09-14T11:30:45.183295+0000","last_active":"2024-09-14T11:55:48.954727+0000","last_peered":"2024-09-14T11:55:48.954727+0000","last_clean":"2024-09-14T11:55:48.954727+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:55:48.954727+0000","last_undegraded":"2024-09-14T11:55:48.954727+0000","last_fullsized":"2024-09-14T11:55:48.954727+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:30.030410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.878101+0000","last_change":"2024-09-14T11:43:35.604955+0000","last_active":"2024-09-14T11:56:13.878101+0000","last_peered":"2024-09-14T11:56:13.878101+0000","last_clean":"2024-09-14T11:56:13.878101+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:56:13.878101+0000","last_undegraded":"2024-09-14T11:56:13.878101+0000","last_fullsized":"2024-09-14T11:56:13.878101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.840822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'14","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:34.026596+0000","last_change":"2024-09-14T11:32:32.584702+0000","last_active":"2024-09-14T11:57:34.026596+0000","last_peered":"2024-09-14T11:57:34.026596+0000","last_clean":"2024-09-14T11:57:34.026596+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:57:34.026596+0000","last_undegraded":"2024-09-14T11:57:34.026596+0000","last_fullsized":"2024-09-14T11:57:34.026596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:19.580871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19460,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'6","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.968432+0000","last_change":"2024-09-14T11:32:29.553252+0000","last_active":"2024-09-14T11:57:28.968432+0000","last_peered":"2024-09-14T11:57:28.968432+0000","last_clean":"2024-09-14T11:57:28.968432+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:57:28.968432+0000","last_undegraded":"2024-09-14T11:57:28.968432+0000","last_fullsized":"2024-09-14T11:57:28.968432+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:40.879039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":128,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.883818+0000","last_change":"2024-09-14T11:30:45.183283+0000","last_active":"2024-09-14T11:56:53.883818+0000","last_peered":"2024-09-14T11:56:53.883818+0000","last_clean":"2024-09-14T11:56:53.883818+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:56:53.883818+0000","last_undegraded":"2024-09-14T11:56:53.883818+0000","last_fullsized":"2024-09-14T11:56:53.883818+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:00.428598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'199","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.460827+0000","last_change":"2024-09-14T11:15:32.311949+0000","last_active":"2024-09-14T11:58:47.460827+0000","last_peered":"2024-09-14T11:58:47.460827+0000","last_clean":"2024-09-14T11:58:47.460827+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:58:47.460827+0000","last_undegraded":"2024-09-14T11:58:47.460827+0000","last_fullsized":"2024-09-14T11:58:47.460827+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:25.643807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":502,"num_read_kb":68162,"num_write":958,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'445","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465587+0000","last_change":"2024-09-14T11:15:34.326897+0000","last_active":"2024-09-14T11:56:38.465587+0000","last_peered":"2024-09-14T11:56:38.465587+0000","last_clean":"2024-09-14T11:56:38.465587+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:56:38.465587+0000","last_undegraded":"2024-09-14T11:56:38.465587+0000","last_fullsized":"2024-09-14T11:56:38.465587+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:44.936272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'206","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.471496+0000","last_change":"2024-09-14T11:15:32.317583+0000","last_active":"2024-09-14T11:58:47.471496+0000","last_peered":"2024-09-14T11:58:47.471496+0000","last_clean":"2024-09-14T11:58:47.471496+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:58:47.471496+0000","last_undegraded":"2024-09-14T11:58:47.471496+0000","last_fullsized":"2024-09-14T11:58:47.471496+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:37.196534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":84679,"num_write":950,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998595+0000","last_change":"2024-09-14T11:15:34.330220+0000","last_active":"2024-09-14T11:56:36.998595+0000","last_peered":"2024-09-14T11:56:36.998595+0000","last_clean":"2024-09-14T11:56:36.998595+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:56:36.998595+0000","last_undegraded":"2024-09-14T11:56:36.998595+0000","last_fullsized":"2024-09-14T11:56:36.998595+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:39.172882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'216","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.393670+0000","last_change":"2024-09-14T11:15:32.302813+0000","last_active":"2024-09-14T11:58:47.393670+0000","last_peered":"2024-09-14T11:58:47.393670+0000","last_clean":"2024-09-14T11:58:47.393670+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:58:47.393670+0000","last_undegraded":"2024-09-14T11:58:47.393670+0000","last_fullsized":"2024-09-14T11:58:47.393670+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:48.865990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":1085,"num_write":1018,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'743","reported_seq":2196,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815132+0000","last_change":"2024-09-14T11:15:34.316987+0000","last_active":"2024-09-14T11:56:31.815132+0000","last_peered":"2024-09-14T11:56:31.815132+0000","last_clean":"2024-09-14T11:56:31.815132+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:56:31.815132+0000","last_undegraded":"2024-09-14T11:56:31.815132+0000","last_fullsized":"2024-09-14T11:56:31.815132+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:20.185745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'239","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.437075+0000","last_change":"2024-09-14T11:15:32.322744+0000","last_active":"2024-09-14T11:58:47.437075+0000","last_peered":"2024-09-14T11:58:47.437075+0000","last_clean":"2024-09-14T11:58:47.437075+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:58:47.437075+0000","last_undegraded":"2024-09-14T11:58:47.437075+0000","last_fullsized":"2024-09-14T11:58:47.437075+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:12.738315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30923,"num_write":1131,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2085,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136947+0000","last_change":"2024-09-14T11:15:34.323811+0000","last_active":"2024-09-14T11:56:39.136947+0000","last_peered":"2024-09-14T11:56:39.136947+0000","last_clean":"2024-09-14T11:56:39.136947+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:56:39.136947+0000","last_undegraded":"2024-09-14T11:56:39.136947+0000","last_fullsized":"2024-09-14T11:56:39.136947+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.122736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'216","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872289+0000","last_change":"2024-09-14T11:15:32.313227+0000","last_active":"2024-09-14T11:55:33.872289+0000","last_peered":"2024-09-14T11:55:33.872289+0000","last_clean":"2024-09-14T11:55:33.872289+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:55:33.872289+0000","last_undegraded":"2024-09-14T11:55:33.872289+0000","last_fullsized":"2024-09-14T11:55:33.872289+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:24.665300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'966","reported_seq":2607,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518596+0000","last_change":"2024-09-14T11:15:34.323939+0000","last_active":"2024-09-14T11:56:33.518596+0000","last_peered":"2024-09-14T11:56:33.518596+0000","last_clean":"2024-09-14T11:56:33.518596+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:56:33.518596+0000","last_undegraded":"2024-09-14T11:56:33.518596+0000","last_fullsized":"2024-09-14T11:56:33.518596+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:54.340034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'184","reported_seq":806,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.412577+0000","last_change":"2024-09-14T11:15:32.323327+0000","last_active":"2024-09-14T11:58:47.412577+0000","last_peered":"2024-09-14T11:58:47.412577+0000","last_clean":"2024-09-14T11:58:47.412577+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:58:47.412577+0000","last_undegraded":"2024-09-14T11:58:47.412577+0000","last_fullsized":"2024-09-14T11:58:47.412577+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:45.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":10177,"num_write":901,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3039,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466977+0000","last_change":"2024-09-14T11:15:34.316280+0000","last_active":"2024-09-14T11:58:14.466977+0000","last_peered":"2024-09-14T11:58:14.466977+0000","last_clean":"2024-09-14T11:58:14.466977+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:58:14.466977+0000","last_undegraded":"2024-09-14T11:58:14.466977+0000","last_fullsized":"2024-09-14T11:58:14.466977+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:00.310713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'196","reported_seq":810,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.453567+0000","last_change":"2024-09-14T11:15:32.317672+0000","last_active":"2024-09-14T11:58:47.453567+0000","last_peered":"2024-09-14T11:58:47.453567+0000","last_clean":"2024-09-14T11:58:47.453567+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:58:47.453567+0000","last_undegraded":"2024-09-14T11:58:47.453567+0000","last_fullsized":"2024-09-14T11:58:47.453567+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:04.495027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":12539,"num_write":927,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'490","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465061+0000","last_change":"2024-09-14T11:15:34.328589+0000","last_active":"2024-09-14T11:56:38.465061+0000","last_peered":"2024-09-14T11:56:38.465061+0000","last_clean":"2024-09-14T11:56:38.465061+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:56:38.465061+0000","last_undegraded":"2024-09-14T11:56:38.465061+0000","last_fullsized":"2024-09-14T11:56:38.465061+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.473320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'220","reported_seq":823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.412743+0000","last_change":"2024-09-14T11:15:32.320364+0000","last_active":"2024-09-14T11:58:47.412743+0000","last_peered":"2024-09-14T11:58:47.412743+0000","last_clean":"2024-09-14T11:58:47.412743+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:58:47.412743+0000","last_undegraded":"2024-09-14T11:58:47.412743+0000","last_fullsized":"2024-09-14T11:58:47.412743+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:11.338356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":31152,"num_write":983,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'593","reported_seq":2457,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882772+0000","last_change":"2024-09-14T11:16:07.517907+0000","last_active":"2024-09-14T11:56:54.882772+0000","last_peered":"2024-09-14T11:56:54.882772+0000","last_clean":"2024-09-14T11:56:54.882772+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:56:54.882772+0000","last_undegraded":"2024-09-14T11:56:54.882772+0000","last_fullsized":"2024-09-14T11:56:54.882772+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:13.243462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'760","reported_seq":2274,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466795+0000","last_change":"2024-09-14T11:15:34.313439+0000","last_active":"2024-09-14T11:58:14.466795+0000","last_peered":"2024-09-14T11:58:14.466795+0000","last_clean":"2024-09-14T11:58:14.466795+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:58:14.466795+0000","last_undegraded":"2024-09-14T11:58:14.466795+0000","last_fullsized":"2024-09-14T11:58:14.466795+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:34.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'228","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.472018+0000","last_change":"2024-09-14T11:15:32.319484+0000","last_active":"2024-09-14T11:58:47.472018+0000","last_peered":"2024-09-14T11:58:47.472018+0000","last_clean":"2024-09-14T11:58:47.472018+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:58:47.472018+0000","last_undegraded":"2024-09-14T11:58:47.472018+0000","last_fullsized":"2024-09-14T11:58:47.472018+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:12.735898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493146,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":8015,"num_write":1062,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'455","reported_seq":2042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.991606+0000","last_change":"2024-09-14T11:15:34.330160+0000","last_active":"2024-09-14T11:56:56.991606+0000","last_peered":"2024-09-14T11:56:56.991606+0000","last_clean":"2024-09-14T11:56:56.991606+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:56:56.991606+0000","last_undegraded":"2024-09-14T11:56:56.991606+0000","last_fullsized":"2024-09-14T11:56:56.991606+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:22.426308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'229","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.447405+0000","last_change":"2024-09-14T11:15:32.315600+0000","last_active":"2024-09-14T11:58:47.447405+0000","last_peered":"2024-09-14T11:58:47.447405+0000","last_clean":"2024-09-14T11:58:47.447405+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:58:47.447405+0000","last_undegraded":"2024-09-14T11:58:47.447405+0000","last_fullsized":"2024-09-14T11:58:47.447405+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:22.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":595,"num_read_kb":24969,"num_write":1057,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'441","reported_seq":1986,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.890926+0000","last_change":"2024-09-14T11:15:34.326565+0000","last_active":"2024-09-14T11:57:43.890926+0000","last_peered":"2024-09-14T11:57:43.890926+0000","last_clean":"2024-09-14T11:57:43.890926+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:57:43.890926+0000","last_undegraded":"2024-09-14T11:57:43.890926+0000","last_fullsized":"2024-09-14T11:57:43.890926+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:36.647727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'220","reported_seq":844,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.469100+0000","last_change":"2024-09-14T11:15:32.315148+0000","last_active":"2024-09-14T11:58:47.469100+0000","last_peered":"2024-09-14T11:58:47.469100+0000","last_clean":"2024-09-14T11:58:47.469100+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:58:47.469100+0000","last_undegraded":"2024-09-14T11:58:47.469100+0000","last_fullsized":"2024-09-14T11:58:47.469100+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:49.800357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":17269,"num_write":968,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'393","reported_seq":1858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465278+0000","last_change":"2024-09-14T11:15:34.323271+0000","last_active":"2024-09-14T11:56:38.465278+0000","last_peered":"2024-09-14T11:56:38.465278+0000","last_clean":"2024-09-14T11:56:38.465278+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:56:38.465278+0000","last_undegraded":"2024-09-14T11:56:38.465278+0000","last_fullsized":"2024-09-14T11:56:38.465278+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:05.710670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'258","reported_seq":892,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.412405+0000","last_change":"2024-09-14T11:15:32.313147+0000","last_active":"2024-09-14T11:58:47.412405+0000","last_peered":"2024-09-14T11:58:47.412405+0000","last_clean":"2024-09-14T11:58:47.412405+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:58:47.412405+0000","last_undegraded":"2024-09-14T11:58:47.412405+0000","last_fullsized":"2024-09-14T11:58:47.412405+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:40.375363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730148,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":20644,"num_write":1068,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.129016+0000","last_change":"2024-09-14T11:15:34.315634+0000","last_active":"2024-09-14T11:56:39.129016+0000","last_peered":"2024-09-14T11:56:39.129016+0000","last_clean":"2024-09-14T11:56:39.129016+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:56:39.129016+0000","last_undegraded":"2024-09-14T11:56:39.129016+0000","last_fullsized":"2024-09-14T11:56:39.129016+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.317560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'290","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.437997+0000","last_change":"2024-09-14T11:15:32.317614+0000","last_active":"2024-09-14T11:58:47.437997+0000","last_peered":"2024-09-14T11:58:47.437997+0000","last_clean":"2024-09-14T11:58:47.437997+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:58:47.437997+0000","last_undegraded":"2024-09-14T11:58:47.437997+0000","last_fullsized":"2024-09-14T11:58:47.437997+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:00.703910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1018,"num_read_kb":39546,"num_write":1294,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'571","reported_seq":2414,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456133+0000","last_change":"2024-09-14T11:15:34.328085+0000","last_active":"2024-09-14T11:58:14.456133+0000","last_peered":"2024-09-14T11:58:14.456133+0000","last_clean":"2024-09-14T11:58:14.456133+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:58:14.456133+0000","last_undegraded":"2024-09-14T11:58:14.456133+0000","last_fullsized":"2024-09-14T11:58:14.456133+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:40.805688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'231","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.424178+0000","last_change":"2024-09-14T11:15:32.309339+0000","last_active":"2024-09-14T11:58:47.424178+0000","last_peered":"2024-09-14T11:58:47.424178+0000","last_clean":"2024-09-14T11:58:47.424178+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:58:47.424178+0000","last_undegraded":"2024-09-14T11:58:47.424178+0000","last_fullsized":"2024-09-14T11:58:47.424178+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:16.044046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":555,"num_read_kb":31277,"num_write":1077,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.583992+0000","last_change":"2024-09-14T11:15:42.348963+0000","last_active":"2024-09-14T11:56:57.583992+0000","last_peered":"2024-09-14T11:56:57.583992+0000","last_clean":"2024-09-14T11:56:57.583992+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:56:57.583992+0000","last_undegraded":"2024-09-14T11:56:57.583992+0000","last_fullsized":"2024-09-14T11:56:57.583992+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:41.155224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'823","reported_seq":2528,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883828+0000","last_change":"2024-09-14T11:15:34.329854+0000","last_active":"2024-09-14T11:56:54.883828+0000","last_peered":"2024-09-14T11:56:54.883828+0000","last_clean":"2024-09-14T11:56:54.883828+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:56:54.883828+0000","last_undegraded":"2024-09-14T11:56:54.883828+0000","last_fullsized":"2024-09-14T11:56:54.883828+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:48.859940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'198","reported_seq":910,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.400180+0000","last_change":"2024-09-14T11:15:32.318773+0000","last_active":"2024-09-14T11:58:47.400180+0000","last_peered":"2024-09-14T11:58:47.400180+0000","last_clean":"2024-09-14T11:58:47.400180+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:58:47.400180+0000","last_undegraded":"2024-09-14T11:58:47.400180+0000","last_fullsized":"2024-09-14T11:58:47.400180+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:41.470746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":885,"num_read_kb":29517,"num_write":954,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861599+0000","last_change":"2024-09-14T11:15:36.329405+0000","last_active":"2024-09-14T11:54:18.861599+0000","last_peered":"2024-09-14T11:54:18.861599+0000","last_clean":"2024-09-14T11:54:18.861599+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:54:18.861599+0000","last_undegraded":"2024-09-14T11:54:18.861599+0000","last_fullsized":"2024-09-14T11:54:18.861599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.437495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'200","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.332319+0000","last_change":"2024-09-14T11:15:38.337357+0000","last_active":"2024-09-14T11:58:47.332319+0000","last_peered":"2024-09-14T11:58:47.332319+0000","last_clean":"2024-09-14T11:58:47.332319+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:58:47.332319+0000","last_undegraded":"2024-09-14T11:58:47.332319+0000","last_fullsized":"2024-09-14T11:58:47.332319+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.259312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":271,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.862314+0000","last_change":"2024-09-14T11:15:40.343299+0000","last_active":"2024-09-14T11:54:23.862314+0000","last_peered":"2024-09-14T11:54:23.862314+0000","last_clean":"2024-09-14T11:54:23.862314+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:54:23.862314+0000","last_undegraded":"2024-09-14T11:54:23.862314+0000","last_fullsized":"2024-09-14T11:54:23.862314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:21.470841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2483","reported_seq":4315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884659+0000","last_change":"2024-09-14T11:15:42.346740+0000","last_active":"2024-09-14T11:56:58.884659+0000","last_peered":"2024-09-14T11:56:58.884659+0000","last_clean":"2024-09-14T11:56:58.884659+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:56:58.884659+0000","last_undegraded":"2024-09-14T11:56:58.884659+0000","last_fullsized":"2024-09-14T11:56:58.884659+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":2400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:08.150839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'431","reported_seq":2262,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.519771+0000","last_change":"2024-09-14T11:15:34.327076+0000","last_active":"2024-09-14T11:56:57.519771+0000","last_peered":"2024-09-14T11:56:57.519771+0000","last_clean":"2024-09-14T11:56:57.519771+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:56:57.519771+0000","last_undegraded":"2024-09-14T11:56:57.519771+0000","last_fullsized":"2024-09-14T11:56:57.519771+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:08.246401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'269","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.471965+0000","last_change":"2024-09-14T11:15:32.308280+0000","last_active":"2024-09-14T11:58:47.471965+0000","last_peered":"2024-09-14T11:58:47.471965+0000","last_clean":"2024-09-14T11:58:47.471965+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:58:47.471965+0000","last_undegraded":"2024-09-14T11:58:47.471965+0000","last_fullsized":"2024-09-14T11:58:47.471965+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:16.723135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":744,"num_read_kb":16466,"num_write":1204,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.872400+0000","last_change":"2024-09-14T11:15:36.334689+0000","last_active":"2024-09-14T11:55:28.872400+0000","last_peered":"2024-09-14T11:55:28.872400+0000","last_clean":"2024-09-14T11:55:28.872400+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:55:28.872400+0000","last_undegraded":"2024-09-14T11:55:28.872400+0000","last_fullsized":"2024-09-14T11:55:28.872400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.914528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'91","reported_seq":605,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.185623+0000","last_change":"2024-09-14T11:15:38.334852+0000","last_active":"2024-09-14T11:55:48.185623+0000","last_peered":"2024-09-14T11:55:48.185623+0000","last_clean":"2024-09-14T11:55:48.185623+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:55:48.185623+0000","last_undegraded":"2024-09-14T11:55:48.185623+0000","last_fullsized":"2024-09-14T11:55:48.185623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:06.733877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.000326+0000","last_change":"2024-09-14T11:15:40.346053+0000","last_active":"2024-09-14T11:54:24.000326+0000","last_peered":"2024-09-14T11:54:24.000326+0000","last_clean":"2024-09-14T11:54:24.000326+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:54:24.000326+0000","last_undegraded":"2024-09-14T11:54:24.000326+0000","last_fullsized":"2024-09-14T11:54:24.000326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.054969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'107","reported_seq":595,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.810718+0000","last_change":"2024-09-14T11:15:42.347308+0000","last_active":"2024-09-14T11:56:31.810718+0000","last_peered":"2024-09-14T11:56:31.810718+0000","last_clean":"2024-09-14T11:56:31.810718+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:56:31.810718+0000","last_undegraded":"2024-09-14T11:56:31.810718+0000","last_fullsized":"2024-09-14T11:56:31.810718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:53.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'424","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.883698+0000","last_change":"2024-09-14T11:15:34.328884+0000","last_active":"2024-09-14T11:56:54.883698+0000","last_peered":"2024-09-14T11:56:54.883698+0000","last_clean":"2024-09-14T11:56:54.883698+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:56:54.883698+0000","last_undegraded":"2024-09-14T11:56:54.883698+0000","last_fullsized":"2024-09-14T11:56:54.883698+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'188","reported_seq":798,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.244124+0000","last_change":"2024-09-14T11:15:32.316916+0000","last_active":"2024-09-14T11:58:47.244124+0000","last_peered":"2024-09-14T11:58:47.244124+0000","last_clean":"2024-09-14T11:58:47.244124+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:58:47.244124+0000","last_undegraded":"2024-09-14T11:58:47.244124+0000","last_fullsized":"2024-09-14T11:58:47.244124+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:45.239724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":30179,"num_write":922,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"36'3","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.730090+0000","last_change":"2024-09-14T11:15:36.333013+0000","last_active":"2024-09-14T11:58:46.730090+0000","last_peered":"2024-09-14T11:58:46.730090+0000","last_clean":"2024-09-14T11:58:46.730090+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:58:46.730090+0000","last_undegraded":"2024-09-14T11:58:46.730090+0000","last_fullsized":"2024-09-14T11:58:46.730090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.296621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'115","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.680045+0000","last_change":"2024-09-14T11:15:38.337017+0000","last_active":"2024-09-14T11:56:32.680045+0000","last_peered":"2024-09-14T11:56:32.680045+0000","last_clean":"2024-09-14T11:56:32.680045+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:56:32.680045+0000","last_undegraded":"2024-09-14T11:56:32.680045+0000","last_fullsized":"2024-09-14T11:56:32.680045+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.412101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'751","reported_seq":2525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.167225+0000","last_change":"2024-09-14T11:15:40.343642+0000","last_active":"2024-09-14T11:58:47.167225+0000","last_peered":"2024-09-14T11:58:47.167225+0000","last_clean":"2024-09-14T11:58:47.167225+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:58:47.167225+0000","last_undegraded":"2024-09-14T11:58:47.167225+0000","last_fullsized":"2024-09-14T11:58:47.167225+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.527132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'193","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.636145+0000","last_change":"2024-09-14T11:15:42.341730+0000","last_active":"2024-09-14T11:56:57.636145+0000","last_peered":"2024-09-14T11:56:57.636145+0000","last_clean":"2024-09-14T11:56:57.636145+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:56:57.636145+0000","last_undegraded":"2024-09-14T11:56:57.636145+0000","last_fullsized":"2024-09-14T11:56:57.636145+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.359150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1027","reported_seq":2587,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.126763+0000","last_change":"2024-09-14T11:15:34.325968+0000","last_active":"2024-09-14T11:56:39.126763+0000","last_peered":"2024-09-14T11:56:39.126763+0000","last_clean":"2024-09-14T11:56:39.126763+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:56:39.126763+0000","last_undegraded":"2024-09-14T11:56:39.126763+0000","last_fullsized":"2024-09-14T11:56:39.126763+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:31.103187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'193","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.969100+0000","last_change":"2024-09-14T11:15:32.317790+0000","last_active":"2024-09-14T11:57:33.969100+0000","last_peered":"2024-09-14T11:57:33.969100+0000","last_clean":"2024-09-14T11:57:33.969100+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:57:33.969100+0000","last_undegraded":"2024-09-14T11:57:33.969100+0000","last_fullsized":"2024-09-14T11:57:33.969100+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:32.748526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399062,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":441,"num_read_kb":5281,"num_write":856,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.861627+0000","last_change":"2024-09-14T11:15:36.330106+0000","last_active":"2024-09-14T11:54:18.861627+0000","last_peered":"2024-09-14T11:54:18.861627+0000","last_clean":"2024-09-14T11:54:18.861627+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:54:18.861627+0000","last_undegraded":"2024-09-14T11:54:18.861627+0000","last_fullsized":"2024-09-14T11:54:18.861627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:38.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'123","reported_seq":679,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.291405+0000","last_change":"2024-09-14T11:15:38.337426+0000","last_active":"2024-09-14T11:58:47.291405+0000","last_peered":"2024-09-14T11:58:47.291405+0000","last_clean":"2024-09-14T11:58:47.291405+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:58:47.291405+0000","last_undegraded":"2024-09-14T11:58:47.291405+0000","last_fullsized":"2024-09-14T11:58:47.291405+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:10.689123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":190,"num_write":76,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'812","reported_seq":2227,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.173862+0000","last_change":"2024-09-14T11:15:40.349078+0000","last_active":"2024-09-14T11:58:47.173862+0000","last_peered":"2024-09-14T11:58:47.173862+0000","last_clean":"2024-09-14T11:58:47.173862+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:58:47.173862+0000","last_undegraded":"2024-09-14T11:58:47.173862+0000","last_fullsized":"2024-09-14T11:58:47.173862+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:29.118650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'734","reported_seq":2278,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882475+0000","last_change":"2024-09-14T11:15:34.326626+0000","last_active":"2024-09-14T11:56:43.882475+0000","last_peered":"2024-09-14T11:56:43.882475+0000","last_clean":"2024-09-14T11:56:43.882475+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:56:43.882475+0000","last_undegraded":"2024-09-14T11:56:43.882475+0000","last_fullsized":"2024-09-14T11:56:43.882475+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:29.534366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'205","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.285677+0000","last_change":"2024-09-14T11:15:32.318817+0000","last_active":"2024-09-14T11:58:47.285677+0000","last_peered":"2024-09-14T11:58:47.285677+0000","last_clean":"2024-09-14T11:58:47.285677+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:47.285677+0000","last_undegraded":"2024-09-14T11:58:47.285677+0000","last_fullsized":"2024-09-14T11:58:47.285677+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:39.582918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":729,"num_read_kb":30459,"num_write":898,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864459+0000","last_change":"2024-09-14T11:15:36.334240+0000","last_active":"2024-09-14T11:54:38.864459+0000","last_peered":"2024-09-14T11:54:38.864459+0000","last_clean":"2024-09-14T11:54:38.864459+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:54:38.864459+0000","last_undegraded":"2024-09-14T11:54:38.864459+0000","last_fullsized":"2024-09-14T11:54:38.864459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:52.168480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'213","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.371232+0000","last_change":"2024-09-14T11:15:38.335040+0000","last_active":"2024-09-14T11:58:47.371232+0000","last_peered":"2024-09-14T11:58:47.371232+0000","last_clean":"2024-09-14T11:58:47.371232+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:58:47.371232+0000","last_undegraded":"2024-09-14T11:58:47.371232+0000","last_fullsized":"2024-09-14T11:58:47.371232+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.960934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12526,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":287,"num_read_kb":357,"num_write":170,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.873529+0000","last_change":"2024-09-14T11:15:40.345833+0000","last_active":"2024-09-14T11:56:10.873529+0000","last_peered":"2024-09-14T11:56:10.873529+0000","last_clean":"2024-09-14T11:56:10.873529+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:56:10.873529+0000","last_undegraded":"2024-09-14T11:56:10.873529+0000","last_fullsized":"2024-09-14T11:56:10.873529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'552","reported_seq":1347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801804+0000","last_change":"2024-09-14T11:15:42.350220+0000","last_active":"2024-09-14T11:58:15.801804+0000","last_peered":"2024-09-14T11:58:15.801804+0000","last_clean":"2024-09-14T11:58:15.801804+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:58:15.801804+0000","last_undegraded":"2024-09-14T11:58:15.801804+0000","last_fullsized":"2024-09-14T11:58:15.801804+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:29.655558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'833","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.863266+0000","last_change":"2024-09-14T11:15:34.329906+0000","last_active":"2024-09-14T11:57:45.863266+0000","last_peered":"2024-09-14T11:57:45.863266+0000","last_clean":"2024-09-14T11:57:45.863266+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:57:45.863266+0000","last_undegraded":"2024-09-14T11:57:45.863266+0000","last_fullsized":"2024-09-14T11:57:45.863266+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'286","reported_seq":927,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.423465+0000","last_change":"2024-09-14T11:15:32.321404+0000","last_active":"2024-09-14T11:58:47.423465+0000","last_peered":"2024-09-14T11:58:47.423465+0000","last_clean":"2024-09-14T11:58:47.423465+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:58:47.423465+0000","last_undegraded":"2024-09-14T11:58:47.423465+0000","last_fullsized":"2024-09-14T11:58:47.423465+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:33.160296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":15958,"num_write":1147,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856235+0000","last_change":"2024-09-14T11:15:36.323224+0000","last_active":"2024-09-14T11:54:38.856235+0000","last_peered":"2024-09-14T11:54:38.856235+0000","last_clean":"2024-09-14T11:54:38.856235+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:54:38.856235+0000","last_undegraded":"2024-09-14T11:54:38.856235+0000","last_fullsized":"2024-09-14T11:54:38.856235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:40.252261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'120","reported_seq":683,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.489679+0000","last_change":"2024-09-14T11:15:38.336933+0000","last_active":"2024-09-14T11:58:47.489679+0000","last_peered":"2024-09-14T11:58:47.489679+0000","last_clean":"2024-09-14T11:58:47.489679+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:58:47.489679+0000","last_undegraded":"2024-09-14T11:58:47.489679+0000","last_fullsized":"2024-09-14T11:58:47.489679+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.373870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":194,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867935+0000","last_change":"2024-09-14T11:15:40.349051+0000","last_active":"2024-09-14T11:54:53.867935+0000","last_peered":"2024-09-14T11:54:53.867935+0000","last_clean":"2024-09-14T11:54:53.867935+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:54:53.867935+0000","last_undegraded":"2024-09-14T11:54:53.867935+0000","last_fullsized":"2024-09-14T11:54:53.867935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.147760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'124","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.968464+0000","last_change":"2024-09-14T11:15:42.351151+0000","last_active":"2024-09-14T11:57:28.968464+0000","last_peered":"2024-09-14T11:57:28.968464+0000","last_clean":"2024-09-14T11:57:28.968464+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:57:28.968464+0000","last_undegraded":"2024-09-14T11:57:28.968464+0000","last_fullsized":"2024-09-14T11:57:28.968464+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:13.693118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'688","reported_seq":2326,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456533+0000","last_change":"2024-09-14T11:15:34.331821+0000","last_active":"2024-09-14T11:58:14.456533+0000","last_peered":"2024-09-14T11:58:14.456533+0000","last_clean":"2024-09-14T11:58:14.456533+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:58:14.456533+0000","last_undegraded":"2024-09-14T11:58:14.456533+0000","last_fullsized":"2024-09-14T11:58:14.456533+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:17.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'234","reported_seq":864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.360713+0000","last_change":"2024-09-14T11:16:07.518583+0000","last_active":"2024-09-14T11:58:47.360713+0000","last_peered":"2024-09-14T11:58:47.360713+0000","last_clean":"2024-09-14T11:58:47.360713+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:58:47.360713+0000","last_undegraded":"2024-09-14T11:58:47.360713+0000","last_fullsized":"2024-09-14T11:58:47.360713+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":32200,"num_write":1033,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866558+0000","last_change":"2024-09-14T11:15:36.326783+0000","last_active":"2024-09-14T11:56:08.866558+0000","last_peered":"2024-09-14T11:56:08.866558+0000","last_clean":"2024-09-14T11:56:08.866558+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:56:08.866558+0000","last_undegraded":"2024-09-14T11:56:08.866558+0000","last_fullsized":"2024-09-14T11:56:08.866558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:49.025532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'167","reported_seq":740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.386695+0000","last_change":"2024-09-14T11:15:38.339476+0000","last_active":"2024-09-14T11:58:47.386695+0000","last_peered":"2024-09-14T11:58:47.386695+0000","last_clean":"2024-09-14T11:58:47.386695+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:58:47.386695+0000","last_undegraded":"2024-09-14T11:58:47.386695+0000","last_fullsized":"2024-09-14T11:58:47.386695+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:23.876347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":303,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'803","reported_seq":4159,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.173792+0000","last_change":"2024-09-14T11:15:40.344136+0000","last_active":"2024-09-14T11:58:47.173792+0000","last_peered":"2024-09-14T11:58:47.173792+0000","last_clean":"2024-09-14T11:58:47.173792+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:58:47.173792+0000","last_undegraded":"2024-09-14T11:58:47.173792+0000","last_fullsized":"2024-09-14T11:58:47.173792+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:19.808946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'140","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.396582+0000","last_change":"2024-09-14T11:15:42.354873+0000","last_active":"2024-09-14T11:58:14.396582+0000","last_peered":"2024-09-14T11:58:14.396582+0000","last_clean":"2024-09-14T11:58:14.396582+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:58:14.396582+0000","last_undegraded":"2024-09-14T11:58:14.396582+0000","last_fullsized":"2024-09-14T11:58:14.396582+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:42.946889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.123392+0000","last_change":"2024-09-14T11:15:34.330206+0000","last_active":"2024-09-14T11:56:27.123392+0000","last_peered":"2024-09-14T11:56:27.123392+0000","last_clean":"2024-09-14T11:56:27.123392+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:56:27.123392+0000","last_undegraded":"2024-09-14T11:56:27.123392+0000","last_fullsized":"2024-09-14T11:56:27.123392+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:08.630914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'267","reported_seq":946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.493854+0000","last_change":"2024-09-14T11:16:07.390362+0000","last_active":"2024-09-14T11:58:47.493854+0000","last_peered":"2024-09-14T11:58:47.493854+0000","last_clean":"2024-09-14T11:58:47.493854+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:47.493854+0000","last_undegraded":"2024-09-14T11:58:47.493854+0000","last_fullsized":"2024-09-14T11:58:47.493854+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":40477,"num_write":1093,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856857+0000","last_change":"2024-09-14T11:15:36.330224+0000","last_active":"2024-09-14T11:54:43.856857+0000","last_peered":"2024-09-14T11:54:43.856857+0000","last_clean":"2024-09-14T11:54:43.856857+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:54:43.856857+0000","last_undegraded":"2024-09-14T11:54:43.856857+0000","last_fullsized":"2024-09-14T11:54:43.856857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.235014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'204","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.407114+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:58:47.407114+0000","last_peered":"2024-09-14T11:58:47.407114+0000","last_clean":"2024-09-14T11:58:47.407114+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:58:47.407114+0000","last_undegraded":"2024-09-14T11:58:47.407114+0000","last_fullsized":"2024-09-14T11:58:47.407114+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:38.723325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":292,"num_read_kb":532,"num_write":152,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.856808+0000","last_change":"2024-09-14T11:15:40.342222+0000","last_active":"2024-09-14T11:54:43.856808+0000","last_peered":"2024-09-14T11:54:43.856808+0000","last_clean":"2024-09-14T11:54:43.856808+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:54:43.856808+0000","last_undegraded":"2024-09-14T11:54:43.856808+0000","last_fullsized":"2024-09-14T11:54:43.856808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:48.145919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'132","reported_seq":645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:54.698739+0000","last_change":"2024-09-14T11:15:42.350823+0000","last_active":"2024-09-14T11:55:54.698739+0000","last_peered":"2024-09-14T11:55:54.698739+0000","last_clean":"2024-09-14T11:55:54.698739+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:55:54.698739+0000","last_undegraded":"2024-09-14T11:55:54.698739+0000","last_fullsized":"2024-09-14T11:55:54.698739+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:46.253700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'485","reported_seq":2086,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321026+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:42.583484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'230","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.472763+0000","last_change":"2024-09-14T11:15:32.318996+0000","last_active":"2024-09-14T11:58:47.472763+0000","last_peered":"2024-09-14T11:58:47.472763+0000","last_clean":"2024-09-14T11:58:47.472763+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:58:47.472763+0000","last_undegraded":"2024-09-14T11:58:47.472763+0000","last_fullsized":"2024-09-14T11:58:47.472763+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:29.686806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":679,"num_read_kb":211577,"num_write":961,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866594+0000","last_change":"2024-09-14T11:15:36.334662+0000","last_active":"2024-09-14T11:56:08.866594+0000","last_peered":"2024-09-14T11:56:08.866594+0000","last_clean":"2024-09-14T11:56:08.866594+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:56:08.866594+0000","last_undegraded":"2024-09-14T11:56:08.866594+0000","last_fullsized":"2024-09-14T11:56:08.866594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.851922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'143","reported_seq":708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.234555+0000","last_change":"2024-09-14T11:15:38.335114+0000","last_active":"2024-09-14T11:58:47.234555+0000","last_peered":"2024-09-14T11:58:47.234555+0000","last_clean":"2024-09-14T11:58:47.234555+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:58:47.234555+0000","last_undegraded":"2024-09-14T11:58:47.234555+0000","last_fullsized":"2024-09-14T11:58:47.234555+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:02.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":279,"num_write":168,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868727+0000","last_change":"2024-09-14T11:15:40.352052+0000","last_active":"2024-09-14T11:56:18.868727+0000","last_peered":"2024-09-14T11:56:18.868727+0000","last_clean":"2024-09-14T11:56:18.868727+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:56:18.868727+0000","last_undegraded":"2024-09-14T11:56:18.868727+0000","last_fullsized":"2024-09-14T11:56:18.868727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:06.160840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'120","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.892807+0000","last_change":"2024-09-14T11:15:42.350884+0000","last_active":"2024-09-14T11:57:53.892807+0000","last_peered":"2024-09-14T11:57:53.892807+0000","last_clean":"2024-09-14T11:57:53.892807+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:57:53.892807+0000","last_undegraded":"2024-09-14T11:57:53.892807+0000","last_fullsized":"2024-09-14T11:57:53.892807+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.299714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'399","reported_seq":2034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.814843+0000","last_change":"2024-09-14T11:15:34.315484+0000","last_active":"2024-09-14T11:56:31.814843+0000","last_peered":"2024-09-14T11:56:31.814843+0000","last_clean":"2024-09-14T11:56:31.814843+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:56:31.814843+0000","last_undegraded":"2024-09-14T11:56:31.814843+0000","last_fullsized":"2024-09-14T11:56:31.814843+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:48.314937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'220","reported_seq":1030,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.288247+0000","last_change":"2024-09-14T11:15:32.316393+0000","last_active":"2024-09-14T11:58:47.288247+0000","last_peered":"2024-09-14T11:58:47.288247+0000","last_clean":"2024-09-14T11:58:47.288247+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:47.288247+0000","last_undegraded":"2024-09-14T11:58:47.288247+0000","last_fullsized":"2024-09-14T11:58:47.288247+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:19.207524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1176,"num_read_kb":14840,"num_write":1005,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872741+0000","last_change":"2024-09-14T11:15:36.331915+0000","last_active":"2024-09-14T11:56:05.872741+0000","last_peered":"2024-09-14T11:56:05.872741+0000","last_clean":"2024-09-14T11:56:05.872741+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:56:05.872741+0000","last_undegraded":"2024-09-14T11:56:05.872741+0000","last_fullsized":"2024-09-14T11:56:05.872741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:44.896969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'163","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.462901+0000","last_change":"2024-09-14T11:15:38.333787+0000","last_active":"2024-09-14T11:58:47.462901+0000","last_peered":"2024-09-14T11:58:47.462901+0000","last_clean":"2024-09-14T11:58:47.462901+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:58:47.462901+0000","last_undegraded":"2024-09-14T11:58:47.462901+0000","last_fullsized":"2024-09-14T11:58:47.462901+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.212849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9189,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":308,"num_write":130,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2518,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.168636+0000","last_change":"2024-09-14T11:15:40.337972+0000","last_active":"2024-09-14T11:58:47.168636+0000","last_peered":"2024-09-14T11:58:47.168636+0000","last_clean":"2024-09-14T11:58:47.168636+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:58:47.168636+0000","last_undegraded":"2024-09-14T11:58:47.168636+0000","last_fullsized":"2024-09-14T11:58:47.168636+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:41.159033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.461101+0000","last_change":"2024-09-14T11:15:42.355458+0000","last_active":"2024-09-14T11:56:38.461101+0000","last_peered":"2024-09-14T11:56:38.461101+0000","last_clean":"2024-09-14T11:56:38.461101+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:56:38.461101+0000","last_undegraded":"2024-09-14T11:56:38.461101+0000","last_fullsized":"2024-09-14T11:56:38.461101+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:20.221336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1221","reported_seq":2786,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530783+0000","last_change":"2024-09-14T11:15:34.321994+0000","last_active":"2024-09-14T11:56:57.530783+0000","last_peered":"2024-09-14T11:56:57.530783+0000","last_clean":"2024-09-14T11:56:57.530783+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:56:57.530783+0000","last_undegraded":"2024-09-14T11:56:57.530783+0000","last_fullsized":"2024-09-14T11:56:57.530783+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.102163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'199","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.414930+0000","last_change":"2024-09-14T11:15:32.310048+0000","last_active":"2024-09-14T11:58:47.414930+0000","last_peered":"2024-09-14T11:58:47.414930+0000","last_clean":"2024-09-14T11:58:47.414930+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:58:47.414930+0000","last_undegraded":"2024-09-14T11:58:47.414930+0000","last_fullsized":"2024-09-14T11:58:47.414930+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":33043,"num_write":876,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.740948+0000","last_change":"2024-09-14T11:15:36.330154+0000","last_active":"2024-09-14T11:58:46.740948+0000","last_peered":"2024-09-14T11:58:46.740948+0000","last_clean":"2024-09-14T11:58:46.740948+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:58:46.740948+0000","last_undegraded":"2024-09-14T11:58:46.740948+0000","last_fullsized":"2024-09-14T11:58:46.740948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":951,"num_read_kb":951,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'89","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.878066+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:56:08.878066+0000","last_peered":"2024-09-14T11:56:08.878066+0000","last_clean":"2024-09-14T11:56:08.878066+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:56:08.878066+0000","last_undegraded":"2024-09-14T11:56:08.878066+0000","last_fullsized":"2024-09-14T11:56:08.878066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.353564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'769","reported_seq":2233,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.169431+0000","last_change":"2024-09-14T11:15:40.344574+0000","last_active":"2024-09-14T11:58:47.169431+0000","last_peered":"2024-09-14T11:58:47.169431+0000","last_clean":"2024-09-14T11:58:47.169431+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:58:47.169431+0000","last_undegraded":"2024-09-14T11:58:47.169431+0000","last_fullsized":"2024-09-14T11:58:47.169431+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:07.380196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'148","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.994130+0000","last_change":"2024-09-14T11:15:42.354665+0000","last_active":"2024-09-14T11:56:36.994130+0000","last_peered":"2024-09-14T11:56:36.994130+0000","last_clean":"2024-09-14T11:56:36.994130+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:56:36.994130+0000","last_undegraded":"2024-09-14T11:56:36.994130+0000","last_fullsized":"2024-09-14T11:56:36.994130+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:56.500802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'422","reported_seq":2140,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992323+0000","last_change":"2024-09-14T11:15:34.335198+0000","last_active":"2024-09-14T11:56:56.992323+0000","last_peered":"2024-09-14T11:56:56.992323+0000","last_clean":"2024-09-14T11:56:56.992323+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:56:56.992323+0000","last_undegraded":"2024-09-14T11:56:56.992323+0000","last_fullsized":"2024-09-14T11:56:56.992323+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:17.261692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'176","reported_seq":782,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.425019+0000","last_change":"2024-09-14T11:15:32.310770+0000","last_active":"2024-09-14T11:58:47.425019+0000","last_peered":"2024-09-14T11:58:47.425019+0000","last_clean":"2024-09-14T11:58:47.425019+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:58:47.425019+0000","last_undegraded":"2024-09-14T11:58:47.425019+0000","last_fullsized":"2024-09-14T11:58:47.425019+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":26947,"num_write":787,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013965+0000","last_change":"2024-09-14T11:15:36.335046+0000","last_active":"2024-09-14T11:56:09.013965+0000","last_peered":"2024-09-14T11:56:09.013965+0000","last_clean":"2024-09-14T11:56:09.013965+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:56:09.013965+0000","last_undegraded":"2024-09-14T11:56:09.013965+0000","last_fullsized":"2024-09-14T11:56:09.013965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:54.481756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'210","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.345467+0000","last_change":"2024-09-14T11:15:38.333929+0000","last_active":"2024-09-14T11:58:47.345467+0000","last_peered":"2024-09-14T11:58:47.345467+0000","last_clean":"2024-09-14T11:58:47.345467+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:58:47.345467+0000","last_undegraded":"2024-09-14T11:58:47.345467+0000","last_fullsized":"2024-09-14T11:58:47.345467+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.403088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":896,"num_read_kb":967,"num_write":1418,"num_write_kb":1294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.958089+0000","last_change":"2024-09-14T11:15:40.349110+0000","last_active":"2024-09-14T11:56:13.958089+0000","last_peered":"2024-09-14T11:56:13.958089+0000","last_clean":"2024-09-14T11:56:13.958089+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:56:13.958089+0000","last_undegraded":"2024-09-14T11:56:13.958089+0000","last_fullsized":"2024-09-14T11:56:13.958089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:33.798885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'145","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.161350+0000","last_change":"2024-09-14T11:15:42.351759+0000","last_active":"2024-09-14T11:55:57.161350+0000","last_peered":"2024-09-14T11:55:57.161350+0000","last_clean":"2024-09-14T11:55:57.161350+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:55:57.161350+0000","last_undegraded":"2024-09-14T11:55:57.161350+0000","last_fullsized":"2024-09-14T11:55:57.161350+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:09.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'800","reported_seq":2315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531202+0000","last_change":"2024-09-14T11:15:34.322606+0000","last_active":"2024-09-14T11:56:57.531202+0000","last_peered":"2024-09-14T11:56:57.531202+0000","last_clean":"2024-09-14T11:56:57.531202+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:56:57.531202+0000","last_undegraded":"2024-09-14T11:56:57.531202+0000","last_fullsized":"2024-09-14T11:56:57.531202+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:47.471242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870764+0000","last_change":"2024-09-14T11:15:15.722374+0000","last_active":"2024-09-14T11:55:23.870764+0000","last_peered":"2024-09-14T11:55:23.870764+0000","last_clean":"2024-09-14T11:55:23.870764+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:55:23.870764+0000","last_undegraded":"2024-09-14T11:55:23.870764+0000","last_fullsized":"2024-09-14T11:55:23.870764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:14.033306+0000","last_clean_scrub_stamp":"2024-09-14T11:15:14.033306+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:20.114027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867317+0000","last_change":"2024-09-14T11:15:23.082390+0000","last_active":"2024-09-14T11:54:58.867317+0000","last_peered":"2024-09-14T11:54:58.867317+0000","last_clean":"2024-09-14T11:54:58.867317+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:54:58.867317+0000","last_undegraded":"2024-09-14T11:54:58.867317+0000","last_fullsized":"2024-09-14T11:54:58.867317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:33.700173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'242","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.815404+0000","last_change":"2024-09-14T11:58:53.815404+0000","last_active":"2024-09-14T11:58:53.815404+0000","last_peered":"2024-09-14T11:58:53.815404+0000","last_clean":"2024-09-14T11:58:53.815404+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:58:53.815404+0000","last_undegraded":"2024-09-14T11:58:53.815404+0000","last_fullsized":"2024-09-14T11:58:53.815404+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'242","last_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_deep_scrub":"262'242","last_deep_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.815334+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:37.358269+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":31904,"num_write":1129,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.869304+0000","last_change":"2024-09-14T11:15:36.333660+0000","last_active":"2024-09-14T11:55:13.869304+0000","last_peered":"2024-09-14T11:55:13.869304+0000","last_clean":"2024-09-14T11:55:13.869304+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:55:13.869304+0000","last_undegraded":"2024-09-14T11:55:13.869304+0000","last_fullsized":"2024-09-14T11:55:13.869304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:23.212696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'305","reported_seq":990,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.448983+0000","last_change":"2024-09-14T11:15:38.335792+0000","last_active":"2024-09-14T11:58:47.448983+0000","last_peered":"2024-09-14T11:58:47.448983+0000","last_clean":"2024-09-14T11:58:47.448983+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:58:47.448983+0000","last_undegraded":"2024-09-14T11:58:47.448983+0000","last_fullsized":"2024-09-14T11:58:47.448983+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:30.822708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36736,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":789,"num_write":500,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.857414+0000","last_change":"2024-09-14T11:15:40.350659+0000","last_active":"2024-09-14T11:54:43.857414+0000","last_peered":"2024-09-14T11:54:43.857414+0000","last_clean":"2024-09-14T11:54:43.857414+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:54:43.857414+0000","last_undegraded":"2024-09-14T11:54:43.857414+0000","last_fullsized":"2024-09-14T11:54:43.857414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:02.205911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'189","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.537414+0000","last_change":"2024-09-14T11:15:42.350534+0000","last_active":"2024-09-14T11:56:57.537414+0000","last_peered":"2024-09-14T11:56:57.537414+0000","last_clean":"2024-09-14T11:56:57.537414+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:56:57.537414+0000","last_undegraded":"2024-09-14T11:56:57.537414+0000","last_fullsized":"2024-09-14T11:56:57.537414+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:58.455641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'494","reported_seq":2045,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.871461+0000","last_change":"2024-09-14T11:15:34.330808+0000","last_active":"2024-09-14T11:56:43.871461+0000","last_peered":"2024-09-14T11:56:43.871461+0000","last_clean":"2024-09-14T11:56:43.871461+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:56:43.871461+0000","last_undegraded":"2024-09-14T11:56:43.871461+0000","last_fullsized":"2024-09-14T11:56:43.871461+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.871431+0000","last_change":"2024-09-14T11:15:23.927708+0000","last_active":"2024-09-14T11:55:28.871431+0000","last_peered":"2024-09-14T11:55:28.871431+0000","last_clean":"2024-09-14T11:55:28.871431+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:55:28.871431+0000","last_undegraded":"2024-09-14T11:55:28.871431+0000","last_fullsized":"2024-09-14T11:55:28.871431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.482495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'197","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.272045+0000","last_change":"2024-09-14T11:58:52.272045+0000","last_active":"2024-09-14T11:58:52.272045+0000","last_peered":"2024-09-14T11:58:52.272045+0000","last_clean":"2024-09-14T11:58:52.272045+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:58:52.272045+0000","last_undegraded":"2024-09-14T11:58:52.272045+0000","last_fullsized":"2024-09-14T11:58:52.272045+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.271906+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:15.088566+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":761,"num_read_kb":134470,"num_write":901,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.864617+0000","last_change":"2024-09-14T11:15:36.329488+0000","last_active":"2024-09-14T11:54:38.864617+0000","last_peered":"2024-09-14T11:54:38.864617+0000","last_clean":"2024-09-14T11:54:38.864617+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:54:38.864617+0000","last_undegraded":"2024-09-14T11:54:38.864617+0000","last_fullsized":"2024-09-14T11:54:38.864617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.992710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'855","reported_seq":2301,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.496094+0000","last_change":"2024-09-14T11:15:38.335641+0000","last_active":"2024-09-14T11:58:47.496094+0000","last_peered":"2024-09-14T11:58:47.496094+0000","last_clean":"2024-09-14T11:58:47.496094+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:58:47.496094+0000","last_undegraded":"2024-09-14T11:58:47.496094+0000","last_fullsized":"2024-09-14T11:58:47.496094+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:31.939839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34835,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1171,"num_read_kb":1364,"num_write":276,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870881+0000","last_change":"2024-09-14T11:15:40.344759+0000","last_active":"2024-09-14T11:55:23.870881+0000","last_peered":"2024-09-14T11:55:23.870881+0000","last_clean":"2024-09-14T11:55:23.870881+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:55:23.870881+0000","last_undegraded":"2024-09-14T11:55:23.870881+0000","last_fullsized":"2024-09-14T11:55:23.870881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.591931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'99","reported_seq":599,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.131967+0000","last_change":"2024-09-14T11:15:42.346979+0000","last_active":"2024-09-14T11:56:39.131967+0000","last_peered":"2024-09-14T11:56:39.131967+0000","last_clean":"2024-09-14T11:56:39.131967+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:56:39.131967+0000","last_undegraded":"2024-09-14T11:56:39.131967+0000","last_fullsized":"2024-09-14T11:56:39.131967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:56.582504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'537","reported_seq":2057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.982239+0000","last_change":"2024-09-14T11:15:34.328947+0000","last_active":"2024-09-14T11:56:56.982239+0000","last_peered":"2024-09-14T11:56:56.982239+0000","last_clean":"2024-09-14T11:56:56.982239+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:56:56.982239+0000","last_undegraded":"2024-09-14T11:56:56.982239+0000","last_fullsized":"2024-09-14T11:56:56.982239+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:22.306344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.235819+0000","last_change":"2024-09-14T11:58:53.235819+0000","last_active":"2024-09-14T11:58:53.235819+0000","last_peered":"2024-09-14T11:58:53.235819+0000","last_clean":"2024-09-14T11:58:53.235819+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:58:53.235819+0000","last_undegraded":"2024-09-14T11:58:53.235819+0000","last_fullsized":"2024-09-14T11:58:53.235819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.235741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:53.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'175","reported_seq":768,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.415344+0000","last_change":"2024-09-14T11:15:32.308521+0000","last_active":"2024-09-14T11:58:47.415344+0000","last_peered":"2024-09-14T11:58:47.415344+0000","last_clean":"2024-09-14T11:58:47.415344+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:58:47.415344+0000","last_undegraded":"2024-09-14T11:58:47.415344+0000","last_fullsized":"2024-09-14T11:58:47.415344+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.589077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":27621,"num_write":841,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.856296+0000","last_change":"2024-09-14T11:15:36.322255+0000","last_active":"2024-09-14T11:54:38.856296+0000","last_peered":"2024-09-14T11:54:38.856296+0000","last_clean":"2024-09-14T11:54:38.856296+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:54:38.856296+0000","last_undegraded":"2024-09-14T11:54:38.856296+0000","last_fullsized":"2024-09-14T11:54:38.856296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:41.156825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'213","reported_seq":1266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842747+0000","last_change":"2024-09-14T11:15:38.338714+0000","last_active":"2024-09-14T11:58:15.842747+0000","last_peered":"2024-09-14T11:58:15.842747+0000","last_clean":"2024-09-14T11:58:15.842747+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:58:15.842747+0000","last_undegraded":"2024-09-14T11:58:15.842747+0000","last_fullsized":"2024-09-14T11:58:15.842747+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:12.349920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861300+0000","last_change":"2024-09-14T11:15:40.351390+0000","last_active":"2024-09-14T11:55:18.861300+0000","last_peered":"2024-09-14T11:55:18.861300+0000","last_clean":"2024-09-14T11:55:18.861300+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:55:18.861300+0000","last_undegraded":"2024-09-14T11:55:18.861300+0000","last_fullsized":"2024-09-14T11:55:18.861300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.483392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'280","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.803304+0000","last_change":"2024-09-14T11:15:42.351361+0000","last_active":"2024-09-14T11:58:15.803304+0000","last_peered":"2024-09-14T11:58:15.803304+0000","last_clean":"2024-09-14T11:58:15.803304+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:58:15.803304+0000","last_undegraded":"2024-09-14T11:58:15.803304+0000","last_fullsized":"2024-09-14T11:58:15.803304+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'555","reported_seq":2127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.371131+0000","last_change":"2024-09-14T11:15:34.326991+0000","last_active":"2024-09-14T11:56:34.371131+0000","last_peered":"2024-09-14T11:56:34.371131+0000","last_clean":"2024-09-14T11:56:34.371131+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:56:34.371131+0000","last_undegraded":"2024-09-14T11:56:34.371131+0000","last_fullsized":"2024-09-14T11:56:34.371131+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:01.433893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867284+0000","last_change":"2024-09-14T11:15:23.082813+0000","last_active":"2024-09-14T11:54:58.867284+0000","last_peered":"2024-09-14T11:54:58.867284+0000","last_clean":"2024-09-14T11:54:58.867284+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:54:58.867284+0000","last_undegraded":"2024-09-14T11:54:58.867284+0000","last_fullsized":"2024-09-14T11:54:58.867284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:09.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'213","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.393731+0000","last_change":"2024-09-14T11:15:32.304267+0000","last_active":"2024-09-14T11:58:47.393731+0000","last_peered":"2024-09-14T11:58:47.393731+0000","last_clean":"2024-09-14T11:58:47.393731+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:58:47.393731+0000","last_undegraded":"2024-09-14T11:58:47.393731+0000","last_fullsized":"2024-09-14T11:58:47.393731+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:11.058375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":21127,"num_write":1026,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861326+0000","last_change":"2024-09-14T11:15:36.327923+0000","last_active":"2024-09-14T11:55:18.861326+0000","last_peered":"2024-09-14T11:55:18.861326+0000","last_clean":"2024-09-14T11:55:18.861326+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:55:18.861326+0000","last_undegraded":"2024-09-14T11:55:18.861326+0000","last_fullsized":"2024-09-14T11:55:18.861326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:19.678938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'124","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.882670+0000","last_change":"2024-09-14T11:15:38.340290+0000","last_active":"2024-09-14T11:56:48.882670+0000","last_peered":"2024-09-14T11:56:48.882670+0000","last_clean":"2024-09-14T11:56:48.882670+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:56:48.882670+0000","last_undegraded":"2024-09-14T11:56:48.882670+0000","last_fullsized":"2024-09-14T11:56:48.882670+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:51.345233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.946533+0000","last_change":"2024-09-14T11:15:40.343946+0000","last_active":"2024-09-14T11:54:43.946533+0000","last_peered":"2024-09-14T11:54:43.946533+0000","last_clean":"2024-09-14T11:54:43.946533+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:54:43.946533+0000","last_undegraded":"2024-09-14T11:54:43.946533+0000","last_fullsized":"2024-09-14T11:54:43.946533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.497566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'166","reported_seq":727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.995883+0000","last_change":"2024-09-14T11:15:42.351795+0000","last_active":"2024-09-14T11:56:36.995883+0000","last_peered":"2024-09-14T11:56:36.995883+0000","last_clean":"2024-09-14T11:56:36.995883+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:56:36.995883+0000","last_undegraded":"2024-09-14T11:56:36.995883+0000","last_fullsized":"2024-09-14T11:56:36.995883+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:00.523427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'890","reported_seq":2625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531193+0000","last_change":"2024-09-14T11:15:34.330814+0000","last_active":"2024-09-14T11:56:57.531193+0000","last_peered":"2024-09-14T11:56:57.531193+0000","last_clean":"2024-09-14T11:56:57.531193+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:56:57.531193+0000","last_undegraded":"2024-09-14T11:56:57.531193+0000","last_fullsized":"2024-09-14T11:56:57.531193+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:26.576464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'213","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.422146+0000","last_change":"2024-09-14T11:15:32.322181+0000","last_active":"2024-09-14T11:58:47.422146+0000","last_peered":"2024-09-14T11:58:47.422146+0000","last_clean":"2024-09-14T11:58:47.422146+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:58:47.422146+0000","last_undegraded":"2024-09-14T11:58:47.422146+0000","last_fullsized":"2024-09-14T11:58:47.422146+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:25.998267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146072,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":7241,"num_write":969,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863547+0000","last_change":"2024-09-14T11:15:23.085013+0000","last_active":"2024-09-14T11:54:55.863547+0000","last_peered":"2024-09-14T11:54:55.863547+0000","last_clean":"2024-09-14T11:54:55.863547+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:54:55.863547+0000","last_undegraded":"2024-09-14T11:54:55.863547+0000","last_fullsized":"2024-09-14T11:54:55.863547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:25.505724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.860745+0000","last_change":"2024-09-14T11:15:36.327557+0000","last_active":"2024-09-14T11:55:13.860745+0000","last_peered":"2024-09-14T11:55:13.860745+0000","last_clean":"2024-09-14T11:55:13.860745+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:55:13.860745+0000","last_undegraded":"2024-09-14T11:55:13.860745+0000","last_fullsized":"2024-09-14T11:55:13.860745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:46.694330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'270","reported_seq":920,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.455071+0000","last_change":"2024-09-14T11:15:38.333171+0000","last_active":"2024-09-14T11:58:47.455071+0000","last_peered":"2024-09-14T11:58:47.455071+0000","last_clean":"2024-09-14T11:58:47.455071+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:58:47.455071+0000","last_undegraded":"2024-09-14T11:58:47.455071+0000","last_fullsized":"2024-09-14T11:58:47.455071+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:45.638370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16117,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":365,"num_read_kb":486,"num_write":204,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.007091+0000","last_change":"2024-09-14T11:15:40.348810+0000","last_active":"2024-09-14T11:55:19.007091+0000","last_peered":"2024-09-14T11:55:19.007091+0000","last_clean":"2024-09-14T11:55:19.007091+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:55:19.007091+0000","last_undegraded":"2024-09-14T11:55:19.007091+0000","last_fullsized":"2024-09-14T11:55:19.007091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:45.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'169","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.464163+0000","last_change":"2024-09-14T11:15:42.354465+0000","last_active":"2024-09-14T11:58:14.464163+0000","last_peered":"2024-09-14T11:58:14.464163+0000","last_clean":"2024-09-14T11:58:14.464163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:58:14.464163+0000","last_undegraded":"2024-09-14T11:58:14.464163+0000","last_fullsized":"2024-09-14T11:58:14.464163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:00.902965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'771","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.531136+0000","last_change":"2024-09-14T11:15:34.328838+0000","last_active":"2024-09-14T11:56:57.531136+0000","last_peered":"2024-09-14T11:56:57.531136+0000","last_clean":"2024-09-14T11:56:57.531136+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:56:57.531136+0000","last_undegraded":"2024-09-14T11:56:57.531136+0000","last_fullsized":"2024-09-14T11:56:57.531136+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:06.220137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'265","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.422734+0000","last_change":"2024-09-14T11:15:32.309908+0000","last_active":"2024-09-14T11:58:47.422734+0000","last_peered":"2024-09-14T11:58:47.422734+0000","last_clean":"2024-09-14T11:58:47.422734+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:58:47.422734+0000","last_undegraded":"2024-09-14T11:58:47.422734+0000","last_fullsized":"2024-09-14T11:58:47.422734+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:42.117912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":40043,"num_write":1045,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867981+0000","last_change":"2024-09-14T11:15:23.927653+0000","last_active":"2024-09-14T11:55:03.867981+0000","last_peered":"2024-09-14T11:55:03.867981+0000","last_clean":"2024-09-14T11:55:03.867981+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:55:03.867981+0000","last_undegraded":"2024-09-14T11:55:03.867981+0000","last_fullsized":"2024-09-14T11:55:03.867981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:15.013876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"36'4","reported_seq":964,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.728648+0000","last_change":"2024-09-14T11:15:36.327972+0000","last_active":"2024-09-14T11:58:46.728648+0000","last_peered":"2024-09-14T11:58:46.728648+0000","last_clean":"2024-09-14T11:58:46.728648+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:58:46.728648+0000","last_undegraded":"2024-09-14T11:58:46.728648+0000","last_fullsized":"2024-09-14T11:58:46.728648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:19.046696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'167","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.919058+0000","last_change":"2024-09-14T11:15:38.327367+0000","last_active":"2024-09-14T11:57:15.919058+0000","last_peered":"2024-09-14T11:57:15.919058+0000","last_clean":"2024-09-14T11:57:15.919058+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:57:15.919058+0000","last_undegraded":"2024-09-14T11:57:15.919058+0000","last_fullsized":"2024-09-14T11:57:15.919058+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:37.848547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'799","reported_seq":4699,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.422533+0000","last_change":"2024-09-14T11:15:40.337171+0000","last_active":"2024-09-14T11:58:47.422533+0000","last_peered":"2024-09-14T11:58:47.422533+0000","last_clean":"2024-09-14T11:58:47.422533+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:58:47.422533+0000","last_undegraded":"2024-09-14T11:58:47.422533+0000","last_fullsized":"2024-09-14T11:58:47.422533+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.203863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'132","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.805016+0000","last_change":"2024-09-14T11:15:42.349144+0000","last_active":"2024-09-14T11:58:15.805016+0000","last_peered":"2024-09-14T11:58:15.805016+0000","last_clean":"2024-09-14T11:58:15.805016+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:58:15.805016+0000","last_undegraded":"2024-09-14T11:58:15.805016+0000","last_fullsized":"2024-09-14T11:58:15.805016+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:09.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'891","reported_seq":2471,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.891391+0000","last_change":"2024-09-14T11:15:34.334008+0000","last_active":"2024-09-14T11:57:43.891391+0000","last_peered":"2024-09-14T11:57:43.891391+0000","last_clean":"2024-09-14T11:57:43.891391+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:57:43.891391+0000","last_undegraded":"2024-09-14T11:57:43.891391+0000","last_fullsized":"2024-09-14T11:57:43.891391+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:23.699506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'242","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.472334+0000","last_change":"2024-09-14T11:15:32.315658+0000","last_active":"2024-09-14T11:58:47.472334+0000","last_peered":"2024-09-14T11:58:47.472334+0000","last_clean":"2024-09-14T11:58:47.472334+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:58:47.472334+0000","last_undegraded":"2024-09-14T11:58:47.472334+0000","last_fullsized":"2024-09-14T11:58:47.472334+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460231,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":25317,"num_write":1130,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.875825+0000","last_change":"2024-09-14T11:15:23.084925+0000","last_active":"2024-09-14T11:56:30.875825+0000","last_peered":"2024-09-14T11:56:30.875825+0000","last_clean":"2024-09-14T11:56:30.875825+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:56:30.875825+0000","last_undegraded":"2024-09-14T11:56:30.875825+0000","last_fullsized":"2024-09-14T11:56:30.875825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.357227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:14.006501+0000","last_change":"2024-09-14T11:15:36.331117+0000","last_active":"2024-09-14T11:55:14.006501+0000","last_peered":"2024-09-14T11:55:14.006501+0000","last_clean":"2024-09-14T11:55:14.006501+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:55:14.006501+0000","last_undegraded":"2024-09-14T11:55:14.006501+0000","last_fullsized":"2024-09-14T11:55:14.006501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:51.839727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'111","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.942678+0000","last_change":"2024-09-14T11:15:38.337313+0000","last_active":"2024-09-14T11:56:30.942678+0000","last_peered":"2024-09-14T11:56:30.942678+0000","last_clean":"2024-09-14T11:56:30.942678+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:56:30.942678+0000","last_undegraded":"2024-09-14T11:56:30.942678+0000","last_fullsized":"2024-09-14T11:56:30.942678+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:15.549271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'812","reported_seq":2430,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.172424+0000","last_change":"2024-09-14T11:15:40.353831+0000","last_active":"2024-09-14T11:58:47.172424+0000","last_peered":"2024-09-14T11:58:47.172424+0000","last_clean":"2024-09-14T11:58:47.172424+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:58:47.172424+0000","last_undegraded":"2024-09-14T11:58:47.172424+0000","last_fullsized":"2024-09-14T11:58:47.172424+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:41.935731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'282","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.867897+0000","last_change":"2024-09-14T11:15:42.349524+0000","last_active":"2024-09-14T11:56:13.867897+0000","last_peered":"2024-09-14T11:56:13.867897+0000","last_clean":"2024-09-14T11:56:13.867897+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:56:13.867897+0000","last_undegraded":"2024-09-14T11:56:13.867897+0000","last_fullsized":"2024-09-14T11:56:13.867897+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:39.795329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'401","reported_seq":1934,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.882633+0000","last_change":"2024-09-14T11:15:34.326976+0000","last_active":"2024-09-14T11:56:54.882633+0000","last_peered":"2024-09-14T11:56:54.882633+0000","last_clean":"2024-09-14T11:56:54.882633+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:56:54.882633+0000","last_undegraded":"2024-09-14T11:56:54.882633+0000","last_fullsized":"2024-09-14T11:56:54.882633+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:16.837130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'220","reported_seq":847,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.306793+0000","last_change":"2024-09-14T11:58:53.306687+0000","last_active":"2024-09-14T11:58:53.306793+0000","last_peered":"2024-09-14T11:58:53.306793+0000","last_clean":"2024-09-14T11:58:53.306793+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:58:53.306793+0000","last_undegraded":"2024-09-14T11:58:53.306793+0000","last_fullsized":"2024-09-14T11:58:53.306793+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.306580+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.561679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":11363,"num_write":1017,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.960844+0000","last_change":"2024-09-14T11:15:23.927661+0000","last_active":"2024-09-14T11:56:33.960844+0000","last_peered":"2024-09-14T11:56:33.960844+0000","last_clean":"2024-09-14T11:56:33.960844+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:56:33.960844+0000","last_undegraded":"2024-09-14T11:56:33.960844+0000","last_fullsized":"2024-09-14T11:56:33.960844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:20.052341+0000","last_clean_scrub_stamp":"2024-09-14T11:15:20.052341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:47.701947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875423+0000","last_change":"2024-09-14T11:15:36.331051+0000","last_active":"2024-09-14T11:55:48.875423+0000","last_peered":"2024-09-14T11:55:48.875423+0000","last_clean":"2024-09-14T11:55:48.875423+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:55:48.875423+0000","last_undegraded":"2024-09-14T11:55:48.875423+0000","last_fullsized":"2024-09-14T11:55:48.875423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:18.610941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'307","reported_seq":1012,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.322304+0000","last_change":"2024-09-14T11:15:38.337405+0000","last_active":"2024-09-14T11:58:47.322304+0000","last_peered":"2024-09-14T11:58:47.322304+0000","last_clean":"2024-09-14T11:58:47.322304+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:58:47.322304+0000","last_undegraded":"2024-09-14T11:58:47.322304+0000","last_fullsized":"2024-09-14T11:58:47.322304+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:37.729796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":677,"num_write":230,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870986+0000","last_change":"2024-09-14T11:15:40.349294+0000","last_active":"2024-09-14T11:55:18.870986+0000","last_peered":"2024-09-14T11:55:18.870986+0000","last_clean":"2024-09-14T11:55:18.870986+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:55:18.870986+0000","last_undegraded":"2024-09-14T11:55:18.870986+0000","last_fullsized":"2024-09-14T11:55:18.870986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:06.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'134","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.668467+0000","last_change":"2024-09-14T11:15:42.351815+0000","last_active":"2024-09-14T11:56:19.668467+0000","last_peered":"2024-09-14T11:56:19.668467+0000","last_clean":"2024-09-14T11:56:19.668467+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:56:19.668467+0000","last_undegraded":"2024-09-14T11:56:19.668467+0000","last_fullsized":"2024-09-14T11:56:19.668467+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:31.950118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'146","reported_seq":688,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.639329+0000","last_change":"2024-09-14T11:15:42.348937+0000","last_active":"2024-09-14T11:56:57.639329+0000","last_peered":"2024-09-14T11:56:57.639329+0000","last_clean":"2024-09-14T11:56:57.639329+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:56:57.639329+0000","last_undegraded":"2024-09-14T11:56:57.639329+0000","last_fullsized":"2024-09-14T11:56:57.639329+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'563","reported_seq":2425,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.458556+0000","last_change":"2024-09-14T11:15:34.319146+0000","last_active":"2024-09-14T11:58:14.458556+0000","last_peered":"2024-09-14T11:58:14.458556+0000","last_clean":"2024-09-14T11:58:14.458556+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:58:14.458556+0000","last_undegraded":"2024-09-14T11:58:14.458556+0000","last_fullsized":"2024-09-14T11:58:14.458556+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:44.411480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'202","reported_seq":811,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.360166+0000","last_change":"2024-09-14T11:15:32.313281+0000","last_active":"2024-09-14T11:58:47.360166+0000","last_peered":"2024-09-14T11:58:47.360166+0000","last_clean":"2024-09-14T11:58:47.360166+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:58:47.360166+0000","last_undegraded":"2024-09-14T11:58:47.360166+0000","last_fullsized":"2024-09-14T11:58:47.360166+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:47.748935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":19870,"num_write":904,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866061+0000","last_change":"2024-09-14T11:15:36.335097+0000","last_active":"2024-09-14T11:55:15.866061+0000","last_peered":"2024-09-14T11:55:15.866061+0000","last_clean":"2024-09-14T11:55:15.866061+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:55:15.866061+0000","last_undegraded":"2024-09-14T11:55:15.866061+0000","last_fullsized":"2024-09-14T11:55:15.866061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:16.648545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'157","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.378867+0000","last_change":"2024-09-14T11:15:38.334700+0000","last_active":"2024-09-14T11:58:47.378867+0000","last_peered":"2024-09-14T11:58:47.378867+0000","last_clean":"2024-09-14T11:58:47.378867+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:58:47.378867+0000","last_undegraded":"2024-09-14T11:58:47.378867+0000","last_fullsized":"2024-09-14T11:58:47.378867+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:17.379507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":267,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.871577+0000","last_change":"2024-09-14T11:15:40.349844+0000","last_active":"2024-09-14T11:55:23.871577+0000","last_peered":"2024-09-14T11:55:23.871577+0000","last_clean":"2024-09-14T11:55:23.871577+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:55:23.871577+0000","last_undegraded":"2024-09-14T11:55:23.871577+0000","last_fullsized":"2024-09-14T11:55:23.871577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:12.340019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.002060+0000","last_change":"2024-09-14T11:15:42.351873+0000","last_active":"2024-09-14T11:56:57.002060+0000","last_peered":"2024-09-14T11:56:57.002060+0000","last_clean":"2024-09-14T11:56:57.002060+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:56:57.002060+0000","last_undegraded":"2024-09-14T11:56:57.002060+0000","last_fullsized":"2024-09-14T11:56:57.002060+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.030349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1370","reported_seq":3005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.687050+0000","last_change":"2024-09-14T11:15:34.330128+0000","last_active":"2024-09-14T11:56:35.687050+0000","last_peered":"2024-09-14T11:56:35.687050+0000","last_clean":"2024-09-14T11:56:35.687050+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:56:35.687050+0000","last_undegraded":"2024-09-14T11:56:35.687050+0000","last_fullsized":"2024-09-14T11:56:35.687050+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.528231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'175","reported_seq":766,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.469286+0000","last_change":"2024-09-14T11:15:32.321575+0000","last_active":"2024-09-14T11:58:47.469286+0000","last_peered":"2024-09-14T11:58:47.469286+0000","last_clean":"2024-09-14T11:58:47.469286+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:58:47.469286+0000","last_undegraded":"2024-09-14T11:58:47.469286+0000","last_fullsized":"2024-09-14T11:58:47.469286+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:37.366540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":363,"num_read_kb":34037,"num_write":744,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.871010+0000","last_change":"2024-09-14T11:15:36.330880+0000","last_active":"2024-09-14T11:55:18.871010+0000","last_peered":"2024-09-14T11:55:18.871010+0000","last_clean":"2024-09-14T11:55:18.871010+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:55:18.871010+0000","last_undegraded":"2024-09-14T11:55:18.871010+0000","last_fullsized":"2024-09-14T11:55:18.871010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:31.962906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'43","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.223600+0000","last_change":"2024-09-14T11:15:38.332435+0000","last_active":"2024-09-14T11:56:30.223600+0000","last_peered":"2024-09-14T11:56:30.223600+0000","last_clean":"2024-09-14T11:56:30.223600+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:56:30.223600+0000","last_undegraded":"2024-09-14T11:56:30.223600+0000","last_fullsized":"2024-09-14T11:56:30.223600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:58.253268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870821+0000","last_change":"2024-09-14T11:15:40.344174+0000","last_active":"2024-09-14T11:55:23.870821+0000","last_peered":"2024-09-14T11:55:23.870821+0000","last_clean":"2024-09-14T11:55:23.870821+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:55:23.870821+0000","last_undegraded":"2024-09-14T11:55:23.870821+0000","last_fullsized":"2024-09-14T11:55:23.870821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:53.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'215","reported_seq":729,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.995205+0000","last_change":"2024-09-14T11:15:42.348738+0000","last_active":"2024-09-14T11:56:56.995205+0000","last_peered":"2024-09-14T11:56:56.995205+0000","last_clean":"2024-09-14T11:56:56.995205+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:56:56.995205+0000","last_undegraded":"2024-09-14T11:56:56.995205+0000","last_fullsized":"2024-09-14T11:56:56.995205+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:07.647856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'455","reported_seq":1989,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.674512+0000","last_change":"2024-09-14T11:15:34.322075+0000","last_active":"2024-09-14T11:56:19.674512+0000","last_peered":"2024-09-14T11:56:19.674512+0000","last_clean":"2024-09-14T11:56:19.674512+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:56:19.674512+0000","last_undegraded":"2024-09-14T11:56:19.674512+0000","last_fullsized":"2024-09-14T11:56:19.674512+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:01.128060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'355","reported_seq":999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.467888+0000","last_change":"2024-09-14T11:16:07.497232+0000","last_active":"2024-09-14T11:58:47.467888+0000","last_peered":"2024-09-14T11:58:47.467888+0000","last_clean":"2024-09-14T11:58:47.467888+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:58:47.467888+0000","last_undegraded":"2024-09-14T11:58:47.467888+0000","last_fullsized":"2024-09-14T11:58:47.467888+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:57.221580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":986,"num_read_kb":18905,"num_write":1307,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870031+0000","last_change":"2024-09-14T11:15:36.339369+0000","last_active":"2024-09-14T11:55:18.870031+0000","last_peered":"2024-09-14T11:55:18.870031+0000","last_clean":"2024-09-14T11:55:18.870031+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:55:18.870031+0000","last_undegraded":"2024-09-14T11:55:18.870031+0000","last_fullsized":"2024-09-14T11:55:18.870031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:43.628492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'159","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.279891+0000","last_change":"2024-09-14T11:15:38.334637+0000","last_active":"2024-09-14T11:58:47.279891+0000","last_peered":"2024-09-14T11:58:47.279891+0000","last_clean":"2024-09-14T11:58:47.279891+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:58:47.279891+0000","last_undegraded":"2024-09-14T11:58:47.279891+0000","last_fullsized":"2024-09-14T11:58:47.279891+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:56.809543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":270,"num_write":114,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951144+0000","last_change":"2024-09-14T11:15:40.343098+0000","last_active":"2024-09-14T11:55:23.951144+0000","last_peered":"2024-09-14T11:55:23.951144+0000","last_clean":"2024-09-14T11:55:23.951144+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:55:23.951144+0000","last_undegraded":"2024-09-14T11:55:23.951144+0000","last_fullsized":"2024-09-14T11:55:23.951144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.732839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'115","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.989039+0000","last_change":"2024-09-14T11:15:42.348868+0000","last_active":"2024-09-14T11:56:56.989039+0000","last_peered":"2024-09-14T11:56:56.989039+0000","last_clean":"2024-09-14T11:56:56.989039+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:56:56.989039+0000","last_undegraded":"2024-09-14T11:56:56.989039+0000","last_fullsized":"2024-09-14T11:56:56.989039+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.040910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'810","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.890119+0000","last_change":"2024-09-14T11:15:34.332878+0000","last_active":"2024-09-14T11:57:33.890119+0000","last_peered":"2024-09-14T11:57:33.890119+0000","last_clean":"2024-09-14T11:57:33.890119+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:57:33.890119+0000","last_undegraded":"2024-09-14T11:57:33.890119+0000","last_fullsized":"2024-09-14T11:57:33.890119+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:47.822581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'260","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.870882+0000","last_change":"2024-09-14T11:15:32.313576+0000","last_active":"2024-09-14T11:56:38.870882+0000","last_peered":"2024-09-14T11:56:38.870882+0000","last_clean":"2024-09-14T11:56:38.870882+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:56:38.870882+0000","last_undegraded":"2024-09-14T11:56:38.870882+0000","last_fullsized":"2024-09-14T11:56:38.870882+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:01.256758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730159,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":14443,"num_write":1155,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.950374+0000","last_change":"2024-09-14T11:15:36.330819+0000","last_active":"2024-09-14T11:55:18.950374+0000","last_peered":"2024-09-14T11:55:18.950374+0000","last_clean":"2024-09-14T11:55:18.950374+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:55:18.950374+0000","last_undegraded":"2024-09-14T11:55:18.950374+0000","last_fullsized":"2024-09-14T11:55:18.950374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:42.392337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'136","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.257763+0000","last_change":"2024-09-14T11:15:38.338705+0000","last_active":"2024-09-14T11:58:47.257763+0000","last_peered":"2024-09-14T11:58:47.257763+0000","last_clean":"2024-09-14T11:58:47.257763+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:58:47.257763+0000","last_undegraded":"2024-09-14T11:58:47.257763+0000","last_fullsized":"2024-09-14T11:58:47.257763+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:13.916538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44743,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":353,"num_write":106,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861871+0000","last_change":"2024-09-14T11:15:40.351822+0000","last_active":"2024-09-14T11:55:23.861871+0000","last_peered":"2024-09-14T11:55:23.861871+0000","last_clean":"2024-09-14T11:55:23.861871+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:55:23.861871+0000","last_undegraded":"2024-09-14T11:55:23.861871+0000","last_fullsized":"2024-09-14T11:55:23.861871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'849","reported_seq":2468,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.966335+0000","last_change":"2024-09-14T11:15:34.327038+0000","last_active":"2024-09-14T11:57:13.966335+0000","last_peered":"2024-09-14T11:57:13.966335+0000","last_clean":"2024-09-14T11:57:13.966335+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:57:13.966335+0000","last_undegraded":"2024-09-14T11:57:13.966335+0000","last_fullsized":"2024-09-14T11:57:13.966335+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:27.678371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'200","reported_seq":799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.469705+0000","last_change":"2024-09-14T11:15:32.318761+0000","last_active":"2024-09-14T11:58:47.469705+0000","last_peered":"2024-09-14T11:58:47.469705+0000","last_clean":"2024-09-14T11:58:47.469705+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:58:47.469705+0000","last_undegraded":"2024-09-14T11:58:47.469705+0000","last_fullsized":"2024-09-14T11:58:47.469705+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:06.906697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":38166,"num_write":911,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864502+0000","last_change":"2024-09-14T11:15:36.334440+0000","last_active":"2024-09-14T11:55:43.864502+0000","last_peered":"2024-09-14T11:55:43.864502+0000","last_clean":"2024-09-14T11:55:43.864502+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:55:43.864502+0000","last_undegraded":"2024-09-14T11:55:43.864502+0000","last_fullsized":"2024-09-14T11:55:43.864502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:33.779211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'199","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.439653+0000","last_change":"2024-09-14T11:15:38.334848+0000","last_active":"2024-09-14T11:58:47.439653+0000","last_peered":"2024-09-14T11:58:47.439653+0000","last_clean":"2024-09-14T11:58:47.439653+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:58:47.439653+0000","last_undegraded":"2024-09-14T11:58:47.439653+0000","last_fullsized":"2024-09-14T11:58:47.439653+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14688,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":397,"num_write":180,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.873860+0000","last_change":"2024-09-14T11:15:40.348746+0000","last_active":"2024-09-14T11:55:43.873860+0000","last_peered":"2024-09-14T11:55:43.873860+0000","last_clean":"2024-09-14T11:55:43.873860+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:55:43.873860+0000","last_undegraded":"2024-09-14T11:55:43.873860+0000","last_fullsized":"2024-09-14T11:55:43.873860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:48.113026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'159","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.879691+0000","last_change":"2024-09-14T11:15:42.352372+0000","last_active":"2024-09-14T11:55:59.879691+0000","last_peered":"2024-09-14T11:55:59.879691+0000","last_clean":"2024-09-14T11:55:59.879691+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:55:59.879691+0000","last_undegraded":"2024-09-14T11:55:59.879691+0000","last_fullsized":"2024-09-14T11:55:59.879691+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:49.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":1996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530068+0000","last_change":"2024-09-14T11:15:34.318828+0000","last_active":"2024-09-14T11:56:57.530068+0000","last_peered":"2024-09-14T11:56:57.530068+0000","last_clean":"2024-09-14T11:56:57.530068+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:56:57.530068+0000","last_undegraded":"2024-09-14T11:56:57.530068+0000","last_fullsized":"2024-09-14T11:56:57.530068+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:26.298183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'226","reported_seq":863,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.446335+0000","last_change":"2024-09-14T11:15:32.312194+0000","last_active":"2024-09-14T11:58:47.446335+0000","last_peered":"2024-09-14T11:58:47.446335+0000","last_clean":"2024-09-14T11:58:47.446335+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:58:47.446335+0000","last_undegraded":"2024-09-14T11:58:47.446335+0000","last_fullsized":"2024-09-14T11:58:47.446335+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.459882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":613,"num_read_kb":11802,"num_write":1015,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.949977+0000","last_change":"2024-09-14T11:15:36.330927+0000","last_active":"2024-09-14T11:55:13.949977+0000","last_peered":"2024-09-14T11:55:13.949977+0000","last_clean":"2024-09-14T11:55:13.949977+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:55:13.949977+0000","last_undegraded":"2024-09-14T11:55:13.949977+0000","last_fullsized":"2024-09-14T11:55:13.949977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:56.526006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'157","reported_seq":728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.263292+0000","last_change":"2024-09-14T11:15:38.341444+0000","last_active":"2024-09-14T11:58:47.263292+0000","last_peered":"2024-09-14T11:58:47.263292+0000","last_clean":"2024-09-14T11:58:47.263292+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:58:47.263292+0000","last_undegraded":"2024-09-14T11:58:47.263292+0000","last_fullsized":"2024-09-14T11:58:47.263292+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:11.384017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":272,"num_write":132,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869587+0000","last_change":"2024-09-14T11:15:40.346858+0000","last_active":"2024-09-14T11:55:40.869587+0000","last_peered":"2024-09-14T11:55:40.869587+0000","last_clean":"2024-09-14T11:55:40.869587+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:55:40.869587+0000","last_undegraded":"2024-09-14T11:55:40.869587+0000","last_fullsized":"2024-09-14T11:55:40.869587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:12.423799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'255","reported_seq":1118,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.480297+0000","last_change":"2024-09-14T11:15:42.347978+0000","last_active":"2024-09-14T11:56:55.480297+0000","last_peered":"2024-09-14T11:56:55.480297+0000","last_clean":"2024-09-14T11:56:55.480297+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:56:55.480297+0000","last_undegraded":"2024-09-14T11:56:55.480297+0000","last_fullsized":"2024-09-14T11:56:55.480297+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:59.600834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'851","reported_seq":2419,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518009+0000","last_change":"2024-09-14T11:15:34.327867+0000","last_active":"2024-09-14T11:56:33.518009+0000","last_peered":"2024-09-14T11:56:33.518009+0000","last_clean":"2024-09-14T11:56:33.518009+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:56:33.518009+0000","last_undegraded":"2024-09-14T11:56:33.518009+0000","last_fullsized":"2024-09-14T11:56:33.518009+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:01.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'194","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.009084+0000","last_change":"2024-09-14T11:15:32.312185+0000","last_active":"2024-09-14T11:55:34.009084+0000","last_peered":"2024-09-14T11:55:34.009084+0000","last_clean":"2024-09-14T11:55:34.009084+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:55:34.009084+0000","last_undegraded":"2024-09-14T11:55:34.009084+0000","last_fullsized":"2024-09-14T11:55:34.009084+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:40.741870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.009957+0000","last_change":"2024-09-14T11:15:36.330057+0000","last_active":"2024-09-14T11:55:39.009957+0000","last_peered":"2024-09-14T11:55:39.009957+0000","last_clean":"2024-09-14T11:55:39.009957+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:55:39.009957+0000","last_undegraded":"2024-09-14T11:55:39.009957+0000","last_fullsized":"2024-09-14T11:55:39.009957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.691223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'131","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.416509+0000","last_change":"2024-09-14T11:15:38.336865+0000","last_active":"2024-09-14T11:58:47.416509+0000","last_peered":"2024-09-14T11:58:47.416509+0000","last_clean":"2024-09-14T11:58:47.416509+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:58:47.416509+0000","last_undegraded":"2024-09-14T11:58:47.416509+0000","last_fullsized":"2024-09-14T11:58:47.416509+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:20.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":266,"num_write":100,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870237+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:55:45.870237+0000","last_peered":"2024-09-14T11:55:45.870237+0000","last_clean":"2024-09-14T11:55:45.870237+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:55:45.870237+0000","last_undegraded":"2024-09-14T11:55:45.870237+0000","last_fullsized":"2024-09-14T11:55:45.870237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.612855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'145","reported_seq":635,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801285+0000","last_change":"2024-09-14T11:15:42.348516+0000","last_active":"2024-09-14T11:58:15.801285+0000","last_peered":"2024-09-14T11:58:15.801285+0000","last_clean":"2024-09-14T11:58:15.801285+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:58:15.801285+0000","last_undegraded":"2024-09-14T11:58:15.801285+0000","last_fullsized":"2024-09-14T11:58:15.801285+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:57.841456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'425","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.459589+0000","last_change":"2024-09-14T11:16:07.518584+0000","last_active":"2024-09-14T11:58:14.459589+0000","last_peered":"2024-09-14T11:58:14.459589+0000","last_clean":"2024-09-14T11:58:14.459589+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:14.459589+0000","last_undegraded":"2024-09-14T11:58:14.459589+0000","last_fullsized":"2024-09-14T11:58:14.459589+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:45.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'219","reported_seq":823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.401215+0000","last_change":"2024-09-14T11:15:32.310716+0000","last_active":"2024-09-14T11:58:47.401215+0000","last_peered":"2024-09-14T11:58:47.401215+0000","last_clean":"2024-09-14T11:58:47.401215+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:58:47.401215+0000","last_undegraded":"2024-09-14T11:58:47.401215+0000","last_fullsized":"2024-09-14T11:58:47.401215+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:42.627407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":12620,"num_write":955,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:35.868896+0000","last_change":"2024-09-14T11:15:36.330575+0000","last_active":"2024-09-14T11:55:35.868896+0000","last_peered":"2024-09-14T11:55:35.868896+0000","last_clean":"2024-09-14T11:55:35.868896+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:55:35.868896+0000","last_undegraded":"2024-09-14T11:55:35.868896+0000","last_fullsized":"2024-09-14T11:55:35.868896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:23.577919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'99","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.374104+0000","last_change":"2024-09-14T11:15:38.335710+0000","last_active":"2024-09-14T11:56:21.374104+0000","last_peered":"2024-09-14T11:56:21.374104+0000","last_clean":"2024-09-14T11:56:21.374104+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:56:21.374104+0000","last_undegraded":"2024-09-14T11:56:21.374104+0000","last_fullsized":"2024-09-14T11:56:21.374104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:16.942605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'769","reported_seq":2180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.164292+0000","last_change":"2024-09-14T11:15:40.347027+0000","last_active":"2024-09-14T11:58:47.164292+0000","last_peered":"2024-09-14T11:58:47.164292+0000","last_clean":"2024-09-14T11:58:47.164292+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:58:47.164292+0000","last_undegraded":"2024-09-14T11:58:47.164292+0000","last_fullsized":"2024-09-14T11:58:47.164292+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.157408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":604,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.934707+0000","last_change":"2024-09-14T11:15:42.350291+0000","last_active":"2024-09-14T11:56:30.934707+0000","last_peered":"2024-09-14T11:56:30.934707+0000","last_clean":"2024-09-14T11:56:30.934707+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:56:30.934707+0000","last_undegraded":"2024-09-14T11:56:30.934707+0000","last_fullsized":"2024-09-14T11:56:30.934707+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.774415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'894","reported_seq":2466,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.677671+0000","last_change":"2024-09-14T11:15:34.322958+0000","last_active":"2024-09-14T11:56:32.677671+0000","last_peered":"2024-09-14T11:56:32.677671+0000","last_clean":"2024-09-14T11:56:32.677671+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:56:32.677671+0000","last_undegraded":"2024-09-14T11:56:32.677671+0000","last_fullsized":"2024-09-14T11:56:32.677671+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'214","reported_seq":929,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.461420+0000","last_change":"2024-09-14T11:15:32.310372+0000","last_active":"2024-09-14T11:58:47.461420+0000","last_peered":"2024-09-14T11:58:47.461420+0000","last_clean":"2024-09-14T11:58:47.461420+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:58:47.461420+0000","last_undegraded":"2024-09-14T11:58:47.461420+0000","last_fullsized":"2024-09-14T11:58:47.461420+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:20.309040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":930,"num_read_kb":28634,"num_write":971,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872979+0000","last_change":"2024-09-14T11:15:36.334783+0000","last_active":"2024-09-14T11:55:38.872979+0000","last_peered":"2024-09-14T11:55:38.872979+0000","last_clean":"2024-09-14T11:55:38.872979+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:55:38.872979+0000","last_undegraded":"2024-09-14T11:55:38.872979+0000","last_fullsized":"2024-09-14T11:55:38.872979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:31.368261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'156","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.474156+0000","last_change":"2024-09-14T11:15:38.333129+0000","last_active":"2024-09-14T11:58:47.474156+0000","last_peered":"2024-09-14T11:58:47.474156+0000","last_clean":"2024-09-14T11:58:47.474156+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:58:47.474156+0000","last_undegraded":"2024-09-14T11:58:47.474156+0000","last_fullsized":"2024-09-14T11:58:47.474156+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:23.609841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7170,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":208,"num_read_kb":287,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.854707+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:54:23.854707+0000","last_peered":"2024-09-14T11:54:23.854707+0000","last_clean":"2024-09-14T11:54:23.854707+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:54:23.854707+0000","last_undegraded":"2024-09-14T11:54:23.854707+0000","last_fullsized":"2024-09-14T11:54:23.854707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:23.255804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'105","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513654+0000","last_change":"2024-09-14T11:15:42.354717+0000","last_active":"2024-09-14T11:56:33.513654+0000","last_peered":"2024-09-14T11:56:33.513654+0000","last_clean":"2024-09-14T11:56:33.513654+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:56:33.513654+0000","last_undegraded":"2024-09-14T11:56:33.513654+0000","last_fullsized":"2024-09-14T11:56:33.513654+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:10.490861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'654","reported_seq":2517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.456955+0000","last_change":"2024-09-14T11:15:34.319956+0000","last_active":"2024-09-14T11:58:14.456955+0000","last_peered":"2024-09-14T11:58:14.456955+0000","last_clean":"2024-09-14T11:58:14.456955+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:58:14.456955+0000","last_undegraded":"2024-09-14T11:58:14.456955+0000","last_fullsized":"2024-09-14T11:58:14.456955+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:38.765206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'198","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.479442+0000","last_change":"2024-09-14T11:15:32.311339+0000","last_active":"2024-09-14T11:58:47.479442+0000","last_peered":"2024-09-14T11:58:47.479442+0000","last_clean":"2024-09-14T11:58:47.479442+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:58:47.479442+0000","last_undegraded":"2024-09-14T11:58:47.479442+0000","last_fullsized":"2024-09-14T11:58:47.479442+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:40.088024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":24057,"num_write":879,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872982+0000","last_change":"2024-09-14T11:15:36.323716+0000","last_active":"2024-09-14T11:55:38.872982+0000","last_peered":"2024-09-14T11:55:38.872982+0000","last_clean":"2024-09-14T11:55:38.872982+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:55:38.872982+0000","last_undegraded":"2024-09-14T11:55:38.872982+0000","last_fullsized":"2024-09-14T11:55:38.872982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:05.232742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'146","reported_seq":701,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.484416+0000","last_change":"2024-09-14T11:15:38.333174+0000","last_active":"2024-09-14T11:58:47.484416+0000","last_peered":"2024-09-14T11:58:47.484416+0000","last_clean":"2024-09-14T11:58:47.484416+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:58:47.484416+0000","last_undegraded":"2024-09-14T11:58:47.484416+0000","last_fullsized":"2024-09-14T11:58:47.484416+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:29.536985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":267,"num_write":100,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944488+0000","last_change":"2024-09-14T11:15:40.344604+0000","last_active":"2024-09-14T11:54:28.944488+0000","last_peered":"2024-09-14T11:54:28.944488+0000","last_clean":"2024-09-14T11:54:28.944488+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:54:28.944488+0000","last_undegraded":"2024-09-14T11:54:28.944488+0000","last_fullsized":"2024-09-14T11:54:28.944488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:07.536782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'141","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.134030+0000","last_change":"2024-09-14T11:15:42.348390+0000","last_active":"2024-09-14T11:56:39.134030+0000","last_peered":"2024-09-14T11:56:39.134030+0000","last_clean":"2024-09-14T11:56:39.134030+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:56:39.134030+0000","last_undegraded":"2024-09-14T11:56:39.134030+0000","last_fullsized":"2024-09-14T11:56:39.134030+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:35.472396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'745","reported_seq":2355,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.981012+0000","last_change":"2024-09-14T11:15:34.323276+0000","last_active":"2024-09-14T11:56:56.981012+0000","last_peered":"2024-09-14T11:56:56.981012+0000","last_clean":"2024-09-14T11:56:56.981012+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:56:56.981012+0000","last_undegraded":"2024-09-14T11:56:56.981012+0000","last_fullsized":"2024-09-14T11:56:56.981012+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:11.314085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'244","reported_seq":995,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.404056+0000","last_change":"2024-09-14T11:15:32.314412+0000","last_active":"2024-09-14T11:58:47.404056+0000","last_peered":"2024-09-14T11:58:47.404056+0000","last_clean":"2024-09-14T11:58:47.404056+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:58:47.404056+0000","last_undegraded":"2024-09-14T11:58:47.404056+0000","last_fullsized":"2024-09-14T11:58:47.404056+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:54.314072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":149417,"num_write":1050,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.999537+0000","last_change":"2024-09-14T11:15:36.334370+0000","last_active":"2024-09-14T11:54:18.999537+0000","last_peered":"2024-09-14T11:54:18.999537+0000","last_clean":"2024-09-14T11:54:18.999537+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:54:18.999537+0000","last_undegraded":"2024-09-14T11:54:18.999537+0000","last_fullsized":"2024-09-14T11:54:18.999537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:16.183616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'98","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.395183+0000","last_change":"2024-09-14T11:15:38.339773+0000","last_active":"2024-09-14T11:58:47.395183+0000","last_peered":"2024-09-14T11:58:47.395183+0000","last_clean":"2024-09-14T11:58:47.395183+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:58:47.395183+0000","last_undegraded":"2024-09-14T11:58:47.395183+0000","last_fullsized":"2024-09-14T11:58:47.395183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.547669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8817,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":183,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.010579+0000","last_change":"2024-09-14T11:15:40.345970+0000","last_active":"2024-09-14T11:55:44.010579+0000","last_peered":"2024-09-14T11:55:44.010579+0000","last_clean":"2024-09-14T11:55:44.010579+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:55:44.010579+0000","last_undegraded":"2024-09-14T11:55:44.010579+0000","last_fullsized":"2024-09-14T11:55:44.010579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.446853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'154","reported_seq":1252,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.149214+0000","last_change":"2024-09-14T11:15:42.354185+0000","last_active":"2024-09-14T11:56:55.149214+0000","last_peered":"2024-09-14T11:56:55.149214+0000","last_clean":"2024-09-14T11:56:55.149214+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:56:55.149214+0000","last_undegraded":"2024-09-14T11:56:55.149214+0000","last_fullsized":"2024-09-14T11:56:55.149214+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:00.385532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'446","reported_seq":1936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.748803+0000","last_change":"2024-09-14T11:15:34.320209+0000","last_active":"2024-09-14T11:56:37.748803+0000","last_peered":"2024-09-14T11:56:37.748803+0000","last_clean":"2024-09-14T11:56:37.748803+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:56:37.748803+0000","last_undegraded":"2024-09-14T11:56:37.748803+0000","last_fullsized":"2024-09-14T11:56:37.748803+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:44.754267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'206","reported_seq":834,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.376758+0000","last_change":"2024-09-14T11:15:32.314784+0000","last_active":"2024-09-14T11:58:47.376758+0000","last_peered":"2024-09-14T11:58:47.376758+0000","last_clean":"2024-09-14T11:58:47.376758+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:58:47.376758+0000","last_undegraded":"2024-09-14T11:58:47.376758+0000","last_fullsized":"2024-09-14T11:58:47.376758+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.987083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":36694,"num_write":987,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.858535+0000","last_change":"2024-09-14T11:15:36.334335+0000","last_active":"2024-09-14T11:54:20.858535+0000","last_peered":"2024-09-14T11:54:20.858535+0000","last_clean":"2024-09-14T11:54:20.858535+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:54:20.858535+0000","last_undegraded":"2024-09-14T11:54:20.858535+0000","last_fullsized":"2024-09-14T11:54:20.858535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:15.469593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'148","reported_seq":722,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.429338+0000","last_change":"2024-09-14T11:15:38.340747+0000","last_active":"2024-09-14T11:58:47.429338+0000","last_peered":"2024-09-14T11:58:47.429338+0000","last_clean":"2024-09-14T11:58:47.429338+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:58:47.429338+0000","last_undegraded":"2024-09-14T11:58:47.429338+0000","last_fullsized":"2024-09-14T11:58:47.429338+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:13.972291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":283,"num_write":116,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864425+0000","last_change":"2024-09-14T11:15:40.351076+0000","last_active":"2024-09-14T11:55:43.864425+0000","last_peered":"2024-09-14T11:55:43.864425+0000","last_clean":"2024-09-14T11:55:43.864425+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:55:43.864425+0000","last_undegraded":"2024-09-14T11:55:43.864425+0000","last_fullsized":"2024-09-14T11:55:43.864425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:55.409953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'93","reported_seq":570,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.455750+0000","last_change":"2024-09-14T11:15:42.354581+0000","last_active":"2024-09-14T11:58:14.455750+0000","last_peered":"2024-09-14T11:58:14.455750+0000","last_clean":"2024-09-14T11:58:14.455750+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:58:14.455750+0000","last_undegraded":"2024-09-14T11:58:14.455750+0000","last_fullsized":"2024-09-14T11:58:14.455750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:56.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'422","reported_seq":1871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.440972+0000","last_change":"2024-09-14T11:15:34.326286+0000","last_active":"2024-09-14T11:56:24.440972+0000","last_peered":"2024-09-14T11:56:24.440972+0000","last_clean":"2024-09-14T11:56:24.440972+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:56:24.440972+0000","last_undegraded":"2024-09-14T11:56:24.440972+0000","last_fullsized":"2024-09-14T11:56:24.440972+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:42.344126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.368385+0000","last_change":"2024-09-14T11:15:32.318065+0000","last_active":"2024-09-14T11:58:47.368385+0000","last_peered":"2024-09-14T11:58:47.368385+0000","last_clean":"2024-09-14T11:58:47.368385+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:58:47.368385+0000","last_undegraded":"2024-09-14T11:58:47.368385+0000","last_fullsized":"2024-09-14T11:58:47.368385+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:17.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":66072,"num_write":894,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.217987+0000","last_change":"2024-09-14T11:15:34.326738+0000","last_active":"2024-09-14T11:56:20.217987+0000","last_peered":"2024-09-14T11:56:20.217987+0000","last_clean":"2024-09-14T11:56:20.217987+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:56:20.217987+0000","last_undegraded":"2024-09-14T11:56:20.217987+0000","last_fullsized":"2024-09-14T11:56:20.217987+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:19.559783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'212","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.405751+0000","last_change":"2024-09-14T11:16:07.388971+0000","last_active":"2024-09-14T11:58:47.405751+0000","last_peered":"2024-09-14T11:58:47.405751+0000","last_clean":"2024-09-14T11:58:47.405751+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:58:47.405751+0000","last_undegraded":"2024-09-14T11:58:47.405751+0000","last_fullsized":"2024-09-14T11:58:47.405751+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:24.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":30107,"num_write":970,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'535","reported_seq":2202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882580+0000","last_change":"2024-09-14T11:15:34.327112+0000","last_active":"2024-09-14T11:56:43.882580+0000","last_peered":"2024-09-14T11:56:43.882580+0000","last_clean":"2024-09-14T11:56:43.882580+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:56:43.882580+0000","last_undegraded":"2024-09-14T11:56:43.882580+0000","last_fullsized":"2024-09-14T11:56:43.882580+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:38.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'184","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.479362+0000","last_change":"2024-09-14T11:15:32.322695+0000","last_active":"2024-09-14T11:58:47.479362+0000","last_peered":"2024-09-14T11:58:47.479362+0000","last_clean":"2024-09-14T11:58:47.479362+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:58:47.479362+0000","last_undegraded":"2024-09-14T11:58:47.479362+0000","last_fullsized":"2024-09-14T11:58:47.479362+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:51.640989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":397,"num_read_kb":13678,"num_write":826,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'686","reported_seq":2125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815081+0000","last_change":"2024-09-14T11:15:34.326696+0000","last_active":"2024-09-14T11:56:31.815081+0000","last_peered":"2024-09-14T11:56:31.815081+0000","last_clean":"2024-09-14T11:56:31.815081+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:56:31.815081+0000","last_undegraded":"2024-09-14T11:56:31.815081+0000","last_fullsized":"2024-09-14T11:56:31.815081+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:33.740522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'224","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.438234+0000","last_change":"2024-09-14T11:15:32.316203+0000","last_active":"2024-09-14T11:58:47.438234+0000","last_peered":"2024-09-14T11:58:47.438234+0000","last_clean":"2024-09-14T11:58:47.438234+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:58:47.438234+0000","last_undegraded":"2024-09-14T11:58:47.438234+0000","last_fullsized":"2024-09-14T11:58:47.438234+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:22.666605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":673,"num_read_kb":8461,"num_write":1067,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'577","reported_seq":2174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.999003+0000","last_change":"2024-09-14T11:15:34.321891+0000","last_active":"2024-09-14T11:56:36.999003+0000","last_peered":"2024-09-14T11:56:36.999003+0000","last_clean":"2024-09-14T11:56:36.999003+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:56:36.999003+0000","last_undegraded":"2024-09-14T11:56:36.999003+0000","last_fullsized":"2024-09-14T11:56:36.999003+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:57.912381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'259","reported_seq":920,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.493816+0000","last_change":"2024-09-14T11:15:32.318820+0000","last_active":"2024-09-14T11:58:47.493816+0000","last_peered":"2024-09-14T11:58:47.493816+0000","last_clean":"2024-09-14T11:58:47.493816+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:58:47.493816+0000","last_undegraded":"2024-09-14T11:58:47.493816+0000","last_fullsized":"2024-09-14T11:58:47.493816+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":625,"num_read_kb":65552,"num_write":1161,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1210","reported_seq":2813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.749031+0000","last_change":"2024-09-14T11:15:34.321918+0000","last_active":"2024-09-14T11:56:37.749031+0000","last_peered":"2024-09-14T11:56:37.749031+0000","last_clean":"2024-09-14T11:56:37.749031+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:56:37.749031+0000","last_undegraded":"2024-09-14T11:56:37.749031+0000","last_fullsized":"2024-09-14T11:56:37.749031+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":1100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:50.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'199","reported_seq":814,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.469245+0000","last_change":"2024-09-14T11:15:32.315289+0000","last_active":"2024-09-14T11:58:47.469245+0000","last_peered":"2024-09-14T11:58:47.469245+0000","last_clean":"2024-09-14T11:58:47.469245+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:58:47.469245+0000","last_undegraded":"2024-09-14T11:58:47.469245+0000","last_fullsized":"2024-09-14T11:58:47.469245+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.565051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":515,"num_read_kb":18867,"num_write":899,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'487","reported_seq":2135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.885876+0000","last_change":"2024-09-14T11:15:34.331577+0000","last_active":"2024-09-14T11:57:13.885876+0000","last_peered":"2024-09-14T11:57:13.885876+0000","last_clean":"2024-09-14T11:57:13.885876+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:57:13.885876+0000","last_undegraded":"2024-09-14T11:57:13.885876+0000","last_fullsized":"2024-09-14T11:57:13.885876+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:11.178476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'181","reported_seq":759,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.426140+0000","last_change":"2024-09-14T11:15:32.316992+0000","last_active":"2024-09-14T11:58:47.426140+0000","last_peered":"2024-09-14T11:58:47.426140+0000","last_clean":"2024-09-14T11:58:47.426140+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:58:47.426140+0000","last_undegraded":"2024-09-14T11:58:47.426140+0000","last_fullsized":"2024-09-14T11:58:47.426140+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:26.850078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":3776,"num_write":815,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'438","reported_seq":1967,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.992326+0000","last_change":"2024-09-14T11:15:34.320939+0000","last_active":"2024-09-14T11:56:56.992326+0000","last_peered":"2024-09-14T11:56:56.992326+0000","last_clean":"2024-09-14T11:56:56.992326+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:56:56.992326+0000","last_undegraded":"2024-09-14T11:56:56.992326+0000","last_fullsized":"2024-09-14T11:56:56.992326+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:48.296671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'273","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.412586+0000","last_change":"2024-09-14T11:15:32.313940+0000","last_active":"2024-09-14T11:58:47.412586+0000","last_peered":"2024-09-14T11:58:47.412586+0000","last_clean":"2024-09-14T11:58:47.412586+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:58:47.412586+0000","last_undegraded":"2024-09-14T11:58:47.412586+0000","last_fullsized":"2024-09-14T11:58:47.412586+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":36414,"num_write":1104,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'491","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815278+0000","last_change":"2024-09-14T11:15:34.329614+0000","last_active":"2024-09-14T11:56:31.815278+0000","last_peered":"2024-09-14T11:56:31.815278+0000","last_clean":"2024-09-14T11:56:31.815278+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:56:31.815278+0000","last_undegraded":"2024-09-14T11:56:31.815278+0000","last_fullsized":"2024-09-14T11:56:31.815278+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:54.327097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'284","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.470551+0000","last_change":"2024-09-14T11:15:32.315107+0000","last_active":"2024-09-14T11:58:47.470551+0000","last_peered":"2024-09-14T11:58:47.470551+0000","last_clean":"2024-09-14T11:58:47.470551+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:58:47.470551+0000","last_undegraded":"2024-09-14T11:58:47.470551+0000","last_fullsized":"2024-09-14T11:58:47.470551+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:38.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":728,"num_read_kb":57965,"num_write":1175,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'745","reported_seq":2318,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.401835+0000","last_change":"2024-09-14T11:15:34.315526+0000","last_active":"2024-09-14T11:56:29.401835+0000","last_peered":"2024-09-14T11:56:29.401835+0000","last_clean":"2024-09-14T11:56:29.401835+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:56:29.401835+0000","last_undegraded":"2024-09-14T11:56:29.401835+0000","last_fullsized":"2024-09-14T11:56:29.401835+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:14.858173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'200","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.415092+0000","last_change":"2024-09-14T11:15:32.314904+0000","last_active":"2024-09-14T11:58:47.415092+0000","last_peered":"2024-09-14T11:58:47.415092+0000","last_clean":"2024-09-14T11:58:47.415092+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:58:47.415092+0000","last_undegraded":"2024-09-14T11:58:47.415092+0000","last_fullsized":"2024-09-14T11:58:47.415092+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:26.432997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":27346,"num_write":953,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.518380+0000","last_change":"2024-09-14T11:15:34.319049+0000","last_active":"2024-09-14T11:56:33.518380+0000","last_peered":"2024-09-14T11:56:33.518380+0000","last_clean":"2024-09-14T11:56:33.518380+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:56:33.518380+0000","last_undegraded":"2024-09-14T11:56:33.518380+0000","last_fullsized":"2024-09-14T11:56:33.518380+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:49.759336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'215","reported_seq":834,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.384019+0000","last_change":"2024-09-14T11:15:32.323060+0000","last_active":"2024-09-14T11:58:47.384019+0000","last_peered":"2024-09-14T11:58:47.384019+0000","last_clean":"2024-09-14T11:58:47.384019+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:58:47.384019+0000","last_undegraded":"2024-09-14T11:58:47.384019+0000","last_fullsized":"2024-09-14T11:58:47.384019+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:45.398432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":6791,"num_write":1023,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1091","reported_seq":2577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.465397+0000","last_change":"2024-09-14T11:15:34.322193+0000","last_active":"2024-09-14T11:56:38.465397+0000","last_peered":"2024-09-14T11:56:38.465397+0000","last_clean":"2024-09-14T11:56:38.465397+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:56:38.465397+0000","last_undegraded":"2024-09-14T11:56:38.465397+0000","last_fullsized":"2024-09-14T11:56:38.465397+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":1000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:22.542879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'196","reported_seq":798,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.288761+0000","last_change":"2024-09-14T11:15:32.310112+0000","last_active":"2024-09-14T11:58:47.288761+0000","last_peered":"2024-09-14T11:58:47.288761+0000","last_clean":"2024-09-14T11:58:47.288761+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:58:47.288761+0000","last_undegraded":"2024-09-14T11:58:47.288761+0000","last_fullsized":"2024-09-14T11:58:47.288761+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:07.469578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":8671,"num_write":968,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'890","reported_seq":2796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.530140+0000","last_change":"2024-09-14T11:15:34.324712+0000","last_active":"2024-09-14T11:56:57.530140+0000","last_peered":"2024-09-14T11:56:57.530140+0000","last_clean":"2024-09-14T11:56:57.530140+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:56:57.530140+0000","last_undegraded":"2024-09-14T11:56:57.530140+0000","last_fullsized":"2024-09-14T11:56:57.530140+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.495184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'216","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.414526+0000","last_change":"2024-09-14T11:15:32.318750+0000","last_active":"2024-09-14T11:58:47.414526+0000","last_peered":"2024-09-14T11:58:47.414526+0000","last_clean":"2024-09-14T11:58:47.414526+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:58:47.414526+0000","last_undegraded":"2024-09-14T11:58:47.414526+0000","last_fullsized":"2024-09-14T11:58:47.414526+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.743260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":9098,"num_write":1061,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.467024+0000","last_change":"2024-09-14T11:15:34.332778+0000","last_active":"2024-09-14T11:58:14.467024+0000","last_peered":"2024-09-14T11:58:14.467024+0000","last_clean":"2024-09-14T11:58:14.467024+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:58:14.467024+0000","last_undegraded":"2024-09-14T11:58:14.467024+0000","last_fullsized":"2024-09-14T11:58:14.467024+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:54.250812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'225","reported_seq":863,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.403336+0000","last_change":"2024-09-14T11:15:32.312591+0000","last_active":"2024-09-14T11:58:47.403336+0000","last_peered":"2024-09-14T11:58:47.403336+0000","last_clean":"2024-09-14T11:58:47.403336+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:58:47.403336+0000","last_undegraded":"2024-09-14T11:58:47.403336+0000","last_fullsized":"2024-09-14T11:58:47.403336+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:10.213620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":2234,"num_write":1097,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1087","reported_seq":2853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.466283+0000","last_change":"2024-09-14T11:15:34.328111+0000","last_active":"2024-09-14T11:58:14.466283+0000","last_peered":"2024-09-14T11:58:14.466283+0000","last_clean":"2024-09-14T11:58:14.466283+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:58:14.466283+0000","last_undegraded":"2024-09-14T11:58:14.466283+0000","last_fullsized":"2024-09-14T11:58:14.466283+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":1000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:12.718283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'209","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.875870+0000","last_change":"2024-09-14T11:15:32.313441+0000","last_active":"2024-09-14T11:57:33.875870+0000","last_peered":"2024-09-14T11:57:33.875870+0000","last_clean":"2024-09-14T11:57:33.875870+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:57:33.875870+0000","last_undegraded":"2024-09-14T11:57:33.875870+0000","last_fullsized":"2024-09-14T11:57:33.875870+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:11.822923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":34303,"num_write":987,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2022,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.998517+0000","last_change":"2024-09-14T11:15:34.327960+0000","last_active":"2024-09-14T11:56:36.998517+0000","last_peered":"2024-09-14T11:56:36.998517+0000","last_clean":"2024-09-14T11:56:36.998517+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:56:36.998517+0000","last_undegraded":"2024-09-14T11:56:36.998517+0000","last_fullsized":"2024-09-14T11:56:36.998517+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:15.598992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'251","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.278437+0000","last_change":"2024-09-14T11:15:32.319862+0000","last_active":"2024-09-14T11:58:47.278437+0000","last_peered":"2024-09-14T11:58:47.278437+0000","last_clean":"2024-09-14T11:58:47.278437+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:58:47.278437+0000","last_undegraded":"2024-09-14T11:58:47.278437+0000","last_fullsized":"2024-09-14T11:58:47.278437+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:02.612992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":43532,"num_write":1122,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'185","reported_seq":783,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.472951+0000","last_change":"2024-09-14T11:15:32.313012+0000","last_active":"2024-09-14T11:58:47.472951+0000","last_peered":"2024-09-14T11:58:47.472951+0000","last_clean":"2024-09-14T11:58:47.472951+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:58:47.472951+0000","last_undegraded":"2024-09-14T11:58:47.472951+0000","last_fullsized":"2024-09-14T11:58:47.472951+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:04.134671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":29604,"num_write":903,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'412","reported_seq":1879,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.136779+0000","last_change":"2024-09-14T11:15:34.329317+0000","last_active":"2024-09-14T11:56:39.136779+0000","last_peered":"2024-09-14T11:56:39.136779+0000","last_clean":"2024-09-14T11:56:39.136779+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:56:39.136779+0000","last_undegraded":"2024-09-14T11:56:39.136779+0000","last_fullsized":"2024-09-14T11:56:39.136779+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:48.380875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'278","reported_seq":1050,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.414509+0000","last_change":"2024-09-14T11:15:32.312792+0000","last_active":"2024-09-14T11:58:47.414509+0000","last_peered":"2024-09-14T11:58:47.414509+0000","last_clean":"2024-09-14T11:58:47.414509+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:58:47.414509+0000","last_undegraded":"2024-09-14T11:58:47.414509+0000","last_fullsized":"2024-09-14T11:58:47.414509+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.357853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1009,"num_read_kb":66938,"num_write":1373,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'573","reported_seq":2170,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.863303+0000","last_change":"2024-09-14T11:15:34.326395+0000","last_active":"2024-09-14T11:57:45.863303+0000","last_peered":"2024-09-14T11:57:45.863303+0000","last_clean":"2024-09-14T11:57:45.863303+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:57:45.863303+0000","last_undegraded":"2024-09-14T11:57:45.863303+0000","last_fullsized":"2024-09-14T11:57:45.863303+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:54.259695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":452,"ondisk_log_size":452,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":377666,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8331,"num_read_kb":10588,"num_write":5619,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1919,"ondisk_log_size":1919,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4076,"ondisk_log_size":4076,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42836797,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38922,"num_read_kb":2111716,"num_write":64484,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86687744,"data_stored":85673594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3941,"ondisk_log_size":3941,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":180487,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":169164,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509969,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":233280,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94138560,"statfs":{"total":96636764160,"available":96397885440,"internally_reserved":0,"allocated":13533184,"data_stored":11861887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509969,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229072,"kb_used_data":9048,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94142768,"statfs":{"total":96636764160,"available":96402194432,"internally_reserved":0,"allocated":9265152,"data_stored":7716819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509970,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101784,"kb_used_data":12360,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94270056,"statfs":{"total":96636764160,"available":96532537344,"internally_reserved":0,"allocated":12656640,"data_stored":10956578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509969,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93500,"kb_used_data":17900,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278340,"statfs":{"total":96636764160,"available":96541020160,"internally_reserved":0,"allocated":18329600,"data_stored":16701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509971,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248368,"kb_used_data":18584,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123472,"statfs":{"total":96636764160,"available":96382435328,"internally_reserved":0,"allocated":19030016,"data_stored":17385395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509969,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75964,"kb_used_data":8656,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295876,"statfs":{"total":96636764160,"available":96558977024,"internally_reserved":0,"allocated":8863744,"data_stored":7316623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509967,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252032,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94119808,"statfs":{"total":96636764160,"available":96378683392,"internally_reserved":0,"allocated":22855680,"data_stored":21154199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575375,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133480,"kb_used_data":12052,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94238360,"statfs":{"total":96636764160,"available":96500080640,"internally_reserved":0,"allocated":12341248,"data_stored":10776464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":18434939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8728576,"data_stored":8650845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5275648,"data_stored":5190678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15388672,"data_stored":15257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8986624,"data_stored":8830204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5656576,"data_stored":5589626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9293824,"data_stored":9144278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:55.908 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.908 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.909 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.910 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.911 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.912 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.913 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.914 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.915 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.916 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.917 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.918 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.919 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.920 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.921 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.922 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.923 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.924 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.925 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.926 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.927 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.928 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.929 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.930 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.931 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:15:14.033306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:15:20.052341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:15:20.052341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.932 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.933 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:15:20.052341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:15:20.052341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.934 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:15:20.052341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.935 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T11:15:20.052341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:15:20.052341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.936 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.937 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.938 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.939 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.940 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.941 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.942 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.943 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.944 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.945 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.946 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:55.947 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:59:15.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:59:16.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:59:16.312 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:59:16.314 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1577,"stamp":"2024-09-14T11:59:14.793036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43821918,"num_objects":628,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":628,"num_whiteouts":0,"num_read":296215,"num_read_kb":2700212,"num_write":146664,"num_write_kb":2447739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35729,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13633,"ondisk_log_size":13633,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1367192,"kb_used_data":114136,"kb_used_omap":12,"kb_used_meta":1252915,"kb_avail":753607528,"statfs":{"total":773094113280,"available":771694108672,"internally_reserved":0,"allocated":116875264,"data_stored":103868988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1282985520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35089,"num_omap_keys":141,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005347"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877231+0000","last_change":"2024-09-14T11:43:35.602913+0000","last_active":"2024-09-14T11:56:08.877231+0000","last_peered":"2024-09-14T11:56:08.877231+0000","last_clean":"2024-09-14T11:56:08.877231+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:56:08.877231+0000","last_undegraded":"2024-09-14T11:56:08.877231+0000","last_fullsized":"2024-09-14T11:56:08.877231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:06.258234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867970+0000","last_change":"2024-09-14T11:32:32.583802+0000","last_active":"2024-09-14T11:55:03.867970+0000","last_peered":"2024-09-14T11:55:03.867970+0000","last_clean":"2024-09-14T11:55:03.867970+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:55:03.867970+0000","last_undegraded":"2024-09-14T11:55:03.867970+0000","last_fullsized":"2024-09-14T11:55:03.867970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:58.807468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.889529+0000","last_change":"2024-09-14T11:32:29.554679+0000","last_active":"2024-09-14T11:57:28.889529+0000","last_peered":"2024-09-14T11:57:28.889529+0000","last_clean":"2024-09-14T11:57:28.889529+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:57:28.889529+0000","last_undegraded":"2024-09-14T11:57:28.889529+0000","last_fullsized":"2024-09-14T11:57:28.889529+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:20.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.865041+0000","last_change":"2024-09-14T11:30:45.179357+0000","last_active":"2024-09-14T11:55:48.865041+0000","last_peered":"2024-09-14T11:55:48.865041+0000","last_clean":"2024-09-14T11:55:48.865041+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:55:48.865041+0000","last_undegraded":"2024-09-14T11:55:48.865041+0000","last_fullsized":"2024-09-14T11:55:48.865041+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:03.066351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.866530+0000","last_change":"2024-09-14T11:43:35.602901+0000","last_active":"2024-09-14T11:56:08.866530+0000","last_peered":"2024-09-14T11:56:08.866530+0000","last_clean":"2024-09-14T11:56:08.866530+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:56:08.866530+0000","last_undegraded":"2024-09-14T11:56:08.866530+0000","last_fullsized":"2024-09-14T11:56:08.866530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:07.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'6","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.413106+0000","last_change":"2024-09-14T11:32:32.582294+0000","last_active":"2024-09-14T11:58:47.413106+0000","last_peered":"2024-09-14T11:58:47.413106+0000","last_clean":"2024-09-14T11:58:47.413106+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:58:47.413106+0000","last_undegraded":"2024-09-14T11:58:47.413106+0000","last_fullsized":"2024-09-14T11:58:47.413106+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.399340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.864287+0000","last_change":"2024-09-14T11:32:29.558121+0000","last_active":"2024-09-14T11:55:00.864287+0000","last_peered":"2024-09-14T11:55:00.864287+0000","last_clean":"2024-09-14T11:55:00.864287+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:55:00.864287+0000","last_undegraded":"2024-09-14T11:55:00.864287+0000","last_fullsized":"2024-09-14T11:55:00.864287+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:52.777925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.320376+0000","last_change":"2024-09-14T11:59:13.320376+0000","last_active":"2024-09-14T11:59:13.320376+0000","last_peered":"2024-09-14T11:59:13.320376+0000","last_clean":"2024-09-14T11:59:13.320376+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:59:13.320376+0000","last_undegraded":"2024-09-14T11:59:13.320376+0000","last_fullsized":"2024-09-14T11:59:13.320376+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'59","last_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_deep_scrub":"262'59","last_deep_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.320284+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:41.355939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.954160+0000","last_change":"2024-09-14T11:43:35.597712+0000","last_active":"2024-09-14T11:55:43.954160+0000","last_peered":"2024-09-14T11:55:43.954160+0000","last_clean":"2024-09-14T11:55:43.954160+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:55:43.954160+0000","last_undegraded":"2024-09-14T11:55:43.954160+0000","last_fullsized":"2024-09-14T11:55:43.954160+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:12.892547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'8","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.241902+0000","last_change":"2024-09-14T11:32:32.578401+0000","last_active":"2024-09-14T11:58:47.241902+0000","last_peered":"2024-09-14T11:58:47.241902+0000","last_clean":"2024-09-14T11:58:47.241902+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:58:47.241902+0000","last_undegraded":"2024-09-14T11:58:47.241902+0000","last_fullsized":"2024-09-14T11:58:47.241902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:07.530877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13314,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.377588+0000","last_change":"2024-09-14T11:32:29.550110+0000","last_active":"2024-09-14T11:58:47.377588+0000","last_peered":"2024-09-14T11:58:47.377588+0000","last_clean":"2024-09-14T11:58:47.377588+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:58:47.377588+0000","last_undegraded":"2024-09-14T11:58:47.377588+0000","last_fullsized":"2024-09-14T11:58:47.377588+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:36.277584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.864987+0000","last_change":"2024-09-14T11:30:45.186185+0000","last_active":"2024-09-14T11:55:48.864987+0000","last_peered":"2024-09-14T11:55:48.864987+0000","last_clean":"2024-09-14T11:55:48.864987+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:55:48.864987+0000","last_undegraded":"2024-09-14T11:55:48.864987+0000","last_fullsized":"2024-09-14T11:55:48.864987+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.774513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875479+0000","last_change":"2024-09-14T11:43:35.603929+0000","last_active":"2024-09-14T11:55:48.875479+0000","last_peered":"2024-09-14T11:55:48.875479+0000","last_clean":"2024-09-14T11:55:48.875479+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:55:48.875479+0000","last_undegraded":"2024-09-14T11:55:48.875479+0000","last_fullsized":"2024-09-14T11:55:48.875479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:33.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.899916+0000","last_change":"2024-09-14T11:32:32.589192+0000","last_active":"2024-09-14T11:58:43.899916+0000","last_peered":"2024-09-14T11:58:43.899916+0000","last_clean":"2024-09-14T11:58:43.899916+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:58:43.899916+0000","last_undegraded":"2024-09-14T11:58:43.899916+0000","last_fullsized":"2024-09-14T11:58:43.899916+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:52.225210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.233103+0000","last_change":"2024-09-14T11:32:29.549479+0000","last_active":"2024-09-14T11:58:47.233103+0000","last_peered":"2024-09-14T11:58:47.233103+0000","last_clean":"2024-09-14T11:58:47.233103+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:58:47.233103+0000","last_undegraded":"2024-09-14T11:58:47.233103+0000","last_fullsized":"2024-09-14T11:58:47.233103+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:56.796049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875525+0000","last_change":"2024-09-14T11:30:45.187877+0000","last_active":"2024-09-14T11:55:48.875525+0000","last_peered":"2024-09-14T11:55:48.875525+0000","last_clean":"2024-09-14T11:55:48.875525+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:55:48.875525+0000","last_undegraded":"2024-09-14T11:55:48.875525+0000","last_fullsized":"2024-09-14T11:55:48.875525+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:40.426491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874894+0000","last_change":"2024-09-14T11:43:35.601032+0000","last_active":"2024-09-14T11:55:43.874894+0000","last_peered":"2024-09-14T11:55:43.874894+0000","last_clean":"2024-09-14T11:55:43.874894+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:55:43.874894+0000","last_undegraded":"2024-09-14T11:55:43.874894+0000","last_fullsized":"2024-09-14T11:55:43.874894+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.697673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'4","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.297049+0000","last_change":"2024-09-14T11:33:08.805104+0000","last_active":"2024-09-14T11:58:47.297049+0000","last_peered":"2024-09-14T11:58:47.297049+0000","last_clean":"2024-09-14T11:58:47.297049+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:58:47.297049+0000","last_undegraded":"2024-09-14T11:58:47.297049+0000","last_fullsized":"2024-09-14T11:58:47.297049+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:03.683048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'8","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.434909+0000","last_change":"2024-09-14T11:32:29.558168+0000","last_active":"2024-09-14T11:58:47.434909+0000","last_peered":"2024-09-14T11:58:47.434909+0000","last_clean":"2024-09-14T11:58:47.434909+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:58:47.434909+0000","last_undegraded":"2024-09-14T11:58:47.434909+0000","last_fullsized":"2024-09-14T11:58:47.434909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875505+0000","last_change":"2024-09-14T11:30:45.184142+0000","last_active":"2024-09-14T11:55:48.875505+0000","last_peered":"2024-09-14T11:55:48.875505+0000","last_clean":"2024-09-14T11:55:48.875505+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:55:48.875505+0000","last_undegraded":"2024-09-14T11:55:48.875505+0000","last_fullsized":"2024-09-14T11:55:48.875505+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:48.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872788+0000","last_change":"2024-09-14T11:43:35.605737+0000","last_active":"2024-09-14T11:56:05.872788+0000","last_peered":"2024-09-14T11:56:05.872788+0000","last_clean":"2024-09-14T11:56:05.872788+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:56:05.872788+0000","last_undegraded":"2024-09-14T11:56:05.872788+0000","last_fullsized":"2024-09-14T11:56:05.872788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'2","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.434742+0000","last_change":"2024-09-14T11:32:32.582277+0000","last_active":"2024-09-14T11:58:47.434742+0000","last_peered":"2024-09-14T11:58:47.434742+0000","last_clean":"2024-09-14T11:58:47.434742+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:58:47.434742+0000","last_undegraded":"2024-09-14T11:58:47.434742+0000","last_fullsized":"2024-09-14T11:58:47.434742+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.233351+0000","last_change":"2024-09-14T11:32:29.550064+0000","last_active":"2024-09-14T11:58:47.233351+0000","last_peered":"2024-09-14T11:58:47.233351+0000","last_clean":"2024-09-14T11:58:47.233351+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:58:47.233351+0000","last_undegraded":"2024-09-14T11:58:47.233351+0000","last_fullsized":"2024-09-14T11:58:47.233351+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954746+0000","last_change":"2024-09-14T11:30:45.178964+0000","last_active":"2024-09-14T11:55:48.954746+0000","last_peered":"2024-09-14T11:55:48.954746+0000","last_clean":"2024-09-14T11:55:48.954746+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:55:48.954746+0000","last_undegraded":"2024-09-14T11:55:48.954746+0000","last_fullsized":"2024-09-14T11:55:48.954746+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:14.255189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877316+0000","last_change":"2024-09-14T11:43:35.605759+0000","last_active":"2024-09-14T11:56:08.877316+0000","last_peered":"2024-09-14T11:56:08.877316+0000","last_clean":"2024-09-14T11:56:08.877316+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:56:08.877316+0000","last_undegraded":"2024-09-14T11:56:08.877316+0000","last_fullsized":"2024-09-14T11:56:08.877316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.948842+0000","last_change":"2024-09-14T11:32:32.580274+0000","last_active":"2024-09-14T11:55:03.948842+0000","last_peered":"2024-09-14T11:55:03.948842+0000","last_clean":"2024-09-14T11:55:03.948842+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:55:03.948842+0000","last_undegraded":"2024-09-14T11:55:03.948842+0000","last_fullsized":"2024-09-14T11:55:03.948842+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:14.222467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004336+0000","last_change":"2024-09-14T11:32:29.555376+0000","last_active":"2024-09-14T11:54:59.004336+0000","last_peered":"2024-09-14T11:54:59.004336+0000","last_clean":"2024-09-14T11:54:59.004336+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:54:59.004336+0000","last_undegraded":"2024-09-14T11:54:59.004336+0000","last_fullsized":"2024-09-14T11:54:59.004336+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.859610+0000","last_change":"2024-09-14T11:30:45.175070+0000","last_active":"2024-09-14T11:55:03.859610+0000","last_peered":"2024-09-14T11:55:03.859610+0000","last_clean":"2024-09-14T11:55:03.859610+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:55:03.859610+0000","last_undegraded":"2024-09-14T11:55:03.859610+0000","last_fullsized":"2024-09-14T11:55:03.859610+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.836949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877363+0000","last_change":"2024-09-14T11:43:35.607526+0000","last_active":"2024-09-14T11:56:08.877363+0000","last_peered":"2024-09-14T11:56:08.877363+0000","last_clean":"2024-09-14T11:56:08.877363+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:56:08.877363+0000","last_undegraded":"2024-09-14T11:56:08.877363+0000","last_fullsized":"2024-09-14T11:56:08.877363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.745235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869068+0000","last_change":"2024-09-14T11:32:32.587761+0000","last_active":"2024-09-14T11:55:03.869068+0000","last_peered":"2024-09-14T11:55:03.869068+0000","last_clean":"2024-09-14T11:55:03.869068+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:55:03.869068+0000","last_undegraded":"2024-09-14T11:55:03.869068+0000","last_fullsized":"2024-09-14T11:55:03.869068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:27.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859019+0000","last_change":"2024-09-14T11:32:29.555600+0000","last_active":"2024-09-14T11:54:58.859019+0000","last_peered":"2024-09-14T11:54:58.859019+0000","last_clean":"2024-09-14T11:54:58.859019+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:54:58.859019+0000","last_undegraded":"2024-09-14T11:54:58.859019+0000","last_fullsized":"2024-09-14T11:54:58.859019+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.338753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.863479+0000","last_change":"2024-09-14T11:30:45.182076+0000","last_active":"2024-09-14T11:54:55.863479+0000","last_peered":"2024-09-14T11:54:55.863479+0000","last_clean":"2024-09-14T11:54:55.863479+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:54:55.863479+0000","last_undegraded":"2024-09-14T11:54:55.863479+0000","last_fullsized":"2024-09-14T11:54:55.863479+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:51.625984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866051+0000","last_change":"2024-09-14T11:43:35.603298+0000","last_active":"2024-09-14T11:55:15.866051+0000","last_peered":"2024-09-14T11:55:15.866051+0000","last_clean":"2024-09-14T11:55:15.866051+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:55:15.866051+0000","last_undegraded":"2024-09-14T11:55:15.866051+0000","last_fullsized":"2024-09-14T11:55:15.866051+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882047+0000","last_change":"2024-09-14T11:32:32.585885+0000","last_active":"2024-09-14T11:56:43.882047+0000","last_peered":"2024-09-14T11:56:43.882047+0000","last_clean":"2024-09-14T11:56:43.882047+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:56:43.882047+0000","last_undegraded":"2024-09-14T11:56:43.882047+0000","last_fullsized":"2024-09-14T11:56:43.882047+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.875756+0000","last_change":"2024-09-14T11:32:29.556257+0000","last_active":"2024-09-14T11:55:58.875756+0000","last_peered":"2024-09-14T11:55:58.875756+0000","last_clean":"2024-09-14T11:55:58.875756+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:55:58.875756+0000","last_undegraded":"2024-09-14T11:55:58.875756+0000","last_fullsized":"2024-09-14T11:55:58.875756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:03.738228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859107+0000","last_change":"2024-09-14T11:30:45.181226+0000","last_active":"2024-09-14T11:54:58.859107+0000","last_peered":"2024-09-14T11:54:58.859107+0000","last_clean":"2024-09-14T11:54:58.859107+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:54:58.859107+0000","last_undegraded":"2024-09-14T11:54:58.859107+0000","last_fullsized":"2024-09-14T11:54:58.859107+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:13.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.860482+0000","last_change":"2024-09-14T11:43:35.601936+0000","last_active":"2024-09-14T11:55:18.860482+0000","last_peered":"2024-09-14T11:55:18.860482+0000","last_clean":"2024-09-14T11:55:18.860482+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:55:18.860482+0000","last_undegraded":"2024-09-14T11:55:18.860482+0000","last_fullsized":"2024-09-14T11:55:18.860482+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:28.098855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877364+0000","last_change":"2024-09-14T11:32:32.588409+0000","last_active":"2024-09-14T11:56:03.877364+0000","last_peered":"2024-09-14T11:56:03.877364+0000","last_clean":"2024-09-14T11:56:03.877364+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:56:03.877364+0000","last_undegraded":"2024-09-14T11:56:03.877364+0000","last_fullsized":"2024-09-14T11:56:03.877364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:05.997127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'4","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.320879+0000","last_change":"2024-09-14T11:32:29.554191+0000","last_active":"2024-09-14T11:58:47.320879+0000","last_peered":"2024-09-14T11:58:47.320879+0000","last_clean":"2024-09-14T11:58:47.320879+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:58:47.320879+0000","last_undegraded":"2024-09-14T11:58:47.320879+0000","last_fullsized":"2024-09-14T11:58:47.320879+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.870574+0000","last_change":"2024-09-14T11:30:45.186297+0000","last_active":"2024-09-14T11:55:59.870574+0000","last_peered":"2024-09-14T11:55:59.870574+0000","last_clean":"2024-09-14T11:55:59.870574+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:55:59.870574+0000","last_undegraded":"2024-09-14T11:55:59.870574+0000","last_fullsized":"2024-09-14T11:55:59.870574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.503260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869999+0000","last_change":"2024-09-14T11:43:35.602751+0000","last_active":"2024-09-14T11:55:18.869999+0000","last_peered":"2024-09-14T11:55:18.869999+0000","last_clean":"2024-09-14T11:55:18.869999+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:55:18.869999+0000","last_undegraded":"2024-09-14T11:55:18.869999+0000","last_fullsized":"2024-09-14T11:55:18.869999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:27.871586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.392754+0000","last_change":"2024-09-14T11:32:32.582994+0000","last_active":"2024-09-14T11:58:47.392754+0000","last_peered":"2024-09-14T11:58:47.392754+0000","last_clean":"2024-09-14T11:58:47.392754+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:58:47.392754+0000","last_undegraded":"2024-09-14T11:58:47.392754+0000","last_fullsized":"2024-09-14T11:58:47.392754+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.435708+0000","last_change":"2024-09-14T11:32:29.544034+0000","last_active":"2024-09-14T11:58:47.435708+0000","last_peered":"2024-09-14T11:58:47.435708+0000","last_clean":"2024-09-14T11:58:47.435708+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:58:47.435708+0000","last_undegraded":"2024-09-14T11:58:47.435708+0000","last_fullsized":"2024-09-14T11:58:47.435708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.340892+0000","last_change":"2024-09-14T11:59:07.340892+0000","last_active":"2024-09-14T11:59:07.340892+0000","last_peered":"2024-09-14T11:59:07.340892+0000","last_clean":"2024-09-14T11:59:07.340892+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:59:07.340892+0000","last_undegraded":"2024-09-14T11:59:07.340892+0000","last_fullsized":"2024-09-14T11:59:07.340892+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.340795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:53.630134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869969+0000","last_change":"2024-09-14T11:43:35.601578+0000","last_active":"2024-09-14T11:55:18.869969+0000","last_peered":"2024-09-14T11:55:18.869969+0000","last_clean":"2024-09-14T11:55:18.869969+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:55:18.869969+0000","last_undegraded":"2024-09-14T11:55:18.869969+0000","last_fullsized":"2024-09-14T11:55:18.869969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:45.561461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.019292+0000","last_change":"2024-09-14T11:32:32.581631+0000","last_active":"2024-09-14T11:56:44.019292+0000","last_peered":"2024-09-14T11:56:44.019292+0000","last_clean":"2024-09-14T11:56:44.019292+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:56:44.019292+0000","last_undegraded":"2024-09-14T11:56:44.019292+0000","last_fullsized":"2024-09-14T11:56:44.019292+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.870856+0000","last_change":"2024-09-14T11:32:29.550009+0000","last_active":"2024-09-14T11:56:38.870856+0000","last_peered":"2024-09-14T11:56:38.870856+0000","last_clean":"2024-09-14T11:56:38.870856+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:56:38.870856+0000","last_undegraded":"2024-09-14T11:56:38.870856+0000","last_fullsized":"2024-09-14T11:56:38.870856+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.881198+0000","last_change":"2024-09-14T11:30:45.185397+0000","last_active":"2024-09-14T11:56:33.881198+0000","last_peered":"2024-09-14T11:56:33.881198+0000","last_clean":"2024-09-14T11:56:33.881198+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:56:33.881198+0000","last_undegraded":"2024-09-14T11:56:33.881198+0000","last_fullsized":"2024-09-14T11:56:33.881198+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:30.178621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874909+0000","last_change":"2024-09-14T11:43:35.603719+0000","last_active":"2024-09-14T11:55:43.874909+0000","last_peered":"2024-09-14T11:55:43.874909+0000","last_clean":"2024-09-14T11:55:43.874909+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:55:43.874909+0000","last_undegraded":"2024-09-14T11:55:43.874909+0000","last_fullsized":"2024-09-14T11:55:43.874909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:21.587122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'5","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.241182+0000","last_change":"2024-09-14T11:32:32.583371+0000","last_active":"2024-09-14T11:58:47.241182+0000","last_peered":"2024-09-14T11:58:47.241182+0000","last_clean":"2024-09-14T11:58:47.241182+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:58:47.241182+0000","last_undegraded":"2024-09-14T11:58:47.241182+0000","last_fullsized":"2024-09-14T11:58:47.241182+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:26.139200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'7","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.031907+0000","last_change":"2024-09-14T11:32:29.556494+0000","last_active":"2024-09-14T11:58:09.031907+0000","last_peered":"2024-09-14T11:58:09.031907+0000","last_clean":"2024-09-14T11:58:09.031907+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:58:09.031907+0000","last_undegraded":"2024-09-14T11:58:09.031907+0000","last_fullsized":"2024-09-14T11:58:09.031907+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:44.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7227,"num_write":12,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880349+0000","last_change":"2024-09-14T11:30:45.184935+0000","last_active":"2024-09-14T11:56:28.880349+0000","last_peered":"2024-09-14T11:56:28.880349+0000","last_clean":"2024-09-14T11:56:28.880349+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:56:28.880349+0000","last_undegraded":"2024-09-14T11:56:28.880349+0000","last_fullsized":"2024-09-14T11:56:28.880349+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:16.452875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864520+0000","last_change":"2024-09-14T11:43:35.606065+0000","last_active":"2024-09-14T11:55:43.864520+0000","last_peered":"2024-09-14T11:55:43.864520+0000","last_clean":"2024-09-14T11:55:43.864520+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:55:43.864520+0000","last_undegraded":"2024-09-14T11:55:43.864520+0000","last_fullsized":"2024-09-14T11:55:43.864520+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:45.826564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'6","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.888107+0000","last_change":"2024-09-14T11:32:32.581191+0000","last_active":"2024-09-14T11:58:15.888107+0000","last_peered":"2024-09-14T11:58:15.888107+0000","last_clean":"2024-09-14T11:58:15.888107+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:58:15.888107+0000","last_undegraded":"2024-09-14T11:58:15.888107+0000","last_fullsized":"2024-09-14T11:58:15.888107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:56.670374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875460+0000","last_change":"2024-09-14T11:32:29.543122+0000","last_active":"2024-09-14T11:55:48.875460+0000","last_peered":"2024-09-14T11:55:48.875460+0000","last_clean":"2024-09-14T11:55:48.875460+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:55:48.875460+0000","last_undegraded":"2024-09-14T11:55:48.875460+0000","last_fullsized":"2024-09-14T11:55:48.875460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:34.079866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":73,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.869725+0000","last_change":"2024-09-14T11:30:45.187136+0000","last_active":"2024-09-14T11:56:28.869725+0000","last_peered":"2024-09-14T11:56:28.869725+0000","last_clean":"2024-09-14T11:56:28.869725+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:56:28.869725+0000","last_undegraded":"2024-09-14T11:56:28.869725+0000","last_fullsized":"2024-09-14T11:56:28.869725+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:42.845918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861900+0000","last_change":"2024-09-14T11:43:35.608421+0000","last_active":"2024-09-14T11:55:23.861900+0000","last_peered":"2024-09-14T11:55:23.861900+0000","last_clean":"2024-09-14T11:55:23.861900+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:55:23.861900+0000","last_undegraded":"2024-09-14T11:55:23.861900+0000","last_fullsized":"2024-09-14T11:55:23.861900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:33.729484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.895413+0000","last_change":"2024-09-14T11:32:32.590267+0000","last_active":"2024-09-14T11:58:13.895413+0000","last_peered":"2024-09-14T11:58:13.895413+0000","last_clean":"2024-09-14T11:58:13.895413+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:58:13.895413+0000","last_undegraded":"2024-09-14T11:58:13.895413+0000","last_fullsized":"2024-09-14T11:58:13.895413+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.861311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954756+0000","last_change":"2024-09-14T11:32:29.557676+0000","last_active":"2024-09-14T11:55:48.954756+0000","last_peered":"2024-09-14T11:55:48.954756+0000","last_clean":"2024-09-14T11:55:48.954756+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:55:48.954756+0000","last_undegraded":"2024-09-14T11:55:48.954756+0000","last_fullsized":"2024-09-14T11:55:48.954756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:16.569296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.016904+0000","last_change":"2024-09-14T11:30:45.183316+0000","last_active":"2024-09-14T11:56:29.016904+0000","last_peered":"2024-09-14T11:56:29.016904+0000","last_clean":"2024-09-14T11:56:29.016904+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:56:29.016904+0000","last_undegraded":"2024-09-14T11:56:29.016904+0000","last_fullsized":"2024-09-14T11:56:29.016904+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:21.498493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874873+0000","last_change":"2024-09-14T11:43:35.603573+0000","last_active":"2024-09-14T11:55:43.874873+0000","last_peered":"2024-09-14T11:55:43.874873+0000","last_clean":"2024-09-14T11:55:43.874873+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:55:43.874873+0000","last_undegraded":"2024-09-14T11:55:43.874873+0000","last_fullsized":"2024-09-14T11:55:43.874873+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:21.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.955285+0000","last_change":"2024-09-14T11:32:32.583874+0000","last_active":"2024-09-14T11:55:53.955285+0000","last_peered":"2024-09-14T11:55:53.955285+0000","last_clean":"2024-09-14T11:55:53.955285+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:55:53.955285+0000","last_undegraded":"2024-09-14T11:55:53.955285+0000","last_fullsized":"2024-09-14T11:55:53.955285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:14.827399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874557+0000","last_change":"2024-09-14T11:32:29.557054+0000","last_active":"2024-09-14T11:55:48.874557+0000","last_peered":"2024-09-14T11:55:48.874557+0000","last_clean":"2024-09-14T11:55:48.874557+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:55:48.874557+0000","last_undegraded":"2024-09-14T11:55:48.874557+0000","last_fullsized":"2024-09-14T11:55:48.874557+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:17.332064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880162+0000","last_change":"2024-09-14T11:30:45.188008+0000","last_active":"2024-09-14T11:56:28.880162+0000","last_peered":"2024-09-14T11:56:28.880162+0000","last_clean":"2024-09-14T11:56:28.880162+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:56:28.880162+0000","last_undegraded":"2024-09-14T11:56:28.880162+0000","last_fullsized":"2024-09-14T11:56:28.880162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:10.454288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.870158+0000","last_change":"2024-09-14T11:43:35.601146+0000","last_active":"2024-09-14T11:56:43.870158+0000","last_peered":"2024-09-14T11:56:43.870158+0000","last_clean":"2024-09-14T11:56:43.870158+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:56:43.870158+0000","last_undegraded":"2024-09-14T11:56:43.870158+0000","last_fullsized":"2024-09-14T11:56:43.870158+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869141+0000","last_change":"2024-09-14T11:32:32.585896+0000","last_active":"2024-09-14T11:55:03.869141+0000","last_peered":"2024-09-14T11:55:03.869141+0000","last_clean":"2024-09-14T11:55:03.869141+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:55:03.869141+0000","last_undegraded":"2024-09-14T11:55:03.869141+0000","last_fullsized":"2024-09-14T11:55:03.869141+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:46.169476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867339+0000","last_change":"2024-09-14T11:32:29.550392+0000","last_active":"2024-09-14T11:54:58.867339+0000","last_peered":"2024-09-14T11:54:58.867339+0000","last_clean":"2024-09-14T11:54:58.867339+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:54:58.867339+0000","last_undegraded":"2024-09-14T11:54:58.867339+0000","last_fullsized":"2024-09-14T11:54:58.867339+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.897313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":98,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874939+0000","last_change":"2024-09-14T11:30:45.187527+0000","last_active":"2024-09-14T11:55:43.874939+0000","last_peered":"2024-09-14T11:55:43.874939+0000","last_clean":"2024-09-14T11:55:43.874939+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:55:43.874939+0000","last_undegraded":"2024-09-14T11:55:43.874939+0000","last_fullsized":"2024-09-14T11:55:43.874939+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:10.115937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866776+0000","last_change":"2024-09-14T11:43:35.607758+0000","last_active":"2024-09-14T11:54:53.866776+0000","last_peered":"2024-09-14T11:54:53.866776+0000","last_clean":"2024-09-14T11:54:53.866776+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:54:53.866776+0000","last_undegraded":"2024-09-14T11:54:53.866776+0000","last_fullsized":"2024-09-14T11:54:53.866776+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:25.238514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'4","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.436213+0000","last_change":"2024-09-14T11:32:32.589816+0000","last_active":"2024-09-14T11:58:47.436213+0000","last_peered":"2024-09-14T11:58:47.436213+0000","last_clean":"2024-09-14T11:58:47.436213+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:58:47.436213+0000","last_undegraded":"2024-09-14T11:58:47.436213+0000","last_fullsized":"2024-09-14T11:58:47.436213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:48.593038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.321896+0000","last_change":"2024-09-14T11:59:10.321896+0000","last_active":"2024-09-14T11:59:10.321896+0000","last_peered":"2024-09-14T11:59:10.321896+0000","last_clean":"2024-09-14T11:59:10.321896+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:59:10.321896+0000","last_undegraded":"2024-09-14T11:59:10.321896+0000","last_fullsized":"2024-09-14T11:59:10.321896+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.321802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:41.521238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.872259+0000","last_change":"2024-09-14T11:30:45.175794+0000","last_active":"2024-09-14T11:55:33.872259+0000","last_peered":"2024-09-14T11:55:33.872259+0000","last_clean":"2024-09-14T11:55:33.872259+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:55:33.872259+0000","last_undegraded":"2024-09-14T11:55:33.872259+0000","last_fullsized":"2024-09-14T11:55:33.872259+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:12.580971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.961478+0000","last_change":"2024-09-14T11:43:35.603624+0000","last_active":"2024-09-14T11:56:38.961478+0000","last_peered":"2024-09-14T11:56:38.961478+0000","last_clean":"2024-09-14T11:56:38.961478+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:56:38.961478+0000","last_undegraded":"2024-09-14T11:56:38.961478+0000","last_fullsized":"2024-09-14T11:56:38.961478+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:06.649979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:10.865526+0000","last_change":"2024-09-14T11:32:32.582078+0000","last_active":"2024-09-14T11:55:10.865526+0000","last_peered":"2024-09-14T11:55:10.865526+0000","last_clean":"2024-09-14T11:55:10.865526+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:55:10.865526+0000","last_undegraded":"2024-09-14T11:55:10.865526+0000","last_fullsized":"2024-09-14T11:55:10.865526+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.729935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859071+0000","last_change":"2024-09-14T11:32:29.556788+0000","last_active":"2024-09-14T11:54:58.859071+0000","last_peered":"2024-09-14T11:54:58.859071+0000","last_clean":"2024-09-14T11:54:58.859071+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:54:58.859071+0000","last_undegraded":"2024-09-14T11:54:58.859071+0000","last_fullsized":"2024-09-14T11:54:58.859071+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:25.298432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.952685+0000","last_change":"2024-09-14T11:30:45.181601+0000","last_active":"2024-09-14T11:55:33.952685+0000","last_peered":"2024-09-14T11:55:33.952685+0000","last_clean":"2024-09-14T11:55:33.952685+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:55:33.952685+0000","last_undegraded":"2024-09-14T11:55:33.952685+0000","last_fullsized":"2024-09-14T11:55:33.952685+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:00.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.881804+0000","last_change":"2024-09-14T11:43:35.603524+0000","last_active":"2024-09-14T11:56:38.881804+0000","last_peered":"2024-09-14T11:56:38.881804+0000","last_clean":"2024-09-14T11:56:38.881804+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:56:38.881804+0000","last_undegraded":"2024-09-14T11:56:38.881804+0000","last_fullsized":"2024-09-14T11:56:38.881804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:22.177315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'5","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.886567+0000","last_change":"2024-09-14T11:32:32.588422+0000","last_active":"2024-09-14T11:57:18.886567+0000","last_peered":"2024-09-14T11:57:18.886567+0000","last_clean":"2024-09-14T11:57:18.886567+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:57:18.886567+0000","last_undegraded":"2024-09-14T11:57:18.886567+0000","last_fullsized":"2024-09-14T11:57:18.886567+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.486355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.274746+0000","last_change":"2024-09-14T11:32:29.558855+0000","last_active":"2024-09-14T11:58:47.274746+0000","last_peered":"2024-09-14T11:58:47.274746+0000","last_clean":"2024-09-14T11:58:47.274746+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:58:47.274746+0000","last_undegraded":"2024-09-14T11:58:47.274746+0000","last_fullsized":"2024-09-14T11:58:47.274746+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.718076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":172,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.862421+0000","last_change":"2024-09-14T11:30:45.186320+0000","last_active":"2024-09-14T11:55:33.862421+0000","last_peered":"2024-09-14T11:55:33.862421+0000","last_clean":"2024-09-14T11:55:33.862421+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:55:33.862421+0000","last_undegraded":"2024-09-14T11:55:33.862421+0000","last_fullsized":"2024-09-14T11:55:33.862421+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:02.402885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.867996+0000","last_change":"2024-09-14T11:43:35.607826+0000","last_active":"2024-09-14T11:54:53.867996+0000","last_peered":"2024-09-14T11:54:53.867996+0000","last_clean":"2024-09-14T11:54:53.867996+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:54:53.867996+0000","last_undegraded":"2024-09-14T11:54:53.867996+0000","last_fullsized":"2024-09-14T11:54:53.867996+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:17.558008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:34.035624+0000","last_change":"2024-09-14T11:32:32.590048+0000","last_active":"2024-09-14T11:58:34.035624+0000","last_peered":"2024-09-14T11:58:34.035624+0000","last_clean":"2024-09-14T11:58:34.035624+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:58:34.035624+0000","last_undegraded":"2024-09-14T11:58:34.035624+0000","last_fullsized":"2024-09-14T11:58:34.035624+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:10.124434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868576+0000","last_change":"2024-09-14T11:32:29.557361+0000","last_active":"2024-09-14T11:56:18.868576+0000","last_peered":"2024-09-14T11:56:18.868576+0000","last_clean":"2024-09-14T11:56:18.868576+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:56:18.868576+0000","last_undegraded":"2024-09-14T11:56:18.868576+0000","last_fullsized":"2024-09-14T11:56:18.868576+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:06.391010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":177,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:33.863103+0000","last_change":"2024-09-14T11:30:45.189776+0000","last_active":"2024-09-14T11:55:33.863103+0000","last_peered":"2024-09-14T11:55:33.863103+0000","last_clean":"2024-09-14T11:55:33.863103+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:55:33.863103+0000","last_undegraded":"2024-09-14T11:55:33.863103+0000","last_fullsized":"2024-09-14T11:55:33.863103+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:07.248111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.867381+0000","last_change":"2024-09-14T11:43:35.605135+0000","last_active":"2024-09-14T11:54:58.867381+0000","last_peered":"2024-09-14T11:54:58.867381+0000","last_clean":"2024-09-14T11:54:58.867381+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:54:58.867381+0000","last_undegraded":"2024-09-14T11:54:58.867381+0000","last_fullsized":"2024-09-14T11:54:58.867381+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:13.659827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879560+0000","last_change":"2024-09-14T11:32:32.579119+0000","last_active":"2024-09-14T11:56:23.879560+0000","last_peered":"2024-09-14T11:56:23.879560+0000","last_clean":"2024-09-14T11:56:23.879560+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:56:23.879560+0000","last_undegraded":"2024-09-14T11:56:23.879560+0000","last_fullsized":"2024-09-14T11:56:23.879560+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:39.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:30.889872+0000","last_change":"2024-09-14T11:32:29.558623+0000","last_active":"2024-09-14T11:58:30.889872+0000","last_peered":"2024-09-14T11:58:30.889872+0000","last_clean":"2024-09-14T11:58:30.889872+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:58:30.889872+0000","last_undegraded":"2024-09-14T11:58:30.889872+0000","last_fullsized":"2024-09-14T11:58:30.889872+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:00.753847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.883886+0000","last_change":"2024-09-14T11:30:45.184693+0000","last_active":"2024-09-14T11:56:53.883886+0000","last_peered":"2024-09-14T11:56:53.883886+0000","last_clean":"2024-09-14T11:56:53.883886+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:56:53.883886+0000","last_undegraded":"2024-09-14T11:56:53.883886+0000","last_fullsized":"2024-09-14T11:56:53.883886+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.866795+0000","last_change":"2024-09-14T11:43:35.606592+0000","last_active":"2024-09-14T11:54:53.866795+0000","last_peered":"2024-09-14T11:54:53.866795+0000","last_clean":"2024-09-14T11:54:53.866795+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:54:53.866795+0000","last_undegraded":"2024-09-14T11:54:53.866795+0000","last_fullsized":"2024-09-14T11:54:53.866795+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:47.717972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.864758+0000","last_change":"2024-09-14T11:32:32.582791+0000","last_active":"2024-09-14T11:55:05.864758+0000","last_peered":"2024-09-14T11:55:05.864758+0000","last_clean":"2024-09-14T11:55:05.864758+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:55:05.864758+0000","last_undegraded":"2024-09-14T11:55:05.864758+0000","last_fullsized":"2024-09-14T11:55:05.864758+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.426108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.885147+0000","last_change":"2024-09-14T11:32:29.556753+0000","last_active":"2024-09-14T11:58:33.885147+0000","last_peered":"2024-09-14T11:58:33.885147+0000","last_clean":"2024-09-14T11:58:33.885147+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:58:33.885147+0000","last_undegraded":"2024-09-14T11:58:33.885147+0000","last_fullsized":"2024-09-14T11:58:33.885147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:34.099936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.882574+0000","last_change":"2024-09-14T11:30:45.185455+0000","last_active":"2024-09-14T11:56:48.882574+0000","last_peered":"2024-09-14T11:56:48.882574+0000","last_clean":"2024-09-14T11:56:48.882574+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:56:48.882574+0000","last_undegraded":"2024-09-14T11:56:48.882574+0000","last_fullsized":"2024-09-14T11:56:48.882574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.858467+0000","last_change":"2024-09-14T11:43:35.603825+0000","last_active":"2024-09-14T11:54:53.858467+0000","last_peered":"2024-09-14T11:54:53.858467+0000","last_clean":"2024-09-14T11:54:53.858467+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:54:53.858467+0000","last_undegraded":"2024-09-14T11:54:53.858467+0000","last_fullsized":"2024-09-14T11:54:53.858467+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:22.239624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880311+0000","last_change":"2024-09-14T11:32:32.590037+0000","last_active":"2024-09-14T11:56:28.880311+0000","last_peered":"2024-09-14T11:56:28.880311+0000","last_clean":"2024-09-14T11:56:28.880311+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:56:28.880311+0000","last_undegraded":"2024-09-14T11:56:28.880311+0000","last_fullsized":"2024-09-14T11:56:28.880311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:48.742115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.320757+0000","last_change":"2024-09-14T11:32:29.552051+0000","last_active":"2024-09-14T11:58:47.320757+0000","last_peered":"2024-09-14T11:58:47.320757+0000","last_clean":"2024-09-14T11:58:47.320757+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:58:47.320757+0000","last_undegraded":"2024-09-14T11:58:47.320757+0000","last_fullsized":"2024-09-14T11:58:47.320757+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.824552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.962829+0000","last_change":"2024-09-14T11:30:45.183254+0000","last_active":"2024-09-14T11:56:48.962829+0000","last_peered":"2024-09-14T11:56:48.962829+0000","last_clean":"2024-09-14T11:56:48.962829+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:56:48.962829+0000","last_undegraded":"2024-09-14T11:56:48.962829+0000","last_fullsized":"2024-09-14T11:56:48.962829+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877254+0000","last_change":"2024-09-14T11:43:35.604116+0000","last_active":"2024-09-14T11:56:08.877254+0000","last_peered":"2024-09-14T11:56:08.877254+0000","last_clean":"2024-09-14T11:56:08.877254+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:56:08.877254+0000","last_undegraded":"2024-09-14T11:56:08.877254+0000","last_fullsized":"2024-09-14T11:56:08.877254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:16.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'6","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.393135+0000","last_change":"2024-09-14T11:32:32.583981+0000","last_active":"2024-09-14T11:58:47.393135+0000","last_peered":"2024-09-14T11:58:47.393135+0000","last_clean":"2024-09-14T11:58:47.393135+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:58:47.393135+0000","last_undegraded":"2024-09-14T11:58:47.393135+0000","last_fullsized":"2024-09-14T11:58:47.393135+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:37.109384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'6","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.253435+0000","last_change":"2024-09-14T11:32:29.553611+0000","last_active":"2024-09-14T11:58:47.253435+0000","last_peered":"2024-09-14T11:58:47.253435+0000","last_clean":"2024-09-14T11:58:47.253435+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:58:47.253435+0000","last_undegraded":"2024-09-14T11:58:47.253435+0000","last_fullsized":"2024-09-14T11:58:47.253435+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:23.400420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":138,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.872064+0000","last_change":"2024-09-14T11:30:45.182248+0000","last_active":"2024-09-14T11:56:48.872064+0000","last_peered":"2024-09-14T11:56:48.872064+0000","last_clean":"2024-09-14T11:56:48.872064+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:56:48.872064+0000","last_undegraded":"2024-09-14T11:56:48.872064+0000","last_fullsized":"2024-09-14T11:56:48.872064+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877270+0000","last_change":"2024-09-14T11:43:35.603484+0000","last_active":"2024-09-14T11:56:08.877270+0000","last_peered":"2024-09-14T11:56:08.877270+0000","last_clean":"2024-09-14T11:56:08.877270+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:56:08.877270+0000","last_undegraded":"2024-09-14T11:56:08.877270+0000","last_fullsized":"2024-09-14T11:56:08.877270+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.596092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.877440+0000","last_change":"2024-09-14T11:32:32.575572+0000","last_active":"2024-09-14T11:57:33.877440+0000","last_peered":"2024-09-14T11:57:33.877440+0000","last_clean":"2024-09-14T11:57:33.877440+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:57:33.877440+0000","last_undegraded":"2024-09-14T11:57:33.877440+0000","last_fullsized":"2024-09-14T11:57:33.877440+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:01.425017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.289933+0000","last_change":"2024-09-14T11:59:09.289933+0000","last_active":"2024-09-14T11:59:09.289933+0000","last_peered":"2024-09-14T11:59:09.289933+0000","last_clean":"2024-09-14T11:59:09.289933+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:59:09.289933+0000","last_undegraded":"2024-09-14T11:59:09.289933+0000","last_fullsized":"2024-09-14T11:59:09.289933+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.289838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.777305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.962924+0000","last_change":"2024-09-14T11:30:45.184179+0000","last_active":"2024-09-14T11:56:48.962924+0000","last_peered":"2024-09-14T11:56:48.962924+0000","last_clean":"2024-09-14T11:56:48.962924+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:56:48.962924+0000","last_undegraded":"2024-09-14T11:56:48.962924+0000","last_fullsized":"2024-09-14T11:56:48.962924+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869499+0000","last_change":"2024-09-14T11:43:35.607506+0000","last_active":"2024-09-14T11:55:40.869499+0000","last_peered":"2024-09-14T11:55:40.869499+0000","last_clean":"2024-09-14T11:55:40.869499+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:55:40.869499+0000","last_undegraded":"2024-09-14T11:55:40.869499+0000","last_fullsized":"2024-09-14T11:55:40.869499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:13.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'3","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.898896+0000","last_change":"2024-09-14T11:32:32.583839+0000","last_active":"2024-09-14T11:58:33.898896+0000","last_peered":"2024-09-14T11:58:33.898896+0000","last_clean":"2024-09-14T11:58:33.898896+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:58:33.898896+0000","last_undegraded":"2024-09-14T11:58:33.898896+0000","last_fullsized":"2024-09-14T11:58:33.898896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:03.004208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.898100+0000","last_change":"2024-09-14T11:32:29.554290+0000","last_active":"2024-09-14T11:58:28.898100+0000","last_peered":"2024-09-14T11:58:28.898100+0000","last_clean":"2024-09-14T11:58:28.898100+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:58:28.898100+0000","last_undegraded":"2024-09-14T11:58:28.898100+0000","last_fullsized":"2024-09-14T11:58:28.898100+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:54.635912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":64,"num_write":4,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.875265+0000","last_change":"2024-09-14T11:30:45.188717+0000","last_active":"2024-09-14T11:55:53.875265+0000","last_peered":"2024-09-14T11:55:53.875265+0000","last_clean":"2024-09-14T11:55:53.875265+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:55:53.875265+0000","last_undegraded":"2024-09-14T11:55:53.875265+0000","last_fullsized":"2024-09-14T11:55:53.875265+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:22.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013869+0000","last_change":"2024-09-14T11:43:35.604229+0000","last_active":"2024-09-14T11:56:09.013869+0000","last_peered":"2024-09-14T11:56:09.013869+0000","last_clean":"2024-09-14T11:56:09.013869+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:56:09.013869+0000","last_undegraded":"2024-09-14T11:56:09.013869+0000","last_fullsized":"2024-09-14T11:56:09.013869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:36.198961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.251971+0000","last_change":"2024-09-14T11:32:32.579628+0000","last_active":"2024-09-14T11:58:47.251971+0000","last_peered":"2024-09-14T11:58:47.251971+0000","last_clean":"2024-09-14T11:58:47.251971+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:58:47.251971+0000","last_undegraded":"2024-09-14T11:58:47.251971+0000","last_fullsized":"2024-09-14T11:58:47.251971+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:15.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2088,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.898008+0000","last_change":"2024-09-14T11:32:29.555597+0000","last_active":"2024-09-14T11:58:28.898008+0000","last_peered":"2024-09-14T11:58:28.898008+0000","last_clean":"2024-09-14T11:58:28.898008+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:58:28.898008+0000","last_undegraded":"2024-09-14T11:58:28.898008+0000","last_fullsized":"2024-09-14T11:58:28.898008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:41.029993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870178+0000","last_change":"2024-09-14T11:30:45.176934+0000","last_active":"2024-09-14T11:55:45.870178+0000","last_peered":"2024-09-14T11:55:45.870178+0000","last_clean":"2024-09-14T11:55:45.870178+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:55:45.870178+0000","last_undegraded":"2024-09-14T11:55:45.870178+0000","last_fullsized":"2024-09-14T11:55:45.870178+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:07.587565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":21,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.869724+0000","last_change":"2024-09-14T11:43:35.606492+0000","last_active":"2024-09-14T11:56:38.869724+0000","last_peered":"2024-09-14T11:56:38.869724+0000","last_clean":"2024-09-14T11:56:38.869724+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:56:38.869724+0000","last_undegraded":"2024-09-14T11:56:38.869724+0000","last_fullsized":"2024-09-14T11:56:38.869724+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:37.980270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:35.883204+0000","last_change":"2024-09-14T11:32:32.587253+0000","last_active":"2024-09-14T11:57:35.883204+0000","last_peered":"2024-09-14T11:57:35.883204+0000","last_clean":"2024-09-14T11:57:35.883204+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:57:35.883204+0000","last_undegraded":"2024-09-14T11:57:35.883204+0000","last_fullsized":"2024-09-14T11:57:35.883204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:48.236842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.898789+0000","last_change":"2024-09-14T11:32:29.554686+0000","last_active":"2024-09-14T11:58:33.898789+0000","last_peered":"2024-09-14T11:58:33.898789+0000","last_clean":"2024-09-14T11:58:33.898789+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:58:33.898789+0000","last_undegraded":"2024-09-14T11:58:33.898789+0000","last_fullsized":"2024-09-14T11:58:33.898789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:47.349081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.874577+0000","last_change":"2024-09-14T11:30:45.181837+0000","last_active":"2024-09-14T11:55:48.874577+0000","last_peered":"2024-09-14T11:55:48.874577+0000","last_clean":"2024-09-14T11:55:48.874577+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:55:48.874577+0000","last_undegraded":"2024-09-14T11:55:48.874577+0000","last_fullsized":"2024-09-14T11:55:48.874577+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:59.286638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.870841+0000","last_change":"2024-09-14T11:43:35.601443+0000","last_active":"2024-09-14T11:56:38.870841+0000","last_peered":"2024-09-14T11:56:38.870841+0000","last_clean":"2024-09-14T11:56:38.870841+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:56:38.870841+0000","last_undegraded":"2024-09-14T11:56:38.870841+0000","last_fullsized":"2024-09-14T11:56:38.870841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.372764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882441+0000","last_change":"2024-09-14T11:32:32.587278+0000","last_active":"2024-09-14T11:56:43.882441+0000","last_peered":"2024-09-14T11:56:43.882441+0000","last_clean":"2024-09-14T11:56:43.882441+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:56:43.882441+0000","last_undegraded":"2024-09-14T11:56:43.882441+0000","last_fullsized":"2024-09-14T11:56:43.882441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.322094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870808+0000","last_change":"2024-09-14T11:32:29.548859+0000","last_active":"2024-09-14T11:55:23.870808+0000","last_peered":"2024-09-14T11:55:23.870808+0000","last_clean":"2024-09-14T11:55:23.870808+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:55:23.870808+0000","last_undegraded":"2024-09-14T11:55:23.870808+0000","last_fullsized":"2024-09-14T11:55:23.870808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:45.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":210,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.011327+0000","last_change":"2024-09-14T11:30:45.187608+0000","last_active":"2024-09-14T11:55:49.011327+0000","last_peered":"2024-09-14T11:55:49.011327+0000","last_clean":"2024-09-14T11:55:49.011327+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:55:49.011327+0000","last_undegraded":"2024-09-14T11:55:49.011327+0000","last_fullsized":"2024-09-14T11:55:49.011327+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:16.607409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.867231+0000","last_change":"2024-09-14T11:43:35.605855+0000","last_active":"2024-09-14T11:56:08.867231+0000","last_peered":"2024-09-14T11:56:08.867231+0000","last_clean":"2024-09-14T11:56:08.867231+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:56:08.867231+0000","last_undegraded":"2024-09-14T11:56:08.867231+0000","last_fullsized":"2024-09-14T11:56:08.867231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:26.463408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.232233+0000","last_change":"2024-09-14T11:32:32.590849+0000","last_active":"2024-09-14T11:58:47.232233+0000","last_peered":"2024-09-14T11:58:47.232233+0000","last_clean":"2024-09-14T11:58:47.232233+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:58:47.232233+0000","last_undegraded":"2024-09-14T11:58:47.232233+0000","last_fullsized":"2024-09-14T11:58:47.232233+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:53.175496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2166,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'9","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.401586+0000","last_change":"2024-09-14T11:32:29.553146+0000","last_active":"2024-09-14T11:58:47.401586+0000","last_peered":"2024-09-14T11:58:47.401586+0000","last_clean":"2024-09-14T11:58:47.401586+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:58:47.401586+0000","last_undegraded":"2024-09-14T11:58:47.401586+0000","last_fullsized":"2024-09-14T11:58:47.401586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:39.348345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":87,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.954727+0000","last_change":"2024-09-14T11:30:45.183295+0000","last_active":"2024-09-14T11:55:48.954727+0000","last_peered":"2024-09-14T11:55:48.954727+0000","last_clean":"2024-09-14T11:55:48.954727+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:55:48.954727+0000","last_undegraded":"2024-09-14T11:55:48.954727+0000","last_fullsized":"2024-09-14T11:55:48.954727+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:30.030410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.878101+0000","last_change":"2024-09-14T11:43:35.604955+0000","last_active":"2024-09-14T11:56:13.878101+0000","last_peered":"2024-09-14T11:56:13.878101+0000","last_clean":"2024-09-14T11:56:13.878101+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:56:13.878101+0000","last_undegraded":"2024-09-14T11:56:13.878101+0000","last_fullsized":"2024-09-14T11:56:13.878101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.840822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'14","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:34.026596+0000","last_change":"2024-09-14T11:32:32.584702+0000","last_active":"2024-09-14T11:57:34.026596+0000","last_peered":"2024-09-14T11:57:34.026596+0000","last_clean":"2024-09-14T11:57:34.026596+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:57:34.026596+0000","last_undegraded":"2024-09-14T11:57:34.026596+0000","last_fullsized":"2024-09-14T11:57:34.026596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:19.580871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19460,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'6","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.968432+0000","last_change":"2024-09-14T11:32:29.553252+0000","last_active":"2024-09-14T11:57:28.968432+0000","last_peered":"2024-09-14T11:57:28.968432+0000","last_clean":"2024-09-14T11:57:28.968432+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:57:28.968432+0000","last_undegraded":"2024-09-14T11:57:28.968432+0000","last_fullsized":"2024-09-14T11:57:28.968432+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:40.879039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":128,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.883818+0000","last_change":"2024-09-14T11:30:45.183283+0000","last_active":"2024-09-14T11:56:53.883818+0000","last_peered":"2024-09-14T11:56:53.883818+0000","last_clean":"2024-09-14T11:56:53.883818+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:56:53.883818+0000","last_undegraded":"2024-09-14T11:56:53.883818+0000","last_fullsized":"2024-09-14T11:56:53.883818+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:00.428598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'201","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.924210+0000","last_change":"2024-09-14T11:59:06.924210+0000","last_active":"2024-09-14T11:59:06.924210+0000","last_peered":"2024-09-14T11:59:06.924210+0000","last_clean":"2024-09-14T11:59:06.924210+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:59:06.924210+0000","last_undegraded":"2024-09-14T11:59:06.924210+0000","last_fullsized":"2024-09-14T11:59:06.924210+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.924116+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:26.609676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":502,"num_read_kb":68162,"num_write":958,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'448","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.842355+0000","last_change":"2024-09-14T11:59:10.842355+0000","last_active":"2024-09-14T11:59:10.842355+0000","last_peered":"2024-09-14T11:59:10.842355+0000","last_clean":"2024-09-14T11:59:10.842355+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:59:10.842355+0000","last_undegraded":"2024-09-14T11:59:10.842355+0000","last_fullsized":"2024-09-14T11:59:10.842355+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.842253+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:51.500139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'208","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.657477+0000","last_change":"2024-09-14T11:58:59.657477+0000","last_active":"2024-09-14T11:58:59.657477+0000","last_peered":"2024-09-14T11:58:59.657477+0000","last_clean":"2024-09-14T11:58:59.657477+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:58:59.657477+0000","last_undegraded":"2024-09-14T11:58:59.657477+0000","last_fullsized":"2024-09-14T11:58:59.657477+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.657360+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:27.452025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":84679,"num_write":950,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.017097+0000","last_change":"2024-09-14T11:59:12.017097+0000","last_active":"2024-09-14T11:59:12.017097+0000","last_peered":"2024-09-14T11:59:12.017097+0000","last_clean":"2024-09-14T11:59:12.017097+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:59:12.017097+0000","last_undegraded":"2024-09-14T11:59:12.017097+0000","last_fullsized":"2024-09-14T11:59:12.017097+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'440","last_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_deep_scrub":"262'440","last_deep_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.016980+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:59.528853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'217","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.294031+0000","last_change":"2024-09-14T11:59:01.294031+0000","last_active":"2024-09-14T11:59:01.294031+0000","last_peered":"2024-09-14T11:59:01.294031+0000","last_clean":"2024-09-14T11:59:01.294031+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:59:01.294031+0000","last_undegraded":"2024-09-14T11:59:01.294031+0000","last_fullsized":"2024-09-14T11:59:01.294031+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.293939+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:45.221973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":1085,"num_write":1018,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'743","reported_seq":2196,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.815132+0000","last_change":"2024-09-14T11:15:34.316987+0000","last_active":"2024-09-14T11:56:31.815132+0000","last_peered":"2024-09-14T11:56:31.815132+0000","last_clean":"2024-09-14T11:56:31.815132+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:56:31.815132+0000","last_undegraded":"2024-09-14T11:56:31.815132+0000","last_fullsized":"2024-09-14T11:56:31.815132+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:20.185745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'243","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.828088+0000","last_change":"2024-09-14T11:59:05.828088+0000","last_active":"2024-09-14T11:59:05.828088+0000","last_peered":"2024-09-14T11:59:05.828088+0000","last_clean":"2024-09-14T11:59:05.828088+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:59:05.828088+0000","last_undegraded":"2024-09-14T11:59:05.828088+0000","last_fullsized":"2024-09-14T11:59:05.828088+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'243","last_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_deep_scrub":"262'243","last_deep_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.827996+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:32.370355+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30923,"num_write":1131,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.390988+0000","last_change":"2024-09-14T11:59:10.390988+0000","last_active":"2024-09-14T11:59:10.390988+0000","last_peered":"2024-09-14T11:59:10.390988+0000","last_clean":"2024-09-14T11:59:10.390988+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:59:10.390988+0000","last_undegraded":"2024-09-14T11:59:10.390988+0000","last_fullsized":"2024-09-14T11:59:10.390988+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'684","last_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_deep_scrub":"262'684","last_deep_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.390898+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:20.267647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.925437+0000","last_change":"2024-09-14T11:59:07.925437+0000","last_active":"2024-09-14T11:59:07.925437+0000","last_peered":"2024-09-14T11:59:07.925437+0000","last_clean":"2024-09-14T11:59:07.925437+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:59:07.925437+0000","last_undegraded":"2024-09-14T11:59:07.925437+0000","last_fullsized":"2024-09-14T11:59:07.925437+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.925347+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.275783+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'970","reported_seq":2619,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.160176+0000","last_change":"2024-09-14T11:59:07.160176+0000","last_active":"2024-09-14T11:59:07.160176+0000","last_peered":"2024-09-14T11:59:07.160176+0000","last_clean":"2024-09-14T11:59:07.160176+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:59:07.160176+0000","last_undegraded":"2024-09-14T11:59:07.160176+0000","last_fullsized":"2024-09-14T11:59:07.160176+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'970","last_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_deep_scrub":"262'970","last_deep_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.160091+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.347228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'188","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.854866+0000","last_change":"2024-09-14T11:59:04.854866+0000","last_active":"2024-09-14T11:59:04.854866+0000","last_peered":"2024-09-14T11:59:04.854866+0000","last_clean":"2024-09-14T11:59:04.854866+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:59:04.854866+0000","last_undegraded":"2024-09-14T11:59:04.854866+0000","last_fullsized":"2024-09-14T11:59:04.854866+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.854773+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:26.093727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":10177,"num_write":901,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3047,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.100750+0000","last_change":"2024-09-14T11:59:13.100750+0000","last_active":"2024-09-14T11:59:13.100750+0000","last_peered":"2024-09-14T11:59:13.100750+0000","last_clean":"2024-09-14T11:59:13.100750+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:59:13.100750+0000","last_undegraded":"2024-09-14T11:59:13.100750+0000","last_fullsized":"2024-09-14T11:59:13.100750+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1496","last_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_deep_scrub":"262'1496","last_deep_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.100637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:52.980892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'197","reported_seq":819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.941409+0000","last_change":"2024-09-14T11:59:05.941409+0000","last_active":"2024-09-14T11:59:05.941409+0000","last_peered":"2024-09-14T11:59:05.941409+0000","last_clean":"2024-09-14T11:59:05.941409+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:59:05.941409+0000","last_undegraded":"2024-09-14T11:59:05.941409+0000","last_fullsized":"2024-09-14T11:59:05.941409+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.941309+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.587968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":12539,"num_write":927,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'493","reported_seq":2329,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.833080+0000","last_change":"2024-09-14T11:59:11.833080+0000","last_active":"2024-09-14T11:59:11.833080+0000","last_peered":"2024-09-14T11:59:11.833080+0000","last_clean":"2024-09-14T11:59:11.833080+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:59:11.833080+0000","last_undegraded":"2024-09-14T11:59:11.833080+0000","last_fullsized":"2024-09-14T11:59:11.833080+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.832989+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:47.359326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4847,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'221","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.012282+0000","last_change":"2024-09-14T11:59:09.012282+0000","last_active":"2024-09-14T11:59:09.012282+0000","last_peered":"2024-09-14T11:59:09.012282+0000","last_clean":"2024-09-14T11:59:09.012282+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:59:09.012282+0000","last_undegraded":"2024-09-14T11:59:09.012282+0000","last_fullsized":"2024-09-14T11:59:09.012282+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'221","last_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_deep_scrub":"262'221","last_deep_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.012189+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:02.767488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":31152,"num_write":983,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'599","reported_seq":2471,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.267217+0000","last_change":"2024-09-14T11:59:01.267217+0000","last_active":"2024-09-14T11:59:01.267217+0000","last_peered":"2024-09-14T11:59:01.267217+0000","last_clean":"2024-09-14T11:59:01.267217+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:59:01.267217+0000","last_undegraded":"2024-09-14T11:59:01.267217+0000","last_fullsized":"2024-09-14T11:59:01.267217+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'599","last_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_deep_scrub":"262'599","last_deep_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.267099+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:01.732306+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'761","reported_seq":2283,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.160143+0000","last_change":"2024-09-14T11:59:11.160143+0000","last_active":"2024-09-14T11:59:11.160143+0000","last_peered":"2024-09-14T11:59:11.160143+0000","last_clean":"2024-09-14T11:59:11.160143+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:59:11.160143+0000","last_undegraded":"2024-09-14T11:59:11.160143+0000","last_fullsized":"2024-09-14T11:59:11.160143+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'761","last_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_deep_scrub":"262'761","last_deep_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.160044+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:20.157724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'231","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.918014+0000","last_change":"2024-09-14T11:59:04.917960+0000","last_active":"2024-09-14T11:59:04.918014+0000","last_peered":"2024-09-14T11:59:04.918014+0000","last_clean":"2024-09-14T11:59:04.918014+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:59:04.918014+0000","last_undegraded":"2024-09-14T11:59:04.918014+0000","last_fullsized":"2024-09-14T11:59:04.918014+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.917863+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.312915+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493146,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":8015,"num_write":1062,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'458","reported_seq":2053,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.977768+0000","last_change":"2024-09-14T11:59:10.977768+0000","last_active":"2024-09-14T11:59:10.977768+0000","last_peered":"2024-09-14T11:59:10.977768+0000","last_clean":"2024-09-14T11:59:10.977768+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:59:10.977768+0000","last_undegraded":"2024-09-14T11:59:10.977768+0000","last_fullsized":"2024-09-14T11:59:10.977768+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'458","last_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_deep_scrub":"262'458","last_deep_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.977676+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:08.362285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2530,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'231","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.220440+0000","last_change":"2024-09-14T11:59:02.220381+0000","last_active":"2024-09-14T11:59:02.220440+0000","last_peered":"2024-09-14T11:59:02.220440+0000","last_clean":"2024-09-14T11:59:02.220440+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:59:02.220440+0000","last_undegraded":"2024-09-14T11:59:02.220440+0000","last_fullsized":"2024-09-14T11:59:02.220440+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.220287+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:16.151277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":595,"num_read_kb":24969,"num_write":1057,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'444","reported_seq":1997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.859552+0000","last_change":"2024-09-14T11:59:08.859552+0000","last_active":"2024-09-14T11:59:08.859552+0000","last_peered":"2024-09-14T11:59:08.859552+0000","last_clean":"2024-09-14T11:59:08.859552+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:59:08.859552+0000","last_undegraded":"2024-09-14T11:59:08.859552+0000","last_fullsized":"2024-09-14T11:59:08.859552+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.859468+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.056045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'222","reported_seq":855,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.221736+0000","last_change":"2024-09-14T11:59:01.221670+0000","last_active":"2024-09-14T11:59:01.221736+0000","last_peered":"2024-09-14T11:59:01.221736+0000","last_clean":"2024-09-14T11:59:01.221736+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:59:01.221736+0000","last_undegraded":"2024-09-14T11:59:01.221736+0000","last_fullsized":"2024-09-14T11:59:01.221736+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.221555+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:14.230182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":17269,"num_write":968,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'396","reported_seq":1870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.318870+0000","last_change":"2024-09-14T11:58:59.318739+0000","last_active":"2024-09-14T11:58:59.318870+0000","last_peered":"2024-09-14T11:58:59.318870+0000","last_clean":"2024-09-14T11:58:59.318870+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:58:59.318870+0000","last_undegraded":"2024-09-14T11:58:59.318870+0000","last_fullsized":"2024-09-14T11:58:59.318870+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.318633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:40.556708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'264","reported_seq":907,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.105757+0000","last_change":"2024-09-14T11:58:55.105686+0000","last_active":"2024-09-14T11:58:55.105757+0000","last_peered":"2024-09-14T11:58:55.105757+0000","last_clean":"2024-09-14T11:58:55.105757+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:58:55.105757+0000","last_undegraded":"2024-09-14T11:58:55.105757+0000","last_fullsized":"2024-09-14T11:58:55.105757+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'264","last_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_deep_scrub":"262'264","last_deep_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.105587+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:06.894664+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730148,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":20644,"num_write":1068,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.290767+0000","last_change":"2024-09-14T11:59:00.290708+0000","last_active":"2024-09-14T11:59:00.290767+0000","last_peered":"2024-09-14T11:59:00.290767+0000","last_clean":"2024-09-14T11:59:00.290767+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:59:00.290767+0000","last_undegraded":"2024-09-14T11:59:00.290767+0000","last_fullsized":"2024-09-14T11:59:00.290767+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'348","last_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_deep_scrub":"262'348","last_deep_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.290615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:28.191506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'292","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.884033+0000","last_change":"2024-09-14T11:59:02.883970+0000","last_active":"2024-09-14T11:59:02.884033+0000","last_peered":"2024-09-14T11:59:02.884033+0000","last_clean":"2024-09-14T11:59:02.884033+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:59:02.884033+0000","last_undegraded":"2024-09-14T11:59:02.884033+0000","last_fullsized":"2024-09-14T11:59:02.884033+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.883867+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.038831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1018,"num_read_kb":39546,"num_write":1294,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'574","reported_seq":2426,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.119802+0000","last_change":"2024-09-14T11:59:12.119802+0000","last_active":"2024-09-14T11:59:12.119802+0000","last_peered":"2024-09-14T11:59:12.119802+0000","last_clean":"2024-09-14T11:59:12.119802+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:59:12.119802+0000","last_undegraded":"2024-09-14T11:59:12.119802+0000","last_fullsized":"2024-09-14T11:59:12.119802+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.119675+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:52.499284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2946,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'231","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.260419+0000","last_change":"2024-09-14T11:59:00.260419+0000","last_active":"2024-09-14T11:59:00.260419+0000","last_peered":"2024-09-14T11:59:00.260419+0000","last_clean":"2024-09-14T11:59:00.260419+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:59:00.260419+0000","last_undegraded":"2024-09-14T11:59:00.260419+0000","last_fullsized":"2024-09-14T11:59:00.260419+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.260330+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:44.587761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":555,"num_read_kb":31277,"num_write":1077,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'146","reported_seq":643,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.592174+0000","last_change":"2024-09-14T11:15:42.348963+0000","last_active":"2024-09-14T11:56:57.592174+0000","last_peered":"2024-09-14T11:56:57.592174+0000","last_clean":"2024-09-14T11:56:57.592174+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:56:57.592174+0000","last_undegraded":"2024-09-14T11:56:57.592174+0000","last_fullsized":"2024-09-14T11:56:57.592174+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'826","reported_seq":2539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.890292+0000","last_change":"2024-09-14T11:59:04.890292+0000","last_active":"2024-09-14T11:59:04.890292+0000","last_peered":"2024-09-14T11:59:04.890292+0000","last_clean":"2024-09-14T11:59:04.890292+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:59:04.890292+0000","last_undegraded":"2024-09-14T11:59:04.890292+0000","last_fullsized":"2024-09-14T11:59:04.890292+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'826","last_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_deep_scrub":"262'826","last_deep_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.890191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:04.714390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'201","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.806796+0000","last_change":"2024-09-14T11:59:01.806796+0000","last_active":"2024-09-14T11:59:01.806796+0000","last_peered":"2024-09-14T11:59:01.806796+0000","last_clean":"2024-09-14T11:59:01.806796+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:59:01.806796+0000","last_undegraded":"2024-09-14T11:59:01.806796+0000","last_fullsized":"2024-09-14T11:59:01.806796+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.806682+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:50.717629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":885,"num_read_kb":29517,"num_write":954,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882603+0000","last_change":"2024-09-14T11:15:36.329405+0000","last_active":"2024-09-14T11:56:43.882603+0000","last_peered":"2024-09-14T11:56:43.882603+0000","last_clean":"2024-09-14T11:56:43.882603+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:56:43.882603+0000","last_undegraded":"2024-09-14T11:56:43.882603+0000","last_fullsized":"2024-09-14T11:56:43.882603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'200","reported_seq":790,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.333851+0000","last_change":"2024-09-14T11:15:38.337357+0000","last_active":"2024-09-14T11:58:47.333851+0000","last_peered":"2024-09-14T11:58:47.333851+0000","last_clean":"2024-09-14T11:58:47.333851+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:58:47.333851+0000","last_undegraded":"2024-09-14T11:58:47.333851+0000","last_fullsized":"2024-09-14T11:58:47.333851+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":271,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.883270+0000","last_change":"2024-09-14T11:15:40.343299+0000","last_active":"2024-09-14T11:56:48.883270+0000","last_peered":"2024-09-14T11:56:48.883270+0000","last_clean":"2024-09-14T11:56:48.883270+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:56:48.883270+0000","last_undegraded":"2024-09-14T11:56:48.883270+0000","last_fullsized":"2024-09-14T11:56:48.883270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2483","reported_seq":4315,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.884659+0000","last_change":"2024-09-14T11:15:42.346740+0000","last_active":"2024-09-14T11:56:58.884659+0000","last_peered":"2024-09-14T11:56:58.884659+0000","last_clean":"2024-09-14T11:56:58.884659+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:56:58.884659+0000","last_undegraded":"2024-09-14T11:56:58.884659+0000","last_fullsized":"2024-09-14T11:56:58.884659+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":2400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:08.150839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'435","reported_seq":2275,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.898976+0000","last_change":"2024-09-14T11:59:07.898976+0000","last_active":"2024-09-14T11:59:07.898976+0000","last_peered":"2024-09-14T11:59:07.898976+0000","last_clean":"2024-09-14T11:59:07.898976+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:59:07.898976+0000","last_undegraded":"2024-09-14T11:59:07.898976+0000","last_fullsized":"2024-09-14T11:59:07.898976+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'435","last_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_deep_scrub":"262'435","last_deep_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.898878+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.901107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2558,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'274","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.272095+0000","last_change":"2024-09-14T11:58:54.272095+0000","last_active":"2024-09-14T11:58:54.272095+0000","last_peered":"2024-09-14T11:58:54.272095+0000","last_clean":"2024-09-14T11:58:54.272095+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:58:54.272095+0000","last_undegraded":"2024-09-14T11:58:54.272095+0000","last_fullsized":"2024-09-14T11:58:54.272095+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'274","last_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_deep_scrub":"262'274","last_deep_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.272007+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:31.710416+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":744,"num_read_kb":16466,"num_write":1204,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.872400+0000","last_change":"2024-09-14T11:15:36.334689+0000","last_active":"2024-09-14T11:55:28.872400+0000","last_peered":"2024-09-14T11:55:28.872400+0000","last_clean":"2024-09-14T11:55:28.872400+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:55:28.872400+0000","last_undegraded":"2024-09-14T11:55:28.872400+0000","last_fullsized":"2024-09-14T11:55:28.872400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.914528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'91","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.019321+0000","last_change":"2024-09-14T11:15:38.334852+0000","last_active":"2024-09-14T11:56:44.019321+0000","last_peered":"2024-09-14T11:56:44.019321+0000","last_clean":"2024-09-14T11:56:44.019321+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:56:44.019321+0000","last_undegraded":"2024-09-14T11:56:44.019321+0000","last_fullsized":"2024-09-14T11:56:44.019321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.020177+0000","last_change":"2024-09-14T11:15:40.346053+0000","last_active":"2024-09-14T11:56:49.020177+0000","last_peered":"2024-09-14T11:56:49.020177+0000","last_clean":"2024-09-14T11:56:49.020177+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:56:49.020177+0000","last_undegraded":"2024-09-14T11:56:49.020177+0000","last_fullsized":"2024-09-14T11:56:49.020177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'107","reported_seq":595,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.810718+0000","last_change":"2024-09-14T11:15:42.347308+0000","last_active":"2024-09-14T11:56:31.810718+0000","last_peered":"2024-09-14T11:56:31.810718+0000","last_clean":"2024-09-14T11:56:31.810718+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:56:31.810718+0000","last_undegraded":"2024-09-14T11:56:31.810718+0000","last_fullsized":"2024-09-14T11:56:31.810718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:53.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'425","reported_seq":1999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.318212+0000","last_change":"2024-09-14T11:59:05.318212+0000","last_active":"2024-09-14T11:59:05.318212+0000","last_peered":"2024-09-14T11:59:05.318212+0000","last_clean":"2024-09-14T11:59:05.318212+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:59:05.318212+0000","last_undegraded":"2024-09-14T11:59:05.318212+0000","last_fullsized":"2024-09-14T11:59:05.318212+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'425","last_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_deep_scrub":"262'425","last_deep_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.318119+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:41.523199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'190","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.782772+0000","last_change":"2024-09-14T11:59:00.782772+0000","last_active":"2024-09-14T11:59:00.782772+0000","last_peered":"2024-09-14T11:59:00.782772+0000","last_clean":"2024-09-14T11:59:00.782772+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:59:00.782772+0000","last_undegraded":"2024-09-14T11:59:00.782772+0000","last_fullsized":"2024-09-14T11:59:00.782772+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.782673+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.605643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":30179,"num_write":922,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"36'3","reported_seq":970,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.160723+0000","last_change":"2024-09-14T11:15:36.333013+0000","last_active":"2024-09-14T11:58:47.160723+0000","last_peered":"2024-09-14T11:58:47.160723+0000","last_clean":"2024-09-14T11:58:47.160723+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:58:47.160723+0000","last_undegraded":"2024-09-14T11:58:47.160723+0000","last_fullsized":"2024-09-14T11:58:47.160723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'115","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.680045+0000","last_change":"2024-09-14T11:15:38.337017+0000","last_active":"2024-09-14T11:56:32.680045+0000","last_peered":"2024-09-14T11:56:32.680045+0000","last_clean":"2024-09-14T11:56:32.680045+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:56:32.680045+0000","last_undegraded":"2024-09-14T11:56:32.680045+0000","last_fullsized":"2024-09-14T11:56:32.680045+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.412101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'751","reported_seq":2526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.500469+0000","last_change":"2024-09-14T11:15:40.343642+0000","last_active":"2024-09-14T11:58:47.500469+0000","last_peered":"2024-09-14T11:58:47.500469+0000","last_clean":"2024-09-14T11:58:47.500469+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:58:47.500469+0000","last_undegraded":"2024-09-14T11:58:47.500469+0000","last_fullsized":"2024-09-14T11:58:47.500469+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'193","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.636145+0000","last_change":"2024-09-14T11:15:42.341730+0000","last_active":"2024-09-14T11:56:57.636145+0000","last_peered":"2024-09-14T11:56:57.636145+0000","last_clean":"2024-09-14T11:56:57.636145+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:56:57.636145+0000","last_undegraded":"2024-09-14T11:56:57.636145+0000","last_fullsized":"2024-09-14T11:56:57.636145+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.359150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1029","reported_seq":2598,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.984926+0000","last_change":"2024-09-14T11:59:06.984926+0000","last_active":"2024-09-14T11:59:06.984926+0000","last_peered":"2024-09-14T11:59:06.984926+0000","last_clean":"2024-09-14T11:59:06.984926+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:59:06.984926+0000","last_undegraded":"2024-09-14T11:59:06.984926+0000","last_fullsized":"2024-09-14T11:59:06.984926+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1029","last_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_deep_scrub":"262'1029","last_deep_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.984839+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":1000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:57.478127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'194","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.258145+0000","last_change":"2024-09-14T11:58:58.258145+0000","last_active":"2024-09-14T11:58:58.258145+0000","last_peered":"2024-09-14T11:58:58.258145+0000","last_clean":"2024-09-14T11:58:58.258145+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:58:58.258145+0000","last_undegraded":"2024-09-14T11:58:58.258145+0000","last_fullsized":"2024-09-14T11:58:58.258145+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.258058+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:41.203458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399062,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":441,"num_read_kb":5281,"num_write":856,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882629+0000","last_change":"2024-09-14T11:15:36.330106+0000","last_active":"2024-09-14T11:56:43.882629+0000","last_peered":"2024-09-14T11:56:43.882629+0000","last_clean":"2024-09-14T11:56:43.882629+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:56:43.882629+0000","last_undegraded":"2024-09-14T11:56:43.882629+0000","last_fullsized":"2024-09-14T11:56:43.882629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'123","reported_seq":680,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.292455+0000","last_change":"2024-09-14T11:15:38.337426+0000","last_active":"2024-09-14T11:58:47.292455+0000","last_peered":"2024-09-14T11:58:47.292455+0000","last_clean":"2024-09-14T11:58:47.292455+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:58:47.292455+0000","last_undegraded":"2024-09-14T11:58:47.292455+0000","last_fullsized":"2024-09-14T11:58:47.292455+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":190,"num_write":76,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'812","reported_seq":2227,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.173862+0000","last_change":"2024-09-14T11:15:40.349078+0000","last_active":"2024-09-14T11:58:47.173862+0000","last_peered":"2024-09-14T11:58:47.173862+0000","last_clean":"2024-09-14T11:58:47.173862+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:58:47.173862+0000","last_undegraded":"2024-09-14T11:58:47.173862+0000","last_fullsized":"2024-09-14T11:58:47.173862+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:29.118650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'737","reported_seq":2289,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.860018+0000","last_change":"2024-09-14T11:59:06.860018+0000","last_active":"2024-09-14T11:59:06.860018+0000","last_peered":"2024-09-14T11:59:06.860018+0000","last_clean":"2024-09-14T11:59:06.860018+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:59:06.860018+0000","last_undegraded":"2024-09-14T11:59:06.860018+0000","last_fullsized":"2024-09-14T11:59:06.860018+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.859938+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:44.442477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'207","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.703945+0000","last_change":"2024-09-14T11:58:57.703945+0000","last_active":"2024-09-14T11:58:57.703945+0000","last_peered":"2024-09-14T11:58:57.703945+0000","last_clean":"2024-09-14T11:58:57.703945+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:57.703945+0000","last_undegraded":"2024-09-14T11:58:57.703945+0000","last_fullsized":"2024-09-14T11:58:57.703945+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.703856+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:11.335540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":729,"num_read_kb":30459,"num_write":898,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.883158+0000","last_change":"2024-09-14T11:15:36.334240+0000","last_active":"2024-09-14T11:56:48.883158+0000","last_peered":"2024-09-14T11:56:48.883158+0000","last_clean":"2024-09-14T11:56:48.883158+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:56:48.883158+0000","last_undegraded":"2024-09-14T11:56:48.883158+0000","last_fullsized":"2024-09-14T11:56:48.883158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'213","reported_seq":809,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.372230+0000","last_change":"2024-09-14T11:15:38.335040+0000","last_active":"2024-09-14T11:58:47.372230+0000","last_peered":"2024-09-14T11:58:47.372230+0000","last_clean":"2024-09-14T11:58:47.372230+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:58:47.372230+0000","last_undegraded":"2024-09-14T11:58:47.372230+0000","last_fullsized":"2024-09-14T11:58:47.372230+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12526,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":287,"num_read_kb":357,"num_write":170,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.873529+0000","last_change":"2024-09-14T11:15:40.345833+0000","last_active":"2024-09-14T11:56:10.873529+0000","last_peered":"2024-09-14T11:56:10.873529+0000","last_clean":"2024-09-14T11:56:10.873529+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:56:10.873529+0000","last_undegraded":"2024-09-14T11:56:10.873529+0000","last_fullsized":"2024-09-14T11:56:10.873529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:28.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'552","reported_seq":1347,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801804+0000","last_change":"2024-09-14T11:15:42.350220+0000","last_active":"2024-09-14T11:58:15.801804+0000","last_peered":"2024-09-14T11:58:15.801804+0000","last_clean":"2024-09-14T11:58:15.801804+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:58:15.801804+0000","last_undegraded":"2024-09-14T11:58:15.801804+0000","last_fullsized":"2024-09-14T11:58:15.801804+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:29.655558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'839","reported_seq":2332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.167101+0000","last_change":"2024-09-14T11:59:00.167101+0000","last_active":"2024-09-14T11:59:00.167101+0000","last_peered":"2024-09-14T11:59:00.167101+0000","last_clean":"2024-09-14T11:59:00.167101+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:59:00.167101+0000","last_undegraded":"2024-09-14T11:59:00.167101+0000","last_fullsized":"2024-09-14T11:59:00.167101+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'839","last_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_deep_scrub":"262'839","last_deep_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.167013+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.391900+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'287","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.738135+0000","last_change":"2024-09-14T11:58:58.738135+0000","last_active":"2024-09-14T11:58:58.738135+0000","last_peered":"2024-09-14T11:58:58.738135+0000","last_clean":"2024-09-14T11:58:58.738135+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:58:58.738135+0000","last_undegraded":"2024-09-14T11:58:58.738135+0000","last_fullsized":"2024-09-14T11:58:58.738135+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'287","last_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_deep_scrub":"262'287","last_deep_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.738053+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:39.322669+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":15958,"num_write":1147,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.282011+0000","last_change":"2024-09-14T11:59:12.282011+0000","last_active":"2024-09-14T11:59:12.282011+0000","last_peered":"2024-09-14T11:59:12.282011+0000","last_clean":"2024-09-14T11:59:12.282011+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:59:12.282011+0000","last_undegraded":"2024-09-14T11:59:12.282011+0000","last_fullsized":"2024-09-14T11:59:12.282011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.281919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:33.989125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'120","reported_seq":683,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.489679+0000","last_change":"2024-09-14T11:15:38.336933+0000","last_active":"2024-09-14T11:58:47.489679+0000","last_peered":"2024-09-14T11:58:47.489679+0000","last_clean":"2024-09-14T11:58:47.489679+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:58:47.489679+0000","last_undegraded":"2024-09-14T11:58:47.489679+0000","last_fullsized":"2024-09-14T11:58:47.489679+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.373870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":194,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.884387+0000","last_change":"2024-09-14T11:15:40.349051+0000","last_active":"2024-09-14T11:57:03.884387+0000","last_peered":"2024-09-14T11:57:03.884387+0000","last_clean":"2024-09-14T11:57:03.884387+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:57:03.884387+0000","last_undegraded":"2024-09-14T11:57:03.884387+0000","last_fullsized":"2024-09-14T11:57:03.884387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'124","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.968464+0000","last_change":"2024-09-14T11:15:42.351151+0000","last_active":"2024-09-14T11:57:28.968464+0000","last_peered":"2024-09-14T11:57:28.968464+0000","last_clean":"2024-09-14T11:57:28.968464+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:57:28.968464+0000","last_undegraded":"2024-09-14T11:57:28.968464+0000","last_fullsized":"2024-09-14T11:57:28.968464+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:13.693118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'695","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.215163+0000","last_change":"2024-09-14T11:59:04.215163+0000","last_active":"2024-09-14T11:59:04.215163+0000","last_peered":"2024-09-14T11:59:04.215163+0000","last_clean":"2024-09-14T11:59:04.215163+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:59:04.215163+0000","last_undegraded":"2024-09-14T11:59:04.215163+0000","last_fullsized":"2024-09-14T11:59:04.215163+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'695","last_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_deep_scrub":"262'695","last_deep_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.215080+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:28.285334+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":241,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'236","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.244348+0000","last_change":"2024-09-14T11:58:55.244348+0000","last_active":"2024-09-14T11:58:55.244348+0000","last_peered":"2024-09-14T11:58:55.244348+0000","last_clean":"2024-09-14T11:58:55.244348+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:58:55.244348+0000","last_undegraded":"2024-09-14T11:58:55.244348+0000","last_fullsized":"2024-09-14T11:58:55.244348+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'236","last_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_deep_scrub":"262'236","last_deep_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.244245+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:50.597423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":32200,"num_write":1033,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.276886+0000","last_change":"2024-09-14T11:59:03.276886+0000","last_active":"2024-09-14T11:59:03.276886+0000","last_peered":"2024-09-14T11:59:03.276886+0000","last_clean":"2024-09-14T11:59:03.276886+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:59:03.276886+0000","last_undegraded":"2024-09-14T11:59:03.276886+0000","last_fullsized":"2024-09-14T11:59:03.276886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.276755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:59.224975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'167","reported_seq":741,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.387607+0000","last_change":"2024-09-14T11:15:38.339476+0000","last_active":"2024-09-14T11:58:47.387607+0000","last_peered":"2024-09-14T11:58:47.387607+0000","last_clean":"2024-09-14T11:58:47.387607+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:58:47.387607+0000","last_undegraded":"2024-09-14T11:58:47.387607+0000","last_fullsized":"2024-09-14T11:58:47.387607+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":303,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'803","reported_seq":4160,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.505839+0000","last_change":"2024-09-14T11:15:40.344136+0000","last_active":"2024-09-14T11:58:47.505839+0000","last_peered":"2024-09-14T11:58:47.505839+0000","last_clean":"2024-09-14T11:58:47.505839+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:58:47.505839+0000","last_undegraded":"2024-09-14T11:58:47.505839+0000","last_fullsized":"2024-09-14T11:58:47.505839+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'140","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.462485+0000","last_change":"2024-09-14T11:15:42.354873+0000","last_active":"2024-09-14T11:58:14.462485+0000","last_peered":"2024-09-14T11:58:14.462485+0000","last_clean":"2024-09-14T11:58:14.462485+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:58:14.462485+0000","last_undegraded":"2024-09-14T11:58:14.462485+0000","last_fullsized":"2024-09-14T11:58:14.462485+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.286153+0000","last_change":"2024-09-14T11:59:04.286153+0000","last_active":"2024-09-14T11:59:04.286153+0000","last_peered":"2024-09-14T11:59:04.286153+0000","last_clean":"2024-09-14T11:59:04.286153+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:59:04.286153+0000","last_undegraded":"2024-09-14T11:59:04.286153+0000","last_fullsized":"2024-09-14T11:59:04.286153+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'842","last_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_deep_scrub":"262'842","last_deep_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.286054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:06.803501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'270","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.198507+0000","last_change":"2024-09-14T11:58:54.198507+0000","last_active":"2024-09-14T11:58:54.198507+0000","last_peered":"2024-09-14T11:58:54.198507+0000","last_clean":"2024-09-14T11:58:54.198507+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:54.198507+0000","last_undegraded":"2024-09-14T11:58:54.198507+0000","last_fullsized":"2024-09-14T11:58:54.198507+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'270","last_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_deep_scrub":"262'270","last_deep_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.198407+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:41.502019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":40477,"num_write":1093,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.246881+0000","last_change":"2024-09-14T11:59:02.246809+0000","last_active":"2024-09-14T11:59:02.246881+0000","last_peered":"2024-09-14T11:59:02.246881+0000","last_clean":"2024-09-14T11:59:02.246881+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:59:02.246881+0000","last_undegraded":"2024-09-14T11:59:02.246881+0000","last_fullsized":"2024-09-14T11:59:02.246881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.246720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:43.335103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'204","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.408180+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:58:47.408180+0000","last_peered":"2024-09-14T11:58:47.408180+0000","last_clean":"2024-09-14T11:58:47.408180+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:58:47.408180+0000","last_undegraded":"2024-09-14T11:58:47.408180+0000","last_fullsized":"2024-09-14T11:58:47.408180+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":292,"num_read_kb":532,"num_write":152,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.871107+0000","last_change":"2024-09-14T11:15:40.342222+0000","last_active":"2024-09-14T11:56:53.871107+0000","last_peered":"2024-09-14T11:56:53.871107+0000","last_clean":"2024-09-14T11:56:53.871107+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:56:53.871107+0000","last_undegraded":"2024-09-14T11:56:53.871107+0000","last_fullsized":"2024-09-14T11:56:53.871107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'132","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.878824+0000","last_change":"2024-09-14T11:15:42.350823+0000","last_active":"2024-09-14T11:56:55.878824+0000","last_peered":"2024-09-14T11:56:55.878824+0000","last_clean":"2024-09-14T11:56:55.878824+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:56:55.878824+0000","last_undegraded":"2024-09-14T11:56:55.878824+0000","last_fullsized":"2024-09-14T11:56:55.878824+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'489","reported_seq":2098,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.170207+0000","last_change":"2024-09-14T11:59:01.170207+0000","last_active":"2024-09-14T11:59:01.170207+0000","last_peered":"2024-09-14T11:59:01.170207+0000","last_clean":"2024-09-14T11:59:01.170207+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:59:01.170207+0000","last_undegraded":"2024-09-14T11:59:01.170207+0000","last_fullsized":"2024-09-14T11:59:01.170207+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'489","last_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_deep_scrub":"262'489","last_deep_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.170127+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:23.040904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":957,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'233","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.841862+0000","last_change":"2024-09-14T11:58:56.841862+0000","last_active":"2024-09-14T11:58:56.841862+0000","last_peered":"2024-09-14T11:58:56.841862+0000","last_clean":"2024-09-14T11:58:56.841862+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:58:56.841862+0000","last_undegraded":"2024-09-14T11:58:56.841862+0000","last_fullsized":"2024-09-14T11:58:56.841862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'233","last_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_deep_scrub":"262'233","last_deep_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.841768+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:37.320911+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":679,"num_read_kb":211577,"num_write":961,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.271674+0000","last_change":"2024-09-14T11:59:04.271674+0000","last_active":"2024-09-14T11:59:04.271674+0000","last_peered":"2024-09-14T11:59:04.271674+0000","last_clean":"2024-09-14T11:59:04.271674+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:59:04.271674+0000","last_undegraded":"2024-09-14T11:59:04.271674+0000","last_fullsized":"2024-09-14T11:59:04.271674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.271581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:18.845590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'143","reported_seq":708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.234555+0000","last_change":"2024-09-14T11:15:38.335114+0000","last_active":"2024-09-14T11:58:47.234555+0000","last_peered":"2024-09-14T11:58:47.234555+0000","last_clean":"2024-09-14T11:58:47.234555+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:58:47.234555+0000","last_undegraded":"2024-09-14T11:58:47.234555+0000","last_fullsized":"2024-09-14T11:58:47.234555+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:02.079815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":279,"num_write":168,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868727+0000","last_change":"2024-09-14T11:15:40.352052+0000","last_active":"2024-09-14T11:56:18.868727+0000","last_peered":"2024-09-14T11:56:18.868727+0000","last_clean":"2024-09-14T11:56:18.868727+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:56:18.868727+0000","last_undegraded":"2024-09-14T11:56:18.868727+0000","last_fullsized":"2024-09-14T11:56:18.868727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:06.160840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'120","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.892807+0000","last_change":"2024-09-14T11:15:42.350884+0000","last_active":"2024-09-14T11:57:53.892807+0000","last_peered":"2024-09-14T11:57:53.892807+0000","last_clean":"2024-09-14T11:57:53.892807+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:57:53.892807+0000","last_undegraded":"2024-09-14T11:57:53.892807+0000","last_fullsized":"2024-09-14T11:57:53.892807+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.299714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'401","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.146653+0000","last_change":"2024-09-14T11:59:02.146653+0000","last_active":"2024-09-14T11:59:02.146653+0000","last_peered":"2024-09-14T11:59:02.146653+0000","last_clean":"2024-09-14T11:59:02.146653+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:59:02.146653+0000","last_undegraded":"2024-09-14T11:59:02.146653+0000","last_fullsized":"2024-09-14T11:59:02.146653+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'401","last_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_deep_scrub":"262'401","last_deep_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.146555+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:42.384227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'223","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.241638+0000","last_change":"2024-09-14T11:58:56.241556+0000","last_active":"2024-09-14T11:58:56.241638+0000","last_peered":"2024-09-14T11:58:56.241638+0000","last_clean":"2024-09-14T11:58:56.241638+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:56.241638+0000","last_undegraded":"2024-09-14T11:58:56.241638+0000","last_fullsized":"2024-09-14T11:58:56.241638+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.241416+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:27.853420+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1176,"num_read_kb":14840,"num_write":1005,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.643614+0000","last_change":"2024-09-14T11:59:08.643614+0000","last_active":"2024-09-14T11:59:08.643614+0000","last_peered":"2024-09-14T11:59:08.643614+0000","last_clean":"2024-09-14T11:59:08.643614+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:59:08.643614+0000","last_undegraded":"2024-09-14T11:59:08.643614+0000","last_fullsized":"2024-09-14T11:59:08.643614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.643511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:00.185539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'169","reported_seq":756,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.269583+0000","last_change":"2024-09-14T11:59:05.269583+0000","last_active":"2024-09-14T11:59:05.269583+0000","last_peered":"2024-09-14T11:59:05.269583+0000","last_clean":"2024-09-14T11:59:05.269583+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:59:05.269583+0000","last_undegraded":"2024-09-14T11:59:05.269583+0000","last_fullsized":"2024-09-14T11:59:05.269583+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'169","last_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_deep_scrub":"262'169","last_deep_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.269486+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:22.201735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9189,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":308,"num_write":130,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.312182+0000","last_change":"2024-09-14T11:59:11.312182+0000","last_active":"2024-09-14T11:59:11.312182+0000","last_peered":"2024-09-14T11:59:11.312182+0000","last_clean":"2024-09-14T11:59:11.312182+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:59:11.312182+0000","last_undegraded":"2024-09-14T11:59:11.312182+0000","last_fullsized":"2024-09-14T11:59:11.312182+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.312094+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:03.384832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'137","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.461101+0000","last_change":"2024-09-14T11:15:42.355458+0000","last_active":"2024-09-14T11:56:38.461101+0000","last_peered":"2024-09-14T11:56:38.461101+0000","last_clean":"2024-09-14T11:56:38.461101+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:56:38.461101+0000","last_undegraded":"2024-09-14T11:56:38.461101+0000","last_fullsized":"2024-09-14T11:56:38.461101+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:20.221336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1226","reported_seq":2799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.175076+0000","last_change":"2024-09-14T11:59:03.175076+0000","last_active":"2024-09-14T11:59:03.175076+0000","last_peered":"2024-09-14T11:59:03.175076+0000","last_clean":"2024-09-14T11:59:03.175076+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:59:03.175076+0000","last_undegraded":"2024-09-14T11:59:03.175076+0000","last_fullsized":"2024-09-14T11:59:03.175076+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1226","last_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_deep_scrub":"262'1226","last_deep_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.174965+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.571515+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'203","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.140005+0000","last_change":"2024-09-14T11:58:58.140005+0000","last_active":"2024-09-14T11:58:58.140005+0000","last_peered":"2024-09-14T11:58:58.140005+0000","last_clean":"2024-09-14T11:58:58.140005+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:58:58.140005+0000","last_undegraded":"2024-09-14T11:58:58.140005+0000","last_fullsized":"2024-09-14T11:58:58.140005+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.139868+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:54.848038+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":33043,"num_write":876,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.740948+0000","last_change":"2024-09-14T11:15:36.330154+0000","last_active":"2024-09-14T11:58:46.740948+0000","last_peered":"2024-09-14T11:58:46.740948+0000","last_clean":"2024-09-14T11:58:46.740948+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:58:46.740948+0000","last_undegraded":"2024-09-14T11:58:46.740948+0000","last_fullsized":"2024-09-14T11:58:46.740948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":951,"num_read_kb":951,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'89","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.878066+0000","last_change":"2024-09-14T11:15:38.335382+0000","last_active":"2024-09-14T11:56:08.878066+0000","last_peered":"2024-09-14T11:56:08.878066+0000","last_clean":"2024-09-14T11:56:08.878066+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:56:08.878066+0000","last_undegraded":"2024-09-14T11:56:08.878066+0000","last_fullsized":"2024-09-14T11:56:08.878066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.353564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'769","reported_seq":2241,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.136534+0000","last_change":"2024-09-14T11:59:13.136534+0000","last_active":"2024-09-14T11:59:13.136534+0000","last_peered":"2024-09-14T11:59:13.136534+0000","last_clean":"2024-09-14T11:59:13.136534+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:59:13.136534+0000","last_undegraded":"2024-09-14T11:59:13.136534+0000","last_fullsized":"2024-09-14T11:59:13.136534+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'769","last_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_deep_scrub":"262'769","last_deep_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.136434+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:03.613925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'148","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.994130+0000","last_change":"2024-09-14T11:15:42.354665+0000","last_active":"2024-09-14T11:56:36.994130+0000","last_peered":"2024-09-14T11:56:36.994130+0000","last_clean":"2024-09-14T11:56:36.994130+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:56:36.994130+0000","last_undegraded":"2024-09-14T11:56:36.994130+0000","last_fullsized":"2024-09-14T11:56:36.994130+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:56.500802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'426","reported_seq":2152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.612965+0000","last_change":"2024-09-14T11:59:03.612965+0000","last_active":"2024-09-14T11:59:03.612965+0000","last_peered":"2024-09-14T11:59:03.612965+0000","last_clean":"2024-09-14T11:59:03.612965+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:59:03.612965+0000","last_undegraded":"2024-09-14T11:59:03.612965+0000","last_fullsized":"2024-09-14T11:59:03.612965+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'426","last_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_deep_scrub":"262'426","last_deep_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.612866+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:46.847404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'177","reported_seq":791,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.824967+0000","last_change":"2024-09-14T11:58:55.824967+0000","last_active":"2024-09-14T11:58:55.824967+0000","last_peered":"2024-09-14T11:58:55.824967+0000","last_clean":"2024-09-14T11:58:55.824967+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:58:55.824967+0000","last_undegraded":"2024-09-14T11:58:55.824967+0000","last_fullsized":"2024-09-14T11:58:55.824967+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.824891+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.305401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":26947,"num_write":787,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013965+0000","last_change":"2024-09-14T11:15:36.335046+0000","last_active":"2024-09-14T11:56:09.013965+0000","last_peered":"2024-09-14T11:56:09.013965+0000","last_clean":"2024-09-14T11:56:09.013965+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:56:09.013965+0000","last_undegraded":"2024-09-14T11:56:09.013965+0000","last_fullsized":"2024-09-14T11:56:09.013965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:54.481756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'210","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.345467+0000","last_change":"2024-09-14T11:15:38.333929+0000","last_active":"2024-09-14T11:58:47.345467+0000","last_peered":"2024-09-14T11:58:47.345467+0000","last_clean":"2024-09-14T11:58:47.345467+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:58:47.345467+0000","last_undegraded":"2024-09-14T11:58:47.345467+0000","last_fullsized":"2024-09-14T11:58:47.345467+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:34.403088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":896,"num_read_kb":967,"num_write":1418,"num_write_kb":1294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.100560+0000","last_change":"2024-09-14T11:59:11.100560+0000","last_active":"2024-09-14T11:59:11.100560+0000","last_peered":"2024-09-14T11:59:11.100560+0000","last_clean":"2024-09-14T11:59:11.100560+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:59:11.100560+0000","last_undegraded":"2024-09-14T11:59:11.100560+0000","last_fullsized":"2024-09-14T11:59:11.100560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.100464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.020435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'145","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.161350+0000","last_change":"2024-09-14T11:15:42.351759+0000","last_active":"2024-09-14T11:55:57.161350+0000","last_peered":"2024-09-14T11:55:57.161350+0000","last_clean":"2024-09-14T11:55:57.161350+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:55:57.161350+0000","last_undegraded":"2024-09-14T11:55:57.161350+0000","last_fullsized":"2024-09-14T11:55:57.161350+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:09.805942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'801","reported_seq":2324,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.230934+0000","last_change":"2024-09-14T11:59:03.230934+0000","last_active":"2024-09-14T11:59:03.230934+0000","last_peered":"2024-09-14T11:59:03.230934+0000","last_clean":"2024-09-14T11:59:03.230934+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:59:03.230934+0000","last_undegraded":"2024-09-14T11:59:03.230934+0000","last_fullsized":"2024-09-14T11:59:03.230934+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'801","last_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_deep_scrub":"262'801","last_deep_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.230846+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:04.064474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.760463+0000","last_change":"2024-09-14T11:58:59.760463+0000","last_active":"2024-09-14T11:58:59.760463+0000","last_peered":"2024-09-14T11:58:59.760463+0000","last_clean":"2024-09-14T11:58:59.760463+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:58:59.760463+0000","last_undegraded":"2024-09-14T11:58:59.760463+0000","last_fullsized":"2024-09-14T11:58:59.760463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.760359+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.092864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":518,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.827346+0000","last_change":"2024-09-14T11:58:54.827283+0000","last_active":"2024-09-14T11:58:54.827346+0000","last_peered":"2024-09-14T11:58:54.827346+0000","last_clean":"2024-09-14T11:58:54.827346+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:58:54.827346+0000","last_undegraded":"2024-09-14T11:58:54.827346+0000","last_fullsized":"2024-09-14T11:58:54.827346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.827191+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:45.032950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'242","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.815404+0000","last_change":"2024-09-14T11:58:53.815404+0000","last_active":"2024-09-14T11:58:53.815404+0000","last_peered":"2024-09-14T11:58:53.815404+0000","last_clean":"2024-09-14T11:58:53.815404+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:58:53.815404+0000","last_undegraded":"2024-09-14T11:58:53.815404+0000","last_fullsized":"2024-09-14T11:58:53.815404+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'242","last_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_deep_scrub":"262'242","last_deep_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.815334+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:37.358269+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":31904,"num_write":1129,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.999968+0000","last_change":"2024-09-14T11:59:12.999968+0000","last_active":"2024-09-14T11:59:12.999968+0000","last_peered":"2024-09-14T11:59:12.999968+0000","last_clean":"2024-09-14T11:59:12.999968+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:59:12.999968+0000","last_undegraded":"2024-09-14T11:59:12.999968+0000","last_fullsized":"2024-09-14T11:59:12.999968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.999868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:32.858382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'305","reported_seq":991,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.450014+0000","last_change":"2024-09-14T11:15:38.335792+0000","last_active":"2024-09-14T11:58:47.450014+0000","last_peered":"2024-09-14T11:58:47.450014+0000","last_clean":"2024-09-14T11:58:47.450014+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:58:47.450014+0000","last_undegraded":"2024-09-14T11:58:47.450014+0000","last_fullsized":"2024-09-14T11:58:47.450014+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36736,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":789,"num_write":500,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.872713+0000","last_change":"2024-09-14T11:15:40.350659+0000","last_active":"2024-09-14T11:56:53.872713+0000","last_peered":"2024-09-14T11:56:53.872713+0000","last_clean":"2024-09-14T11:56:53.872713+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:56:53.872713+0000","last_undegraded":"2024-09-14T11:56:53.872713+0000","last_fullsized":"2024-09-14T11:56:53.872713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'189","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.587670+0000","last_change":"2024-09-14T11:15:42.350534+0000","last_active":"2024-09-14T11:56:57.587670+0000","last_peered":"2024-09-14T11:56:57.587670+0000","last_clean":"2024-09-14T11:56:57.587670+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:56:57.587670+0000","last_undegraded":"2024-09-14T11:56:57.587670+0000","last_fullsized":"2024-09-14T11:56:57.587670+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'496","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.319385+0000","last_change":"2024-09-14T11:59:03.319385+0000","last_active":"2024-09-14T11:59:03.319385+0000","last_peered":"2024-09-14T11:59:03.319385+0000","last_clean":"2024-09-14T11:59:03.319385+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:59:03.319385+0000","last_undegraded":"2024-09-14T11:59:03.319385+0000","last_fullsized":"2024-09-14T11:59:03.319385+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.319251+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.665879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751104+0000","last_change":"2024-09-14T11:58:56.751104+0000","last_active":"2024-09-14T11:58:56.751104+0000","last_peered":"2024-09-14T11:58:56.751104+0000","last_clean":"2024-09-14T11:58:56.751104+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:58:56.751104+0000","last_undegraded":"2024-09-14T11:58:56.751104+0000","last_fullsized":"2024-09-14T11:58:56.751104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:51.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'197","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.272045+0000","last_change":"2024-09-14T11:58:52.272045+0000","last_active":"2024-09-14T11:58:52.272045+0000","last_peered":"2024-09-14T11:58:52.272045+0000","last_clean":"2024-09-14T11:58:52.272045+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:58:52.272045+0000","last_undegraded":"2024-09-14T11:58:52.272045+0000","last_fullsized":"2024-09-14T11:58:52.272045+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.271906+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:15.088566+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":761,"num_read_kb":134470,"num_write":901,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.833801+0000","last_change":"2024-09-14T11:59:12.833801+0000","last_active":"2024-09-14T11:59:12.833801+0000","last_peered":"2024-09-14T11:59:12.833801+0000","last_clean":"2024-09-14T11:59:12.833801+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:59:12.833801+0000","last_undegraded":"2024-09-14T11:59:12.833801+0000","last_fullsized":"2024-09-14T11:59:12.833801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.833667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:02.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'855","reported_seq":2301,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.496094+0000","last_change":"2024-09-14T11:15:38.335641+0000","last_active":"2024-09-14T11:58:47.496094+0000","last_peered":"2024-09-14T11:58:47.496094+0000","last_clean":"2024-09-14T11:58:47.496094+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:58:47.496094+0000","last_undegraded":"2024-09-14T11:58:47.496094+0000","last_fullsized":"2024-09-14T11:58:47.496094+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:31.939839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34835,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1171,"num_read_kb":1364,"num_write":276,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870881+0000","last_change":"2024-09-14T11:15:40.344759+0000","last_active":"2024-09-14T11:55:23.870881+0000","last_peered":"2024-09-14T11:55:23.870881+0000","last_clean":"2024-09-14T11:55:23.870881+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:55:23.870881+0000","last_undegraded":"2024-09-14T11:55:23.870881+0000","last_fullsized":"2024-09-14T11:55:23.870881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:49.591931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'99","reported_seq":600,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.879380+0000","last_change":"2024-09-14T11:15:42.346979+0000","last_active":"2024-09-14T11:57:00.879380+0000","last_peered":"2024-09-14T11:57:00.879380+0000","last_clean":"2024-09-14T11:57:00.879380+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:57:00.879380+0000","last_undegraded":"2024-09-14T11:57:00.879380+0000","last_fullsized":"2024-09-14T11:57:00.879380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'540","reported_seq":2069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.642068+0000","last_change":"2024-09-14T11:59:02.642068+0000","last_active":"2024-09-14T11:59:02.642068+0000","last_peered":"2024-09-14T11:59:02.642068+0000","last_clean":"2024-09-14T11:59:02.642068+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:59:02.642068+0000","last_undegraded":"2024-09-14T11:59:02.642068+0000","last_fullsized":"2024-09-14T11:59:02.642068+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.641963+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:17.604167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.235879+0000","last_change":"2024-09-14T11:58:53.235819+0000","last_active":"2024-09-14T11:58:53.235879+0000","last_peered":"2024-09-14T11:58:53.235879+0000","last_clean":"2024-09-14T11:58:53.235879+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:58:53.235879+0000","last_undegraded":"2024-09-14T11:58:53.235879+0000","last_fullsized":"2024-09-14T11:58:53.235879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.235741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:53.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'177","reported_seq":778,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.608013+0000","last_change":"2024-09-14T11:58:54.608013+0000","last_active":"2024-09-14T11:58:54.608013+0000","last_peered":"2024-09-14T11:58:54.608013+0000","last_clean":"2024-09-14T11:58:54.608013+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:58:54.608013+0000","last_undegraded":"2024-09-14T11:58:54.608013+0000","last_fullsized":"2024-09-14T11:58:54.608013+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.607889+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:25.551492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":27621,"num_write":841,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.323218+0000","last_change":"2024-09-14T11:59:08.323218+0000","last_active":"2024-09-14T11:59:08.323218+0000","last_peered":"2024-09-14T11:59:08.323218+0000","last_clean":"2024-09-14T11:59:08.323218+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:59:08.323218+0000","last_undegraded":"2024-09-14T11:59:08.323218+0000","last_fullsized":"2024-09-14T11:59:08.323218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.323133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:08.984207+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'213","reported_seq":1266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.842747+0000","last_change":"2024-09-14T11:15:38.338714+0000","last_active":"2024-09-14T11:58:15.842747+0000","last_peered":"2024-09-14T11:58:15.842747+0000","last_clean":"2024-09-14T11:58:15.842747+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:58:15.842747+0000","last_undegraded":"2024-09-14T11:58:15.842747+0000","last_fullsized":"2024-09-14T11:58:15.842747+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:12.349920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.861300+0000","last_change":"2024-09-14T11:15:40.351390+0000","last_active":"2024-09-14T11:55:18.861300+0000","last_peered":"2024-09-14T11:55:18.861300+0000","last_clean":"2024-09-14T11:55:18.861300+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:55:18.861300+0000","last_undegraded":"2024-09-14T11:55:18.861300+0000","last_fullsized":"2024-09-14T11:55:18.861300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.483392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'280","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.803304+0000","last_change":"2024-09-14T11:15:42.351361+0000","last_active":"2024-09-14T11:58:15.803304+0000","last_peered":"2024-09-14T11:58:15.803304+0000","last_clean":"2024-09-14T11:58:15.803304+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:58:15.803304+0000","last_undegraded":"2024-09-14T11:58:15.803304+0000","last_fullsized":"2024-09-14T11:58:15.803304+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.895714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'558","reported_seq":2138,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.639356+0000","last_change":"2024-09-14T11:59:01.639356+0000","last_active":"2024-09-14T11:59:01.639356+0000","last_peered":"2024-09-14T11:59:01.639356+0000","last_clean":"2024-09-14T11:59:01.639356+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:59:01.639356+0000","last_undegraded":"2024-09-14T11:59:01.639356+0000","last_fullsized":"2024-09-14T11:59:01.639356+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'558","last_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_deep_scrub":"262'558","last_deep_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.639211+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:58.123592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":519,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.779905+0000","last_change":"2024-09-14T11:58:55.779846+0000","last_active":"2024-09-14T11:58:55.779905+0000","last_peered":"2024-09-14T11:58:55.779905+0000","last_clean":"2024-09-14T11:58:55.779905+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:58:55.779905+0000","last_undegraded":"2024-09-14T11:58:55.779905+0000","last_fullsized":"2024-09-14T11:58:55.779905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.779753+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:41.730972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'218","reported_seq":844,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.148939+0000","last_change":"2024-09-14T11:58:54.148939+0000","last_active":"2024-09-14T11:58:54.148939+0000","last_peered":"2024-09-14T11:58:54.148939+0000","last_clean":"2024-09-14T11:58:54.148939+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:58:54.148939+0000","last_undegraded":"2024-09-14T11:58:54.148939+0000","last_fullsized":"2024-09-14T11:58:54.148939+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.148824+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:26.080263+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":21127,"num_write":1026,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.398988+0000","last_change":"2024-09-14T11:59:12.398988+0000","last_active":"2024-09-14T11:59:12.398988+0000","last_peered":"2024-09-14T11:59:12.398988+0000","last_clean":"2024-09-14T11:59:12.398988+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:59:12.398988+0000","last_undegraded":"2024-09-14T11:59:12.398988+0000","last_fullsized":"2024-09-14T11:59:12.398988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.398880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.920892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'124","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.922281+0000","last_change":"2024-09-14T11:15:38.340290+0000","last_active":"2024-09-14T11:58:15.922281+0000","last_peered":"2024-09-14T11:58:15.922281+0000","last_clean":"2024-09-14T11:58:15.922281+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:58:15.922281+0000","last_undegraded":"2024-09-14T11:58:15.922281+0000","last_fullsized":"2024-09-14T11:58:15.922281+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.128482+0000","last_change":"2024-09-14T11:59:12.128482+0000","last_active":"2024-09-14T11:59:12.128482+0000","last_peered":"2024-09-14T11:59:12.128482+0000","last_clean":"2024-09-14T11:59:12.128482+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:59:12.128482+0000","last_undegraded":"2024-09-14T11:59:12.128482+0000","last_fullsized":"2024-09-14T11:59:12.128482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.128387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:35.793136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'166","reported_seq":728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.883980+0000","last_change":"2024-09-14T11:15:42.351795+0000","last_active":"2024-09-14T11:56:53.883980+0000","last_peered":"2024-09-14T11:56:53.883980+0000","last_clean":"2024-09-14T11:56:53.883980+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:56:53.883980+0000","last_undegraded":"2024-09-14T11:56:53.883980+0000","last_fullsized":"2024-09-14T11:56:53.883980+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'893","reported_seq":2636,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.605777+0000","last_change":"2024-09-14T11:59:00.605777+0000","last_active":"2024-09-14T11:59:00.605777+0000","last_peered":"2024-09-14T11:59:00.605777+0000","last_clean":"2024-09-14T11:59:00.605777+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:59:00.605777+0000","last_undegraded":"2024-09-14T11:59:00.605777+0000","last_fullsized":"2024-09-14T11:59:00.605777+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'893","last_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_deep_scrub":"262'893","last_deep_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.605689+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:06.292394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'214","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.779368+0000","last_change":"2024-09-14T11:58:56.779368+0000","last_active":"2024-09-14T11:58:56.779368+0000","last_peered":"2024-09-14T11:58:56.779368+0000","last_clean":"2024-09-14T11:58:56.779368+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:58:56.779368+0000","last_undegraded":"2024-09-14T11:58:56.779368+0000","last_fullsized":"2024-09-14T11:58:56.779368+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'214","last_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_deep_scrub":"262'214","last_deep_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.779283+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:05.019231+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146072,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":7241,"num_write":969,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.671249+0000","last_change":"2024-09-14T11:58:52.671195+0000","last_active":"2024-09-14T11:58:52.671249+0000","last_peered":"2024-09-14T11:58:52.671249+0000","last_clean":"2024-09-14T11:58:52.671249+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:58:52.671249+0000","last_undegraded":"2024-09-14T11:58:52.671249+0000","last_fullsized":"2024-09-14T11:58:52.671249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.671120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:36.505369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.404674+0000","last_change":"2024-09-14T11:59:11.404674+0000","last_active":"2024-09-14T11:59:11.404674+0000","last_peered":"2024-09-14T11:59:11.404674+0000","last_clean":"2024-09-14T11:59:11.404674+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:59:11.404674+0000","last_undegraded":"2024-09-14T11:59:11.404674+0000","last_fullsized":"2024-09-14T11:59:11.404674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.404575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:53.428957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'270","reported_seq":920,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.455071+0000","last_change":"2024-09-14T11:15:38.333171+0000","last_active":"2024-09-14T11:58:47.455071+0000","last_peered":"2024-09-14T11:58:47.455071+0000","last_clean":"2024-09-14T11:58:47.455071+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:58:47.455071+0000","last_undegraded":"2024-09-14T11:58:47.455071+0000","last_fullsized":"2024-09-14T11:58:47.455071+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:45.638370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16117,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":365,"num_read_kb":486,"num_write":204,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.007091+0000","last_change":"2024-09-14T11:15:40.348810+0000","last_active":"2024-09-14T11:55:19.007091+0000","last_peered":"2024-09-14T11:55:19.007091+0000","last_clean":"2024-09-14T11:55:19.007091+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:55:19.007091+0000","last_undegraded":"2024-09-14T11:55:19.007091+0000","last_fullsized":"2024-09-14T11:55:19.007091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:45.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'169","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.464163+0000","last_change":"2024-09-14T11:15:42.354465+0000","last_active":"2024-09-14T11:58:14.464163+0000","last_peered":"2024-09-14T11:58:14.464163+0000","last_clean":"2024-09-14T11:58:14.464163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:58:14.464163+0000","last_undegraded":"2024-09-14T11:58:14.464163+0000","last_fullsized":"2024-09-14T11:58:14.464163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:00.902965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'774","reported_seq":2194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.277485+0000","last_change":"2024-09-14T11:59:02.277485+0000","last_active":"2024-09-14T11:59:02.277485+0000","last_peered":"2024-09-14T11:59:02.277485+0000","last_clean":"2024-09-14T11:59:02.277485+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:59:02.277485+0000","last_undegraded":"2024-09-14T11:59:02.277485+0000","last_fullsized":"2024-09-14T11:59:02.277485+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.277389+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:34.730626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'268","reported_seq":905,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.656880+0000","last_change":"2024-09-14T11:58:55.656880+0000","last_active":"2024-09-14T11:58:55.656880+0000","last_peered":"2024-09-14T11:58:55.656880+0000","last_clean":"2024-09-14T11:58:55.656880+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:58:55.656880+0000","last_undegraded":"2024-09-14T11:58:55.656880+0000","last_fullsized":"2024-09-14T11:58:55.656880+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'268","last_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_deep_scrub":"262'268","last_deep_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.656804+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.470057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":40043,"num_write":1045,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.713853+0000","last_change":"2024-09-14T11:58:55.713779+0000","last_active":"2024-09-14T11:58:55.713853+0000","last_peered":"2024-09-14T11:58:55.713853+0000","last_clean":"2024-09-14T11:58:55.713853+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:58:55.713853+0000","last_undegraded":"2024-09-14T11:58:55.713853+0000","last_fullsized":"2024-09-14T11:58:55.713853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.713672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:50.890524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"262'5","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.148251+0000","last_change":"2024-09-14T11:59:08.148251+0000","last_active":"2024-09-14T11:59:08.148251+0000","last_peered":"2024-09-14T11:59:08.148251+0000","last_clean":"2024-09-14T11:59:08.148251+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:59:08.148251+0000","last_undegraded":"2024-09-14T11:59:08.148251+0000","last_fullsized":"2024-09-14T11:59:08.148251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.148173+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:01.374450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'167","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.919058+0000","last_change":"2024-09-14T11:15:38.327367+0000","last_active":"2024-09-14T11:57:15.919058+0000","last_peered":"2024-09-14T11:57:15.919058+0000","last_clean":"2024-09-14T11:57:15.919058+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:57:15.919058+0000","last_undegraded":"2024-09-14T11:57:15.919058+0000","last_fullsized":"2024-09-14T11:57:15.919058+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:37.848547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'799","reported_seq":4699,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.422533+0000","last_change":"2024-09-14T11:15:40.337171+0000","last_active":"2024-09-14T11:58:47.422533+0000","last_peered":"2024-09-14T11:58:47.422533+0000","last_clean":"2024-09-14T11:58:47.422533+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:58:47.422533+0000","last_undegraded":"2024-09-14T11:58:47.422533+0000","last_fullsized":"2024-09-14T11:58:47.422533+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:24.203863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'132","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.805016+0000","last_change":"2024-09-14T11:15:42.349144+0000","last_active":"2024-09-14T11:58:15.805016+0000","last_peered":"2024-09-14T11:58:15.805016+0000","last_clean":"2024-09-14T11:58:15.805016+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:58:15.805016+0000","last_undegraded":"2024-09-14T11:58:15.805016+0000","last_fullsized":"2024-09-14T11:58:15.805016+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:09.966995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'892","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.989877+0000","last_change":"2024-09-14T11:59:10.989877+0000","last_active":"2024-09-14T11:59:10.989877+0000","last_peered":"2024-09-14T11:59:10.989877+0000","last_clean":"2024-09-14T11:59:10.989877+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:59:10.989877+0000","last_undegraded":"2024-09-14T11:59:10.989877+0000","last_fullsized":"2024-09-14T11:59:10.989877+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'892","last_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_deep_scrub":"262'892","last_deep_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.989791+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:39.808429+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'247","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.849696+0000","last_change":"2024-09-14T11:58:54.849696+0000","last_active":"2024-09-14T11:58:54.849696+0000","last_peered":"2024-09-14T11:58:54.849696+0000","last_clean":"2024-09-14T11:58:54.849696+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:58:54.849696+0000","last_undegraded":"2024-09-14T11:58:54.849696+0000","last_fullsized":"2024-09-14T11:58:54.849696+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.849617+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:59.404448+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460231,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":25317,"num_write":1130,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.648824+0000","last_change":"2024-09-14T11:58:53.648824+0000","last_active":"2024-09-14T11:58:53.648824+0000","last_peered":"2024-09-14T11:58:53.648824+0000","last_clean":"2024-09-14T11:58:53.648824+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:58:53.648824+0000","last_undegraded":"2024-09-14T11:58:53.648824+0000","last_fullsized":"2024-09-14T11:58:53.648824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.648747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:10.973858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:14.006501+0000","last_change":"2024-09-14T11:15:36.331117+0000","last_active":"2024-09-14T11:55:14.006501+0000","last_peered":"2024-09-14T11:55:14.006501+0000","last_clean":"2024-09-14T11:55:14.006501+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:55:14.006501+0000","last_undegraded":"2024-09-14T11:55:14.006501+0000","last_fullsized":"2024-09-14T11:55:14.006501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:51.839727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'111","reported_seq":638,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.942678+0000","last_change":"2024-09-14T11:15:38.337313+0000","last_active":"2024-09-14T11:56:30.942678+0000","last_peered":"2024-09-14T11:56:30.942678+0000","last_clean":"2024-09-14T11:56:30.942678+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:56:30.942678+0000","last_undegraded":"2024-09-14T11:56:30.942678+0000","last_fullsized":"2024-09-14T11:56:30.942678+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:15.549271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'812","reported_seq":2430,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.172424+0000","last_change":"2024-09-14T11:15:40.353831+0000","last_active":"2024-09-14T11:58:47.172424+0000","last_peered":"2024-09-14T11:58:47.172424+0000","last_clean":"2024-09-14T11:58:47.172424+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:58:47.172424+0000","last_undegraded":"2024-09-14T11:58:47.172424+0000","last_fullsized":"2024-09-14T11:58:47.172424+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:41.935731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'282","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.867897+0000","last_change":"2024-09-14T11:15:42.349524+0000","last_active":"2024-09-14T11:56:13.867897+0000","last_peered":"2024-09-14T11:56:13.867897+0000","last_clean":"2024-09-14T11:56:13.867897+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:56:13.867897+0000","last_undegraded":"2024-09-14T11:56:13.867897+0000","last_fullsized":"2024-09-14T11:56:13.867897+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:39.795329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'405","reported_seq":1946,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.182039+0000","last_change":"2024-09-14T11:58:59.182039+0000","last_active":"2024-09-14T11:58:59.182039+0000","last_peered":"2024-09-14T11:58:59.182039+0000","last_clean":"2024-09-14T11:58:59.182039+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:58:59.182039+0000","last_undegraded":"2024-09-14T11:58:59.182039+0000","last_fullsized":"2024-09-14T11:58:59.182039+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.181953+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:02.301110+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'220","reported_seq":847,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.306793+0000","last_change":"2024-09-14T11:58:53.306687+0000","last_active":"2024-09-14T11:58:53.306793+0000","last_peered":"2024-09-14T11:58:53.306793+0000","last_clean":"2024-09-14T11:58:53.306793+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:58:53.306793+0000","last_undegraded":"2024-09-14T11:58:53.306793+0000","last_fullsized":"2024-09-14T11:58:53.306793+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.306580+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.561679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":11363,"num_write":1017,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.267522+0000","last_change":"2024-09-14T11:58:55.267522+0000","last_active":"2024-09-14T11:58:55.267522+0000","last_peered":"2024-09-14T11:58:55.267522+0000","last_clean":"2024-09-14T11:58:55.267522+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:58:55.267522+0000","last_undegraded":"2024-09-14T11:58:55.267522+0000","last_fullsized":"2024-09-14T11:58:55.267522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.267441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:53.067234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875423+0000","last_change":"2024-09-14T11:15:36.331051+0000","last_active":"2024-09-14T11:55:48.875423+0000","last_peered":"2024-09-14T11:55:48.875423+0000","last_clean":"2024-09-14T11:55:48.875423+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:55:48.875423+0000","last_undegraded":"2024-09-14T11:55:48.875423+0000","last_fullsized":"2024-09-14T11:55:48.875423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:18.610941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'307","reported_seq":1012,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.322304+0000","last_change":"2024-09-14T11:15:38.337405+0000","last_active":"2024-09-14T11:58:47.322304+0000","last_peered":"2024-09-14T11:58:47.322304+0000","last_clean":"2024-09-14T11:58:47.322304+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:58:47.322304+0000","last_undegraded":"2024-09-14T11:58:47.322304+0000","last_fullsized":"2024-09-14T11:58:47.322304+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:37.729796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":677,"num_write":230,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870986+0000","last_change":"2024-09-14T11:15:40.349294+0000","last_active":"2024-09-14T11:55:18.870986+0000","last_peered":"2024-09-14T11:55:18.870986+0000","last_clean":"2024-09-14T11:55:18.870986+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:55:18.870986+0000","last_undegraded":"2024-09-14T11:55:18.870986+0000","last_fullsized":"2024-09-14T11:55:18.870986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:06.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'134","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:19.668467+0000","last_change":"2024-09-14T11:15:42.351815+0000","last_active":"2024-09-14T11:56:19.668467+0000","last_peered":"2024-09-14T11:56:19.668467+0000","last_clean":"2024-09-14T11:56:19.668467+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:56:19.668467+0000","last_undegraded":"2024-09-14T11:56:19.668467+0000","last_fullsized":"2024-09-14T11:56:19.668467+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:31.950118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'146","reported_seq":688,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.639329+0000","last_change":"2024-09-14T11:15:42.348937+0000","last_active":"2024-09-14T11:56:57.639329+0000","last_peered":"2024-09-14T11:56:57.639329+0000","last_clean":"2024-09-14T11:56:57.639329+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:56:57.639329+0000","last_undegraded":"2024-09-14T11:56:57.639329+0000","last_fullsized":"2024-09-14T11:56:57.639329+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'566","reported_seq":2436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.169611+0000","last_change":"2024-09-14T11:59:04.169611+0000","last_active":"2024-09-14T11:59:04.169611+0000","last_peered":"2024-09-14T11:59:04.169611+0000","last_clean":"2024-09-14T11:59:04.169611+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:59:04.169611+0000","last_undegraded":"2024-09-14T11:59:04.169611+0000","last_fullsized":"2024-09-14T11:59:04.169611+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'566","last_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_deep_scrub":"262'566","last_deep_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.169517+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:42.390726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'204","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.091134+0000","last_change":"2024-09-14T11:58:57.091134+0000","last_active":"2024-09-14T11:58:57.091134+0000","last_peered":"2024-09-14T11:58:57.091134+0000","last_clean":"2024-09-14T11:58:57.091134+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:58:57.091134+0000","last_undegraded":"2024-09-14T11:58:57.091134+0000","last_fullsized":"2024-09-14T11:58:57.091134+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.091049+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:22.628478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":19870,"num_write":904,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.621484+0000","last_change":"2024-09-14T11:59:09.621484+0000","last_active":"2024-09-14T11:59:09.621484+0000","last_peered":"2024-09-14T11:59:09.621484+0000","last_clean":"2024-09-14T11:59:09.621484+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:59:09.621484+0000","last_undegraded":"2024-09-14T11:59:09.621484+0000","last_fullsized":"2024-09-14T11:59:09.621484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.621385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:21.637776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'157","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.378867+0000","last_change":"2024-09-14T11:15:38.334700+0000","last_active":"2024-09-14T11:58:47.378867+0000","last_peered":"2024-09-14T11:58:47.378867+0000","last_clean":"2024-09-14T11:58:47.378867+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:58:47.378867+0000","last_undegraded":"2024-09-14T11:58:47.378867+0000","last_fullsized":"2024-09-14T11:58:47.378867+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:17.379507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":267,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.871577+0000","last_change":"2024-09-14T11:15:40.349844+0000","last_active":"2024-09-14T11:55:23.871577+0000","last_peered":"2024-09-14T11:55:23.871577+0000","last_clean":"2024-09-14T11:55:23.871577+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:55:23.871577+0000","last_undegraded":"2024-09-14T11:55:23.871577+0000","last_fullsized":"2024-09-14T11:55:23.871577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:12.340019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.002060+0000","last_change":"2024-09-14T11:15:42.351873+0000","last_active":"2024-09-14T11:56:57.002060+0000","last_peered":"2024-09-14T11:56:57.002060+0000","last_clean":"2024-09-14T11:56:57.002060+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:56:57.002060+0000","last_undegraded":"2024-09-14T11:56:57.002060+0000","last_fullsized":"2024-09-14T11:56:57.002060+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.030349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1372","reported_seq":3015,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.656353+0000","last_change":"2024-09-14T11:59:06.656353+0000","last_active":"2024-09-14T11:59:06.656353+0000","last_peered":"2024-09-14T11:59:06.656353+0000","last_clean":"2024-09-14T11:59:06.656353+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:59:06.656353+0000","last_undegraded":"2024-09-14T11:59:06.656353+0000","last_fullsized":"2024-09-14T11:59:06.656353+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1372","last_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_deep_scrub":"262'1372","last_deep_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.656260+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":1300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:59.071627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'177","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.826463+0000","last_change":"2024-09-14T11:59:02.826361+0000","last_active":"2024-09-14T11:59:02.826463+0000","last_peered":"2024-09-14T11:59:02.826463+0000","last_clean":"2024-09-14T11:59:02.826463+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:59:02.826463+0000","last_undegraded":"2024-09-14T11:59:02.826463+0000","last_fullsized":"2024-09-14T11:59:02.826463+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.826225+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:54.230672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":363,"num_read_kb":34037,"num_write":744,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.871010+0000","last_change":"2024-09-14T11:15:36.330880+0000","last_active":"2024-09-14T11:55:18.871010+0000","last_peered":"2024-09-14T11:55:18.871010+0000","last_clean":"2024-09-14T11:55:18.871010+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:55:18.871010+0000","last_undegraded":"2024-09-14T11:55:18.871010+0000","last_fullsized":"2024-09-14T11:55:18.871010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:31.962906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'43","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.223600+0000","last_change":"2024-09-14T11:15:38.332435+0000","last_active":"2024-09-14T11:56:30.223600+0000","last_peered":"2024-09-14T11:56:30.223600+0000","last_clean":"2024-09-14T11:56:30.223600+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:56:30.223600+0000","last_undegraded":"2024-09-14T11:56:30.223600+0000","last_fullsized":"2024-09-14T11:56:30.223600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:58.253268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.870821+0000","last_change":"2024-09-14T11:15:40.344174+0000","last_active":"2024-09-14T11:55:23.870821+0000","last_peered":"2024-09-14T11:55:23.870821+0000","last_clean":"2024-09-14T11:55:23.870821+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:55:23.870821+0000","last_undegraded":"2024-09-14T11:55:23.870821+0000","last_fullsized":"2024-09-14T11:55:23.870821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:53.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'215","reported_seq":729,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.995205+0000","last_change":"2024-09-14T11:15:42.348738+0000","last_active":"2024-09-14T11:56:56.995205+0000","last_peered":"2024-09-14T11:56:56.995205+0000","last_clean":"2024-09-14T11:56:56.995205+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:56:56.995205+0000","last_undegraded":"2024-09-14T11:56:56.995205+0000","last_fullsized":"2024-09-14T11:56:56.995205+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:07.647856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'457","reported_seq":1999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.857852+0000","last_change":"2024-09-14T11:59:03.857852+0000","last_active":"2024-09-14T11:59:03.857852+0000","last_peered":"2024-09-14T11:59:03.857852+0000","last_clean":"2024-09-14T11:59:03.857852+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:59:03.857852+0000","last_undegraded":"2024-09-14T11:59:03.857852+0000","last_fullsized":"2024-09-14T11:59:03.857852+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.857750+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:10.626306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'355","reported_seq":999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.467888+0000","last_change":"2024-09-14T11:16:07.497232+0000","last_active":"2024-09-14T11:58:47.467888+0000","last_peered":"2024-09-14T11:58:47.467888+0000","last_clean":"2024-09-14T11:58:47.467888+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:58:47.467888+0000","last_undegraded":"2024-09-14T11:58:47.467888+0000","last_fullsized":"2024-09-14T11:58:47.467888+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:31.285879+0000","last_clean_scrub_stamp":"2024-09-14T11:15:31.285879+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:57.221580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":986,"num_read_kb":18905,"num_write":1307,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.870031+0000","last_change":"2024-09-14T11:15:36.339369+0000","last_active":"2024-09-14T11:55:18.870031+0000","last_peered":"2024-09-14T11:55:18.870031+0000","last_clean":"2024-09-14T11:55:18.870031+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:55:18.870031+0000","last_undegraded":"2024-09-14T11:55:18.870031+0000","last_fullsized":"2024-09-14T11:55:18.870031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:43.628492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'159","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.279891+0000","last_change":"2024-09-14T11:15:38.334637+0000","last_active":"2024-09-14T11:58:47.279891+0000","last_peered":"2024-09-14T11:58:47.279891+0000","last_clean":"2024-09-14T11:58:47.279891+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:58:47.279891+0000","last_undegraded":"2024-09-14T11:58:47.279891+0000","last_fullsized":"2024-09-14T11:58:47.279891+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:56.809543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":270,"num_write":114,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.951144+0000","last_change":"2024-09-14T11:15:40.343098+0000","last_active":"2024-09-14T11:55:23.951144+0000","last_peered":"2024-09-14T11:55:23.951144+0000","last_clean":"2024-09-14T11:55:23.951144+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:55:23.951144+0000","last_undegraded":"2024-09-14T11:55:23.951144+0000","last_fullsized":"2024-09-14T11:55:23.951144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.732839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'115","reported_seq":608,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.989039+0000","last_change":"2024-09-14T11:15:42.348868+0000","last_active":"2024-09-14T11:56:56.989039+0000","last_peered":"2024-09-14T11:56:56.989039+0000","last_clean":"2024-09-14T11:56:56.989039+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:56:56.989039+0000","last_undegraded":"2024-09-14T11:56:56.989039+0000","last_fullsized":"2024-09-14T11:56:56.989039+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.040910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'812","reported_seq":2490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.010369+0000","last_change":"2024-09-14T11:59:12.010369+0000","last_active":"2024-09-14T11:59:12.010369+0000","last_peered":"2024-09-14T11:59:12.010369+0000","last_clean":"2024-09-14T11:59:12.010369+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:59:12.010369+0000","last_undegraded":"2024-09-14T11:59:12.010369+0000","last_fullsized":"2024-09-14T11:59:12.010369+0000","mapping_epoch":26,"log_start":"262'801","ondisk_log_start":"262'801","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'812","last_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_deep_scrub":"262'812","last_deep_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.010264+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:55.948418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'266","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.277392+0000","last_change":"2024-09-14T11:58:55.277324+0000","last_active":"2024-09-14T11:58:55.277392+0000","last_peered":"2024-09-14T11:58:55.277392+0000","last_clean":"2024-09-14T11:58:55.277392+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:58:55.277392+0000","last_undegraded":"2024-09-14T11:58:55.277392+0000","last_fullsized":"2024-09-14T11:58:55.277392+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'266","last_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_deep_scrub":"262'266","last_deep_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.277222+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:42.232250+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730159,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":14443,"num_write":1155,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.121731+0000","last_change":"2024-09-14T11:59:10.121731+0000","last_active":"2024-09-14T11:59:10.121731+0000","last_peered":"2024-09-14T11:59:10.121731+0000","last_clean":"2024-09-14T11:59:10.121731+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:59:10.121731+0000","last_undegraded":"2024-09-14T11:59:10.121731+0000","last_fullsized":"2024-09-14T11:59:10.121731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.121629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:35.666450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'136","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.257763+0000","last_change":"2024-09-14T11:15:38.338705+0000","last_active":"2024-09-14T11:58:47.257763+0000","last_peered":"2024-09-14T11:58:47.257763+0000","last_clean":"2024-09-14T11:58:47.257763+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:58:47.257763+0000","last_undegraded":"2024-09-14T11:58:47.257763+0000","last_fullsized":"2024-09-14T11:58:47.257763+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:13.916538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44743,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":353,"num_write":106,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861871+0000","last_change":"2024-09-14T11:15:40.351822+0000","last_active":"2024-09-14T11:55:23.861871+0000","last_peered":"2024-09-14T11:55:23.861871+0000","last_clean":"2024-09-14T11:55:23.861871+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:55:23.861871+0000","last_undegraded":"2024-09-14T11:55:23.861871+0000","last_fullsized":"2024-09-14T11:55:23.861871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'852","reported_seq":2479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.204800+0000","last_change":"2024-09-14T11:59:05.204800+0000","last_active":"2024-09-14T11:59:05.204800+0000","last_peered":"2024-09-14T11:59:05.204800+0000","last_clean":"2024-09-14T11:59:05.204800+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:59:05.204800+0000","last_undegraded":"2024-09-14T11:59:05.204800+0000","last_fullsized":"2024-09-14T11:59:05.204800+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.204698+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:33.564491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'204","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.874744+0000","last_change":"2024-09-14T11:58:57.874630+0000","last_active":"2024-09-14T11:58:57.874744+0000","last_peered":"2024-09-14T11:58:57.874744+0000","last_clean":"2024-09-14T11:58:57.874744+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:58:57.874744+0000","last_undegraded":"2024-09-14T11:58:57.874744+0000","last_fullsized":"2024-09-14T11:58:57.874744+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.874491+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:32.927288+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":38166,"num_write":911,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.378224+0000","last_change":"2024-09-14T11:59:13.378224+0000","last_active":"2024-09-14T11:59:13.378224+0000","last_peered":"2024-09-14T11:59:13.378224+0000","last_clean":"2024-09-14T11:59:13.378224+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:59:13.378224+0000","last_undegraded":"2024-09-14T11:59:13.378224+0000","last_fullsized":"2024-09-14T11:59:13.378224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.378137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:53.165338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'199","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.439653+0000","last_change":"2024-09-14T11:15:38.334848+0000","last_active":"2024-09-14T11:58:47.439653+0000","last_peered":"2024-09-14T11:58:47.439653+0000","last_clean":"2024-09-14T11:58:47.439653+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:58:47.439653+0000","last_undegraded":"2024-09-14T11:58:47.439653+0000","last_fullsized":"2024-09-14T11:58:47.439653+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14688,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":397,"num_write":180,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.873860+0000","last_change":"2024-09-14T11:15:40.348746+0000","last_active":"2024-09-14T11:55:43.873860+0000","last_peered":"2024-09-14T11:55:43.873860+0000","last_clean":"2024-09-14T11:55:43.873860+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:55:43.873860+0000","last_undegraded":"2024-09-14T11:55:43.873860+0000","last_fullsized":"2024-09-14T11:55:43.873860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:48.113026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'159","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.879691+0000","last_change":"2024-09-14T11:15:42.352372+0000","last_active":"2024-09-14T11:55:59.879691+0000","last_peered":"2024-09-14T11:55:59.879691+0000","last_clean":"2024-09-14T11:55:59.879691+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:55:59.879691+0000","last_undegraded":"2024-09-14T11:55:59.879691+0000","last_fullsized":"2024-09-14T11:55:59.879691+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:49.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":2004,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.337559+0000","last_change":"2024-09-14T11:59:06.337559+0000","last_active":"2024-09-14T11:59:06.337559+0000","last_peered":"2024-09-14T11:59:06.337559+0000","last_clean":"2024-09-14T11:59:06.337559+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:59:06.337559+0000","last_undegraded":"2024-09-14T11:59:06.337559+0000","last_fullsized":"2024-09-14T11:59:06.337559+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'451","last_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_deep_scrub":"262'451","last_deep_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.337474+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:21.970696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'228","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.646609+0000","last_change":"2024-09-14T11:58:56.646544+0000","last_active":"2024-09-14T11:58:56.646609+0000","last_peered":"2024-09-14T11:58:56.646609+0000","last_clean":"2024-09-14T11:58:56.646609+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:58:56.646609+0000","last_undegraded":"2024-09-14T11:58:56.646609+0000","last_fullsized":"2024-09-14T11:58:56.646609+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'228","last_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_deep_scrub":"262'228","last_deep_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.646441+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:26.476328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":613,"num_read_kb":11802,"num_write":1015,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.110795+0000","last_change":"2024-09-14T11:59:09.110795+0000","last_active":"2024-09-14T11:59:09.110795+0000","last_peered":"2024-09-14T11:59:09.110795+0000","last_clean":"2024-09-14T11:59:09.110795+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:59:09.110795+0000","last_undegraded":"2024-09-14T11:59:09.110795+0000","last_fullsized":"2024-09-14T11:59:09.110795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.110702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.995238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'157","reported_seq":728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.263292+0000","last_change":"2024-09-14T11:15:38.341444+0000","last_active":"2024-09-14T11:58:47.263292+0000","last_peered":"2024-09-14T11:58:47.263292+0000","last_clean":"2024-09-14T11:58:47.263292+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:58:47.263292+0000","last_undegraded":"2024-09-14T11:58:47.263292+0000","last_fullsized":"2024-09-14T11:58:47.263292+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:11.384017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":272,"num_write":132,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869587+0000","last_change":"2024-09-14T11:15:40.346858+0000","last_active":"2024-09-14T11:55:40.869587+0000","last_peered":"2024-09-14T11:55:40.869587+0000","last_clean":"2024-09-14T11:55:40.869587+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:55:40.869587+0000","last_undegraded":"2024-09-14T11:55:40.869587+0000","last_fullsized":"2024-09-14T11:55:40.869587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:12.423799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'255","reported_seq":1118,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.480297+0000","last_change":"2024-09-14T11:15:42.347978+0000","last_active":"2024-09-14T11:56:55.480297+0000","last_peered":"2024-09-14T11:56:55.480297+0000","last_clean":"2024-09-14T11:56:55.480297+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:56:55.480297+0000","last_undegraded":"2024-09-14T11:56:55.480297+0000","last_fullsized":"2024-09-14T11:56:55.480297+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:59.600834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'852","reported_seq":2428,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.986861+0000","last_change":"2024-09-14T11:59:07.986861+0000","last_active":"2024-09-14T11:59:07.986861+0000","last_peered":"2024-09-14T11:59:07.986861+0000","last_clean":"2024-09-14T11:59:07.986861+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:59:07.986861+0000","last_undegraded":"2024-09-14T11:59:07.986861+0000","last_fullsized":"2024-09-14T11:59:07.986861+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.986754+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:08.810573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'197","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.093051+0000","last_change":"2024-09-14T11:58:56.093051+0000","last_active":"2024-09-14T11:58:56.093051+0000","last_peered":"2024-09-14T11:58:56.093051+0000","last_clean":"2024-09-14T11:58:56.093051+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:58:56.093051+0000","last_undegraded":"2024-09-14T11:58:56.093051+0000","last_fullsized":"2024-09-14T11:58:56.093051+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.092935+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.174953+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.009957+0000","last_change":"2024-09-14T11:15:36.330057+0000","last_active":"2024-09-14T11:55:39.009957+0000","last_peered":"2024-09-14T11:55:39.009957+0000","last_clean":"2024-09-14T11:55:39.009957+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:55:39.009957+0000","last_undegraded":"2024-09-14T11:55:39.009957+0000","last_fullsized":"2024-09-14T11:55:39.009957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.691223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'131","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.416509+0000","last_change":"2024-09-14T11:15:38.336865+0000","last_active":"2024-09-14T11:58:47.416509+0000","last_peered":"2024-09-14T11:58:47.416509+0000","last_clean":"2024-09-14T11:58:47.416509+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:58:47.416509+0000","last_undegraded":"2024-09-14T11:58:47.416509+0000","last_fullsized":"2024-09-14T11:58:47.416509+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:20.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":266,"num_write":100,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:45.870237+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:55:45.870237+0000","last_peered":"2024-09-14T11:55:45.870237+0000","last_clean":"2024-09-14T11:55:45.870237+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:55:45.870237+0000","last_undegraded":"2024-09-14T11:55:45.870237+0000","last_fullsized":"2024-09-14T11:55:45.870237+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:52.612855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'145","reported_seq":635,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.801285+0000","last_change":"2024-09-14T11:15:42.348516+0000","last_active":"2024-09-14T11:58:15.801285+0000","last_peered":"2024-09-14T11:58:15.801285+0000","last_clean":"2024-09-14T11:58:15.801285+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:58:15.801285+0000","last_undegraded":"2024-09-14T11:58:15.801285+0000","last_fullsized":"2024-09-14T11:58:15.801285+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:57.841456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'428","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.288212+0000","last_change":"2024-09-14T11:58:57.288212+0000","last_active":"2024-09-14T11:58:57.288212+0000","last_peered":"2024-09-14T11:58:57.288212+0000","last_clean":"2024-09-14T11:58:57.288212+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:57.288212+0000","last_undegraded":"2024-09-14T11:58:57.288212+0000","last_fullsized":"2024-09-14T11:58:57.288212+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'428","last_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_deep_scrub":"262'428","last_deep_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.288124+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:39.134746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'224","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.269287+0000","last_change":"2024-09-14T11:58:56.269287+0000","last_active":"2024-09-14T11:58:56.269287+0000","last_peered":"2024-09-14T11:58:56.269287+0000","last_clean":"2024-09-14T11:58:56.269287+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:58:56.269287+0000","last_undegraded":"2024-09-14T11:58:56.269287+0000","last_fullsized":"2024-09-14T11:58:56.269287+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'224","last_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_deep_scrub":"262'224","last_deep_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.269178+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.507042+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":12620,"num_write":955,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:35.868896+0000","last_change":"2024-09-14T11:15:36.330575+0000","last_active":"2024-09-14T11:55:35.868896+0000","last_peered":"2024-09-14T11:55:35.868896+0000","last_clean":"2024-09-14T11:55:35.868896+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:55:35.868896+0000","last_undegraded":"2024-09-14T11:55:35.868896+0000","last_fullsized":"2024-09-14T11:55:35.868896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:23.577919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'99","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.374104+0000","last_change":"2024-09-14T11:15:38.335710+0000","last_active":"2024-09-14T11:56:21.374104+0000","last_peered":"2024-09-14T11:56:21.374104+0000","last_clean":"2024-09-14T11:56:21.374104+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:56:21.374104+0000","last_undegraded":"2024-09-14T11:56:21.374104+0000","last_fullsized":"2024-09-14T11:56:21.374104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:16.942605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'769","reported_seq":2180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.164292+0000","last_change":"2024-09-14T11:15:40.347027+0000","last_active":"2024-09-14T11:58:47.164292+0000","last_peered":"2024-09-14T11:58:47.164292+0000","last_clean":"2024-09-14T11:58:47.164292+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:58:47.164292+0000","last_undegraded":"2024-09-14T11:58:47.164292+0000","last_fullsized":"2024-09-14T11:58:47.164292+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.157408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":604,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.934707+0000","last_change":"2024-09-14T11:15:42.350291+0000","last_active":"2024-09-14T11:56:30.934707+0000","last_peered":"2024-09-14T11:56:30.934707+0000","last_clean":"2024-09-14T11:56:30.934707+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:56:30.934707+0000","last_undegraded":"2024-09-14T11:56:30.934707+0000","last_fullsized":"2024-09-14T11:56:30.934707+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.774415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'895","reported_seq":2475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.225811+0000","last_change":"2024-09-14T11:59:07.225811+0000","last_active":"2024-09-14T11:59:07.225811+0000","last_peered":"2024-09-14T11:59:07.225811+0000","last_clean":"2024-09-14T11:59:07.225811+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:59:07.225811+0000","last_undegraded":"2024-09-14T11:59:07.225811+0000","last_fullsized":"2024-09-14T11:59:07.225811+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'895","last_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_deep_scrub":"262'895","last_deep_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.225717+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:52.394209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'218","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.793958+0000","last_change":"2024-09-14T11:58:57.793958+0000","last_active":"2024-09-14T11:58:57.793958+0000","last_peered":"2024-09-14T11:58:57.793958+0000","last_clean":"2024-09-14T11:58:57.793958+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:58:57.793958+0000","last_undegraded":"2024-09-14T11:58:57.793958+0000","last_fullsized":"2024-09-14T11:58:57.793958+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.793829+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:47.418639+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":930,"num_read_kb":28634,"num_write":971,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872979+0000","last_change":"2024-09-14T11:15:36.334783+0000","last_active":"2024-09-14T11:55:38.872979+0000","last_peered":"2024-09-14T11:55:38.872979+0000","last_clean":"2024-09-14T11:55:38.872979+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:55:38.872979+0000","last_undegraded":"2024-09-14T11:55:38.872979+0000","last_fullsized":"2024-09-14T11:55:38.872979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:31.368261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'156","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.474156+0000","last_change":"2024-09-14T11:15:38.333129+0000","last_active":"2024-09-14T11:58:47.474156+0000","last_peered":"2024-09-14T11:58:47.474156+0000","last_clean":"2024-09-14T11:58:47.474156+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:58:47.474156+0000","last_undegraded":"2024-09-14T11:58:47.474156+0000","last_fullsized":"2024-09-14T11:58:47.474156+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:23.609841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7170,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":208,"num_read_kb":287,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":477,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.871957+0000","last_change":"2024-09-14T11:15:40.349763+0000","last_active":"2024-09-14T11:56:48.871957+0000","last_peered":"2024-09-14T11:56:48.871957+0000","last_clean":"2024-09-14T11:56:48.871957+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:56:48.871957+0000","last_undegraded":"2024-09-14T11:56:48.871957+0000","last_fullsized":"2024-09-14T11:56:48.871957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'105","reported_seq":603,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.883258+0000","last_change":"2024-09-14T11:15:42.354717+0000","last_active":"2024-09-14T11:56:48.883258+0000","last_peered":"2024-09-14T11:56:48.883258+0000","last_clean":"2024-09-14T11:56:48.883258+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:56:48.883258+0000","last_undegraded":"2024-09-14T11:56:48.883258+0000","last_fullsized":"2024-09-14T11:56:48.883258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'660","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.203014+0000","last_change":"2024-09-14T11:59:06.203014+0000","last_active":"2024-09-14T11:59:06.203014+0000","last_peered":"2024-09-14T11:59:06.203014+0000","last_clean":"2024-09-14T11:59:06.203014+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:59:06.203014+0000","last_undegraded":"2024-09-14T11:59:06.203014+0000","last_fullsized":"2024-09-14T11:59:06.203014+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'660","last_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_deep_scrub":"262'660","last_deep_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.202929+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:52.793955+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3256,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'201","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.792801+0000","last_change":"2024-09-14T11:58:59.792801+0000","last_active":"2024-09-14T11:58:59.792801+0000","last_peered":"2024-09-14T11:58:59.792801+0000","last_clean":"2024-09-14T11:58:59.792801+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:58:59.792801+0000","last_undegraded":"2024-09-14T11:58:59.792801+0000","last_fullsized":"2024-09-14T11:58:59.792801+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.792678+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:48.220393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":24057,"num_write":879,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:38.872982+0000","last_change":"2024-09-14T11:15:36.323716+0000","last_active":"2024-09-14T11:55:38.872982+0000","last_peered":"2024-09-14T11:55:38.872982+0000","last_clean":"2024-09-14T11:55:38.872982+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:55:38.872982+0000","last_undegraded":"2024-09-14T11:55:38.872982+0000","last_fullsized":"2024-09-14T11:55:38.872982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:05.232742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'146","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.485341+0000","last_change":"2024-09-14T11:15:38.333174+0000","last_active":"2024-09-14T11:58:47.485341+0000","last_peered":"2024-09-14T11:58:47.485341+0000","last_clean":"2024-09-14T11:58:47.485341+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:58:47.485341+0000","last_undegraded":"2024-09-14T11:58:47.485341+0000","last_fullsized":"2024-09-14T11:58:47.485341+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":267,"num_write":100,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.944488+0000","last_change":"2024-09-14T11:15:40.344604+0000","last_active":"2024-09-14T11:54:28.944488+0000","last_peered":"2024-09-14T11:54:28.944488+0000","last_clean":"2024-09-14T11:54:28.944488+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:54:28.944488+0000","last_undegraded":"2024-09-14T11:54:28.944488+0000","last_fullsized":"2024-09-14T11:54:28.944488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:07.536782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'141","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.882656+0000","last_change":"2024-09-14T11:15:42.348390+0000","last_active":"2024-09-14T11:56:48.882656+0000","last_peered":"2024-09-14T11:56:48.882656+0000","last_clean":"2024-09-14T11:56:48.882656+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:56:48.882656+0000","last_undegraded":"2024-09-14T11:56:48.882656+0000","last_fullsized":"2024-09-14T11:56:48.882656+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'748","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.939963+0000","last_change":"2024-09-14T11:59:05.939875+0000","last_active":"2024-09-14T11:59:05.939963+0000","last_peered":"2024-09-14T11:59:05.939963+0000","last_clean":"2024-09-14T11:59:05.939963+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:59:05.939963+0000","last_undegraded":"2024-09-14T11:59:05.939963+0000","last_fullsized":"2024-09-14T11:59:05.939963+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'748","last_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_deep_scrub":"262'748","last_deep_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.939748+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:27.001770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'247","reported_seq":1006,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.848888+0000","last_change":"2024-09-14T11:58:58.848888+0000","last_active":"2024-09-14T11:58:58.848888+0000","last_peered":"2024-09-14T11:58:58.848888+0000","last_clean":"2024-09-14T11:58:58.848888+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:58:58.848888+0000","last_undegraded":"2024-09-14T11:58:58.848888+0000","last_fullsized":"2024-09-14T11:58:58.848888+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.848767+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.657561+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":149417,"num_write":1050,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.019183+0000","last_change":"2024-09-14T11:15:36.334370+0000","last_active":"2024-09-14T11:56:44.019183+0000","last_peered":"2024-09-14T11:56:44.019183+0000","last_clean":"2024-09-14T11:56:44.019183+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:56:44.019183+0000","last_undegraded":"2024-09-14T11:56:44.019183+0000","last_fullsized":"2024-09-14T11:56:44.019183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:35.306279+0000","last_clean_scrub_stamp":"2024-09-14T11:15:35.306279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'98","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.395183+0000","last_change":"2024-09-14T11:15:38.339773+0000","last_active":"2024-09-14T11:58:47.395183+0000","last_peered":"2024-09-14T11:58:47.395183+0000","last_clean":"2024-09-14T11:58:47.395183+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:58:47.395183+0000","last_undegraded":"2024-09-14T11:58:47.395183+0000","last_fullsized":"2024-09-14T11:58:47.395183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.547669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8817,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":183,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.010579+0000","last_change":"2024-09-14T11:15:40.345970+0000","last_active":"2024-09-14T11:55:44.010579+0000","last_peered":"2024-09-14T11:55:44.010579+0000","last_clean":"2024-09-14T11:55:44.010579+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:55:44.010579+0000","last_undegraded":"2024-09-14T11:55:44.010579+0000","last_fullsized":"2024-09-14T11:55:44.010579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.446853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'154","reported_seq":1253,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.435155+0000","last_change":"2024-09-14T11:15:42.354185+0000","last_active":"2024-09-14T11:56:55.435155+0000","last_peered":"2024-09-14T11:56:55.435155+0000","last_clean":"2024-09-14T11:56:55.435155+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:56:55.435155+0000","last_undegraded":"2024-09-14T11:56:55.435155+0000","last_fullsized":"2024-09-14T11:56:55.435155+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'448","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.209413+0000","last_change":"2024-09-14T11:59:05.209413+0000","last_active":"2024-09-14T11:59:05.209413+0000","last_peered":"2024-09-14T11:59:05.209413+0000","last_clean":"2024-09-14T11:59:05.209413+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:59:05.209413+0000","last_undegraded":"2024-09-14T11:59:05.209413+0000","last_fullsized":"2024-09-14T11:59:05.209413+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.209323+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.492011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'212","reported_seq":848,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.268656+0000","last_change":"2024-09-14T11:58:57.268656+0000","last_active":"2024-09-14T11:58:57.268656+0000","last_peered":"2024-09-14T11:58:57.268656+0000","last_clean":"2024-09-14T11:58:57.268656+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:58:57.268656+0000","last_undegraded":"2024-09-14T11:58:57.268656+0000","last_fullsized":"2024-09-14T11:58:57.268656+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.268554+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:41.545725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":36694,"num_write":987,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.609596+0000","last_change":"2024-09-14T11:59:10.609493+0000","last_active":"2024-09-14T11:59:10.609596+0000","last_peered":"2024-09-14T11:59:10.609596+0000","last_clean":"2024-09-14T11:59:10.609596+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:59:10.609596+0000","last_undegraded":"2024-09-14T11:59:10.609596+0000","last_fullsized":"2024-09-14T11:59:10.609596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.609353+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.175042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'148","reported_seq":722,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.429338+0000","last_change":"2024-09-14T11:15:38.340747+0000","last_active":"2024-09-14T11:58:47.429338+0000","last_peered":"2024-09-14T11:58:47.429338+0000","last_clean":"2024-09-14T11:58:47.429338+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:58:47.429338+0000","last_undegraded":"2024-09-14T11:58:47.429338+0000","last_fullsized":"2024-09-14T11:58:47.429338+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:37.316157+0000","last_clean_scrub_stamp":"2024-09-14T11:15:37.316157+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:13.972291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":283,"num_write":116,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":476,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864425+0000","last_change":"2024-09-14T11:15:40.351076+0000","last_active":"2024-09-14T11:55:43.864425+0000","last_peered":"2024-09-14T11:55:43.864425+0000","last_clean":"2024-09-14T11:55:43.864425+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:55:43.864425+0000","last_undegraded":"2024-09-14T11:55:43.864425+0000","last_fullsized":"2024-09-14T11:55:43.864425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:39.326991+0000","last_clean_scrub_stamp":"2024-09-14T11:15:39.326991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:55.409953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'93","reported_seq":570,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.455750+0000","last_change":"2024-09-14T11:15:42.354581+0000","last_active":"2024-09-14T11:58:14.455750+0000","last_peered":"2024-09-14T11:58:14.455750+0000","last_clean":"2024-09-14T11:58:14.455750+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:58:14.455750+0000","last_undegraded":"2024-09-14T11:58:14.455750+0000","last_fullsized":"2024-09-14T11:58:14.455750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:56.053707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'423","reported_seq":1881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.669190+0000","last_change":"2024-09-14T11:59:07.669190+0000","last_active":"2024-09-14T11:59:07.669190+0000","last_peered":"2024-09-14T11:59:07.669190+0000","last_clean":"2024-09-14T11:59:07.669190+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:59:07.669190+0000","last_undegraded":"2024-09-14T11:59:07.669190+0000","last_fullsized":"2024-09-14T11:59:07.669190+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'423","last_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_deep_scrub":"262'423","last_deep_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.669106+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:58.372550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.260260+0000","last_change":"2024-09-14T11:58:59.260260+0000","last_active":"2024-09-14T11:58:59.260260+0000","last_peered":"2024-09-14T11:58:59.260260+0000","last_clean":"2024-09-14T11:58:59.260260+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:58:59.260260+0000","last_undegraded":"2024-09-14T11:58:59.260260+0000","last_fullsized":"2024-09-14T11:58:59.260260+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.260175+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:36.438178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":66072,"num_write":894,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2356,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.610576+0000","last_change":"2024-09-14T11:59:05.610576+0000","last_active":"2024-09-14T11:59:05.610576+0000","last_peered":"2024-09-14T11:59:05.610576+0000","last_clean":"2024-09-14T11:59:05.610576+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:59:05.610576+0000","last_undegraded":"2024-09-14T11:59:05.610576+0000","last_fullsized":"2024-09-14T11:59:05.610576+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'841","last_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_deep_scrub":"262'841","last_deep_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.610487+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:37.527850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'213","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.279698+0000","last_change":"2024-09-14T11:58:56.279698+0000","last_active":"2024-09-14T11:58:56.279698+0000","last_peered":"2024-09-14T11:58:56.279698+0000","last_clean":"2024-09-14T11:58:56.279698+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:58:56.279698+0000","last_undegraded":"2024-09-14T11:58:56.279698+0000","last_fullsized":"2024-09-14T11:58:56.279698+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.279629+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:33.552917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":30107,"num_write":970,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'540","reported_seq":2215,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.796673+0000","last_change":"2024-09-14T11:59:13.796673+0000","last_active":"2024-09-14T11:59:13.796673+0000","last_peered":"2024-09-14T11:59:13.796673+0000","last_clean":"2024-09-14T11:59:13.796673+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:59:13.796673+0000","last_undegraded":"2024-09-14T11:59:13.796673+0000","last_fullsized":"2024-09-14T11:59:13.796673+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.796567+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.630324+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'185","reported_seq":773,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.767475+0000","last_change":"2024-09-14T11:58:58.767475+0000","last_active":"2024-09-14T11:58:58.767475+0000","last_peered":"2024-09-14T11:58:58.767475+0000","last_clean":"2024-09-14T11:58:58.767475+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:58:58.767475+0000","last_undegraded":"2024-09-14T11:58:58.767475+0000","last_fullsized":"2024-09-14T11:58:58.767475+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.767391+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:27.127746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":397,"num_read_kb":13678,"num_write":826,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'689","reported_seq":2137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.570572+0000","last_change":"2024-09-14T11:59:04.570572+0000","last_active":"2024-09-14T11:59:04.570572+0000","last_peered":"2024-09-14T11:59:04.570572+0000","last_clean":"2024-09-14T11:59:04.570572+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:59:04.570572+0000","last_undegraded":"2024-09-14T11:59:04.570572+0000","last_fullsized":"2024-09-14T11:59:04.570572+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'689","last_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_deep_scrub":"262'689","last_deep_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.570481+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":600,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:50.385676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'226","reported_seq":893,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.251319+0000","last_change":"2024-09-14T11:58:58.251319+0000","last_active":"2024-09-14T11:58:58.251319+0000","last_peered":"2024-09-14T11:58:58.251319+0000","last_clean":"2024-09-14T11:58:58.251319+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:58:58.251319+0000","last_undegraded":"2024-09-14T11:58:58.251319+0000","last_fullsized":"2024-09-14T11:58:58.251319+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.251228+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:43.426816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":673,"num_read_kb":8461,"num_write":1067,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'577","reported_seq":2174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.999003+0000","last_change":"2024-09-14T11:15:34.321891+0000","last_active":"2024-09-14T11:56:36.999003+0000","last_peered":"2024-09-14T11:56:36.999003+0000","last_clean":"2024-09-14T11:56:36.999003+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:56:36.999003+0000","last_undegraded":"2024-09-14T11:56:36.999003+0000","last_fullsized":"2024-09-14T11:56:36.999003+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:33.296103+0000","last_clean_scrub_stamp":"2024-09-14T11:15:33.296103+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:57.912381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'263","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.887387+0000","last_change":"2024-09-14T11:58:59.887387+0000","last_active":"2024-09-14T11:58:59.887387+0000","last_peered":"2024-09-14T11:58:59.887387+0000","last_clean":"2024-09-14T11:58:59.887387+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:58:59.887387+0000","last_undegraded":"2024-09-14T11:58:59.887387+0000","last_fullsized":"2024-09-14T11:58:59.887387+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.887284+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:57.682098+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":625,"num_read_kb":65552,"num_write":1161,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1211","reported_seq":2822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.196538+0000","last_change":"2024-09-14T11:59:10.196538+0000","last_active":"2024-09-14T11:59:10.196538+0000","last_peered":"2024-09-14T11:59:10.196538+0000","last_clean":"2024-09-14T11:59:10.196538+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:59:10.196538+0000","last_undegraded":"2024-09-14T11:59:10.196538+0000","last_fullsized":"2024-09-14T11:59:10.196538+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1211","last_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_deep_scrub":"262'1211","last_deep_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.196453+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":1100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:27.768853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'200","reported_seq":824,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.627940+0000","last_change":"2024-09-14T11:58:57.627940+0000","last_active":"2024-09-14T11:58:57.627940+0000","last_peered":"2024-09-14T11:58:57.627940+0000","last_clean":"2024-09-14T11:58:57.627940+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:58:57.627940+0000","last_undegraded":"2024-09-14T11:58:57.627940+0000","last_fullsized":"2024-09-14T11:58:57.627940+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.627846+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:24.951020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":515,"num_read_kb":18867,"num_write":899,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'490","reported_seq":2146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.977291+0000","last_change":"2024-09-14T11:59:09.977291+0000","last_active":"2024-09-14T11:59:09.977291+0000","last_peered":"2024-09-14T11:59:09.977291+0000","last_clean":"2024-09-14T11:59:09.977291+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:59:09.977291+0000","last_undegraded":"2024-09-14T11:59:09.977291+0000","last_fullsized":"2024-09-14T11:59:09.977291+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'490","last_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_deep_scrub":"262'490","last_deep_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.977199+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.685268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'183","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.292435+0000","last_change":"2024-09-14T11:58:57.292435+0000","last_active":"2024-09-14T11:58:57.292435+0000","last_peered":"2024-09-14T11:58:57.292435+0000","last_clean":"2024-09-14T11:58:57.292435+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:58:57.292435+0000","last_undegraded":"2024-09-14T11:58:57.292435+0000","last_fullsized":"2024-09-14T11:58:57.292435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'183","last_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_deep_scrub":"262'183","last_deep_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.292341+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:17.394532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":3776,"num_write":815,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'443","reported_seq":1980,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.158439+0000","last_change":"2024-09-14T11:59:06.158439+0000","last_active":"2024-09-14T11:59:06.158439+0000","last_peered":"2024-09-14T11:59:06.158439+0000","last_clean":"2024-09-14T11:59:06.158439+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:59:06.158439+0000","last_undegraded":"2024-09-14T11:59:06.158439+0000","last_fullsized":"2024-09-14T11:59:06.158439+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'443","last_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_deep_scrub":"262'443","last_deep_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.158355+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:22.012200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'273","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.844697+0000","last_change":"2024-09-14T11:59:00.844697+0000","last_active":"2024-09-14T11:59:00.844697+0000","last_peered":"2024-09-14T11:59:00.844697+0000","last_clean":"2024-09-14T11:59:00.844697+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:59:00.844697+0000","last_undegraded":"2024-09-14T11:59:00.844697+0000","last_fullsized":"2024-09-14T11:59:00.844697+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'273","last_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_deep_scrub":"262'273","last_deep_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.844576+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:17.221784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":36414,"num_write":1104,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'493","reported_seq":2015,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.415356+0000","last_change":"2024-09-14T11:59:08.415356+0000","last_active":"2024-09-14T11:59:08.415356+0000","last_peered":"2024-09-14T11:59:08.415356+0000","last_clean":"2024-09-14T11:59:08.415356+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:59:08.415356+0000","last_undegraded":"2024-09-14T11:59:08.415356+0000","last_fullsized":"2024-09-14T11:59:08.415356+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.415265+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:13.317609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'284","reported_seq":939,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.837101+0000","last_change":"2024-09-14T11:59:00.836991+0000","last_active":"2024-09-14T11:59:00.837101+0000","last_peered":"2024-09-14T11:59:00.837101+0000","last_clean":"2024-09-14T11:59:00.837101+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:59:00.837101+0000","last_undegraded":"2024-09-14T11:59:00.837101+0000","last_fullsized":"2024-09-14T11:59:00.837101+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.836878+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:32.971543+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":728,"num_read_kb":57965,"num_write":1175,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'750","reported_seq":2331,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.237837+0000","last_change":"2024-09-14T11:59:09.237837+0000","last_active":"2024-09-14T11:59:09.237837+0000","last_peered":"2024-09-14T11:59:09.237837+0000","last_clean":"2024-09-14T11:59:09.237837+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:59:09.237837+0000","last_undegraded":"2024-09-14T11:59:09.237837+0000","last_fullsized":"2024-09-14T11:59:09.237837+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'750","last_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_deep_scrub":"262'750","last_deep_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.237718+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:11.504189+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'205","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.894568+0000","last_change":"2024-09-14T11:59:01.894568+0000","last_active":"2024-09-14T11:59:01.894568+0000","last_peered":"2024-09-14T11:59:01.894568+0000","last_clean":"2024-09-14T11:59:01.894568+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:59:01.894568+0000","last_undegraded":"2024-09-14T11:59:01.894568+0000","last_fullsized":"2024-09-14T11:59:01.894568+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.894440+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:58.772928+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":27346,"num_write":953,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.278891+0000","last_change":"2024-09-14T11:58:58.278891+0000","last_active":"2024-09-14T11:58:58.278891+0000","last_peered":"2024-09-14T11:58:58.278891+0000","last_clean":"2024-09-14T11:58:58.278891+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:58:58.278891+0000","last_undegraded":"2024-09-14T11:58:58.278891+0000","last_fullsized":"2024-09-14T11:58:58.278891+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'500","last_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_deep_scrub":"262'500","last_deep_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.278804+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:28.836107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.804411+0000","last_change":"2024-09-14T11:59:01.804411+0000","last_active":"2024-09-14T11:59:01.804411+0000","last_peered":"2024-09-14T11:59:01.804411+0000","last_clean":"2024-09-14T11:59:01.804411+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:59:01.804411+0000","last_undegraded":"2024-09-14T11:59:01.804411+0000","last_fullsized":"2024-09-14T11:59:01.804411+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.804299+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:14.419727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":6791,"num_write":1023,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1092","reported_seq":2586,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.266010+0000","last_change":"2024-09-14T11:59:08.266010+0000","last_active":"2024-09-14T11:59:08.266010+0000","last_peered":"2024-09-14T11:59:08.266010+0000","last_clean":"2024-09-14T11:59:08.266010+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:59:08.266010+0000","last_undegraded":"2024-09-14T11:59:08.266010+0000","last_fullsized":"2024-09-14T11:59:08.266010+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1092","last_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_deep_scrub":"262'1092","last_deep_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.265911+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:12.673036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'198","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.255530+0000","last_change":"2024-09-14T11:58:59.255530+0000","last_active":"2024-09-14T11:58:59.255530+0000","last_peered":"2024-09-14T11:58:59.255530+0000","last_clean":"2024-09-14T11:58:59.255530+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:58:59.255530+0000","last_undegraded":"2024-09-14T11:58:59.255530+0000","last_fullsized":"2024-09-14T11:58:59.255530+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.255428+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.960737+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":8671,"num_write":968,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'891","reported_seq":2805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.966742+0000","last_change":"2024-09-14T11:59:09.966742+0000","last_active":"2024-09-14T11:59:09.966742+0000","last_peered":"2024-09-14T11:59:09.966742+0000","last_clean":"2024-09-14T11:59:09.966742+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:59:09.966742+0000","last_undegraded":"2024-09-14T11:59:09.966742+0000","last_fullsized":"2024-09-14T11:59:09.966742+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'891","last_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_deep_scrub":"262'891","last_deep_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.966645+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.534651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'217","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.223498+0000","last_change":"2024-09-14T11:59:00.223498+0000","last_active":"2024-09-14T11:59:00.223498+0000","last_peered":"2024-09-14T11:59:00.223498+0000","last_clean":"2024-09-14T11:59:00.223498+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:59:00.223498+0000","last_undegraded":"2024-09-14T11:59:00.223498+0000","last_fullsized":"2024-09-14T11:59:00.223498+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.223379+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:54.749010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":9098,"num_write":1061,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2083,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.374724+0000","last_change":"2024-09-14T11:59:07.374724+0000","last_active":"2024-09-14T11:59:07.374724+0000","last_peered":"2024-09-14T11:59:07.374724+0000","last_clean":"2024-09-14T11:59:07.374724+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:59:07.374724+0000","last_undegraded":"2024-09-14T11:59:07.374724+0000","last_fullsized":"2024-09-14T11:59:07.374724+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'510","last_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_deep_scrub":"262'510","last_deep_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.374631+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:49.746178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'229","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.873293+0000","last_change":"2024-09-14T11:59:03.873293+0000","last_active":"2024-09-14T11:59:03.873293+0000","last_peered":"2024-09-14T11:59:03.873293+0000","last_clean":"2024-09-14T11:59:03.873293+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:59:03.873293+0000","last_undegraded":"2024-09-14T11:59:03.873293+0000","last_fullsized":"2024-09-14T11:59:03.873293+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.873191+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:41.942314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":2234,"num_write":1097,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1088","reported_seq":2862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.960382+0000","last_change":"2024-09-14T11:59:12.960382+0000","last_active":"2024-09-14T11:59:12.960382+0000","last_peered":"2024-09-14T11:59:12.960382+0000","last_clean":"2024-09-14T11:59:12.960382+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:59:12.960382+0000","last_undegraded":"2024-09-14T11:59:12.960382+0000","last_fullsized":"2024-09-14T11:59:12.960382+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1088","last_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_deep_scrub":"262'1088","last_deep_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.960278+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":1000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:21.372173+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'210","reported_seq":852,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.309896+0000","last_change":"2024-09-14T11:59:06.309896+0000","last_active":"2024-09-14T11:59:06.309896+0000","last_peered":"2024-09-14T11:59:06.309896+0000","last_clean":"2024-09-14T11:59:06.309896+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:59:06.309896+0000","last_undegraded":"2024-09-14T11:59:06.309896+0000","last_fullsized":"2024-09-14T11:59:06.309896+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.309806+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:19.118262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":34303,"num_write":987,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.917735+0000","last_change":"2024-09-14T11:59:08.917735+0000","last_active":"2024-09-14T11:59:08.917735+0000","last_peered":"2024-09-14T11:59:08.917735+0000","last_clean":"2024-09-14T11:59:08.917735+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:59:08.917735+0000","last_undegraded":"2024-09-14T11:59:08.917735+0000","last_fullsized":"2024-09-14T11:59:08.917735+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'475","last_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_deep_scrub":"262'475","last_deep_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.917635+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:56.114023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'254","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.828398+0000","last_change":"2024-09-14T11:59:02.828398+0000","last_active":"2024-09-14T11:59:02.828398+0000","last_peered":"2024-09-14T11:59:02.828398+0000","last_clean":"2024-09-14T11:59:02.828398+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:59:02.828398+0000","last_undegraded":"2024-09-14T11:59:02.828398+0000","last_fullsized":"2024-09-14T11:59:02.828398+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'254","last_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_deep_scrub":"262'254","last_deep_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.828297+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:11.803512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":43532,"num_write":1122,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'188","reported_seq":794,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.832260+0000","last_change":"2024-09-14T11:59:03.832260+0000","last_active":"2024-09-14T11:59:03.832260+0000","last_peered":"2024-09-14T11:59:03.832260+0000","last_clean":"2024-09-14T11:59:03.832260+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:59:03.832260+0000","last_undegraded":"2024-09-14T11:59:03.832260+0000","last_fullsized":"2024-09-14T11:59:03.832260+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.832145+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:54.524505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":29604,"num_write":903,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'414","reported_seq":1890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.403282+0000","last_change":"2024-09-14T11:59:09.403282+0000","last_active":"2024-09-14T11:59:09.403282+0000","last_peered":"2024-09-14T11:59:09.403282+0000","last_clean":"2024-09-14T11:59:09.403282+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:59:09.403282+0000","last_undegraded":"2024-09-14T11:59:09.403282+0000","last_fullsized":"2024-09-14T11:59:09.403282+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'414","last_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_deep_scrub":"262'414","last_deep_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.403191+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:28.990413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'282","reported_seq":1062,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.669653+0000","last_change":"2024-09-14T11:58:58.669653+0000","last_active":"2024-09-14T11:58:58.669653+0000","last_peered":"2024-09-14T11:58:58.669653+0000","last_clean":"2024-09-14T11:58:58.669653+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:58:58.669653+0000","last_undegraded":"2024-09-14T11:58:58.669653+0000","last_fullsized":"2024-09-14T11:58:58.669653+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.669555+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:27.928077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1009,"num_read_kb":66938,"num_write":1373,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'577","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.874845+0000","last_change":"2024-09-14T11:59:09.874845+0000","last_active":"2024-09-14T11:59:09.874845+0000","last_peered":"2024-09-14T11:59:09.874845+0000","last_clean":"2024-09-14T11:59:09.874845+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:59:09.874845+0000","last_undegraded":"2024-09-14T11:59:09.874845+0000","last_fullsized":"2024-09-14T11:59:09.874845+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'577","last_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_deep_scrub":"262'577","last_deep_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.874761+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:07.437905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":452,"ondisk_log_size":452,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":377666,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8331,"num_read_kb":10588,"num_write":5619,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1925,"ondisk_log_size":1925,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35729,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4127,"ondisk_log_size":4127,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42836797,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38922,"num_read_kb":2111716,"num_write":64484,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86687744,"data_stored":85673594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3998,"ondisk_log_size":3998,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":180487,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":169164,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509973,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":233200,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94138640,"statfs":{"total":96636764160,"available":96397967360,"internally_reserved":0,"allocated":13533184,"data_stored":11861887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509973,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229032,"kb_used_data":9048,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94142808,"statfs":{"total":96636764160,"available":96402235392,"internally_reserved":0,"allocated":9265152,"data_stored":7716819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509974,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101784,"kb_used_data":12360,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94270056,"statfs":{"total":96636764160,"available":96532537344,"internally_reserved":0,"allocated":12656640,"data_stored":10956578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509973,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93500,"kb_used_data":17900,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94278340,"statfs":{"total":96636764160,"available":96541020160,"internally_reserved":0,"allocated":18329600,"data_stored":16701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509975,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248296,"kb_used_data":18584,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123544,"statfs":{"total":96636764160,"available":96382509056,"internally_reserved":0,"allocated":19030016,"data_stored":17385395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509973,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75936,"kb_used_data":8656,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295904,"statfs":{"total":96636764160,"available":96559005696,"internally_reserved":0,"allocated":8863744,"data_stored":7316623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509971,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252032,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94119808,"statfs":{"total":96636764160,"available":96378683392,"internally_reserved":0,"allocated":22855680,"data_stored":21154199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575379,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133412,"kb_used_data":12052,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94238428,"statfs":{"total":96636764160,"available":96500150272,"internally_reserved":0,"allocated":12341248,"data_stored":10776464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":18434939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8728576,"data_stored":8650845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5275648,"data_stored":5190678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15388672,"data_stored":15257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8986624,"data_stored":8830204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5656576,"data_stored":5589626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9293824,"data_stored":9144278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:59:16.326 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.326 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.327 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.328 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.329 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.330 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.331 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.332 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.333 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.334 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.335 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.336 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.337 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.338 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.339 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.339 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.339 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.339 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.339 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.339 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.339 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.340 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.341 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.342 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.343 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.344 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.345 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.346 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:15:31.285879+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.347 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.348 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.349 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:15:35.306279+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.350 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.351 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.351 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.351 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:15:37.316157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.351 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:15:39.326991+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.351 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.351 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:15:33.296103+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=33, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:16.352 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:59:36.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:59:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:59:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:59:36.721 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1587,"stamp":"2024-09-14T11:59:34.802407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43821918,"num_objects":628,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":628,"num_whiteouts":0,"num_read":296215,"num_read_kb":2700212,"num_write":146664,"num_write_kb":2447739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740649,"num_omap_keys":1780,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13497,"ondisk_log_size":13497,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1379672,"kb_used_data":114136,"kb_used_omap":12,"kb_used_meta":1265395,"kb_avail":753595048,"statfs":{"total":773094113280,"available":771681329152,"internally_reserved":0,"allocated":116875264,"data_stored":103868988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1295765040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535778,"num_omap_keys":1245,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005385"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877231+0000","last_change":"2024-09-14T11:43:35.602913+0000","last_active":"2024-09-14T11:56:08.877231+0000","last_peered":"2024-09-14T11:56:08.877231+0000","last_clean":"2024-09-14T11:56:08.877231+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:56:08.877231+0000","last_undegraded":"2024-09-14T11:56:08.877231+0000","last_fullsized":"2024-09-14T11:56:08.877231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:06.258234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.867970+0000","last_change":"2024-09-14T11:32:32.583802+0000","last_active":"2024-09-14T11:55:03.867970+0000","last_peered":"2024-09-14T11:55:03.867970+0000","last_clean":"2024-09-14T11:55:03.867970+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:55:03.867970+0000","last_undegraded":"2024-09-14T11:55:03.867970+0000","last_fullsized":"2024-09-14T11:55:03.867970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:58.807468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.889529+0000","last_change":"2024-09-14T11:32:29.554679+0000","last_active":"2024-09-14T11:57:28.889529+0000","last_peered":"2024-09-14T11:57:28.889529+0000","last_clean":"2024-09-14T11:57:28.889529+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:57:28.889529+0000","last_undegraded":"2024-09-14T11:57:28.889529+0000","last_fullsized":"2024-09-14T11:57:28.889529+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:20.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.865041+0000","last_change":"2024-09-14T11:30:45.179357+0000","last_active":"2024-09-14T11:55:48.865041+0000","last_peered":"2024-09-14T11:55:48.865041+0000","last_clean":"2024-09-14T11:55:48.865041+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:55:48.865041+0000","last_undegraded":"2024-09-14T11:55:48.865041+0000","last_fullsized":"2024-09-14T11:55:48.865041+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:03.066351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.256443+0000","last_change":"2024-09-14T11:59:20.256443+0000","last_active":"2024-09-14T11:59:20.256443+0000","last_peered":"2024-09-14T11:59:20.256443+0000","last_clean":"2024-09-14T11:59:20.256443+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:59:20.256443+0000","last_undegraded":"2024-09-14T11:59:20.256443+0000","last_fullsized":"2024-09-14T11:59:20.256443+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.256349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.256349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.256349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:22.982220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'6","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.413106+0000","last_change":"2024-09-14T11:32:32.582294+0000","last_active":"2024-09-14T11:58:47.413106+0000","last_peered":"2024-09-14T11:58:47.413106+0000","last_clean":"2024-09-14T11:58:47.413106+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:58:47.413106+0000","last_undegraded":"2024-09-14T11:58:47.413106+0000","last_fullsized":"2024-09-14T11:58:47.413106+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.399340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.864287+0000","last_change":"2024-09-14T11:32:29.558121+0000","last_active":"2024-09-14T11:55:00.864287+0000","last_peered":"2024-09-14T11:55:00.864287+0000","last_clean":"2024-09-14T11:55:00.864287+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:55:00.864287+0000","last_undegraded":"2024-09-14T11:55:00.864287+0000","last_fullsized":"2024-09-14T11:55:00.864287+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:52.777925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.320376+0000","last_change":"2024-09-14T11:59:13.320376+0000","last_active":"2024-09-14T11:59:13.320376+0000","last_peered":"2024-09-14T11:59:13.320376+0000","last_clean":"2024-09-14T11:59:13.320376+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:59:13.320376+0000","last_undegraded":"2024-09-14T11:59:13.320376+0000","last_fullsized":"2024-09-14T11:59:13.320376+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'59","last_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_deep_scrub":"262'59","last_deep_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.320284+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:41.355939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.078463+0000","last_change":"2024-09-14T11:59:32.078463+0000","last_active":"2024-09-14T11:59:32.078463+0000","last_peered":"2024-09-14T11:59:32.078463+0000","last_clean":"2024-09-14T11:59:32.078463+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:59:32.078463+0000","last_undegraded":"2024-09-14T11:59:32.078463+0000","last_fullsized":"2024-09-14T11:59:32.078463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.078369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.078369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.078369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:18.744142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'8","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.241902+0000","last_change":"2024-09-14T11:32:32.578401+0000","last_active":"2024-09-14T11:58:47.241902+0000","last_peered":"2024-09-14T11:58:47.241902+0000","last_clean":"2024-09-14T11:58:47.241902+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:58:47.241902+0000","last_undegraded":"2024-09-14T11:58:47.241902+0000","last_fullsized":"2024-09-14T11:58:47.241902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:07.530877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13314,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'9","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.249375+0000","last_change":"2024-09-14T11:59:17.249375+0000","last_active":"2024-09-14T11:59:17.249375+0000","last_peered":"2024-09-14T11:59:17.249375+0000","last_clean":"2024-09-14T11:59:17.249375+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:59:17.249375+0000","last_undegraded":"2024-09-14T11:59:17.249375+0000","last_fullsized":"2024-09-14T11:59:17.249375+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:17.249272+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:17.249272+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.249272+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:50.213143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":109,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.864987+0000","last_change":"2024-09-14T11:30:45.186185+0000","last_active":"2024-09-14T11:55:48.864987+0000","last_peered":"2024-09-14T11:55:48.864987+0000","last_clean":"2024-09-14T11:55:48.864987+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:55:48.864987+0000","last_undegraded":"2024-09-14T11:55:48.864987+0000","last_fullsized":"2024-09-14T11:55:48.864987+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.774513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875479+0000","last_change":"2024-09-14T11:43:35.603929+0000","last_active":"2024-09-14T11:55:48.875479+0000","last_peered":"2024-09-14T11:55:48.875479+0000","last_clean":"2024-09-14T11:55:48.875479+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:55:48.875479+0000","last_undegraded":"2024-09-14T11:55:48.875479+0000","last_fullsized":"2024-09-14T11:55:48.875479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:33.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'4","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.899916+0000","last_change":"2024-09-14T11:32:32.589192+0000","last_active":"2024-09-14T11:58:43.899916+0000","last_peered":"2024-09-14T11:58:43.899916+0000","last_clean":"2024-09-14T11:58:43.899916+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:58:43.899916+0000","last_undegraded":"2024-09-14T11:58:43.899916+0000","last_fullsized":"2024-09-14T11:58:43.899916+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:52.225210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.460126+0000","last_change":"2024-09-14T11:32:29.549479+0000","last_active":"2024-09-14T11:58:47.460126+0000","last_peered":"2024-09-14T11:58:47.460126+0000","last_clean":"2024-09-14T11:58:47.460126+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:58:47.460126+0000","last_undegraded":"2024-09-14T11:58:47.460126+0000","last_fullsized":"2024-09-14T11:58:47.460126+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875525+0000","last_change":"2024-09-14T11:30:45.187877+0000","last_active":"2024-09-14T11:55:48.875525+0000","last_peered":"2024-09-14T11:55:48.875525+0000","last_clean":"2024-09-14T11:55:48.875525+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:55:48.875525+0000","last_undegraded":"2024-09-14T11:55:48.875525+0000","last_fullsized":"2024-09-14T11:55:48.875525+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:40.426491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874894+0000","last_change":"2024-09-14T11:43:35.601032+0000","last_active":"2024-09-14T11:55:43.874894+0000","last_peered":"2024-09-14T11:55:43.874894+0000","last_clean":"2024-09-14T11:55:43.874894+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:55:43.874894+0000","last_undegraded":"2024-09-14T11:55:43.874894+0000","last_fullsized":"2024-09-14T11:55:43.874894+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.697673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'4","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.393240+0000","last_change":"2024-09-14T11:33:08.805104+0000","last_active":"2024-09-14T11:58:47.393240+0000","last_peered":"2024-09-14T11:58:47.393240+0000","last_clean":"2024-09-14T11:58:47.393240+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:58:47.393240+0000","last_undegraded":"2024-09-14T11:58:47.393240+0000","last_fullsized":"2024-09-14T11:58:47.393240+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'8","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.434909+0000","last_change":"2024-09-14T11:32:29.558168+0000","last_active":"2024-09-14T11:58:47.434909+0000","last_peered":"2024-09-14T11:58:47.434909+0000","last_clean":"2024-09-14T11:58:47.434909+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:58:47.434909+0000","last_undegraded":"2024-09-14T11:58:47.434909+0000","last_fullsized":"2024-09-14T11:58:47.434909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875505+0000","last_change":"2024-09-14T11:30:45.184142+0000","last_active":"2024-09-14T11:55:48.875505+0000","last_peered":"2024-09-14T11:55:48.875505+0000","last_clean":"2024-09-14T11:55:48.875505+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:55:48.875505+0000","last_undegraded":"2024-09-14T11:55:48.875505+0000","last_fullsized":"2024-09-14T11:55:48.875505+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:48.014837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:05.872788+0000","last_change":"2024-09-14T11:43:35.605737+0000","last_active":"2024-09-14T11:56:05.872788+0000","last_peered":"2024-09-14T11:56:05.872788+0000","last_clean":"2024-09-14T11:56:05.872788+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:56:05.872788+0000","last_undegraded":"2024-09-14T11:56:05.872788+0000","last_fullsized":"2024-09-14T11:56:05.872788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:47.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.131931+0000","last_change":"2024-09-14T11:59:29.131931+0000","last_active":"2024-09-14T11:59:29.131931+0000","last_peered":"2024-09-14T11:59:29.131931+0000","last_clean":"2024-09-14T11:59:29.131931+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:59:29.131931+0000","last_undegraded":"2024-09-14T11:59:29.131931+0000","last_fullsized":"2024-09-14T11:59:29.131931+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:29.131829+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.131829+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.131829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.210029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.233351+0000","last_change":"2024-09-14T11:32:29.550064+0000","last_active":"2024-09-14T11:58:47.233351+0000","last_peered":"2024-09-14T11:58:47.233351+0000","last_clean":"2024-09-14T11:58:47.233351+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:58:47.233351+0000","last_undegraded":"2024-09-14T11:58:47.233351+0000","last_fullsized":"2024-09-14T11:58:47.233351+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.107584+0000","last_change":"2024-09-14T11:59:23.107584+0000","last_active":"2024-09-14T11:59:23.107584+0000","last_peered":"2024-09-14T11:59:23.107584+0000","last_clean":"2024-09-14T11:59:23.107584+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:59:23.107584+0000","last_undegraded":"2024-09-14T11:59:23.107584+0000","last_fullsized":"2024-09-14T11:59:23.107584+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'26","last_scrub_stamp":"2024-09-14T11:59:23.107479+0000","last_deep_scrub":"262'26","last_deep_scrub_stamp":"2024-09-14T11:59:23.107479+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.107479+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:53.674864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877316+0000","last_change":"2024-09-14T11:43:35.605759+0000","last_active":"2024-09-14T11:56:08.877316+0000","last_peered":"2024-09-14T11:56:08.877316+0000","last_clean":"2024-09-14T11:56:08.877316+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:56:08.877316+0000","last_undegraded":"2024-09-14T11:56:08.877316+0000","last_fullsized":"2024-09-14T11:56:08.877316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:50.991769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.129766+0000","last_change":"2024-09-14T11:59:30.129766+0000","last_active":"2024-09-14T11:59:30.129766+0000","last_peered":"2024-09-14T11:59:30.129766+0000","last_clean":"2024-09-14T11:59:30.129766+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:59:30.129766+0000","last_undegraded":"2024-09-14T11:59:30.129766+0000","last_fullsized":"2024-09-14T11:59:30.129766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-14T11:59:30.129669+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-14T11:59:30.129669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.129669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:43.105203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.004336+0000","last_change":"2024-09-14T11:32:29.555376+0000","last_active":"2024-09-14T11:54:59.004336+0000","last_peered":"2024-09-14T11:54:59.004336+0000","last_clean":"2024-09-14T11:54:59.004336+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:54:59.004336+0000","last_undegraded":"2024-09-14T11:54:59.004336+0000","last_fullsized":"2024-09-14T11:54:59.004336+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:13.555945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":203,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.859610+0000","last_change":"2024-09-14T11:30:45.175070+0000","last_active":"2024-09-14T11:55:03.859610+0000","last_peered":"2024-09-14T11:55:03.859610+0000","last_clean":"2024-09-14T11:55:03.859610+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:55:03.859610+0000","last_undegraded":"2024-09-14T11:55:03.859610+0000","last_fullsized":"2024-09-14T11:55:03.859610+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.836949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877363+0000","last_change":"2024-09-14T11:43:35.607526+0000","last_active":"2024-09-14T11:56:08.877363+0000","last_peered":"2024-09-14T11:56:08.877363+0000","last_clean":"2024-09-14T11:56:08.877363+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:56:08.877363+0000","last_undegraded":"2024-09-14T11:56:08.877363+0000","last_fullsized":"2024-09-14T11:56:08.877363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.745235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":33,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.869068+0000","last_change":"2024-09-14T11:32:32.587761+0000","last_active":"2024-09-14T11:55:03.869068+0000","last_peered":"2024-09-14T11:55:03.869068+0000","last_clean":"2024-09-14T11:55:03.869068+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:55:03.869068+0000","last_undegraded":"2024-09-14T11:55:03.869068+0000","last_fullsized":"2024-09-14T11:55:03.869068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:27.086403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859019+0000","last_change":"2024-09-14T11:32:29.555600+0000","last_active":"2024-09-14T11:54:58.859019+0000","last_peered":"2024-09-14T11:54:58.859019+0000","last_clean":"2024-09-14T11:54:58.859019+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:54:58.859019+0000","last_undegraded":"2024-09-14T11:54:58.859019+0000","last_fullsized":"2024-09-14T11:54:58.859019+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.338753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":112,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.423063+0000","last_change":"2024-09-14T11:59:23.423063+0000","last_active":"2024-09-14T11:59:23.423063+0000","last_peered":"2024-09-14T11:59:23.423063+0000","last_clean":"2024-09-14T11:59:23.423063+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:59:23.423063+0000","last_undegraded":"2024-09-14T11:59:23.423063+0000","last_fullsized":"2024-09-14T11:59:23.423063+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-14T11:59:23.422970+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-14T11:59:23.422970+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.422970+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:59.982789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:15.866051+0000","last_change":"2024-09-14T11:43:35.603298+0000","last_active":"2024-09-14T11:55:15.866051+0000","last_peered":"2024-09-14T11:55:15.866051+0000","last_clean":"2024-09-14T11:55:15.866051+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:55:15.866051+0000","last_undegraded":"2024-09-14T11:55:15.866051+0000","last_fullsized":"2024-09-14T11:55:15.866051+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882047+0000","last_change":"2024-09-14T11:32:32.585885+0000","last_active":"2024-09-14T11:56:43.882047+0000","last_peered":"2024-09-14T11:56:43.882047+0000","last_clean":"2024-09-14T11:56:43.882047+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:56:43.882047+0000","last_undegraded":"2024-09-14T11:56:43.882047+0000","last_fullsized":"2024-09-14T11:56:43.882047+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.875756+0000","last_change":"2024-09-14T11:32:29.556257+0000","last_active":"2024-09-14T11:55:58.875756+0000","last_peered":"2024-09-14T11:55:58.875756+0000","last_clean":"2024-09-14T11:55:58.875756+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:55:58.875756+0000","last_undegraded":"2024-09-14T11:55:58.875756+0000","last_fullsized":"2024-09-14T11:55:58.875756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:03.738228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":456,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.859107+0000","last_change":"2024-09-14T11:30:45.181226+0000","last_active":"2024-09-14T11:54:58.859107+0000","last_peered":"2024-09-14T11:54:58.859107+0000","last_clean":"2024-09-14T11:54:58.859107+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:54:58.859107+0000","last_undegraded":"2024-09-14T11:54:58.859107+0000","last_fullsized":"2024-09-14T11:54:58.859107+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:13.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.224414+0000","last_change":"2024-09-14T11:59:19.224414+0000","last_active":"2024-09-14T11:59:19.224414+0000","last_peered":"2024-09-14T11:59:19.224414+0000","last_clean":"2024-09-14T11:59:19.224414+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:59:19.224414+0000","last_undegraded":"2024-09-14T11:59:19.224414+0000","last_fullsized":"2024-09-14T11:59:19.224414+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:19.224326+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:19.224326+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.224326+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:10.820830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.877364+0000","last_change":"2024-09-14T11:32:32.588409+0000","last_active":"2024-09-14T11:56:03.877364+0000","last_peered":"2024-09-14T11:56:03.877364+0000","last_clean":"2024-09-14T11:56:03.877364+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:56:03.877364+0000","last_undegraded":"2024-09-14T11:56:03.877364+0000","last_fullsized":"2024-09-14T11:56:03.877364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:05.997127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'4","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.320879+0000","last_change":"2024-09-14T11:32:29.554191+0000","last_active":"2024-09-14T11:58:47.320879+0000","last_peered":"2024-09-14T11:58:47.320879+0000","last_clean":"2024-09-14T11:58:47.320879+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:58:47.320879+0000","last_undegraded":"2024-09-14T11:58:47.320879+0000","last_fullsized":"2024-09-14T11:58:47.320879+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":232,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.870574+0000","last_change":"2024-09-14T11:30:45.186297+0000","last_active":"2024-09-14T11:55:59.870574+0000","last_peered":"2024-09-14T11:55:59.870574+0000","last_clean":"2024-09-14T11:55:59.870574+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:55:59.870574+0000","last_undegraded":"2024-09-14T11:55:59.870574+0000","last_fullsized":"2024-09-14T11:55:59.870574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.503260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869999+0000","last_change":"2024-09-14T11:43:35.602751+0000","last_active":"2024-09-14T11:55:18.869999+0000","last_peered":"2024-09-14T11:55:18.869999+0000","last_clean":"2024-09-14T11:55:18.869999+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:55:18.869999+0000","last_undegraded":"2024-09-14T11:55:18.869999+0000","last_fullsized":"2024-09-14T11:55:18.869999+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:27.871586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.392754+0000","last_change":"2024-09-14T11:32:32.582994+0000","last_active":"2024-09-14T11:58:47.392754+0000","last_peered":"2024-09-14T11:58:47.392754+0000","last_clean":"2024-09-14T11:58:47.392754+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:58:47.392754+0000","last_undegraded":"2024-09-14T11:58:47.392754+0000","last_fullsized":"2024-09-14T11:58:47.392754+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.289244+0000","last_change":"2024-09-14T11:59:15.289244+0000","last_active":"2024-09-14T11:59:15.289244+0000","last_peered":"2024-09-14T11:59:15.289244+0000","last_clean":"2024-09-14T11:59:15.289244+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:59:15.289244+0000","last_undegraded":"2024-09-14T11:59:15.289244+0000","last_fullsized":"2024-09-14T11:59:15.289244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:15.289158+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:15.289158+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.289158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:54.409715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.340892+0000","last_change":"2024-09-14T11:59:07.340892+0000","last_active":"2024-09-14T11:59:07.340892+0000","last_peered":"2024-09-14T11:59:07.340892+0000","last_clean":"2024-09-14T11:59:07.340892+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:59:07.340892+0000","last_undegraded":"2024-09-14T11:59:07.340892+0000","last_fullsized":"2024-09-14T11:59:07.340892+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.340795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:53.630134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.869969+0000","last_change":"2024-09-14T11:43:35.601578+0000","last_active":"2024-09-14T11:55:18.869969+0000","last_peered":"2024-09-14T11:55:18.869969+0000","last_clean":"2024-09-14T11:55:18.869969+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:55:18.869969+0000","last_undegraded":"2024-09-14T11:55:18.869969+0000","last_fullsized":"2024-09-14T11:55:18.869969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:45.561461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.019292+0000","last_change":"2024-09-14T11:32:32.581631+0000","last_active":"2024-09-14T11:56:44.019292+0000","last_peered":"2024-09-14T11:56:44.019292+0000","last_clean":"2024-09-14T11:56:44.019292+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:56:44.019292+0000","last_undegraded":"2024-09-14T11:56:44.019292+0000","last_fullsized":"2024-09-14T11:56:44.019292+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.870856+0000","last_change":"2024-09-14T11:32:29.550009+0000","last_active":"2024-09-14T11:56:38.870856+0000","last_peered":"2024-09-14T11:56:38.870856+0000","last_clean":"2024-09-14T11:56:38.870856+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:56:38.870856+0000","last_undegraded":"2024-09-14T11:56:38.870856+0000","last_fullsized":"2024-09-14T11:56:38.870856+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.881198+0000","last_change":"2024-09-14T11:30:45.185397+0000","last_active":"2024-09-14T11:56:33.881198+0000","last_peered":"2024-09-14T11:56:33.881198+0000","last_clean":"2024-09-14T11:56:33.881198+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:56:33.881198+0000","last_undegraded":"2024-09-14T11:56:33.881198+0000","last_fullsized":"2024-09-14T11:56:33.881198+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:30.178621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874909+0000","last_change":"2024-09-14T11:43:35.603719+0000","last_active":"2024-09-14T11:55:43.874909+0000","last_peered":"2024-09-14T11:55:43.874909+0000","last_clean":"2024-09-14T11:55:43.874909+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:55:43.874909+0000","last_undegraded":"2024-09-14T11:55:43.874909+0000","last_fullsized":"2024-09-14T11:55:43.874909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:21.587122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'5","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.396750+0000","last_change":"2024-09-14T11:59:30.396750+0000","last_active":"2024-09-14T11:59:30.396750+0000","last_peered":"2024-09-14T11:59:30.396750+0000","last_clean":"2024-09-14T11:59:30.396750+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:59:30.396750+0000","last_undegraded":"2024-09-14T11:59:30.396750+0000","last_fullsized":"2024-09-14T11:59:30.396750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:30.396650+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:30.396650+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.396650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:35.714644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'7","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.967981+0000","last_change":"2024-09-14T11:59:32.967981+0000","last_active":"2024-09-14T11:59:32.967981+0000","last_peered":"2024-09-14T11:59:32.967981+0000","last_clean":"2024-09-14T11:59:32.967981+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:59:32.967981+0000","last_undegraded":"2024-09-14T11:59:32.967981+0000","last_fullsized":"2024-09-14T11:59:32.967981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-14T11:59:32.967882+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-14T11:59:32.967882+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.967882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:45.922771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7227,"num_write":12,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":182,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.055155+0000","last_change":"2024-09-14T11:59:33.055155+0000","last_active":"2024-09-14T11:59:33.055155+0000","last_peered":"2024-09-14T11:59:33.055155+0000","last_clean":"2024-09-14T11:59:33.055155+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:59:33.055155+0000","last_undegraded":"2024-09-14T11:59:33.055155+0000","last_fullsized":"2024-09-14T11:59:33.055155+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-14T11:59:33.055047+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-14T11:59:33.055047+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.055047+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:25.316879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.864520+0000","last_change":"2024-09-14T11:43:35.606065+0000","last_active":"2024-09-14T11:55:43.864520+0000","last_peered":"2024-09-14T11:55:43.864520+0000","last_clean":"2024-09-14T11:55:43.864520+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:55:43.864520+0000","last_undegraded":"2024-09-14T11:55:43.864520+0000","last_fullsized":"2024-09-14T11:55:43.864520+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:45.826564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'6","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:15.888107+0000","last_change":"2024-09-14T11:32:32.581191+0000","last_active":"2024-09-14T11:58:15.888107+0000","last_peered":"2024-09-14T11:58:15.888107+0000","last_clean":"2024-09-14T11:58:15.888107+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:58:15.888107+0000","last_undegraded":"2024-09-14T11:58:15.888107+0000","last_fullsized":"2024-09-14T11:58:15.888107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:56.670374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875460+0000","last_change":"2024-09-14T11:32:29.543122+0000","last_active":"2024-09-14T11:55:48.875460+0000","last_peered":"2024-09-14T11:55:48.875460+0000","last_clean":"2024-09-14T11:55:48.875460+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:55:48.875460+0000","last_undegraded":"2024-09-14T11:55:48.875460+0000","last_fullsized":"2024-09-14T11:55:48.875460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:34.079866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.619952+0000","last_change":"2024-09-14T11:59:33.619952+0000","last_active":"2024-09-14T11:59:33.619952+0000","last_peered":"2024-09-14T11:59:33.619952+0000","last_clean":"2024-09-14T11:59:33.619952+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:59:33.619952+0000","last_undegraded":"2024-09-14T11:59:33.619952+0000","last_fullsized":"2024-09-14T11:59:33.619952+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-14T11:59:33.619863+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-14T11:59:33.619863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.619863+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:49.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.861900+0000","last_change":"2024-09-14T11:43:35.608421+0000","last_active":"2024-09-14T11:55:23.861900+0000","last_peered":"2024-09-14T11:55:23.861900+0000","last_clean":"2024-09-14T11:55:23.861900+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:55:23.861900+0000","last_undegraded":"2024-09-14T11:55:23.861900+0000","last_fullsized":"2024-09-14T11:55:23.861900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:33.729484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:13.895413+0000","last_change":"2024-09-14T11:32:32.590267+0000","last_active":"2024-09-14T11:58:13.895413+0000","last_peered":"2024-09-14T11:58:13.895413+0000","last_clean":"2024-09-14T11:58:13.895413+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:58:13.895413+0000","last_undegraded":"2024-09-14T11:58:13.895413+0000","last_fullsized":"2024-09-14T11:58:13.895413+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:08.861311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.067586+0000","last_change":"2024-09-14T11:59:25.067586+0000","last_active":"2024-09-14T11:59:25.067586+0000","last_peered":"2024-09-14T11:59:25.067586+0000","last_clean":"2024-09-14T11:59:25.067586+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:59:25.067586+0000","last_undegraded":"2024-09-14T11:59:25.067586+0000","last_fullsized":"2024-09-14T11:59:25.067586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.067506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.067506+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.067506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:06.589318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.918900+0000","last_change":"2024-09-14T11:59:31.918900+0000","last_active":"2024-09-14T11:59:31.918900+0000","last_peered":"2024-09-14T11:59:31.918900+0000","last_clean":"2024-09-14T11:59:31.918900+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:59:31.918900+0000","last_undegraded":"2024-09-14T11:59:31.918900+0000","last_fullsized":"2024-09-14T11:59:31.918900+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-14T11:59:31.918814+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-14T11:59:31.918814+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.918814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:45.012003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874873+0000","last_change":"2024-09-14T11:43:35.603573+0000","last_active":"2024-09-14T11:55:43.874873+0000","last_peered":"2024-09-14T11:55:43.874873+0000","last_clean":"2024-09-14T11:55:43.874873+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:55:43.874873+0000","last_undegraded":"2024-09-14T11:55:43.874873+0000","last_fullsized":"2024-09-14T11:55:43.874873+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:21.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.094352+0000","last_change":"2024-09-14T11:59:28.094352+0000","last_active":"2024-09-14T11:59:28.094352+0000","last_peered":"2024-09-14T11:59:28.094352+0000","last_clean":"2024-09-14T11:59:28.094352+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:59:28.094352+0000","last_undegraded":"2024-09-14T11:59:28.094352+0000","last_fullsized":"2024-09-14T11:59:28.094352+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-14T11:59:28.094268+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-14T11:59:28.094268+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.094268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:35.495083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.863794+0000","last_change":"2024-09-14T11:59:33.863794+0000","last_active":"2024-09-14T11:59:33.863794+0000","last_peered":"2024-09-14T11:59:33.863794+0000","last_clean":"2024-09-14T11:59:33.863794+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:59:33.863794+0000","last_undegraded":"2024-09-14T11:59:33.863794+0000","last_fullsized":"2024-09-14T11:59:33.863794+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:33.863688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:33.863688+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.863688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:57.260259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880162+0000","last_change":"2024-09-14T11:30:45.188008+0000","last_active":"2024-09-14T11:56:28.880162+0000","last_peered":"2024-09-14T11:56:28.880162+0000","last_clean":"2024-09-14T11:56:28.880162+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:56:28.880162+0000","last_undegraded":"2024-09-14T11:56:28.880162+0000","last_fullsized":"2024-09-14T11:56:28.880162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:10.454288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.240252+0000","last_change":"2024-09-14T11:59:16.240252+0000","last_active":"2024-09-14T11:59:16.240252+0000","last_peered":"2024-09-14T11:59:16.240252+0000","last_clean":"2024-09-14T11:59:16.240252+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:59:16.240252+0000","last_undegraded":"2024-09-14T11:59:16.240252+0000","last_fullsized":"2024-09-14T11:59:16.240252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.240178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.240178+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.240178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:44.441783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.886549+0000","last_change":"2024-09-14T11:32:32.585896+0000","last_active":"2024-09-14T11:57:18.886549+0000","last_peered":"2024-09-14T11:57:18.886549+0000","last_clean":"2024-09-14T11:57:18.886549+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:57:18.886549+0000","last_undegraded":"2024-09-14T11:57:18.886549+0000","last_fullsized":"2024-09-14T11:57:18.886549+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.886438+0000","last_change":"2024-09-14T11:32:29.550392+0000","last_active":"2024-09-14T11:57:13.886438+0000","last_peered":"2024-09-14T11:57:13.886438+0000","last_clean":"2024-09-14T11:57:13.886438+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:57:13.886438+0000","last_undegraded":"2024-09-14T11:57:13.886438+0000","last_fullsized":"2024-09-14T11:57:13.886438+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":98,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874939+0000","last_change":"2024-09-14T11:30:45.187527+0000","last_active":"2024-09-14T11:55:43.874939+0000","last_peered":"2024-09-14T11:55:43.874939+0000","last_clean":"2024-09-14T11:55:43.874939+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:55:43.874939+0000","last_undegraded":"2024-09-14T11:55:43.874939+0000","last_fullsized":"2024-09-14T11:55:43.874939+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:10.115937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.885807+0000","last_change":"2024-09-14T11:43:35.607758+0000","last_active":"2024-09-14T11:57:08.885807+0000","last_peered":"2024-09-14T11:57:08.885807+0000","last_clean":"2024-09-14T11:57:08.885807+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:57:08.885807+0000","last_undegraded":"2024-09-14T11:57:08.885807+0000","last_fullsized":"2024-09-14T11:57:08.885807+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'4","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.436620+0000","last_change":"2024-09-14T11:32:32.589816+0000","last_active":"2024-09-14T11:58:47.436620+0000","last_peered":"2024-09-14T11:58:47.436620+0000","last_clean":"2024-09-14T11:58:47.436620+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:58:47.436620+0000","last_undegraded":"2024-09-14T11:58:47.436620+0000","last_fullsized":"2024-09-14T11:58:47.436620+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.321965+0000","last_change":"2024-09-14T11:59:10.321896+0000","last_active":"2024-09-14T11:59:10.321965+0000","last_peered":"2024-09-14T11:59:10.321965+0000","last_clean":"2024-09-14T11:59:10.321965+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:59:10.321965+0000","last_undegraded":"2024-09-14T11:59:10.321965+0000","last_fullsized":"2024-09-14T11:59:10.321965+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.321802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:41.521238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":140,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.834444+0000","last_change":"2024-09-14T11:59:31.834444+0000","last_active":"2024-09-14T11:59:31.834444+0000","last_peered":"2024-09-14T11:59:31.834444+0000","last_clean":"2024-09-14T11:59:31.834444+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:59:31.834444+0000","last_undegraded":"2024-09-14T11:59:31.834444+0000","last_fullsized":"2024-09-14T11:59:31.834444+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-14T11:59:31.834343+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-14T11:59:31.834343+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.834343+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:24.480004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.089349+0000","last_change":"2024-09-14T11:59:31.089349+0000","last_active":"2024-09-14T11:59:31.089349+0000","last_peered":"2024-09-14T11:59:31.089349+0000","last_clean":"2024-09-14T11:59:31.089349+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:59:31.089349+0000","last_undegraded":"2024-09-14T11:59:31.089349+0000","last_fullsized":"2024-09-14T11:59:31.089349+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.089230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.089230+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.089230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:18.598347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.419841+0000","last_change":"2024-09-14T11:59:29.419841+0000","last_active":"2024-09-14T11:59:29.419841+0000","last_peered":"2024-09-14T11:59:29.419841+0000","last_clean":"2024-09-14T11:59:29.419841+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:59:29.419841+0000","last_undegraded":"2024-09-14T11:59:29.419841+0000","last_fullsized":"2024-09-14T11:59:29.419841+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-14T11:59:29.419750+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-14T11:59:29.419750+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.419750+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:22.031323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.875103+0000","last_change":"2024-09-14T11:32:29.556788+0000","last_active":"2024-09-14T11:57:13.875103+0000","last_peered":"2024-09-14T11:57:13.875103+0000","last_clean":"2024-09-14T11:57:13.875103+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:57:13.875103+0000","last_undegraded":"2024-09-14T11:57:13.875103+0000","last_fullsized":"2024-09-14T11:57:13.875103+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":110,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.062089+0000","last_change":"2024-09-14T11:59:22.062089+0000","last_active":"2024-09-14T11:59:22.062089+0000","last_peered":"2024-09-14T11:59:22.062089+0000","last_clean":"2024-09-14T11:59:22.062089+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:59:22.062089+0000","last_undegraded":"2024-09-14T11:59:22.062089+0000","last_fullsized":"2024-09-14T11:59:22.062089+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'20","last_scrub_stamp":"2024-09-14T11:59:22.062012+0000","last_deep_scrub":"259'20","last_deep_scrub_stamp":"2024-09-14T11:59:22.062012+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.062012+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:14.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.881804+0000","last_change":"2024-09-14T11:43:35.603524+0000","last_active":"2024-09-14T11:56:38.881804+0000","last_peered":"2024-09-14T11:56:38.881804+0000","last_clean":"2024-09-14T11:56:38.881804+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:56:38.881804+0000","last_undegraded":"2024-09-14T11:56:38.881804+0000","last_fullsized":"2024-09-14T11:56:38.881804+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:22.177315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'5","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.437941+0000","last_change":"2024-09-14T11:32:32.588422+0000","last_active":"2024-09-14T11:58:47.437941+0000","last_peered":"2024-09-14T11:58:47.437941+0000","last_clean":"2024-09-14T11:58:47.437941+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:58:47.437941+0000","last_undegraded":"2024-09-14T11:58:47.437941+0000","last_fullsized":"2024-09-14T11:58:47.437941+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.473019+0000","last_change":"2024-09-14T11:59:26.473019+0000","last_active":"2024-09-14T11:59:26.473019+0000","last_peered":"2024-09-14T11:59:26.473019+0000","last_clean":"2024-09-14T11:59:26.473019+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:59:26.473019+0000","last_undegraded":"2024-09-14T11:59:26.473019+0000","last_fullsized":"2024-09-14T11:59:26.473019+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:26.472928+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:26.472928+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.472928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:48.714852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.201785+0000","last_change":"2024-09-14T11:59:22.201785+0000","last_active":"2024-09-14T11:59:22.201785+0000","last_peered":"2024-09-14T11:59:22.201785+0000","last_clean":"2024-09-14T11:59:22.201785+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:59:22.201785+0000","last_undegraded":"2024-09-14T11:59:22.201785+0000","last_fullsized":"2024-09-14T11:59:22.201785+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'47","last_scrub_stamp":"2024-09-14T11:59:22.201694+0000","last_deep_scrub":"262'47","last_deep_scrub_stamp":"2024-09-14T11:59:22.201694+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.201694+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:46.966633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.885183+0000","last_change":"2024-09-14T11:43:35.607826+0000","last_active":"2024-09-14T11:57:08.885183+0000","last_peered":"2024-09-14T11:57:08.885183+0000","last_clean":"2024-09-14T11:57:08.885183+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:57:08.885183+0000","last_undegraded":"2024-09-14T11:57:08.885183+0000","last_fullsized":"2024-09-14T11:57:08.885183+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:34.035624+0000","last_change":"2024-09-14T11:32:32.590048+0000","last_active":"2024-09-14T11:58:34.035624+0000","last_peered":"2024-09-14T11:58:34.035624+0000","last_clean":"2024-09-14T11:58:34.035624+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:58:34.035624+0000","last_undegraded":"2024-09-14T11:58:34.035624+0000","last_fullsized":"2024-09-14T11:58:34.035624+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:10.124434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.868576+0000","last_change":"2024-09-14T11:32:29.557361+0000","last_active":"2024-09-14T11:56:18.868576+0000","last_peered":"2024-09-14T11:56:18.868576+0000","last_clean":"2024-09-14T11:56:18.868576+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:56:18.868576+0000","last_undegraded":"2024-09-14T11:56:18.868576+0000","last_fullsized":"2024-09-14T11:56:18.868576+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:06.391010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.619581+0000","last_change":"2024-09-14T11:59:32.619581+0000","last_active":"2024-09-14T11:59:32.619581+0000","last_peered":"2024-09-14T11:59:32.619581+0000","last_clean":"2024-09-14T11:59:32.619581+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:59:32.619581+0000","last_undegraded":"2024-09-14T11:59:32.619581+0000","last_fullsized":"2024-09-14T11:59:32.619581+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'50","last_scrub_stamp":"2024-09-14T11:59:32.619489+0000","last_deep_scrub":"262'50","last_deep_scrub_stamp":"2024-09-14T11:59:32.619489+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.619489+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:05.263730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.886490+0000","last_change":"2024-09-14T11:43:35.605135+0000","last_active":"2024-09-14T11:57:13.886490+0000","last_peered":"2024-09-14T11:57:13.886490+0000","last_clean":"2024-09-14T11:57:13.886490+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:57:13.886490+0000","last_undegraded":"2024-09-14T11:57:13.886490+0000","last_fullsized":"2024-09-14T11:57:13.886490+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":40,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.879560+0000","last_change":"2024-09-14T11:32:32.579119+0000","last_active":"2024-09-14T11:56:23.879560+0000","last_peered":"2024-09-14T11:56:23.879560+0000","last_clean":"2024-09-14T11:56:23.879560+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:56:23.879560+0000","last_undegraded":"2024-09-14T11:56:23.879560+0000","last_fullsized":"2024-09-14T11:56:23.879560+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:39.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.504802+0000","last_change":"2024-09-14T11:59:25.504802+0000","last_active":"2024-09-14T11:59:25.504802+0000","last_peered":"2024-09-14T11:59:25.504802+0000","last_clean":"2024-09-14T11:59:25.504802+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:59:25.504802+0000","last_undegraded":"2024-09-14T11:59:25.504802+0000","last_fullsized":"2024-09-14T11:59:25.504802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:25.504716+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:25.504716+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.504716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:37.246547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.019477+0000","last_change":"2024-09-14T11:59:32.019477+0000","last_active":"2024-09-14T11:59:32.019477+0000","last_peered":"2024-09-14T11:59:32.019477+0000","last_clean":"2024-09-14T11:59:32.019477+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:59:32.019477+0000","last_undegraded":"2024-09-14T11:59:32.019477+0000","last_fullsized":"2024-09-14T11:59:32.019477+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:32.019366+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:32.019366+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.019366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:07.050689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":21,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.885840+0000","last_change":"2024-09-14T11:43:35.606592+0000","last_active":"2024-09-14T11:57:08.885840+0000","last_peered":"2024-09-14T11:57:08.885840+0000","last_clean":"2024-09-14T11:57:08.885840+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:57:08.885840+0000","last_undegraded":"2024-09-14T11:57:08.885840+0000","last_fullsized":"2024-09-14T11:57:08.885840+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.435854+0000","last_change":"2024-09-14T11:59:28.435854+0000","last_active":"2024-09-14T11:59:28.435854+0000","last_peered":"2024-09-14T11:59:28.435854+0000","last_clean":"2024-09-14T11:59:28.435854+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:59:28.435854+0000","last_undegraded":"2024-09-14T11:59:28.435854+0000","last_fullsized":"2024-09-14T11:59:28.435854+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:28.435763+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:28.435763+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.435763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:40.532008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.885147+0000","last_change":"2024-09-14T11:32:29.556753+0000","last_active":"2024-09-14T11:58:33.885147+0000","last_peered":"2024-09-14T11:58:33.885147+0000","last_clean":"2024-09-14T11:58:33.885147+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:58:33.885147+0000","last_undegraded":"2024-09-14T11:58:33.885147+0000","last_fullsized":"2024-09-14T11:58:33.885147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:34.099936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":144,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.882574+0000","last_change":"2024-09-14T11:30:45.185455+0000","last_active":"2024-09-14T11:56:48.882574+0000","last_peered":"2024-09-14T11:56:48.882574+0000","last_clean":"2024-09-14T11:56:48.882574+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:56:48.882574+0000","last_undegraded":"2024-09-14T11:56:48.882574+0000","last_fullsized":"2024-09-14T11:56:48.882574+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:44.157075+0000","last_clean_scrub_stamp":"2024-09-14T11:30:44.157075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.874432+0000","last_change":"2024-09-14T11:43:35.603825+0000","last_active":"2024-09-14T11:57:08.874432+0000","last_peered":"2024-09-14T11:57:08.874432+0000","last_clean":"2024-09-14T11:57:08.874432+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:57:08.874432+0000","last_undegraded":"2024-09-14T11:57:08.874432+0000","last_fullsized":"2024-09-14T11:57:08.874432+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.880311+0000","last_change":"2024-09-14T11:32:32.590037+0000","last_active":"2024-09-14T11:56:28.880311+0000","last_peered":"2024-09-14T11:56:28.880311+0000","last_clean":"2024-09-14T11:56:28.880311+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:56:28.880311+0000","last_undegraded":"2024-09-14T11:56:28.880311+0000","last_fullsized":"2024-09-14T11:56:28.880311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:48.742115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.985379+0000","last_change":"2024-09-14T11:59:33.985379+0000","last_active":"2024-09-14T11:59:33.985379+0000","last_peered":"2024-09-14T11:59:33.985379+0000","last_clean":"2024-09-14T11:59:33.985379+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:59:33.985379+0000","last_undegraded":"2024-09-14T11:59:33.985379+0000","last_fullsized":"2024-09-14T11:59:33.985379+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:33.985290+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:33.985290+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.985290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:00.777872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.098732+0000","last_change":"2024-09-14T11:59:24.098732+0000","last_active":"2024-09-14T11:59:24.098732+0000","last_peered":"2024-09-14T11:59:24.098732+0000","last_clean":"2024-09-14T11:59:24.098732+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:59:24.098732+0000","last_undegraded":"2024-09-14T11:59:24.098732+0000","last_fullsized":"2024-09-14T11:59:24.098732+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'34","last_scrub_stamp":"2024-09-14T11:59:24.098645+0000","last_deep_scrub":"262'34","last_deep_scrub_stamp":"2024-09-14T11:59:24.098645+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.098645+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:48.529776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877254+0000","last_change":"2024-09-14T11:43:35.604116+0000","last_active":"2024-09-14T11:56:08.877254+0000","last_peered":"2024-09-14T11:56:08.877254+0000","last_clean":"2024-09-14T11:56:08.877254+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:56:08.877254+0000","last_undegraded":"2024-09-14T11:56:08.877254+0000","last_fullsized":"2024-09-14T11:56:08.877254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:16.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'6","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.393135+0000","last_change":"2024-09-14T11:32:32.583981+0000","last_active":"2024-09-14T11:58:47.393135+0000","last_peered":"2024-09-14T11:58:47.393135+0000","last_clean":"2024-09-14T11:58:47.393135+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:58:47.393135+0000","last_undegraded":"2024-09-14T11:58:47.393135+0000","last_fullsized":"2024-09-14T11:58:47.393135+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:37.109384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.400500+0000","last_change":"2024-09-14T11:32:29.553611+0000","last_active":"2024-09-14T11:58:47.400500+0000","last_peered":"2024-09-14T11:58:47.400500+0000","last_clean":"2024-09-14T11:58:47.400500+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:58:47.400500+0000","last_undegraded":"2024-09-14T11:58:47.400500+0000","last_fullsized":"2024-09-14T11:58:47.400500+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.609733+0000","last_change":"2024-09-14T11:59:31.609733+0000","last_active":"2024-09-14T11:59:31.609733+0000","last_peered":"2024-09-14T11:59:31.609733+0000","last_clean":"2024-09-14T11:59:31.609733+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:59:31.609733+0000","last_undegraded":"2024-09-14T11:59:31.609733+0000","last_fullsized":"2024-09-14T11:59:31.609733+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'33","last_scrub_stamp":"2024-09-14T11:59:31.609589+0000","last_deep_scrub":"262'33","last_deep_scrub_stamp":"2024-09-14T11:59:31.609589+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.609589+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:33.099218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.877270+0000","last_change":"2024-09-14T11:43:35.603484+0000","last_active":"2024-09-14T11:56:08.877270+0000","last_peered":"2024-09-14T11:56:08.877270+0000","last_clean":"2024-09-14T11:56:08.877270+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:56:08.877270+0000","last_undegraded":"2024-09-14T11:56:08.877270+0000","last_fullsized":"2024-09-14T11:56:08.877270+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:52.596092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.877440+0000","last_change":"2024-09-14T11:32:32.575572+0000","last_active":"2024-09-14T11:57:33.877440+0000","last_peered":"2024-09-14T11:57:33.877440+0000","last_clean":"2024-09-14T11:57:33.877440+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:57:33.877440+0000","last_undegraded":"2024-09-14T11:57:33.877440+0000","last_fullsized":"2024-09-14T11:57:33.877440+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:01.425017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.289933+0000","last_change":"2024-09-14T11:59:09.289933+0000","last_active":"2024-09-14T11:59:09.289933+0000","last_peered":"2024-09-14T11:59:09.289933+0000","last_clean":"2024-09-14T11:59:09.289933+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:59:09.289933+0000","last_undegraded":"2024-09-14T11:59:09.289933+0000","last_fullsized":"2024-09-14T11:59:09.289933+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.289838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.777305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.048046+0000","last_change":"2024-09-14T11:59:21.048046+0000","last_active":"2024-09-14T11:59:21.048046+0000","last_peered":"2024-09-14T11:59:21.048046+0000","last_clean":"2024-09-14T11:59:21.048046+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:59:21.048046+0000","last_undegraded":"2024-09-14T11:59:21.048046+0000","last_fullsized":"2024-09-14T11:59:21.048046+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'35","last_scrub_stamp":"2024-09-14T11:59:21.047929+0000","last_deep_scrub":"262'35","last_deep_scrub_stamp":"2024-09-14T11:59:21.047929+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.047929+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:37.654983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:40.869499+0000","last_change":"2024-09-14T11:43:35.607506+0000","last_active":"2024-09-14T11:55:40.869499+0000","last_peered":"2024-09-14T11:55:40.869499+0000","last_clean":"2024-09-14T11:55:40.869499+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:55:40.869499+0000","last_undegraded":"2024-09-14T11:55:40.869499+0000","last_fullsized":"2024-09-14T11:55:40.869499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:13.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'3","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.898896+0000","last_change":"2024-09-14T11:32:32.583839+0000","last_active":"2024-09-14T11:58:33.898896+0000","last_peered":"2024-09-14T11:58:33.898896+0000","last_clean":"2024-09-14T11:58:33.898896+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:58:33.898896+0000","last_undegraded":"2024-09-14T11:58:33.898896+0000","last_fullsized":"2024-09-14T11:58:33.898896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:03.004208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.854047+0000","last_change":"2024-09-14T11:59:32.854047+0000","last_active":"2024-09-14T11:59:32.854047+0000","last_peered":"2024-09-14T11:59:32.854047+0000","last_clean":"2024-09-14T11:59:32.854047+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:59:32.854047+0000","last_undegraded":"2024-09-14T11:59:32.854047+0000","last_fullsized":"2024-09-14T11:59:32.854047+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:32.853953+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:32.853953+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.853953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:49.712176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":64,"num_write":4,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":168,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.066717+0000","last_change":"2024-09-14T11:59:31.066717+0000","last_active":"2024-09-14T11:59:31.066717+0000","last_peered":"2024-09-14T11:59:31.066717+0000","last_clean":"2024-09-14T11:59:31.066717+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:59:31.066717+0000","last_undegraded":"2024-09-14T11:59:31.066717+0000","last_fullsized":"2024-09-14T11:59:31.066717+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'41","last_scrub_stamp":"2024-09-14T11:59:31.066595+0000","last_deep_scrub":"262'41","last_deep_scrub_stamp":"2024-09-14T11:59:31.066595+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.066595+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:17.470858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.013869+0000","last_change":"2024-09-14T11:43:35.604229+0000","last_active":"2024-09-14T11:56:09.013869+0000","last_peered":"2024-09-14T11:56:09.013869+0000","last_clean":"2024-09-14T11:56:09.013869+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:56:09.013869+0000","last_undegraded":"2024-09-14T11:56:09.013869+0000","last_fullsized":"2024-09-14T11:56:09.013869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:36.198961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.251971+0000","last_change":"2024-09-14T11:32:32.579628+0000","last_active":"2024-09-14T11:58:47.251971+0000","last_peered":"2024-09-14T11:58:47.251971+0000","last_clean":"2024-09-14T11:58:47.251971+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:58:47.251971+0000","last_undegraded":"2024-09-14T11:58:47.251971+0000","last_fullsized":"2024-09-14T11:58:47.251971+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:15.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2088,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:28.898008+0000","last_change":"2024-09-14T11:32:29.555597+0000","last_active":"2024-09-14T11:58:28.898008+0000","last_peered":"2024-09-14T11:58:28.898008+0000","last_clean":"2024-09-14T11:58:28.898008+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:58:28.898008+0000","last_undegraded":"2024-09-14T11:58:28.898008+0000","last_fullsized":"2024-09-14T11:58:28.898008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:41.029993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":131,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.446042+0000","last_change":"2024-09-14T11:59:22.446042+0000","last_active":"2024-09-14T11:59:22.446042+0000","last_peered":"2024-09-14T11:59:22.446042+0000","last_clean":"2024-09-14T11:59:22.446042+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:59:22.446042+0000","last_undegraded":"2024-09-14T11:59:22.446042+0000","last_fullsized":"2024-09-14T11:59:22.446042+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-14T11:59:22.445945+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-14T11:59:22.445945+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.445945+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:04.877896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.243954+0000","last_change":"2024-09-14T11:59:21.243954+0000","last_active":"2024-09-14T11:59:21.243954+0000","last_peered":"2024-09-14T11:59:21.243954+0000","last_clean":"2024-09-14T11:59:21.243954+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:59:21.243954+0000","last_undegraded":"2024-09-14T11:59:21.243954+0000","last_fullsized":"2024-09-14T11:59:21.243954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:21.243865+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:21.243865+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.243865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:13.809248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.445022+0000","last_change":"2024-09-14T11:59:27.445022+0000","last_active":"2024-09-14T11:59:27.445022+0000","last_peered":"2024-09-14T11:59:27.445022+0000","last_clean":"2024-09-14T11:59:27.445022+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:59:27.445022+0000","last_undegraded":"2024-09-14T11:59:27.445022+0000","last_fullsized":"2024-09-14T11:59:27.445022+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:59:27.444927+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:59:27.444927+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.444927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:58.758281+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:33.898789+0000","last_change":"2024-09-14T11:32:29.554686+0000","last_active":"2024-09-14T11:58:33.898789+0000","last_peered":"2024-09-14T11:58:33.898789+0000","last_clean":"2024-09-14T11:58:33.898789+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:58:33.898789+0000","last_undegraded":"2024-09-14T11:58:33.898789+0000","last_fullsized":"2024-09-14T11:58:33.898789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:47.349081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":117,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.878884+0000","last_change":"2024-09-14T11:59:30.878884+0000","last_active":"2024-09-14T11:59:30.878884+0000","last_peered":"2024-09-14T11:59:30.878884+0000","last_clean":"2024-09-14T11:59:30.878884+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:59:30.878884+0000","last_undegraded":"2024-09-14T11:59:30.878884+0000","last_fullsized":"2024-09-14T11:59:30.878884+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-14T11:59:30.878792+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-14T11:59:30.878792+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.878792+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:54.392687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.870841+0000","last_change":"2024-09-14T11:43:35.601443+0000","last_active":"2024-09-14T11:56:38.870841+0000","last_peered":"2024-09-14T11:56:38.870841+0000","last_clean":"2024-09-14T11:56:38.870841+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:56:38.870841+0000","last_undegraded":"2024-09-14T11:56:38.870841+0000","last_fullsized":"2024-09-14T11:56:38.870841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.372764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.882441+0000","last_change":"2024-09-14T11:32:32.587278+0000","last_active":"2024-09-14T11:56:43.882441+0000","last_peered":"2024-09-14T11:56:43.882441+0000","last_clean":"2024-09-14T11:56:43.882441+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:56:43.882441+0000","last_undegraded":"2024-09-14T11:56:43.882441+0000","last_fullsized":"2024-09-14T11:56:43.882441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.322094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.888455+0000","last_change":"2024-09-14T11:32:29.548859+0000","last_active":"2024-09-14T11:57:28.888455+0000","last_peered":"2024-09-14T11:57:28.888455+0000","last_clean":"2024-09-14T11:57:28.888455+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:57:28.888455+0000","last_undegraded":"2024-09-14T11:57:28.888455+0000","last_fullsized":"2024-09-14T11:57:28.888455+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:28.529160+0000","last_clean_scrub_stamp":"2024-09-14T11:32:28.529160+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":218,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.963563+0000","last_change":"2024-09-14T11:59:30.963563+0000","last_active":"2024-09-14T11:59:30.963563+0000","last_peered":"2024-09-14T11:59:30.963563+0000","last_clean":"2024-09-14T11:59:30.963563+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:59:30.963563+0000","last_undegraded":"2024-09-14T11:59:30.963563+0000","last_fullsized":"2024-09-14T11:59:30.963563+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-14T11:59:30.963471+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-14T11:59:30.963471+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.963471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:36.019135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:08.867231+0000","last_change":"2024-09-14T11:43:35.605855+0000","last_active":"2024-09-14T11:56:08.867231+0000","last_peered":"2024-09-14T11:56:08.867231+0000","last_clean":"2024-09-14T11:56:08.867231+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:56:08.867231+0000","last_undegraded":"2024-09-14T11:56:08.867231+0000","last_fullsized":"2024-09-14T11:56:08.867231+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:26.463408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.102523+0000","last_change":"2024-09-14T11:59:27.102523+0000","last_active":"2024-09-14T11:59:27.102523+0000","last_peered":"2024-09-14T11:59:27.102523+0000","last_clean":"2024-09-14T11:59:27.102523+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:59:27.102523+0000","last_undegraded":"2024-09-14T11:59:27.102523+0000","last_fullsized":"2024-09-14T11:59:27.102523+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:27.102426+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:27.102426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.102426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:07.537658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2166,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'9","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.472471+0000","last_change":"2024-09-14T11:59:24.472471+0000","last_active":"2024-09-14T11:59:24.472471+0000","last_peered":"2024-09-14T11:59:24.472471+0000","last_clean":"2024-09-14T11:59:24.472471+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:59:24.472471+0000","last_undegraded":"2024-09-14T11:59:24.472471+0000","last_fullsized":"2024-09-14T11:59:24.472471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:24.472369+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:24.472369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.472369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:15.661067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":95,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.077000+0000","last_change":"2024-09-14T11:59:20.077000+0000","last_active":"2024-09-14T11:59:20.077000+0000","last_peered":"2024-09-14T11:59:20.077000+0000","last_clean":"2024-09-14T11:59:20.077000+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:59:20.077000+0000","last_undegraded":"2024-09-14T11:59:20.077000+0000","last_fullsized":"2024-09-14T11:59:20.077000+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'14","last_scrub_stamp":"2024-09-14T11:59:20.076891+0000","last_deep_scrub":"259'14","last_deep_scrub_stamp":"2024-09-14T11:59:20.076891+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.076891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:23.782744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.878101+0000","last_change":"2024-09-14T11:43:35.604955+0000","last_active":"2024-09-14T11:56:13.878101+0000","last_peered":"2024-09-14T11:56:13.878101+0000","last_clean":"2024-09-14T11:56:13.878101+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:56:13.878101+0000","last_undegraded":"2024-09-14T11:56:13.878101+0000","last_fullsized":"2024-09-14T11:56:13.878101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.840822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'14","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:34.026596+0000","last_change":"2024-09-14T11:32:32.584702+0000","last_active":"2024-09-14T11:57:34.026596+0000","last_peered":"2024-09-14T11:57:34.026596+0000","last_clean":"2024-09-14T11:57:34.026596+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:57:34.026596+0000","last_undegraded":"2024-09-14T11:57:34.026596+0000","last_fullsized":"2024-09-14T11:57:34.026596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:31.553098+0000","last_clean_scrub_stamp":"2024-09-14T11:32:31.553098+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:19.580871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19460,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'6","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.112669+0000","last_change":"2024-09-14T11:59:26.112579+0000","last_active":"2024-09-14T11:59:26.112669+0000","last_peered":"2024-09-14T11:59:26.112669+0000","last_clean":"2024-09-14T11:59:26.112669+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:59:26.112669+0000","last_undegraded":"2024-09-14T11:59:26.112669+0000","last_fullsized":"2024-09-14T11:59:26.112669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:26.112465+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:26.112465+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.112465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:09.125649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.039315+0000","last_change":"2024-09-14T11:59:30.039315+0000","last_active":"2024-09-14T11:59:30.039315+0000","last_peered":"2024-09-14T11:59:30.039315+0000","last_clean":"2024-09-14T11:59:30.039315+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:59:30.039315+0000","last_undegraded":"2024-09-14T11:59:30.039315+0000","last_fullsized":"2024-09-14T11:59:30.039315+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-14T11:59:30.039235+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-14T11:59:30.039235+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.039235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:10.445538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'201","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.924265+0000","last_change":"2024-09-14T11:59:06.924210+0000","last_active":"2024-09-14T11:59:06.924265+0000","last_peered":"2024-09-14T11:59:06.924265+0000","last_clean":"2024-09-14T11:59:06.924265+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:59:06.924265+0000","last_undegraded":"2024-09-14T11:59:06.924265+0000","last_fullsized":"2024-09-14T11:59:06.924265+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.924116+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:26.609676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":502,"num_read_kb":68162,"num_write":958,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'448","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.842355+0000","last_change":"2024-09-14T11:59:10.842355+0000","last_active":"2024-09-14T11:59:10.842355+0000","last_peered":"2024-09-14T11:59:10.842355+0000","last_clean":"2024-09-14T11:59:10.842355+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:59:10.842355+0000","last_undegraded":"2024-09-14T11:59:10.842355+0000","last_fullsized":"2024-09-14T11:59:10.842355+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.842253+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:51.500139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'208","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.657549+0000","last_change":"2024-09-14T11:58:59.657477+0000","last_active":"2024-09-14T11:58:59.657549+0000","last_peered":"2024-09-14T11:58:59.657549+0000","last_clean":"2024-09-14T11:58:59.657549+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:58:59.657549+0000","last_undegraded":"2024-09-14T11:58:59.657549+0000","last_fullsized":"2024-09-14T11:58:59.657549+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.657360+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:27.452025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":84679,"num_write":950,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.017097+0000","last_change":"2024-09-14T11:59:12.017097+0000","last_active":"2024-09-14T11:59:12.017097+0000","last_peered":"2024-09-14T11:59:12.017097+0000","last_clean":"2024-09-14T11:59:12.017097+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:59:12.017097+0000","last_undegraded":"2024-09-14T11:59:12.017097+0000","last_fullsized":"2024-09-14T11:59:12.017097+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'440","last_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_deep_scrub":"262'440","last_deep_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.016980+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:59.528853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'217","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.294101+0000","last_change":"2024-09-14T11:59:01.294031+0000","last_active":"2024-09-14T11:59:01.294101+0000","last_peered":"2024-09-14T11:59:01.294101+0000","last_clean":"2024-09-14T11:59:01.294101+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:59:01.294101+0000","last_undegraded":"2024-09-14T11:59:01.294101+0000","last_fullsized":"2024-09-14T11:59:01.294101+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.293939+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:45.221973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":1085,"num_write":1018,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'744","reported_seq":2205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.053192+0000","last_change":"2024-09-14T11:59:14.053192+0000","last_active":"2024-09-14T11:59:14.053192+0000","last_peered":"2024-09-14T11:59:14.053192+0000","last_clean":"2024-09-14T11:59:14.053192+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:59:14.053192+0000","last_undegraded":"2024-09-14T11:59:14.053192+0000","last_fullsized":"2024-09-14T11:59:14.053192+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'744","last_scrub_stamp":"2024-09-14T11:59:14.053105+0000","last_deep_scrub":"262'744","last_deep_scrub_stamp":"2024-09-14T11:59:14.053105+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.053105+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:11.427182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'243","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.828088+0000","last_change":"2024-09-14T11:59:05.828088+0000","last_active":"2024-09-14T11:59:05.828088+0000","last_peered":"2024-09-14T11:59:05.828088+0000","last_clean":"2024-09-14T11:59:05.828088+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:59:05.828088+0000","last_undegraded":"2024-09-14T11:59:05.828088+0000","last_fullsized":"2024-09-14T11:59:05.828088+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'243","last_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_deep_scrub":"262'243","last_deep_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.827996+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:32.370355+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30923,"num_write":1131,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.390988+0000","last_change":"2024-09-14T11:59:10.390988+0000","last_active":"2024-09-14T11:59:10.390988+0000","last_peered":"2024-09-14T11:59:10.390988+0000","last_clean":"2024-09-14T11:59:10.390988+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:59:10.390988+0000","last_undegraded":"2024-09-14T11:59:10.390988+0000","last_fullsized":"2024-09-14T11:59:10.390988+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'684","last_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_deep_scrub":"262'684","last_deep_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.390898+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:20.267647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.925437+0000","last_change":"2024-09-14T11:59:07.925437+0000","last_active":"2024-09-14T11:59:07.925437+0000","last_peered":"2024-09-14T11:59:07.925437+0000","last_clean":"2024-09-14T11:59:07.925437+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:59:07.925437+0000","last_undegraded":"2024-09-14T11:59:07.925437+0000","last_fullsized":"2024-09-14T11:59:07.925437+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.925347+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.275783+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'970","reported_seq":2619,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.160176+0000","last_change":"2024-09-14T11:59:07.160176+0000","last_active":"2024-09-14T11:59:07.160176+0000","last_peered":"2024-09-14T11:59:07.160176+0000","last_clean":"2024-09-14T11:59:07.160176+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:59:07.160176+0000","last_undegraded":"2024-09-14T11:59:07.160176+0000","last_fullsized":"2024-09-14T11:59:07.160176+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'970","last_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_deep_scrub":"262'970","last_deep_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.160091+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.347228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'188","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.854866+0000","last_change":"2024-09-14T11:59:04.854866+0000","last_active":"2024-09-14T11:59:04.854866+0000","last_peered":"2024-09-14T11:59:04.854866+0000","last_clean":"2024-09-14T11:59:04.854866+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:59:04.854866+0000","last_undegraded":"2024-09-14T11:59:04.854866+0000","last_fullsized":"2024-09-14T11:59:04.854866+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.854773+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:26.093727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":10177,"num_write":901,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.100837+0000","last_change":"2024-09-14T11:59:13.100750+0000","last_active":"2024-09-14T11:59:13.100837+0000","last_peered":"2024-09-14T11:59:13.100837+0000","last_clean":"2024-09-14T11:59:13.100837+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:59:13.100837+0000","last_undegraded":"2024-09-14T11:59:13.100837+0000","last_fullsized":"2024-09-14T11:59:13.100837+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1496","last_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_deep_scrub":"262'1496","last_deep_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.100637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:52.980892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'197","reported_seq":819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.941409+0000","last_change":"2024-09-14T11:59:05.941409+0000","last_active":"2024-09-14T11:59:05.941409+0000","last_peered":"2024-09-14T11:59:05.941409+0000","last_clean":"2024-09-14T11:59:05.941409+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:59:05.941409+0000","last_undegraded":"2024-09-14T11:59:05.941409+0000","last_fullsized":"2024-09-14T11:59:05.941409+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.941309+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.587968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":12539,"num_write":927,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'493","reported_seq":2330,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.833178+0000","last_change":"2024-09-14T11:59:11.833080+0000","last_active":"2024-09-14T11:59:11.833178+0000","last_peered":"2024-09-14T11:59:11.833178+0000","last_clean":"2024-09-14T11:59:11.833178+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:59:11.833178+0000","last_undegraded":"2024-09-14T11:59:11.833178+0000","last_fullsized":"2024-09-14T11:59:11.833178+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.832989+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:47.359326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4847,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'221","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.012282+0000","last_change":"2024-09-14T11:59:09.012282+0000","last_active":"2024-09-14T11:59:09.012282+0000","last_peered":"2024-09-14T11:59:09.012282+0000","last_clean":"2024-09-14T11:59:09.012282+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:59:09.012282+0000","last_undegraded":"2024-09-14T11:59:09.012282+0000","last_fullsized":"2024-09-14T11:59:09.012282+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'221","last_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_deep_scrub":"262'221","last_deep_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.012189+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:02.767488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":31152,"num_write":983,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'599","reported_seq":2472,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.267344+0000","last_change":"2024-09-14T11:59:01.267217+0000","last_active":"2024-09-14T11:59:01.267344+0000","last_peered":"2024-09-14T11:59:01.267344+0000","last_clean":"2024-09-14T11:59:01.267344+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:59:01.267344+0000","last_undegraded":"2024-09-14T11:59:01.267344+0000","last_fullsized":"2024-09-14T11:59:01.267344+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'599","last_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_deep_scrub":"262'599","last_deep_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.267099+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:01.732306+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'761","reported_seq":2283,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.160143+0000","last_change":"2024-09-14T11:59:11.160143+0000","last_active":"2024-09-14T11:59:11.160143+0000","last_peered":"2024-09-14T11:59:11.160143+0000","last_clean":"2024-09-14T11:59:11.160143+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:59:11.160143+0000","last_undegraded":"2024-09-14T11:59:11.160143+0000","last_fullsized":"2024-09-14T11:59:11.160143+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'761","last_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_deep_scrub":"262'761","last_deep_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.160044+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:20.157724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'231","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.918014+0000","last_change":"2024-09-14T11:59:04.917960+0000","last_active":"2024-09-14T11:59:04.918014+0000","last_peered":"2024-09-14T11:59:04.918014+0000","last_clean":"2024-09-14T11:59:04.918014+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:59:04.918014+0000","last_undegraded":"2024-09-14T11:59:04.918014+0000","last_fullsized":"2024-09-14T11:59:04.918014+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.917863+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.312915+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493146,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":8015,"num_write":1062,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'458","reported_seq":2053,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.977768+0000","last_change":"2024-09-14T11:59:10.977768+0000","last_active":"2024-09-14T11:59:10.977768+0000","last_peered":"2024-09-14T11:59:10.977768+0000","last_clean":"2024-09-14T11:59:10.977768+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:59:10.977768+0000","last_undegraded":"2024-09-14T11:59:10.977768+0000","last_fullsized":"2024-09-14T11:59:10.977768+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'458","last_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_deep_scrub":"262'458","last_deep_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.977676+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:08.362285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2530,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'231","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.220440+0000","last_change":"2024-09-14T11:59:02.220381+0000","last_active":"2024-09-14T11:59:02.220440+0000","last_peered":"2024-09-14T11:59:02.220440+0000","last_clean":"2024-09-14T11:59:02.220440+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:59:02.220440+0000","last_undegraded":"2024-09-14T11:59:02.220440+0000","last_fullsized":"2024-09-14T11:59:02.220440+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.220287+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:16.151277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":595,"num_read_kb":24969,"num_write":1057,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'444","reported_seq":1997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.859552+0000","last_change":"2024-09-14T11:59:08.859552+0000","last_active":"2024-09-14T11:59:08.859552+0000","last_peered":"2024-09-14T11:59:08.859552+0000","last_clean":"2024-09-14T11:59:08.859552+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:59:08.859552+0000","last_undegraded":"2024-09-14T11:59:08.859552+0000","last_fullsized":"2024-09-14T11:59:08.859552+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.859468+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.056045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'222","reported_seq":855,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.221736+0000","last_change":"2024-09-14T11:59:01.221670+0000","last_active":"2024-09-14T11:59:01.221736+0000","last_peered":"2024-09-14T11:59:01.221736+0000","last_clean":"2024-09-14T11:59:01.221736+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:59:01.221736+0000","last_undegraded":"2024-09-14T11:59:01.221736+0000","last_fullsized":"2024-09-14T11:59:01.221736+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.221555+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:14.230182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":17269,"num_write":968,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'396","reported_seq":1870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.318870+0000","last_change":"2024-09-14T11:58:59.318739+0000","last_active":"2024-09-14T11:58:59.318870+0000","last_peered":"2024-09-14T11:58:59.318870+0000","last_clean":"2024-09-14T11:58:59.318870+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:58:59.318870+0000","last_undegraded":"2024-09-14T11:58:59.318870+0000","last_fullsized":"2024-09-14T11:58:59.318870+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.318633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:40.556708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'264","reported_seq":907,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.105757+0000","last_change":"2024-09-14T11:58:55.105686+0000","last_active":"2024-09-14T11:58:55.105757+0000","last_peered":"2024-09-14T11:58:55.105757+0000","last_clean":"2024-09-14T11:58:55.105757+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:58:55.105757+0000","last_undegraded":"2024-09-14T11:58:55.105757+0000","last_fullsized":"2024-09-14T11:58:55.105757+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'264","last_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_deep_scrub":"262'264","last_deep_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.105587+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:06.894664+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730148,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":20644,"num_write":1068,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.290767+0000","last_change":"2024-09-14T11:59:00.290708+0000","last_active":"2024-09-14T11:59:00.290767+0000","last_peered":"2024-09-14T11:59:00.290767+0000","last_clean":"2024-09-14T11:59:00.290767+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:59:00.290767+0000","last_undegraded":"2024-09-14T11:59:00.290767+0000","last_fullsized":"2024-09-14T11:59:00.290767+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'348","last_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_deep_scrub":"262'348","last_deep_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.290615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:28.191506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'292","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.884033+0000","last_change":"2024-09-14T11:59:02.883970+0000","last_active":"2024-09-14T11:59:02.884033+0000","last_peered":"2024-09-14T11:59:02.884033+0000","last_clean":"2024-09-14T11:59:02.884033+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:59:02.884033+0000","last_undegraded":"2024-09-14T11:59:02.884033+0000","last_fullsized":"2024-09-14T11:59:02.884033+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.883867+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.038831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1018,"num_read_kb":39546,"num_write":1294,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'574","reported_seq":2426,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.119802+0000","last_change":"2024-09-14T11:59:12.119802+0000","last_active":"2024-09-14T11:59:12.119802+0000","last_peered":"2024-09-14T11:59:12.119802+0000","last_clean":"2024-09-14T11:59:12.119802+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:59:12.119802+0000","last_undegraded":"2024-09-14T11:59:12.119802+0000","last_fullsized":"2024-09-14T11:59:12.119802+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.119675+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:52.499284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2946,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'231","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.260419+0000","last_change":"2024-09-14T11:59:00.260419+0000","last_active":"2024-09-14T11:59:00.260419+0000","last_peered":"2024-09-14T11:59:00.260419+0000","last_clean":"2024-09-14T11:59:00.260419+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:59:00.260419+0000","last_undegraded":"2024-09-14T11:59:00.260419+0000","last_fullsized":"2024-09-14T11:59:00.260419+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.260330+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:44.587761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":555,"num_read_kb":31277,"num_write":1077,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'149","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.979528+0000","last_change":"2024-09-14T11:59:28.979528+0000","last_active":"2024-09-14T11:59:28.979528+0000","last_peered":"2024-09-14T11:59:28.979528+0000","last_clean":"2024-09-14T11:59:28.979528+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:59:28.979528+0000","last_undegraded":"2024-09-14T11:59:28.979528+0000","last_fullsized":"2024-09-14T11:59:28.979528+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'149","last_scrub_stamp":"2024-09-14T11:59:28.979448+0000","last_deep_scrub":"262'149","last_deep_scrub_stamp":"2024-09-14T11:59:28.979448+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.979448+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:48.568665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'826","reported_seq":2539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.890292+0000","last_change":"2024-09-14T11:59:04.890292+0000","last_active":"2024-09-14T11:59:04.890292+0000","last_peered":"2024-09-14T11:59:04.890292+0000","last_clean":"2024-09-14T11:59:04.890292+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:59:04.890292+0000","last_undegraded":"2024-09-14T11:59:04.890292+0000","last_fullsized":"2024-09-14T11:59:04.890292+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'826","last_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_deep_scrub":"262'826","last_deep_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.890191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:04.714390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'201","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.806796+0000","last_change":"2024-09-14T11:59:01.806796+0000","last_active":"2024-09-14T11:59:01.806796+0000","last_peered":"2024-09-14T11:59:01.806796+0000","last_clean":"2024-09-14T11:59:01.806796+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:59:01.806796+0000","last_undegraded":"2024-09-14T11:59:01.806796+0000","last_fullsized":"2024-09-14T11:59:01.806796+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.806682+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:50.717629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":885,"num_read_kb":29517,"num_write":954,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.781055+0000","last_change":"2024-09-14T11:59:16.781055+0000","last_active":"2024-09-14T11:59:16.781055+0000","last_peered":"2024-09-14T11:59:16.781055+0000","last_clean":"2024-09-14T11:59:16.781055+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:59:16.781055+0000","last_undegraded":"2024-09-14T11:59:16.781055+0000","last_fullsized":"2024-09-14T11:59:16.781055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.780961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.780961+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.780961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:11.751745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'205","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.379232+0000","last_change":"2024-09-14T11:59:17.379232+0000","last_active":"2024-09-14T11:59:17.379232+0000","last_peered":"2024-09-14T11:59:17.379232+0000","last_clean":"2024-09-14T11:59:17.379232+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:59:17.379232+0000","last_undegraded":"2024-09-14T11:59:17.379232+0000","last_fullsized":"2024-09-14T11:59:17.379232+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-14T11:59:17.379120+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-14T11:59:17.379120+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.379120+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:58.370741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":271,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.047620+0000","last_change":"2024-09-14T11:59:27.047620+0000","last_active":"2024-09-14T11:59:27.047620+0000","last_peered":"2024-09-14T11:59:27.047620+0000","last_clean":"2024-09-14T11:59:27.047620+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:59:27.047620+0000","last_undegraded":"2024-09-14T11:59:27.047620+0000","last_fullsized":"2024-09-14T11:59:27.047620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.047536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.047536+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.047536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:44.276081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2484","reported_seq":4325,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.887173+0000","last_change":"2024-09-14T11:59:28.887173+0000","last_active":"2024-09-14T11:59:28.887173+0000","last_peered":"2024-09-14T11:59:28.887173+0000","last_clean":"2024-09-14T11:59:28.887173+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:59:28.887173+0000","last_undegraded":"2024-09-14T11:59:28.887173+0000","last_fullsized":"2024-09-14T11:59:28.887173+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2484","last_scrub_stamp":"2024-09-14T11:59:28.887087+0000","last_deep_scrub":"262'2484","last_deep_scrub_stamp":"2024-09-14T11:59:28.887087+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.887087+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":2400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:50.361126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'435","reported_seq":2275,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.898976+0000","last_change":"2024-09-14T11:59:07.898976+0000","last_active":"2024-09-14T11:59:07.898976+0000","last_peered":"2024-09-14T11:59:07.898976+0000","last_clean":"2024-09-14T11:59:07.898976+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:59:07.898976+0000","last_undegraded":"2024-09-14T11:59:07.898976+0000","last_fullsized":"2024-09-14T11:59:07.898976+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'435","last_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_deep_scrub":"262'435","last_deep_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.898878+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.901107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2558,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'274","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.272095+0000","last_change":"2024-09-14T11:58:54.272095+0000","last_active":"2024-09-14T11:58:54.272095+0000","last_peered":"2024-09-14T11:58:54.272095+0000","last_clean":"2024-09-14T11:58:54.272095+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:58:54.272095+0000","last_undegraded":"2024-09-14T11:58:54.272095+0000","last_fullsized":"2024-09-14T11:58:54.272095+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'274","last_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_deep_scrub":"262'274","last_deep_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.272007+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:31.710416+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":744,"num_read_kb":16466,"num_write":1204,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.875681+0000","last_change":"2024-09-14T11:59:15.875681+0000","last_active":"2024-09-14T11:59:15.875681+0000","last_peered":"2024-09-14T11:59:15.875681+0000","last_clean":"2024-09-14T11:59:15.875681+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:59:15.875681+0000","last_undegraded":"2024-09-14T11:59:15.875681+0000","last_fullsized":"2024-09-14T11:59:15.875681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.875565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.875565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.875565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:09.206961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'94","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.028546+0000","last_change":"2024-09-14T11:59:20.028546+0000","last_active":"2024-09-14T11:59:20.028546+0000","last_peered":"2024-09-14T11:59:20.028546+0000","last_clean":"2024-09-14T11:59:20.028546+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:59:20.028546+0000","last_undegraded":"2024-09-14T11:59:20.028546+0000","last_fullsized":"2024-09-14T11:59:20.028546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-14T11:59:20.028458+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-14T11:59:20.028458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.028458+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:16.850564+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.018594+0000","last_change":"2024-09-14T11:59:23.018594+0000","last_active":"2024-09-14T11:59:23.018594+0000","last_peered":"2024-09-14T11:59:23.018594+0000","last_clean":"2024-09-14T11:59:23.018594+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:59:23.018594+0000","last_undegraded":"2024-09-14T11:59:23.018594+0000","last_fullsized":"2024-09-14T11:59:23.018594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.018469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.018469+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.018469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:52.119047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'111","reported_seq":607,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.514971+0000","last_change":"2024-09-14T11:59:28.514971+0000","last_active":"2024-09-14T11:59:28.514971+0000","last_peered":"2024-09-14T11:59:28.514971+0000","last_clean":"2024-09-14T11:59:28.514971+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:59:28.514971+0000","last_undegraded":"2024-09-14T11:59:28.514971+0000","last_fullsized":"2024-09-14T11:59:28.514971+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-14T11:59:28.514880+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-14T11:59:28.514880+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.514880+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:19.271522+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'425","reported_seq":1999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.318212+0000","last_change":"2024-09-14T11:59:05.318212+0000","last_active":"2024-09-14T11:59:05.318212+0000","last_peered":"2024-09-14T11:59:05.318212+0000","last_clean":"2024-09-14T11:59:05.318212+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:59:05.318212+0000","last_undegraded":"2024-09-14T11:59:05.318212+0000","last_fullsized":"2024-09-14T11:59:05.318212+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'425","last_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_deep_scrub":"262'425","last_deep_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.318119+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:41.523199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'190","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.782772+0000","last_change":"2024-09-14T11:59:00.782772+0000","last_active":"2024-09-14T11:59:00.782772+0000","last_peered":"2024-09-14T11:59:00.782772+0000","last_clean":"2024-09-14T11:59:00.782772+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:59:00.782772+0000","last_undegraded":"2024-09-14T11:59:00.782772+0000","last_fullsized":"2024-09-14T11:59:00.782772+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.782673+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.605643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":30179,"num_write":922,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"262'4","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.951530+0000","last_change":"2024-09-14T11:59:17.951530+0000","last_active":"2024-09-14T11:59:17.951530+0000","last_peered":"2024-09-14T11:59:17.951530+0000","last_clean":"2024-09-14T11:59:17.951530+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:59:17.951530+0000","last_undegraded":"2024-09-14T11:59:17.951530+0000","last_fullsized":"2024-09-14T11:59:17.951530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:17.951434+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:17.951434+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.951434+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:12.495312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'120","reported_seq":657,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.240509+0000","last_change":"2024-09-14T11:59:18.240509+0000","last_active":"2024-09-14T11:59:18.240509+0000","last_peered":"2024-09-14T11:59:18.240509+0000","last_clean":"2024-09-14T11:59:18.240509+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:59:18.240509+0000","last_undegraded":"2024-09-14T11:59:18.240509+0000","last_fullsized":"2024-09-14T11:59:18.240509+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-14T11:59:18.240402+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-14T11:59:18.240402+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.240402+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:59.012310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'752","reported_seq":2535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.017067+0000","last_change":"2024-09-14T11:59:25.017067+0000","last_active":"2024-09-14T11:59:25.017067+0000","last_peered":"2024-09-14T11:59:25.017067+0000","last_clean":"2024-09-14T11:59:25.017067+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:59:25.017067+0000","last_undegraded":"2024-09-14T11:59:25.017067+0000","last_fullsized":"2024-09-14T11:59:25.017067+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'752","last_scrub_stamp":"2024-09-14T11:59:25.016990+0000","last_deep_scrub":"262'752","last_deep_scrub_stamp":"2024-09-14T11:59:25.016990+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.016990+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:57.991473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'196","reported_seq":1016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.948019+0000","last_change":"2024-09-14T11:59:29.948019+0000","last_active":"2024-09-14T11:59:29.948019+0000","last_peered":"2024-09-14T11:59:29.948019+0000","last_clean":"2024-09-14T11:59:29.948019+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:59:29.948019+0000","last_undegraded":"2024-09-14T11:59:29.948019+0000","last_fullsized":"2024-09-14T11:59:29.948019+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'196","last_scrub_stamp":"2024-09-14T11:59:29.947935+0000","last_deep_scrub":"262'196","last_deep_scrub_stamp":"2024-09-14T11:59:29.947935+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.947935+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:34.985820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1029","reported_seq":2598,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.984926+0000","last_change":"2024-09-14T11:59:06.984926+0000","last_active":"2024-09-14T11:59:06.984926+0000","last_peered":"2024-09-14T11:59:06.984926+0000","last_clean":"2024-09-14T11:59:06.984926+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:59:06.984926+0000","last_undegraded":"2024-09-14T11:59:06.984926+0000","last_fullsized":"2024-09-14T11:59:06.984926+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1029","last_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_deep_scrub":"262'1029","last_deep_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.984839+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":1000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:57.478127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'194","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.258145+0000","last_change":"2024-09-14T11:58:58.258145+0000","last_active":"2024-09-14T11:58:58.258145+0000","last_peered":"2024-09-14T11:58:58.258145+0000","last_clean":"2024-09-14T11:58:58.258145+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:58:58.258145+0000","last_undegraded":"2024-09-14T11:58:58.258145+0000","last_fullsized":"2024-09-14T11:58:58.258145+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.258058+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:41.203458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399062,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":441,"num_read_kb":5281,"num_write":856,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.793009+0000","last_change":"2024-09-14T11:59:15.793009+0000","last_active":"2024-09-14T11:59:15.793009+0000","last_peered":"2024-09-14T11:59:15.793009+0000","last_clean":"2024-09-14T11:59:15.793009+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:59:15.793009+0000","last_undegraded":"2024-09-14T11:59:15.793009+0000","last_fullsized":"2024-09-14T11:59:15.793009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.792911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.792911+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.792911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:11.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'127","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.988911+0000","last_change":"2024-09-14T11:59:20.988911+0000","last_active":"2024-09-14T11:59:20.988911+0000","last_peered":"2024-09-14T11:59:20.988911+0000","last_clean":"2024-09-14T11:59:20.988911+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:59:20.988911+0000","last_undegraded":"2024-09-14T11:59:20.988911+0000","last_fullsized":"2024-09-14T11:59:20.988911+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'127","last_scrub_stamp":"2024-09-14T11:59:20.988790+0000","last_deep_scrub":"262'127","last_deep_scrub_stamp":"2024-09-14T11:59:20.988790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.988790+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:38.988128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":190,"num_write":76,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'813","reported_seq":2236,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.998533+0000","last_change":"2024-09-14T11:59:31.998533+0000","last_active":"2024-09-14T11:59:31.998533+0000","last_peered":"2024-09-14T11:59:31.998533+0000","last_clean":"2024-09-14T11:59:31.998533+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:59:31.998533+0000","last_undegraded":"2024-09-14T11:59:31.998533+0000","last_fullsized":"2024-09-14T11:59:31.998533+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'813","last_scrub_stamp":"2024-09-14T11:59:31.998436+0000","last_deep_scrub":"262'813","last_deep_scrub_stamp":"2024-09-14T11:59:31.998436+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.998436+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:58.220089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'737","reported_seq":2289,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.860018+0000","last_change":"2024-09-14T11:59:06.860018+0000","last_active":"2024-09-14T11:59:06.860018+0000","last_peered":"2024-09-14T11:59:06.860018+0000","last_clean":"2024-09-14T11:59:06.860018+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:59:06.860018+0000","last_undegraded":"2024-09-14T11:59:06.860018+0000","last_fullsized":"2024-09-14T11:59:06.860018+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.859938+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:44.442477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'207","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.703945+0000","last_change":"2024-09-14T11:58:57.703945+0000","last_active":"2024-09-14T11:58:57.703945+0000","last_peered":"2024-09-14T11:58:57.703945+0000","last_clean":"2024-09-14T11:58:57.703945+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:57.703945+0000","last_undegraded":"2024-09-14T11:58:57.703945+0000","last_fullsized":"2024-09-14T11:58:57.703945+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.703856+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:11.335540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":729,"num_read_kb":30459,"num_write":898,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.963904+0000","last_change":"2024-09-14T11:59:13.963904+0000","last_active":"2024-09-14T11:59:13.963904+0000","last_peered":"2024-09-14T11:59:13.963904+0000","last_clean":"2024-09-14T11:59:13.963904+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:59:13.963904+0000","last_undegraded":"2024-09-14T11:59:13.963904+0000","last_fullsized":"2024-09-14T11:59:13.963904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.963802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.963802+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.963802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:21.806765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'223","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.792410+0000","last_change":"2024-09-14T11:59:19.792410+0000","last_active":"2024-09-14T11:59:19.792410+0000","last_peered":"2024-09-14T11:59:19.792410+0000","last_clean":"2024-09-14T11:59:19.792410+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:59:19.792410+0000","last_undegraded":"2024-09-14T11:59:19.792410+0000","last_fullsized":"2024-09-14T11:59:19.792410+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-14T11:59:19.792309+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-14T11:59:19.792309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.792309+0000","objects_scrubbed":10,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:30.265360+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12526,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":287,"num_read_kb":357,"num_write":170,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.594914+0000","last_change":"2024-09-14T11:59:15.594914+0000","last_active":"2024-09-14T11:59:15.594914+0000","last_peered":"2024-09-14T11:59:15.594914+0000","last_clean":"2024-09-14T11:59:15.594914+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:59:15.594914+0000","last_undegraded":"2024-09-14T11:59:15.594914+0000","last_fullsized":"2024-09-14T11:59:15.594914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.594816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.594816+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.594816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.054516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'557","reported_seq":1361,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.843588+0000","last_change":"2024-09-14T11:59:24.843524+0000","last_active":"2024-09-14T11:59:24.843588+0000","last_peered":"2024-09-14T11:59:24.843588+0000","last_clean":"2024-09-14T11:59:24.843588+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:59:24.843588+0000","last_undegraded":"2024-09-14T11:59:24.843588+0000","last_fullsized":"2024-09-14T11:59:24.843588+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'557","last_scrub_stamp":"2024-09-14T11:59:24.843428+0000","last_deep_scrub":"262'557","last_deep_scrub_stamp":"2024-09-14T11:59:24.843428+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.843428+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:59.354050+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'839","reported_seq":2332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.167101+0000","last_change":"2024-09-14T11:59:00.167101+0000","last_active":"2024-09-14T11:59:00.167101+0000","last_peered":"2024-09-14T11:59:00.167101+0000","last_clean":"2024-09-14T11:59:00.167101+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:59:00.167101+0000","last_undegraded":"2024-09-14T11:59:00.167101+0000","last_fullsized":"2024-09-14T11:59:00.167101+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'839","last_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_deep_scrub":"262'839","last_deep_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.167013+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.391900+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'287","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.738135+0000","last_change":"2024-09-14T11:58:58.738135+0000","last_active":"2024-09-14T11:58:58.738135+0000","last_peered":"2024-09-14T11:58:58.738135+0000","last_clean":"2024-09-14T11:58:58.738135+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:58:58.738135+0000","last_undegraded":"2024-09-14T11:58:58.738135+0000","last_fullsized":"2024-09-14T11:58:58.738135+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'287","last_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_deep_scrub":"262'287","last_deep_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.738053+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:39.322669+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":15958,"num_write":1147,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.282011+0000","last_change":"2024-09-14T11:59:12.282011+0000","last_active":"2024-09-14T11:59:12.282011+0000","last_peered":"2024-09-14T11:59:12.282011+0000","last_clean":"2024-09-14T11:59:12.282011+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:59:12.282011+0000","last_undegraded":"2024-09-14T11:59:12.282011+0000","last_fullsized":"2024-09-14T11:59:12.282011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.281919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:33.989125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'124","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.037813+0000","last_change":"2024-09-14T11:59:22.037813+0000","last_active":"2024-09-14T11:59:22.037813+0000","last_peered":"2024-09-14T11:59:22.037813+0000","last_clean":"2024-09-14T11:59:22.037813+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:59:22.037813+0000","last_undegraded":"2024-09-14T11:59:22.037813+0000","last_fullsized":"2024-09-14T11:59:22.037813+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-14T11:59:22.037722+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-14T11:59:22.037722+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.037722+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:56.451683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":194,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.956799+0000","last_change":"2024-09-14T11:59:27.956799+0000","last_active":"2024-09-14T11:59:27.956799+0000","last_peered":"2024-09-14T11:59:27.956799+0000","last_clean":"2024-09-14T11:59:27.956799+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:59:27.956799+0000","last_undegraded":"2024-09-14T11:59:27.956799+0000","last_fullsized":"2024-09-14T11:59:27.956799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.956713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.956713+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.956713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.243127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'125","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.069959+0000","last_change":"2024-09-14T11:59:16.069904+0000","last_active":"2024-09-14T11:59:16.069959+0000","last_peered":"2024-09-14T11:59:16.069959+0000","last_clean":"2024-09-14T11:59:16.069959+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:59:16.069959+0000","last_undegraded":"2024-09-14T11:59:16.069959+0000","last_fullsized":"2024-09-14T11:59:16.069959+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'125","last_scrub_stamp":"2024-09-14T11:59:16.069819+0000","last_deep_scrub":"262'125","last_deep_scrub_stamp":"2024-09-14T11:59:16.069819+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.069819+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.120386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'695","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.215163+0000","last_change":"2024-09-14T11:59:04.215163+0000","last_active":"2024-09-14T11:59:04.215163+0000","last_peered":"2024-09-14T11:59:04.215163+0000","last_clean":"2024-09-14T11:59:04.215163+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:59:04.215163+0000","last_undegraded":"2024-09-14T11:59:04.215163+0000","last_fullsized":"2024-09-14T11:59:04.215163+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'695","last_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_deep_scrub":"262'695","last_deep_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.215080+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:28.285334+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":241,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'236","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.244348+0000","last_change":"2024-09-14T11:58:55.244348+0000","last_active":"2024-09-14T11:58:55.244348+0000","last_peered":"2024-09-14T11:58:55.244348+0000","last_clean":"2024-09-14T11:58:55.244348+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:58:55.244348+0000","last_undegraded":"2024-09-14T11:58:55.244348+0000","last_fullsized":"2024-09-14T11:58:55.244348+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'236","last_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_deep_scrub":"262'236","last_deep_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.244245+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:50.597423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":32200,"num_write":1033,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.276886+0000","last_change":"2024-09-14T11:59:03.276886+0000","last_active":"2024-09-14T11:59:03.276886+0000","last_peered":"2024-09-14T11:59:03.276886+0000","last_clean":"2024-09-14T11:59:03.276886+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:59:03.276886+0000","last_undegraded":"2024-09-14T11:59:03.276886+0000","last_fullsized":"2024-09-14T11:59:03.276886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.276755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:59.224975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'175","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.935132+0000","last_change":"2024-09-14T11:59:18.935132+0000","last_active":"2024-09-14T11:59:18.935132+0000","last_peered":"2024-09-14T11:59:18.935132+0000","last_clean":"2024-09-14T11:59:18.935132+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:59:18.935132+0000","last_undegraded":"2024-09-14T11:59:18.935132+0000","last_fullsized":"2024-09-14T11:59:18.935132+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'175","last_scrub_stamp":"2024-09-14T11:59:18.935016+0000","last_deep_scrub":"262'175","last_deep_scrub_stamp":"2024-09-14T11:59:18.935016+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.935016+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:06.444815+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":303,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'804","reported_seq":4169,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.452341+0000","last_change":"2024-09-14T11:59:21.452341+0000","last_active":"2024-09-14T11:59:21.452341+0000","last_peered":"2024-09-14T11:59:21.452341+0000","last_clean":"2024-09-14T11:59:21.452341+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:59:21.452341+0000","last_undegraded":"2024-09-14T11:59:21.452341+0000","last_fullsized":"2024-09-14T11:59:21.452341+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'804","last_scrub_stamp":"2024-09-14T11:59:21.452251+0000","last_deep_scrub":"262'804","last_deep_scrub_stamp":"2024-09-14T11:59:21.452251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.452251+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:50.712137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'142","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.469961+0000","last_change":"2024-09-14T11:59:27.469961+0000","last_active":"2024-09-14T11:59:27.469961+0000","last_peered":"2024-09-14T11:59:27.469961+0000","last_clean":"2024-09-14T11:59:27.469961+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:59:27.469961+0000","last_undegraded":"2024-09-14T11:59:27.469961+0000","last_fullsized":"2024-09-14T11:59:27.469961+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-14T11:59:27.469878+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-14T11:59:27.469878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.469878+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:26.963886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.286153+0000","last_change":"2024-09-14T11:59:04.286153+0000","last_active":"2024-09-14T11:59:04.286153+0000","last_peered":"2024-09-14T11:59:04.286153+0000","last_clean":"2024-09-14T11:59:04.286153+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:59:04.286153+0000","last_undegraded":"2024-09-14T11:59:04.286153+0000","last_fullsized":"2024-09-14T11:59:04.286153+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'842","last_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_deep_scrub":"262'842","last_deep_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.286054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:06.803501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'270","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.198507+0000","last_change":"2024-09-14T11:58:54.198507+0000","last_active":"2024-09-14T11:58:54.198507+0000","last_peered":"2024-09-14T11:58:54.198507+0000","last_clean":"2024-09-14T11:58:54.198507+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:54.198507+0000","last_undegraded":"2024-09-14T11:58:54.198507+0000","last_fullsized":"2024-09-14T11:58:54.198507+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'270","last_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_deep_scrub":"262'270","last_deep_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.198407+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:41.502019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":40477,"num_write":1093,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.246881+0000","last_change":"2024-09-14T11:59:02.246809+0000","last_active":"2024-09-14T11:59:02.246881+0000","last_peered":"2024-09-14T11:59:02.246881+0000","last_clean":"2024-09-14T11:59:02.246881+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:59:02.246881+0000","last_undegraded":"2024-09-14T11:59:02.246881+0000","last_fullsized":"2024-09-14T11:59:02.246881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.246720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:43.335103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'207","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.338673+0000","last_change":"2024-09-14T11:59:14.338673+0000","last_active":"2024-09-14T11:59:14.338673+0000","last_peered":"2024-09-14T11:59:14.338673+0000","last_clean":"2024-09-14T11:59:14.338673+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:59:14.338673+0000","last_undegraded":"2024-09-14T11:59:14.338673+0000","last_fullsized":"2024-09-14T11:59:14.338673+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-14T11:59:14.338559+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-14T11:59:14.338559+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.338559+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:25.967619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":292,"num_read_kb":532,"num_write":152,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.338348+0000","last_change":"2024-09-14T11:59:14.338348+0000","last_active":"2024-09-14T11:59:14.338348+0000","last_peered":"2024-09-14T11:59:14.338348+0000","last_clean":"2024-09-14T11:59:14.338348+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:59:14.338348+0000","last_undegraded":"2024-09-14T11:59:14.338348+0000","last_fullsized":"2024-09-14T11:59:14.338348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.338219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.338219+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.338219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:18.751994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'133","reported_seq":655,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.491087+0000","last_change":"2024-09-14T11:59:20.491087+0000","last_active":"2024-09-14T11:59:20.491087+0000","last_peered":"2024-09-14T11:59:20.491087+0000","last_clean":"2024-09-14T11:59:20.491087+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:59:20.491087+0000","last_undegraded":"2024-09-14T11:59:20.491087+0000","last_fullsized":"2024-09-14T11:59:20.491087+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'133","last_scrub_stamp":"2024-09-14T11:59:20.490994+0000","last_deep_scrub":"262'133","last_deep_scrub_stamp":"2024-09-14T11:59:20.490994+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.490994+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:34.944128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'489","reported_seq":2098,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.170207+0000","last_change":"2024-09-14T11:59:01.170207+0000","last_active":"2024-09-14T11:59:01.170207+0000","last_peered":"2024-09-14T11:59:01.170207+0000","last_clean":"2024-09-14T11:59:01.170207+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:59:01.170207+0000","last_undegraded":"2024-09-14T11:59:01.170207+0000","last_fullsized":"2024-09-14T11:59:01.170207+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'489","last_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_deep_scrub":"262'489","last_deep_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.170127+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:23.040904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":957,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'233","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.841862+0000","last_change":"2024-09-14T11:58:56.841862+0000","last_active":"2024-09-14T11:58:56.841862+0000","last_peered":"2024-09-14T11:58:56.841862+0000","last_clean":"2024-09-14T11:58:56.841862+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:58:56.841862+0000","last_undegraded":"2024-09-14T11:58:56.841862+0000","last_fullsized":"2024-09-14T11:58:56.841862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'233","last_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_deep_scrub":"262'233","last_deep_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.841768+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:37.320911+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":679,"num_read_kb":211577,"num_write":961,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.271674+0000","last_change":"2024-09-14T11:59:04.271674+0000","last_active":"2024-09-14T11:59:04.271674+0000","last_peered":"2024-09-14T11:59:04.271674+0000","last_clean":"2024-09-14T11:59:04.271674+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:59:04.271674+0000","last_undegraded":"2024-09-14T11:59:04.271674+0000","last_fullsized":"2024-09-14T11:59:04.271674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.271581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:18.845590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'150","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.000067+0000","last_change":"2024-09-14T11:59:19.000067+0000","last_active":"2024-09-14T11:59:19.000067+0000","last_peered":"2024-09-14T11:59:19.000067+0000","last_clean":"2024-09-14T11:59:19.000067+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:59:19.000067+0000","last_undegraded":"2024-09-14T11:59:19.000067+0000","last_fullsized":"2024-09-14T11:59:19.000067+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'150","last_scrub_stamp":"2024-09-14T11:59:18.999983+0000","last_deep_scrub":"262'150","last_deep_scrub_stamp":"2024-09-14T11:59:18.999983+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.999983+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:30.082383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":279,"num_write":168,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.482082+0000","last_change":"2024-09-14T11:59:22.482082+0000","last_active":"2024-09-14T11:59:22.482082+0000","last_peered":"2024-09-14T11:59:22.482082+0000","last_clean":"2024-09-14T11:59:22.482082+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:59:22.482082+0000","last_undegraded":"2024-09-14T11:59:22.482082+0000","last_fullsized":"2024-09-14T11:59:22.482082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.481998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.481998+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.481998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:30.175507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'120","reported_seq":602,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:53.892807+0000","last_change":"2024-09-14T11:15:42.350884+0000","last_active":"2024-09-14T11:57:53.892807+0000","last_peered":"2024-09-14T11:57:53.892807+0000","last_clean":"2024-09-14T11:57:53.892807+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:57:53.892807+0000","last_undegraded":"2024-09-14T11:57:53.892807+0000","last_fullsized":"2024-09-14T11:57:53.892807+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.299714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'401","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.146653+0000","last_change":"2024-09-14T11:59:02.146653+0000","last_active":"2024-09-14T11:59:02.146653+0000","last_peered":"2024-09-14T11:59:02.146653+0000","last_clean":"2024-09-14T11:59:02.146653+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:59:02.146653+0000","last_undegraded":"2024-09-14T11:59:02.146653+0000","last_fullsized":"2024-09-14T11:59:02.146653+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'401","last_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_deep_scrub":"262'401","last_deep_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.146555+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:42.384227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'223","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.241638+0000","last_change":"2024-09-14T11:58:56.241556+0000","last_active":"2024-09-14T11:58:56.241638+0000","last_peered":"2024-09-14T11:58:56.241638+0000","last_clean":"2024-09-14T11:58:56.241638+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:56.241638+0000","last_undegraded":"2024-09-14T11:58:56.241638+0000","last_fullsized":"2024-09-14T11:58:56.241638+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.241416+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:27.853420+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1176,"num_read_kb":14840,"num_write":1005,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.643614+0000","last_change":"2024-09-14T11:59:08.643614+0000","last_active":"2024-09-14T11:59:08.643614+0000","last_peered":"2024-09-14T11:59:08.643614+0000","last_clean":"2024-09-14T11:59:08.643614+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:59:08.643614+0000","last_undegraded":"2024-09-14T11:59:08.643614+0000","last_fullsized":"2024-09-14T11:59:08.643614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.643511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:00.185539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'169","reported_seq":756,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.269583+0000","last_change":"2024-09-14T11:59:05.269583+0000","last_active":"2024-09-14T11:59:05.269583+0000","last_peered":"2024-09-14T11:59:05.269583+0000","last_clean":"2024-09-14T11:59:05.269583+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:59:05.269583+0000","last_undegraded":"2024-09-14T11:59:05.269583+0000","last_fullsized":"2024-09-14T11:59:05.269583+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'169","last_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_deep_scrub":"262'169","last_deep_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.269486+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:22.201735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9189,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":308,"num_write":130,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.312182+0000","last_change":"2024-09-14T11:59:11.312182+0000","last_active":"2024-09-14T11:59:11.312182+0000","last_peered":"2024-09-14T11:59:11.312182+0000","last_clean":"2024-09-14T11:59:11.312182+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:59:11.312182+0000","last_undegraded":"2024-09-14T11:59:11.312182+0000","last_fullsized":"2024-09-14T11:59:11.312182+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.312094+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:03.384832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'140","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.496372+0000","last_change":"2024-09-14T11:59:18.496302+0000","last_active":"2024-09-14T11:59:18.496372+0000","last_peered":"2024-09-14T11:59:18.496372+0000","last_clean":"2024-09-14T11:59:18.496372+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:59:18.496372+0000","last_undegraded":"2024-09-14T11:59:18.496372+0000","last_fullsized":"2024-09-14T11:59:18.496372+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:18.496205+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:18.496205+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.496205+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:21.623170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1226","reported_seq":2799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.175076+0000","last_change":"2024-09-14T11:59:03.175076+0000","last_active":"2024-09-14T11:59:03.175076+0000","last_peered":"2024-09-14T11:59:03.175076+0000","last_clean":"2024-09-14T11:59:03.175076+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:59:03.175076+0000","last_undegraded":"2024-09-14T11:59:03.175076+0000","last_fullsized":"2024-09-14T11:59:03.175076+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1226","last_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_deep_scrub":"262'1226","last_deep_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.174965+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.571515+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'203","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.140005+0000","last_change":"2024-09-14T11:58:58.140005+0000","last_active":"2024-09-14T11:58:58.140005+0000","last_peered":"2024-09-14T11:58:58.140005+0000","last_clean":"2024-09-14T11:58:58.140005+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:58:58.140005+0000","last_undegraded":"2024-09-14T11:58:58.140005+0000","last_fullsized":"2024-09-14T11:58:58.140005+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.139868+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:54.848038+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":33043,"num_write":876,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1446,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.781031+0000","last_change":"2024-09-14T11:59:14.781031+0000","last_active":"2024-09-14T11:59:14.781031+0000","last_peered":"2024-09-14T11:59:14.781031+0000","last_clean":"2024-09-14T11:59:14.781031+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:59:14.781031+0000","last_undegraded":"2024-09-14T11:59:14.781031+0000","last_fullsized":"2024-09-14T11:59:14.781031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:14.780939+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:14.780939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.780939+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:39.596476+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":951,"num_read_kb":951,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'94","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.988876+0000","last_change":"2024-09-14T11:59:19.988876+0000","last_active":"2024-09-14T11:59:19.988876+0000","last_peered":"2024-09-14T11:59:19.988876+0000","last_clean":"2024-09-14T11:59:19.988876+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:59:19.988876+0000","last_undegraded":"2024-09-14T11:59:19.988876+0000","last_fullsized":"2024-09-14T11:59:19.988876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-14T11:59:19.988779+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-14T11:59:19.988779+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.988779+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:05.383676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'769","reported_seq":2241,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.136534+0000","last_change":"2024-09-14T11:59:13.136534+0000","last_active":"2024-09-14T11:59:13.136534+0000","last_peered":"2024-09-14T11:59:13.136534+0000","last_clean":"2024-09-14T11:59:13.136534+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:59:13.136534+0000","last_undegraded":"2024-09-14T11:59:13.136534+0000","last_fullsized":"2024-09-14T11:59:13.136534+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'769","last_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_deep_scrub":"262'769","last_deep_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.136434+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:03.613925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'150","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.010097+0000","last_change":"2024-09-14T11:59:27.010015+0000","last_active":"2024-09-14T11:59:27.010097+0000","last_peered":"2024-09-14T11:59:27.010097+0000","last_clean":"2024-09-14T11:59:27.010097+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:59:27.010097+0000","last_undegraded":"2024-09-14T11:59:27.010097+0000","last_fullsized":"2024-09-14T11:59:27.010097+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'150","last_scrub_stamp":"2024-09-14T11:59:27.009930+0000","last_deep_scrub":"262'150","last_deep_scrub_stamp":"2024-09-14T11:59:27.009930+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.009930+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.093068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'426","reported_seq":2152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.612965+0000","last_change":"2024-09-14T11:59:03.612965+0000","last_active":"2024-09-14T11:59:03.612965+0000","last_peered":"2024-09-14T11:59:03.612965+0000","last_clean":"2024-09-14T11:59:03.612965+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:59:03.612965+0000","last_undegraded":"2024-09-14T11:59:03.612965+0000","last_fullsized":"2024-09-14T11:59:03.612965+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'426","last_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_deep_scrub":"262'426","last_deep_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.612866+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:46.847404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'177","reported_seq":791,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.824967+0000","last_change":"2024-09-14T11:58:55.824967+0000","last_active":"2024-09-14T11:58:55.824967+0000","last_peered":"2024-09-14T11:58:55.824967+0000","last_clean":"2024-09-14T11:58:55.824967+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:58:55.824967+0000","last_undegraded":"2024-09-14T11:58:55.824967+0000","last_fullsized":"2024-09-14T11:58:55.824967+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.824891+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.305401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":26947,"num_write":787,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.055419+0000","last_change":"2024-09-14T11:59:16.055419+0000","last_active":"2024-09-14T11:59:16.055419+0000","last_peered":"2024-09-14T11:59:16.055419+0000","last_clean":"2024-09-14T11:59:16.055419+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:59:16.055419+0000","last_undegraded":"2024-09-14T11:59:16.055419+0000","last_fullsized":"2024-09-14T11:59:16.055419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.055322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.055322+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.055322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:34.773506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'219","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.822193+0000","last_change":"2024-09-14T11:59:20.822193+0000","last_active":"2024-09-14T11:59:20.822193+0000","last_peered":"2024-09-14T11:59:20.822193+0000","last_clean":"2024-09-14T11:59:20.822193+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:59:20.822193+0000","last_undegraded":"2024-09-14T11:59:20.822193+0000","last_fullsized":"2024-09-14T11:59:20.822193+0000","mapping_epoch":30,"log_start":"262'201","ondisk_log_start":"262'201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:20.822090+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:20.822090+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.822090+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":201,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:07.759480+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":896,"num_read_kb":967,"num_write":1418,"num_write_kb":1294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.100560+0000","last_change":"2024-09-14T11:59:11.100560+0000","last_active":"2024-09-14T11:59:11.100560+0000","last_peered":"2024-09-14T11:59:11.100560+0000","last_clean":"2024-09-14T11:59:11.100560+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:59:11.100560+0000","last_undegraded":"2024-09-14T11:59:11.100560+0000","last_fullsized":"2024-09-14T11:59:11.100560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.100464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.020435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'148","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.456666+0000","last_change":"2024-09-14T11:59:19.456602+0000","last_active":"2024-09-14T11:59:19.456666+0000","last_peered":"2024-09-14T11:59:19.456666+0000","last_clean":"2024-09-14T11:59:19.456666+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:59:19.456666+0000","last_undegraded":"2024-09-14T11:59:19.456666+0000","last_fullsized":"2024-09-14T11:59:19.456666+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-14T11:59:19.456498+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-14T11:59:19.456498+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.456498+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:21.465056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'801","reported_seq":2325,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.230985+0000","last_change":"2024-09-14T11:59:03.230934+0000","last_active":"2024-09-14T11:59:03.230985+0000","last_peered":"2024-09-14T11:59:03.230985+0000","last_clean":"2024-09-14T11:59:03.230985+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:59:03.230985+0000","last_undegraded":"2024-09-14T11:59:03.230985+0000","last_fullsized":"2024-09-14T11:59:03.230985+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'801","last_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_deep_scrub":"262'801","last_deep_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.230846+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:04.064474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.760564+0000","last_change":"2024-09-14T11:58:59.760463+0000","last_active":"2024-09-14T11:58:59.760564+0000","last_peered":"2024-09-14T11:58:59.760564+0000","last_clean":"2024-09-14T11:58:59.760564+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:58:59.760564+0000","last_undegraded":"2024-09-14T11:58:59.760564+0000","last_fullsized":"2024-09-14T11:58:59.760564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.760359+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.092864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":518,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.827346+0000","last_change":"2024-09-14T11:58:54.827283+0000","last_active":"2024-09-14T11:58:54.827346+0000","last_peered":"2024-09-14T11:58:54.827346+0000","last_clean":"2024-09-14T11:58:54.827346+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:58:54.827346+0000","last_undegraded":"2024-09-14T11:58:54.827346+0000","last_fullsized":"2024-09-14T11:58:54.827346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.827191+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:45.032950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'242","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.815480+0000","last_change":"2024-09-14T11:58:53.815404+0000","last_active":"2024-09-14T11:58:53.815480+0000","last_peered":"2024-09-14T11:58:53.815480+0000","last_clean":"2024-09-14T11:58:53.815480+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:58:53.815480+0000","last_undegraded":"2024-09-14T11:58:53.815480+0000","last_fullsized":"2024-09-14T11:58:53.815480+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'242","last_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_deep_scrub":"262'242","last_deep_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.815334+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:37.358269+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":31904,"num_write":1129,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.000087+0000","last_change":"2024-09-14T11:59:12.999968+0000","last_active":"2024-09-14T11:59:13.000087+0000","last_peered":"2024-09-14T11:59:13.000087+0000","last_clean":"2024-09-14T11:59:13.000087+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:59:13.000087+0000","last_undegraded":"2024-09-14T11:59:13.000087+0000","last_fullsized":"2024-09-14T11:59:13.000087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.999868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:32.858382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'311","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.744516+0000","last_change":"2024-09-14T11:59:18.744516+0000","last_active":"2024-09-14T11:59:18.744516+0000","last_peered":"2024-09-14T11:59:18.744516+0000","last_clean":"2024-09-14T11:59:18.744516+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:59:18.744516+0000","last_undegraded":"2024-09-14T11:59:18.744516+0000","last_fullsized":"2024-09-14T11:59:18.744516+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'311","last_scrub_stamp":"2024-09-14T11:59:18.744428+0000","last_deep_scrub":"262'311","last_deep_scrub_stamp":"2024-09-14T11:59:18.744428+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.744428+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:34.923657+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36736,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":789,"num_write":500,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107196,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.415321+0000","last_change":"2024-09-14T11:59:20.415321+0000","last_active":"2024-09-14T11:59:20.415321+0000","last_peered":"2024-09-14T11:59:20.415321+0000","last_clean":"2024-09-14T11:59:20.415321+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:59:20.415321+0000","last_undegraded":"2024-09-14T11:59:20.415321+0000","last_fullsized":"2024-09-14T11:59:20.415321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.415213+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'191","reported_seq":885,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.044608+0000","last_change":"2024-09-14T11:59:18.044608+0000","last_active":"2024-09-14T11:59:18.044608+0000","last_peered":"2024-09-14T11:59:18.044608+0000","last_clean":"2024-09-14T11:59:18.044608+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:59:18.044608+0000","last_undegraded":"2024-09-14T11:59:18.044608+0000","last_fullsized":"2024-09-14T11:59:18.044608+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-14T11:59:18.044511+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-14T11:59:18.044511+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.044511+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.155679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'496","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.319385+0000","last_change":"2024-09-14T11:59:03.319385+0000","last_active":"2024-09-14T11:59:03.319385+0000","last_peered":"2024-09-14T11:59:03.319385+0000","last_clean":"2024-09-14T11:59:03.319385+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:59:03.319385+0000","last_undegraded":"2024-09-14T11:59:03.319385+0000","last_fullsized":"2024-09-14T11:59:03.319385+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.319251+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.665879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751184+0000","last_change":"2024-09-14T11:58:56.751104+0000","last_active":"2024-09-14T11:58:56.751184+0000","last_peered":"2024-09-14T11:58:56.751184+0000","last_clean":"2024-09-14T11:58:56.751184+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:58:56.751184+0000","last_undegraded":"2024-09-14T11:58:56.751184+0000","last_fullsized":"2024-09-14T11:58:56.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:51.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'197","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.272150+0000","last_change":"2024-09-14T11:58:52.272045+0000","last_active":"2024-09-14T11:58:52.272150+0000","last_peered":"2024-09-14T11:58:52.272150+0000","last_clean":"2024-09-14T11:58:52.272150+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:58:52.272150+0000","last_undegraded":"2024-09-14T11:58:52.272150+0000","last_fullsized":"2024-09-14T11:58:52.272150+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.271906+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:15.088566+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":761,"num_read_kb":134470,"num_write":901,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.833801+0000","last_change":"2024-09-14T11:59:12.833801+0000","last_active":"2024-09-14T11:59:12.833801+0000","last_peered":"2024-09-14T11:59:12.833801+0000","last_clean":"2024-09-14T11:59:12.833801+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:59:12.833801+0000","last_undegraded":"2024-09-14T11:59:12.833801+0000","last_fullsized":"2024-09-14T11:59:12.833801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.833667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:02.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'862","reported_seq":2317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.614930+0000","last_change":"2024-09-14T11:59:13.614856+0000","last_active":"2024-09-14T11:59:13.614930+0000","last_peered":"2024-09-14T11:59:13.614930+0000","last_clean":"2024-09-14T11:59:13.614930+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:59:13.614930+0000","last_undegraded":"2024-09-14T11:59:13.614930+0000","last_fullsized":"2024-09-14T11:59:13.614930+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'862","last_scrub_stamp":"2024-09-14T11:59:13.614752+0000","last_deep_scrub":"262'862","last_deep_scrub_stamp":"2024-09-14T11:59:13.614752+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.614752+0000","objects_scrubbed":11,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:53.390048+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34835,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1171,"num_read_kb":1364,"num_write":276,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.049133+0000","last_change":"2024-09-14T11:59:24.049072+0000","last_active":"2024-09-14T11:59:24.049133+0000","last_peered":"2024-09-14T11:59:24.049133+0000","last_clean":"2024-09-14T11:59:24.049133+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:59:24.049133+0000","last_undegraded":"2024-09-14T11:59:24.049133+0000","last_fullsized":"2024-09-14T11:59:24.049133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.048995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.048995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.048995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:26.759832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'101","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.469896+0000","last_change":"2024-09-14T11:59:21.469896+0000","last_active":"2024-09-14T11:59:21.469896+0000","last_peered":"2024-09-14T11:59:21.469896+0000","last_clean":"2024-09-14T11:59:21.469896+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:59:21.469896+0000","last_undegraded":"2024-09-14T11:59:21.469896+0000","last_fullsized":"2024-09-14T11:59:21.469896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'101","last_scrub_stamp":"2024-09-14T11:59:21.469788+0000","last_deep_scrub":"262'101","last_deep_scrub_stamp":"2024-09-14T11:59:21.469788+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.469788+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.182457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'540","reported_seq":2069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.642068+0000","last_change":"2024-09-14T11:59:02.642068+0000","last_active":"2024-09-14T11:59:02.642068+0000","last_peered":"2024-09-14T11:59:02.642068+0000","last_clean":"2024-09-14T11:59:02.642068+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:59:02.642068+0000","last_undegraded":"2024-09-14T11:59:02.642068+0000","last_fullsized":"2024-09-14T11:59:02.642068+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.641963+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:17.604167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.235879+0000","last_change":"2024-09-14T11:58:53.235819+0000","last_active":"2024-09-14T11:58:53.235879+0000","last_peered":"2024-09-14T11:58:53.235879+0000","last_clean":"2024-09-14T11:58:53.235879+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:58:53.235879+0000","last_undegraded":"2024-09-14T11:58:53.235879+0000","last_fullsized":"2024-09-14T11:58:53.235879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.235741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:53.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'177","reported_seq":778,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.608013+0000","last_change":"2024-09-14T11:58:54.608013+0000","last_active":"2024-09-14T11:58:54.608013+0000","last_peered":"2024-09-14T11:58:54.608013+0000","last_clean":"2024-09-14T11:58:54.608013+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:58:54.608013+0000","last_undegraded":"2024-09-14T11:58:54.608013+0000","last_fullsized":"2024-09-14T11:58:54.608013+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.607889+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:25.551492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":27621,"num_write":841,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.323218+0000","last_change":"2024-09-14T11:59:08.323218+0000","last_active":"2024-09-14T11:59:08.323218+0000","last_peered":"2024-09-14T11:59:08.323218+0000","last_clean":"2024-09-14T11:59:08.323218+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:59:08.323218+0000","last_undegraded":"2024-09-14T11:59:08.323218+0000","last_fullsized":"2024-09-14T11:59:08.323218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.323133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:08.984207+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'222","reported_seq":1284,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.974923+0000","last_change":"2024-09-14T11:59:17.974864+0000","last_active":"2024-09-14T11:59:17.974923+0000","last_peered":"2024-09-14T11:59:17.974923+0000","last_clean":"2024-09-14T11:59:17.974923+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:59:17.974923+0000","last_undegraded":"2024-09-14T11:59:17.974923+0000","last_fullsized":"2024-09-14T11:59:17.974923+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-14T11:59:17.974770+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-14T11:59:17.974770+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.974770+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:43.176252+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.437525+0000","last_change":"2024-09-14T11:59:19.437398+0000","last_active":"2024-09-14T11:59:19.437525+0000","last_peered":"2024-09-14T11:59:19.437525+0000","last_clean":"2024-09-14T11:59:19.437525+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:59:19.437525+0000","last_undegraded":"2024-09-14T11:59:19.437525+0000","last_fullsized":"2024-09-14T11:59:19.437525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:19.437292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:19.437292+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.437292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:35.303402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'283","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.985762+0000","last_change":"2024-09-14T11:59:29.985762+0000","last_active":"2024-09-14T11:59:29.985762+0000","last_peered":"2024-09-14T11:59:29.985762+0000","last_clean":"2024-09-14T11:59:29.985762+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:59:29.985762+0000","last_undegraded":"2024-09-14T11:59:29.985762+0000","last_fullsized":"2024-09-14T11:59:29.985762+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'283","last_scrub_stamp":"2024-09-14T11:59:29.985661+0000","last_deep_scrub":"262'283","last_deep_scrub_stamp":"2024-09-14T11:59:29.985661+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.985661+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:10.995876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'558","reported_seq":2139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.639462+0000","last_change":"2024-09-14T11:59:01.639356+0000","last_active":"2024-09-14T11:59:01.639462+0000","last_peered":"2024-09-14T11:59:01.639462+0000","last_clean":"2024-09-14T11:59:01.639462+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:59:01.639462+0000","last_undegraded":"2024-09-14T11:59:01.639462+0000","last_fullsized":"2024-09-14T11:59:01.639462+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'558","last_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_deep_scrub":"262'558","last_deep_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.639211+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:58.123592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":519,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.779905+0000","last_change":"2024-09-14T11:58:55.779846+0000","last_active":"2024-09-14T11:58:55.779905+0000","last_peered":"2024-09-14T11:58:55.779905+0000","last_clean":"2024-09-14T11:58:55.779905+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:58:55.779905+0000","last_undegraded":"2024-09-14T11:58:55.779905+0000","last_fullsized":"2024-09-14T11:58:55.779905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.779753+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:41.730972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'218","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.148995+0000","last_change":"2024-09-14T11:58:54.148939+0000","last_active":"2024-09-14T11:58:54.148995+0000","last_peered":"2024-09-14T11:58:54.148995+0000","last_clean":"2024-09-14T11:58:54.148995+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:58:54.148995+0000","last_undegraded":"2024-09-14T11:58:54.148995+0000","last_fullsized":"2024-09-14T11:58:54.148995+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.148824+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:26.080263+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":21127,"num_write":1026,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.399101+0000","last_change":"2024-09-14T11:59:12.398988+0000","last_active":"2024-09-14T11:59:12.399101+0000","last_peered":"2024-09-14T11:59:12.399101+0000","last_clean":"2024-09-14T11:59:12.399101+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:59:12.399101+0000","last_undegraded":"2024-09-14T11:59:12.399101+0000","last_fullsized":"2024-09-14T11:59:12.399101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.398880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.920892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'131","reported_seq":674,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.989487+0000","last_change":"2024-09-14T11:59:18.989487+0000","last_active":"2024-09-14T11:59:18.989487+0000","last_peered":"2024-09-14T11:59:18.989487+0000","last_clean":"2024-09-14T11:59:18.989487+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:59:18.989487+0000","last_undegraded":"2024-09-14T11:59:18.989487+0000","last_fullsized":"2024-09-14T11:59:18.989487+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-14T11:59:18.989375+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-14T11:59:18.989375+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.989375+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:46.747353+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.128482+0000","last_change":"2024-09-14T11:59:12.128482+0000","last_active":"2024-09-14T11:59:12.128482+0000","last_peered":"2024-09-14T11:59:12.128482+0000","last_clean":"2024-09-14T11:59:12.128482+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:59:12.128482+0000","last_undegraded":"2024-09-14T11:59:12.128482+0000","last_fullsized":"2024-09-14T11:59:12.128482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.128387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:35.793136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'168","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.854061+0000","last_change":"2024-09-14T11:59:25.854061+0000","last_active":"2024-09-14T11:59:25.854061+0000","last_peered":"2024-09-14T11:59:25.854061+0000","last_clean":"2024-09-14T11:59:25.854061+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:59:25.854061+0000","last_undegraded":"2024-09-14T11:59:25.854061+0000","last_fullsized":"2024-09-14T11:59:25.854061+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-14T11:59:25.853968+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-14T11:59:25.853968+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.853968+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:16.886940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'893","reported_seq":2637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.605858+0000","last_change":"2024-09-14T11:59:00.605777+0000","last_active":"2024-09-14T11:59:00.605858+0000","last_peered":"2024-09-14T11:59:00.605858+0000","last_clean":"2024-09-14T11:59:00.605858+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:59:00.605858+0000","last_undegraded":"2024-09-14T11:59:00.605858+0000","last_fullsized":"2024-09-14T11:59:00.605858+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'893","last_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_deep_scrub":"262'893","last_deep_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.605689+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:06.292394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'214","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.779435+0000","last_change":"2024-09-14T11:58:56.779368+0000","last_active":"2024-09-14T11:58:56.779435+0000","last_peered":"2024-09-14T11:58:56.779435+0000","last_clean":"2024-09-14T11:58:56.779435+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:58:56.779435+0000","last_undegraded":"2024-09-14T11:58:56.779435+0000","last_fullsized":"2024-09-14T11:58:56.779435+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'214","last_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_deep_scrub":"262'214","last_deep_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.779283+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:05.019231+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146072,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":7241,"num_write":969,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.671249+0000","last_change":"2024-09-14T11:58:52.671195+0000","last_active":"2024-09-14T11:58:52.671249+0000","last_peered":"2024-09-14T11:58:52.671249+0000","last_clean":"2024-09-14T11:58:52.671249+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:58:52.671249+0000","last_undegraded":"2024-09-14T11:58:52.671249+0000","last_fullsized":"2024-09-14T11:58:52.671249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.671120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:36.505369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.404792+0000","last_change":"2024-09-14T11:59:11.404674+0000","last_active":"2024-09-14T11:59:11.404792+0000","last_peered":"2024-09-14T11:59:11.404792+0000","last_clean":"2024-09-14T11:59:11.404792+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:59:11.404792+0000","last_undegraded":"2024-09-14T11:59:11.404792+0000","last_fullsized":"2024-09-14T11:59:11.404792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.404575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:53.428957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'278","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.375871+0000","last_change":"2024-09-14T11:59:15.375871+0000","last_active":"2024-09-14T11:59:15.375871+0000","last_peered":"2024-09-14T11:59:15.375871+0000","last_clean":"2024-09-14T11:59:15.375871+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:59:15.375871+0000","last_undegraded":"2024-09-14T11:59:15.375871+0000","last_fullsized":"2024-09-14T11:59:15.375871+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'278","last_scrub_stamp":"2024-09-14T11:59:15.375762+0000","last_deep_scrub":"262'278","last_deep_scrub_stamp":"2024-09-14T11:59:15.375762+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.375762+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:58.310749+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16117,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":365,"num_read_kb":486,"num_write":204,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.010139+0000","last_change":"2024-09-14T11:59:24.010050+0000","last_active":"2024-09-14T11:59:24.010139+0000","last_peered":"2024-09-14T11:59:24.010139+0000","last_clean":"2024-09-14T11:59:24.010139+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:59:24.010139+0000","last_undegraded":"2024-09-14T11:59:24.010139+0000","last_fullsized":"2024-09-14T11:59:24.010139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.009956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.009956+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.009956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:37.498313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'169","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.464163+0000","last_change":"2024-09-14T11:15:42.354465+0000","last_active":"2024-09-14T11:58:14.464163+0000","last_peered":"2024-09-14T11:58:14.464163+0000","last_clean":"2024-09-14T11:58:14.464163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:58:14.464163+0000","last_undegraded":"2024-09-14T11:58:14.464163+0000","last_fullsized":"2024-09-14T11:58:14.464163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:00.902965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'774","reported_seq":2195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.277548+0000","last_change":"2024-09-14T11:59:02.277485+0000","last_active":"2024-09-14T11:59:02.277548+0000","last_peered":"2024-09-14T11:59:02.277548+0000","last_clean":"2024-09-14T11:59:02.277548+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:59:02.277548+0000","last_undegraded":"2024-09-14T11:59:02.277548+0000","last_fullsized":"2024-09-14T11:59:02.277548+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.277389+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:34.730626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'268","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.656930+0000","last_change":"2024-09-14T11:58:55.656880+0000","last_active":"2024-09-14T11:58:55.656930+0000","last_peered":"2024-09-14T11:58:55.656930+0000","last_clean":"2024-09-14T11:58:55.656930+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:58:55.656930+0000","last_undegraded":"2024-09-14T11:58:55.656930+0000","last_fullsized":"2024-09-14T11:58:55.656930+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'268","last_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_deep_scrub":"262'268","last_deep_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.656804+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.470057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":40043,"num_write":1045,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.713853+0000","last_change":"2024-09-14T11:58:55.713779+0000","last_active":"2024-09-14T11:58:55.713853+0000","last_peered":"2024-09-14T11:58:55.713853+0000","last_clean":"2024-09-14T11:58:55.713853+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:58:55.713853+0000","last_undegraded":"2024-09-14T11:58:55.713853+0000","last_fullsized":"2024-09-14T11:58:55.713853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.713672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:50.890524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"262'5","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.148314+0000","last_change":"2024-09-14T11:59:08.148251+0000","last_active":"2024-09-14T11:59:08.148314+0000","last_peered":"2024-09-14T11:59:08.148314+0000","last_clean":"2024-09-14T11:59:08.148314+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:59:08.148314+0000","last_undegraded":"2024-09-14T11:59:08.148314+0000","last_fullsized":"2024-09-14T11:59:08.148314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.148173+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:01.374450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'175","reported_seq":740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.609529+0000","last_change":"2024-09-14T11:59:12.609466+0000","last_active":"2024-09-14T11:59:12.609529+0000","last_peered":"2024-09-14T11:59:12.609529+0000","last_clean":"2024-09-14T11:59:12.609529+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:59:12.609529+0000","last_undegraded":"2024-09-14T11:59:12.609529+0000","last_fullsized":"2024-09-14T11:59:12.609529+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'175","last_scrub_stamp":"2024-09-14T11:59:12.609349+0000","last_deep_scrub":"262'175","last_deep_scrub_stamp":"2024-09-14T11:59:12.609349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.609349+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:57.156455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'800","reported_seq":4708,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.850044+0000","last_change":"2024-09-14T11:59:21.850044+0000","last_active":"2024-09-14T11:59:21.850044+0000","last_peered":"2024-09-14T11:59:21.850044+0000","last_clean":"2024-09-14T11:59:21.850044+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:59:21.850044+0000","last_undegraded":"2024-09-14T11:59:21.850044+0000","last_fullsized":"2024-09-14T11:59:21.850044+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'800","last_scrub_stamp":"2024-09-14T11:59:21.849956+0000","last_deep_scrub":"262'800","last_deep_scrub_stamp":"2024-09-14T11:59:21.849956+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.849956+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:50.151179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'134","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.987423+0000","last_change":"2024-09-14T11:59:30.987423+0000","last_active":"2024-09-14T11:59:30.987423+0000","last_peered":"2024-09-14T11:59:30.987423+0000","last_clean":"2024-09-14T11:59:30.987423+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:59:30.987423+0000","last_undegraded":"2024-09-14T11:59:30.987423+0000","last_fullsized":"2024-09-14T11:59:30.987423+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-14T11:59:30.987323+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-14T11:59:30.987323+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.987323+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:35.943996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'892","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.989877+0000","last_change":"2024-09-14T11:59:10.989877+0000","last_active":"2024-09-14T11:59:10.989877+0000","last_peered":"2024-09-14T11:59:10.989877+0000","last_clean":"2024-09-14T11:59:10.989877+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:59:10.989877+0000","last_undegraded":"2024-09-14T11:59:10.989877+0000","last_fullsized":"2024-09-14T11:59:10.989877+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'892","last_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_deep_scrub":"262'892","last_deep_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.989791+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:39.808429+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'247","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.849696+0000","last_change":"2024-09-14T11:58:54.849696+0000","last_active":"2024-09-14T11:58:54.849696+0000","last_peered":"2024-09-14T11:58:54.849696+0000","last_clean":"2024-09-14T11:58:54.849696+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:58:54.849696+0000","last_undegraded":"2024-09-14T11:58:54.849696+0000","last_fullsized":"2024-09-14T11:58:54.849696+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.849617+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:59.404448+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460231,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":25317,"num_write":1130,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.648824+0000","last_change":"2024-09-14T11:58:53.648824+0000","last_active":"2024-09-14T11:58:53.648824+0000","last_peered":"2024-09-14T11:58:53.648824+0000","last_clean":"2024-09-14T11:58:53.648824+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:58:53.648824+0000","last_undegraded":"2024-09-14T11:58:53.648824+0000","last_fullsized":"2024-09-14T11:58:53.648824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.648747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:10.973858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.094595+0000","last_change":"2024-09-14T11:59:15.094514+0000","last_active":"2024-09-14T11:59:15.094595+0000","last_peered":"2024-09-14T11:59:15.094595+0000","last_clean":"2024-09-14T11:59:15.094595+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:59:15.094595+0000","last_undegraded":"2024-09-14T11:59:15.094595+0000","last_fullsized":"2024-09-14T11:59:15.094595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.094426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.094426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:27.096812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'117","reported_seq":653,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.038533+0000","last_change":"2024-09-14T11:59:18.038476+0000","last_active":"2024-09-14T11:59:18.038533+0000","last_peered":"2024-09-14T11:59:18.038533+0000","last_clean":"2024-09-14T11:59:18.038533+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:59:18.038533+0000","last_undegraded":"2024-09-14T11:59:18.038533+0000","last_fullsized":"2024-09-14T11:59:18.038533+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-14T11:59:18.038350+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-14T11:59:18.038350+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.038350+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.051109+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'813","reported_seq":2440,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.969645+0000","last_change":"2024-09-14T11:59:25.969585+0000","last_active":"2024-09-14T11:59:25.969645+0000","last_peered":"2024-09-14T11:59:25.969645+0000","last_clean":"2024-09-14T11:59:25.969645+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:59:25.969645+0000","last_undegraded":"2024-09-14T11:59:25.969645+0000","last_fullsized":"2024-09-14T11:59:25.969645+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'813","last_scrub_stamp":"2024-09-14T11:59:25.969495+0000","last_deep_scrub":"262'813","last_deep_scrub_stamp":"2024-09-14T11:59:25.969495+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.969495+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:30.507066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'287","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.424508+0000","last_change":"2024-09-14T11:59:26.424508+0000","last_active":"2024-09-14T11:59:26.424508+0000","last_peered":"2024-09-14T11:59:26.424508+0000","last_clean":"2024-09-14T11:59:26.424508+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:59:26.424508+0000","last_undegraded":"2024-09-14T11:59:26.424508+0000","last_fullsized":"2024-09-14T11:59:26.424508+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'287","last_scrub_stamp":"2024-09-14T11:59:26.424403+0000","last_deep_scrub":"262'287","last_deep_scrub_stamp":"2024-09-14T11:59:26.424403+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.424403+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:31.538298+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'405","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.182110+0000","last_change":"2024-09-14T11:58:59.182039+0000","last_active":"2024-09-14T11:58:59.182110+0000","last_peered":"2024-09-14T11:58:59.182110+0000","last_clean":"2024-09-14T11:58:59.182110+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:58:59.182110+0000","last_undegraded":"2024-09-14T11:58:59.182110+0000","last_fullsized":"2024-09-14T11:58:59.182110+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.181953+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:02.301110+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'220","reported_seq":847,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.306793+0000","last_change":"2024-09-14T11:58:53.306687+0000","last_active":"2024-09-14T11:58:53.306793+0000","last_peered":"2024-09-14T11:58:53.306793+0000","last_clean":"2024-09-14T11:58:53.306793+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:58:53.306793+0000","last_undegraded":"2024-09-14T11:58:53.306793+0000","last_fullsized":"2024-09-14T11:58:53.306793+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.306580+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.561679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":11363,"num_write":1017,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.267522+0000","last_change":"2024-09-14T11:58:55.267522+0000","last_active":"2024-09-14T11:58:55.267522+0000","last_peered":"2024-09-14T11:58:55.267522+0000","last_clean":"2024-09-14T11:58:55.267522+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:58:55.267522+0000","last_undegraded":"2024-09-14T11:58:55.267522+0000","last_fullsized":"2024-09-14T11:58:55.267522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.267441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:53.067234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.911455+0000","last_change":"2024-09-14T11:59:13.911455+0000","last_active":"2024-09-14T11:59:13.911455+0000","last_peered":"2024-09-14T11:59:13.911455+0000","last_clean":"2024-09-14T11:59:13.911455+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:59:13.911455+0000","last_undegraded":"2024-09-14T11:59:13.911455+0000","last_fullsized":"2024-09-14T11:59:13.911455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.911349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.911349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.911349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:57.497967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'312","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.958336+0000","last_change":"2024-09-14T11:59:15.958245+0000","last_active":"2024-09-14T11:59:15.958336+0000","last_peered":"2024-09-14T11:59:15.958336+0000","last_clean":"2024-09-14T11:59:15.958336+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:59:15.958336+0000","last_undegraded":"2024-09-14T11:59:15.958336+0000","last_fullsized":"2024-09-14T11:59:15.958336+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'312","last_scrub_stamp":"2024-09-14T11:59:15.958147+0000","last_deep_scrub":"262'312","last_deep_scrub_stamp":"2024-09-14T11:59:15.958147+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.958147+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:20.078226+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":677,"num_write":230,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.940845+0000","last_change":"2024-09-14T11:59:26.940781+0000","last_active":"2024-09-14T11:59:26.940845+0000","last_peered":"2024-09-14T11:59:26.940845+0000","last_clean":"2024-09-14T11:59:26.940845+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:59:26.940845+0000","last_undegraded":"2024-09-14T11:59:26.940845+0000","last_fullsized":"2024-09-14T11:59:26.940845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:26.940679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:26.940679+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.940679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:03.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'138","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.818284+0000","last_change":"2024-09-14T11:59:26.818284+0000","last_active":"2024-09-14T11:59:26.818284+0000","last_peered":"2024-09-14T11:59:26.818284+0000","last_clean":"2024-09-14T11:59:26.818284+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:59:26.818284+0000","last_undegraded":"2024-09-14T11:59:26.818284+0000","last_fullsized":"2024-09-14T11:59:26.818284+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'138","last_scrub_stamp":"2024-09-14T11:59:26.818190+0000","last_deep_scrub":"262'138","last_deep_scrub_stamp":"2024-09-14T11:59:26.818190+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.818190+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:40.337971+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'147","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.573600+0000","last_change":"2024-09-14T11:59:30.573600+0000","last_active":"2024-09-14T11:59:30.573600+0000","last_peered":"2024-09-14T11:59:30.573600+0000","last_clean":"2024-09-14T11:59:30.573600+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:59:30.573600+0000","last_undegraded":"2024-09-14T11:59:30.573600+0000","last_fullsized":"2024-09-14T11:59:30.573600+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-14T11:59:30.573508+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-14T11:59:30.573508+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.573508+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:59.632163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'566","reported_seq":2436,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.169611+0000","last_change":"2024-09-14T11:59:04.169611+0000","last_active":"2024-09-14T11:59:04.169611+0000","last_peered":"2024-09-14T11:59:04.169611+0000","last_clean":"2024-09-14T11:59:04.169611+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:59:04.169611+0000","last_undegraded":"2024-09-14T11:59:04.169611+0000","last_fullsized":"2024-09-14T11:59:04.169611+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'566","last_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_deep_scrub":"262'566","last_deep_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.169517+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:42.390726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'204","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.091134+0000","last_change":"2024-09-14T11:58:57.091134+0000","last_active":"2024-09-14T11:58:57.091134+0000","last_peered":"2024-09-14T11:58:57.091134+0000","last_clean":"2024-09-14T11:58:57.091134+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:58:57.091134+0000","last_undegraded":"2024-09-14T11:58:57.091134+0000","last_fullsized":"2024-09-14T11:58:57.091134+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.091049+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:22.628478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":19870,"num_write":904,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.621484+0000","last_change":"2024-09-14T11:59:09.621484+0000","last_active":"2024-09-14T11:59:09.621484+0000","last_peered":"2024-09-14T11:59:09.621484+0000","last_clean":"2024-09-14T11:59:09.621484+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:59:09.621484+0000","last_undegraded":"2024-09-14T11:59:09.621484+0000","last_fullsized":"2024-09-14T11:59:09.621484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.621385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:21.637776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'162","reported_seq":737,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.015768+0000","last_change":"2024-09-14T11:59:21.015768+0000","last_active":"2024-09-14T11:59:21.015768+0000","last_peered":"2024-09-14T11:59:21.015768+0000","last_clean":"2024-09-14T11:59:21.015768+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:59:21.015768+0000","last_undegraded":"2024-09-14T11:59:21.015768+0000","last_fullsized":"2024-09-14T11:59:21.015768+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-14T11:59:21.015653+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-14T11:59:21.015653+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.015653+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:32.632601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":267,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.981394+0000","last_change":"2024-09-14T11:59:28.981394+0000","last_active":"2024-09-14T11:59:28.981394+0000","last_peered":"2024-09-14T11:59:28.981394+0000","last_clean":"2024-09-14T11:59:28.981394+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:59:28.981394+0000","last_undegraded":"2024-09-14T11:59:28.981394+0000","last_fullsized":"2024-09-14T11:59:28.981394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:28.981308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:28.981308+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.981308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:52.423936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.002060+0000","last_change":"2024-09-14T11:15:42.351873+0000","last_active":"2024-09-14T11:56:57.002060+0000","last_peered":"2024-09-14T11:56:57.002060+0000","last_clean":"2024-09-14T11:56:57.002060+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:56:57.002060+0000","last_undegraded":"2024-09-14T11:56:57.002060+0000","last_fullsized":"2024-09-14T11:56:57.002060+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.030349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1372","reported_seq":3015,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.656353+0000","last_change":"2024-09-14T11:59:06.656353+0000","last_active":"2024-09-14T11:59:06.656353+0000","last_peered":"2024-09-14T11:59:06.656353+0000","last_clean":"2024-09-14T11:59:06.656353+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:59:06.656353+0000","last_undegraded":"2024-09-14T11:59:06.656353+0000","last_fullsized":"2024-09-14T11:59:06.656353+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1372","last_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_deep_scrub":"262'1372","last_deep_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.656260+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":1300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:59.071627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'177","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.826463+0000","last_change":"2024-09-14T11:59:02.826361+0000","last_active":"2024-09-14T11:59:02.826463+0000","last_peered":"2024-09-14T11:59:02.826463+0000","last_clean":"2024-09-14T11:59:02.826463+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:59:02.826463+0000","last_undegraded":"2024-09-14T11:59:02.826463+0000","last_fullsized":"2024-09-14T11:59:02.826463+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.826225+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:54.230672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":363,"num_read_kb":34037,"num_write":744,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.913452+0000","last_change":"2024-09-14T11:59:16.913452+0000","last_active":"2024-09-14T11:59:16.913452+0000","last_peered":"2024-09-14T11:59:16.913452+0000","last_clean":"2024-09-14T11:59:16.913452+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:59:16.913452+0000","last_undegraded":"2024-09-14T11:59:16.913452+0000","last_fullsized":"2024-09-14T11:59:16.913452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.913365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.913365+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.913365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:59.099290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'46","reported_seq":545,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.402834+0000","last_change":"2024-09-14T11:59:16.402834+0000","last_active":"2024-09-14T11:59:16.402834+0000","last_peered":"2024-09-14T11:59:16.402834+0000","last_clean":"2024-09-14T11:59:16.402834+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:59:16.402834+0000","last_undegraded":"2024-09-14T11:59:16.402834+0000","last_fullsized":"2024-09-14T11:59:16.402834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-14T11:59:16.402762+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-14T11:59:16.402762+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.402762+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:11.461190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.050407+0000","last_change":"2024-09-14T11:59:23.050407+0000","last_active":"2024-09-14T11:59:23.050407+0000","last_peered":"2024-09-14T11:59:23.050407+0000","last_clean":"2024-09-14T11:59:23.050407+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:59:23.050407+0000","last_undegraded":"2024-09-14T11:59:23.050407+0000","last_fullsized":"2024-09-14T11:59:23.050407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.050311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.050311+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.050311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:36.878476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'217","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.543879+0000","last_change":"2024-09-14T11:59:29.543879+0000","last_active":"2024-09-14T11:59:29.543879+0000","last_peered":"2024-09-14T11:59:29.543879+0000","last_clean":"2024-09-14T11:59:29.543879+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:59:29.543879+0000","last_undegraded":"2024-09-14T11:59:29.543879+0000","last_fullsized":"2024-09-14T11:59:29.543879+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:29.543784+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:29.543784+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.543784+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:15.150493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'457","reported_seq":1999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.857852+0000","last_change":"2024-09-14T11:59:03.857852+0000","last_active":"2024-09-14T11:59:03.857852+0000","last_peered":"2024-09-14T11:59:03.857852+0000","last_clean":"2024-09-14T11:59:03.857852+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:59:03.857852+0000","last_undegraded":"2024-09-14T11:59:03.857852+0000","last_fullsized":"2024-09-14T11:59:03.857852+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.857750+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:10.626306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'357","reported_seq":1009,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.206298+0000","last_change":"2024-09-14T11:59:23.206298+0000","last_active":"2024-09-14T11:59:23.206298+0000","last_peered":"2024-09-14T11:59:23.206298+0000","last_clean":"2024-09-14T11:59:23.206298+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:59:23.206298+0000","last_undegraded":"2024-09-14T11:59:23.206298+0000","last_fullsized":"2024-09-14T11:59:23.206298+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'357","last_scrub_stamp":"2024-09-14T11:59:23.206216+0000","last_deep_scrub":"262'357","last_deep_scrub_stamp":"2024-09-14T11:59:23.206216+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.206216+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:29.712357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":986,"num_read_kb":18905,"num_write":1307,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.991490+0000","last_change":"2024-09-14T11:59:14.991490+0000","last_active":"2024-09-14T11:59:14.991490+0000","last_peered":"2024-09-14T11:59:14.991490+0000","last_clean":"2024-09-14T11:59:14.991490+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:59:14.991490+0000","last_undegraded":"2024-09-14T11:59:14.991490+0000","last_fullsized":"2024-09-14T11:59:14.991490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.991406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.991406+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.991406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.178425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'164","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.010383+0000","last_change":"2024-09-14T11:59:23.010383+0000","last_active":"2024-09-14T11:59:23.010383+0000","last_peered":"2024-09-14T11:59:23.010383+0000","last_clean":"2024-09-14T11:59:23.010383+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:59:23.010383+0000","last_undegraded":"2024-09-14T11:59:23.010383+0000","last_fullsized":"2024-09-14T11:59:23.010383+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'164","last_scrub_stamp":"2024-09-14T11:59:23.010289+0000","last_deep_scrub":"262'164","last_deep_scrub_stamp":"2024-09-14T11:59:23.010289+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.010289+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:06.750831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":270,"num_write":114,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.138330+0000","last_change":"2024-09-14T11:59:14.138330+0000","last_active":"2024-09-14T11:59:14.138330+0000","last_peered":"2024-09-14T11:59:14.138330+0000","last_clean":"2024-09-14T11:59:14.138330+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:59:14.138330+0000","last_undegraded":"2024-09-14T11:59:14.138330+0000","last_fullsized":"2024-09-14T11:59:14.138330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.138251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.138251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.138251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:56.076443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'117","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.929825+0000","last_change":"2024-09-14T11:59:29.929825+0000","last_active":"2024-09-14T11:59:29.929825+0000","last_peered":"2024-09-14T11:59:29.929825+0000","last_clean":"2024-09-14T11:59:29.929825+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:59:29.929825+0000","last_undegraded":"2024-09-14T11:59:29.929825+0000","last_fullsized":"2024-09-14T11:59:29.929825+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-14T11:59:29.929714+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-14T11:59:29.929714+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.929714+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:47.615152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'812","reported_seq":2490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.010369+0000","last_change":"2024-09-14T11:59:12.010369+0000","last_active":"2024-09-14T11:59:12.010369+0000","last_peered":"2024-09-14T11:59:12.010369+0000","last_clean":"2024-09-14T11:59:12.010369+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:59:12.010369+0000","last_undegraded":"2024-09-14T11:59:12.010369+0000","last_fullsized":"2024-09-14T11:59:12.010369+0000","mapping_epoch":26,"log_start":"262'801","ondisk_log_start":"262'801","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'812","last_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_deep_scrub":"262'812","last_deep_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.010264+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:55.948418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'266","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.277392+0000","last_change":"2024-09-14T11:58:55.277324+0000","last_active":"2024-09-14T11:58:55.277392+0000","last_peered":"2024-09-14T11:58:55.277392+0000","last_clean":"2024-09-14T11:58:55.277392+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:58:55.277392+0000","last_undegraded":"2024-09-14T11:58:55.277392+0000","last_fullsized":"2024-09-14T11:58:55.277392+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'266","last_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_deep_scrub":"262'266","last_deep_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.277222+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:42.232250+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730159,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":14443,"num_write":1155,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.121731+0000","last_change":"2024-09-14T11:59:10.121731+0000","last_active":"2024-09-14T11:59:10.121731+0000","last_peered":"2024-09-14T11:59:10.121731+0000","last_clean":"2024-09-14T11:59:10.121731+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:59:10.121731+0000","last_undegraded":"2024-09-14T11:59:10.121731+0000","last_fullsized":"2024-09-14T11:59:10.121731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.121629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:35.666450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'140","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.942378+0000","last_change":"2024-09-14T11:59:19.942378+0000","last_active":"2024-09-14T11:59:19.942378+0000","last_peered":"2024-09-14T11:59:19.942378+0000","last_clean":"2024-09-14T11:59:19.942378+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:59:19.942378+0000","last_undegraded":"2024-09-14T11:59:19.942378+0000","last_fullsized":"2024-09-14T11:59:19.942378+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:19.942291+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:19.942291+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.942291+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:17.318683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44743,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":353,"num_write":106,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.437817+0000","last_change":"2024-09-14T11:59:23.437817+0000","last_active":"2024-09-14T11:59:23.437817+0000","last_peered":"2024-09-14T11:59:23.437817+0000","last_clean":"2024-09-14T11:59:23.437817+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:59:23.437817+0000","last_undegraded":"2024-09-14T11:59:23.437817+0000","last_fullsized":"2024-09-14T11:59:23.437817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.437727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.437727+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.437727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:36.382250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'852","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.204861+0000","last_change":"2024-09-14T11:59:05.204800+0000","last_active":"2024-09-14T11:59:05.204861+0000","last_peered":"2024-09-14T11:59:05.204861+0000","last_clean":"2024-09-14T11:59:05.204861+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:59:05.204861+0000","last_undegraded":"2024-09-14T11:59:05.204861+0000","last_fullsized":"2024-09-14T11:59:05.204861+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.204698+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:33.564491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'204","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.874744+0000","last_change":"2024-09-14T11:58:57.874630+0000","last_active":"2024-09-14T11:58:57.874744+0000","last_peered":"2024-09-14T11:58:57.874744+0000","last_clean":"2024-09-14T11:58:57.874744+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:58:57.874744+0000","last_undegraded":"2024-09-14T11:58:57.874744+0000","last_fullsized":"2024-09-14T11:58:57.874744+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.874491+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:32.927288+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":38166,"num_write":911,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.378224+0000","last_change":"2024-09-14T11:59:13.378224+0000","last_active":"2024-09-14T11:59:13.378224+0000","last_peered":"2024-09-14T11:59:13.378224+0000","last_clean":"2024-09-14T11:59:13.378224+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:59:13.378224+0000","last_undegraded":"2024-09-14T11:59:13.378224+0000","last_fullsized":"2024-09-14T11:59:13.378224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.378137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:53.165338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'203","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.597243+0000","last_change":"2024-09-14T11:59:14.597243+0000","last_active":"2024-09-14T11:59:14.597243+0000","last_peered":"2024-09-14T11:59:14.597243+0000","last_clean":"2024-09-14T11:59:14.597243+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:59:14.597243+0000","last_undegraded":"2024-09-14T11:59:14.597243+0000","last_fullsized":"2024-09-14T11:59:14.597243+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-14T11:59:14.597139+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-14T11:59:14.597139+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.597139+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:21.520459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14688,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":397,"num_write":180,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.884004+0000","last_change":"2024-09-14T11:59:23.884004+0000","last_active":"2024-09-14T11:59:23.884004+0000","last_peered":"2024-09-14T11:59:23.884004+0000","last_clean":"2024-09-14T11:59:23.884004+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:59:23.884004+0000","last_undegraded":"2024-09-14T11:59:23.884004+0000","last_fullsized":"2024-09-14T11:59:23.884004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.883920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.883920+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.883920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:02.477946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'159","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:59.879691+0000","last_change":"2024-09-14T11:15:42.352372+0000","last_active":"2024-09-14T11:55:59.879691+0000","last_peered":"2024-09-14T11:55:59.879691+0000","last_clean":"2024-09-14T11:55:59.879691+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:55:59.879691+0000","last_undegraded":"2024-09-14T11:55:59.879691+0000","last_fullsized":"2024-09-14T11:55:59.879691+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:41.330688+0000","last_clean_scrub_stamp":"2024-09-14T11:15:41.330688+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:49.615891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":2004,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.337559+0000","last_change":"2024-09-14T11:59:06.337559+0000","last_active":"2024-09-14T11:59:06.337559+0000","last_peered":"2024-09-14T11:59:06.337559+0000","last_clean":"2024-09-14T11:59:06.337559+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:59:06.337559+0000","last_undegraded":"2024-09-14T11:59:06.337559+0000","last_fullsized":"2024-09-14T11:59:06.337559+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'451","last_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_deep_scrub":"262'451","last_deep_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.337474+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:21.970696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'228","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.646609+0000","last_change":"2024-09-14T11:58:56.646544+0000","last_active":"2024-09-14T11:58:56.646609+0000","last_peered":"2024-09-14T11:58:56.646609+0000","last_clean":"2024-09-14T11:58:56.646609+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:58:56.646609+0000","last_undegraded":"2024-09-14T11:58:56.646609+0000","last_fullsized":"2024-09-14T11:58:56.646609+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'228","last_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_deep_scrub":"262'228","last_deep_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.646441+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:26.476328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":613,"num_read_kb":11802,"num_write":1015,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.110861+0000","last_change":"2024-09-14T11:59:09.110795+0000","last_active":"2024-09-14T11:59:09.110861+0000","last_peered":"2024-09-14T11:59:09.110861+0000","last_clean":"2024-09-14T11:59:09.110861+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:59:09.110861+0000","last_undegraded":"2024-09-14T11:59:09.110861+0000","last_fullsized":"2024-09-14T11:59:09.110861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.110702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.995238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'165","reported_seq":744,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.021469+0000","last_change":"2024-09-14T11:59:22.021469+0000","last_active":"2024-09-14T11:59:22.021469+0000","last_peered":"2024-09-14T11:59:22.021469+0000","last_clean":"2024-09-14T11:59:22.021469+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:59:22.021469+0000","last_undegraded":"2024-09-14T11:59:22.021469+0000","last_fullsized":"2024-09-14T11:59:22.021469+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-14T11:59:22.021375+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-14T11:59:22.021375+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.021375+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:46.273089+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":272,"num_write":132,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.584120+0000","last_change":"2024-09-14T11:59:16.584120+0000","last_active":"2024-09-14T11:59:16.584120+0000","last_peered":"2024-09-14T11:59:16.584120+0000","last_clean":"2024-09-14T11:59:16.584120+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:59:16.584120+0000","last_undegraded":"2024-09-14T11:59:16.584120+0000","last_fullsized":"2024-09-14T11:59:16.584120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.584048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.584048+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.584048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:32.202317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'263","reported_seq":1134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.058263+0000","last_change":"2024-09-14T11:59:19.058263+0000","last_active":"2024-09-14T11:59:19.058263+0000","last_peered":"2024-09-14T11:59:19.058263+0000","last_clean":"2024-09-14T11:59:19.058263+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:59:19.058263+0000","last_undegraded":"2024-09-14T11:59:19.058263+0000","last_fullsized":"2024-09-14T11:59:19.058263+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-14T11:59:19.058169+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-14T11:59:19.058169+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.058169+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:10.548056+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'852","reported_seq":2428,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.986861+0000","last_change":"2024-09-14T11:59:07.986861+0000","last_active":"2024-09-14T11:59:07.986861+0000","last_peered":"2024-09-14T11:59:07.986861+0000","last_clean":"2024-09-14T11:59:07.986861+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:59:07.986861+0000","last_undegraded":"2024-09-14T11:59:07.986861+0000","last_fullsized":"2024-09-14T11:59:07.986861+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.986754+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:08.810573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'197","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.093051+0000","last_change":"2024-09-14T11:58:56.093051+0000","last_active":"2024-09-14T11:58:56.093051+0000","last_peered":"2024-09-14T11:58:56.093051+0000","last_clean":"2024-09-14T11:58:56.093051+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:58:56.093051+0000","last_undegraded":"2024-09-14T11:58:56.093051+0000","last_fullsized":"2024-09-14T11:58:56.093051+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.092935+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.174953+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.987803+0000","last_change":"2024-09-14T11:59:24.987803+0000","last_active":"2024-09-14T11:59:24.987803+0000","last_peered":"2024-09-14T11:59:24.987803+0000","last_clean":"2024-09-14T11:59:24.987803+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:59:24.987803+0000","last_undegraded":"2024-09-14T11:59:24.987803+0000","last_fullsized":"2024-09-14T11:59:24.987803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.987710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.987710+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.987710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:45.341975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'136","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.019921+0000","last_change":"2024-09-14T11:59:25.019921+0000","last_active":"2024-09-14T11:59:25.019921+0000","last_peered":"2024-09-14T11:59:25.019921+0000","last_clean":"2024-09-14T11:59:25.019921+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:59:25.019921+0000","last_undegraded":"2024-09-14T11:59:25.019921+0000","last_fullsized":"2024-09-14T11:59:25.019921+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'136","last_scrub_stamp":"2024-09-14T11:59:25.019830+0000","last_deep_scrub":"262'136","last_deep_scrub_stamp":"2024-09-14T11:59:25.019830+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.019830+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:22.545522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":266,"num_write":100,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.537358+0000","last_change":"2024-09-14T11:59:17.537358+0000","last_active":"2024-09-14T11:59:17.537358+0000","last_peered":"2024-09-14T11:59:17.537358+0000","last_clean":"2024-09-14T11:59:17.537358+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:59:17.537358+0000","last_undegraded":"2024-09-14T11:59:17.537358+0000","last_fullsized":"2024-09-14T11:59:17.537358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.537163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.537163+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.537163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:38.017897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'148","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.841819+0000","last_change":"2024-09-14T11:59:27.841819+0000","last_active":"2024-09-14T11:59:27.841819+0000","last_peered":"2024-09-14T11:59:27.841819+0000","last_clean":"2024-09-14T11:59:27.841819+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:59:27.841819+0000","last_undegraded":"2024-09-14T11:59:27.841819+0000","last_fullsized":"2024-09-14T11:59:27.841819+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-14T11:59:27.841705+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-14T11:59:27.841705+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.841705+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:58.669872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'428","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.288212+0000","last_change":"2024-09-14T11:58:57.288212+0000","last_active":"2024-09-14T11:58:57.288212+0000","last_peered":"2024-09-14T11:58:57.288212+0000","last_clean":"2024-09-14T11:58:57.288212+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:57.288212+0000","last_undegraded":"2024-09-14T11:58:57.288212+0000","last_fullsized":"2024-09-14T11:58:57.288212+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'428","last_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_deep_scrub":"262'428","last_deep_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.288124+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:39.134746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'224","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.269287+0000","last_change":"2024-09-14T11:58:56.269287+0000","last_active":"2024-09-14T11:58:56.269287+0000","last_peered":"2024-09-14T11:58:56.269287+0000","last_clean":"2024-09-14T11:58:56.269287+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:58:56.269287+0000","last_undegraded":"2024-09-14T11:58:56.269287+0000","last_fullsized":"2024-09-14T11:58:56.269287+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'224","last_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_deep_scrub":"262'224","last_deep_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.269178+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.507042+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":12620,"num_write":955,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.640793+0000","last_change":"2024-09-14T11:59:11.640793+0000","last_active":"2024-09-14T11:59:11.640793+0000","last_peered":"2024-09-14T11:59:11.640793+0000","last_clean":"2024-09-14T11:59:11.640793+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:59:11.640793+0000","last_undegraded":"2024-09-14T11:59:11.640793+0000","last_fullsized":"2024-09-14T11:59:11.640793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.640690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.640690+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.640690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:43.026373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'105","reported_seq":625,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.046732+0000","last_change":"2024-09-14T11:59:22.046732+0000","last_active":"2024-09-14T11:59:22.046732+0000","last_peered":"2024-09-14T11:59:22.046732+0000","last_clean":"2024-09-14T11:59:22.046732+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:59:22.046732+0000","last_undegraded":"2024-09-14T11:59:22.046732+0000","last_fullsized":"2024-09-14T11:59:22.046732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'105","last_scrub_stamp":"2024-09-14T11:59:22.046632+0000","last_deep_scrub":"262'105","last_deep_scrub_stamp":"2024-09-14T11:59:22.046632+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.046632+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:39.768126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'769","reported_seq":2189,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.053730+0000","last_change":"2024-09-14T11:59:17.053667+0000","last_active":"2024-09-14T11:59:17.053730+0000","last_peered":"2024-09-14T11:59:17.053730+0000","last_clean":"2024-09-14T11:59:17.053730+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:59:17.053730+0000","last_undegraded":"2024-09-14T11:59:17.053730+0000","last_fullsized":"2024-09-14T11:59:17.053730+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'769","last_scrub_stamp":"2024-09-14T11:59:17.053591+0000","last_deep_scrub":"262'769","last_deep_scrub_stamp":"2024-09-14T11:59:17.053591+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.053591+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:45.573158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":612,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.047452+0000","last_change":"2024-09-14T11:59:26.047452+0000","last_active":"2024-09-14T11:59:26.047452+0000","last_peered":"2024-09-14T11:59:26.047452+0000","last_clean":"2024-09-14T11:59:26.047452+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:59:26.047452+0000","last_undegraded":"2024-09-14T11:59:26.047452+0000","last_fullsized":"2024-09-14T11:59:26.047452+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-14T11:59:26.047364+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-14T11:59:26.047364+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.047364+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:04.775167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'895","reported_seq":2475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.225811+0000","last_change":"2024-09-14T11:59:07.225811+0000","last_active":"2024-09-14T11:59:07.225811+0000","last_peered":"2024-09-14T11:59:07.225811+0000","last_clean":"2024-09-14T11:59:07.225811+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:59:07.225811+0000","last_undegraded":"2024-09-14T11:59:07.225811+0000","last_fullsized":"2024-09-14T11:59:07.225811+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'895","last_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_deep_scrub":"262'895","last_deep_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.225717+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:52.394209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'218","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.793958+0000","last_change":"2024-09-14T11:58:57.793958+0000","last_active":"2024-09-14T11:58:57.793958+0000","last_peered":"2024-09-14T11:58:57.793958+0000","last_clean":"2024-09-14T11:58:57.793958+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:58:57.793958+0000","last_undegraded":"2024-09-14T11:58:57.793958+0000","last_fullsized":"2024-09-14T11:58:57.793958+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.793829+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:47.418639+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":930,"num_read_kb":28634,"num_write":971,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.937493+0000","last_change":"2024-09-14T11:59:16.937493+0000","last_active":"2024-09-14T11:59:16.937493+0000","last_peered":"2024-09-14T11:59:16.937493+0000","last_clean":"2024-09-14T11:59:16.937493+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:59:16.937493+0000","last_undegraded":"2024-09-14T11:59:16.937493+0000","last_fullsized":"2024-09-14T11:59:16.937493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.937391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.937391+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.937391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:57.487607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'163","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.844530+0000","last_change":"2024-09-14T11:59:22.844530+0000","last_active":"2024-09-14T11:59:22.844530+0000","last_peered":"2024-09-14T11:59:22.844530+0000","last_clean":"2024-09-14T11:59:22.844530+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:59:22.844530+0000","last_undegraded":"2024-09-14T11:59:22.844530+0000","last_fullsized":"2024-09-14T11:59:22.844530+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'163","last_scrub_stamp":"2024-09-14T11:59:22.844408+0000","last_deep_scrub":"262'163","last_deep_scrub_stamp":"2024-09-14T11:59:22.844408+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.844408+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.099842+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7170,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":208,"num_read_kb":287,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.475465+0000","last_change":"2024-09-14T11:59:24.475465+0000","last_active":"2024-09-14T11:59:24.475465+0000","last_peered":"2024-09-14T11:59:24.475465+0000","last_clean":"2024-09-14T11:59:24.475465+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:59:24.475465+0000","last_undegraded":"2024-09-14T11:59:24.475465+0000","last_fullsized":"2024-09-14T11:59:24.475465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.475369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.475369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.475369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:08.026060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'107","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.067092+0000","last_change":"2024-09-14T11:59:29.067092+0000","last_active":"2024-09-14T11:59:29.067092+0000","last_peered":"2024-09-14T11:59:29.067092+0000","last_clean":"2024-09-14T11:59:29.067092+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:59:29.067092+0000","last_undegraded":"2024-09-14T11:59:29.067092+0000","last_fullsized":"2024-09-14T11:59:29.067092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'107","last_scrub_stamp":"2024-09-14T11:59:29.066989+0000","last_deep_scrub":"262'107","last_deep_scrub_stamp":"2024-09-14T11:59:29.066989+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.066989+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:05.501581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'660","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.203014+0000","last_change":"2024-09-14T11:59:06.203014+0000","last_active":"2024-09-14T11:59:06.203014+0000","last_peered":"2024-09-14T11:59:06.203014+0000","last_clean":"2024-09-14T11:59:06.203014+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:59:06.203014+0000","last_undegraded":"2024-09-14T11:59:06.203014+0000","last_fullsized":"2024-09-14T11:59:06.203014+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'660","last_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_deep_scrub":"262'660","last_deep_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.202929+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:52.793955+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3256,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'201","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.792801+0000","last_change":"2024-09-14T11:58:59.792801+0000","last_active":"2024-09-14T11:58:59.792801+0000","last_peered":"2024-09-14T11:58:59.792801+0000","last_clean":"2024-09-14T11:58:59.792801+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:58:59.792801+0000","last_undegraded":"2024-09-14T11:58:59.792801+0000","last_fullsized":"2024-09-14T11:58:59.792801+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.792678+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:48.220393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":24057,"num_write":879,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.753252+0000","last_change":"2024-09-14T11:59:17.753252+0000","last_active":"2024-09-14T11:59:17.753252+0000","last_peered":"2024-09-14T11:59:17.753252+0000","last_clean":"2024-09-14T11:59:17.753252+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:59:17.753252+0000","last_undegraded":"2024-09-14T11:59:17.753252+0000","last_fullsized":"2024-09-14T11:59:17.753252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.753121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.753121+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.753121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:23.129023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'151","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.396500+0000","last_change":"2024-09-14T11:59:18.396500+0000","last_active":"2024-09-14T11:59:18.396500+0000","last_peered":"2024-09-14T11:59:18.396500+0000","last_clean":"2024-09-14T11:59:18.396500+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:59:18.396500+0000","last_undegraded":"2024-09-14T11:59:18.396500+0000","last_fullsized":"2024-09-14T11:59:18.396500+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'151","last_scrub_stamp":"2024-09-14T11:59:18.396392+0000","last_deep_scrub":"262'151","last_deep_scrub_stamp":"2024-09-14T11:59:18.396392+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.396392+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:50.867281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":267,"num_write":100,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.094453+0000","last_change":"2024-09-14T11:59:15.094399+0000","last_active":"2024-09-14T11:59:15.094453+0000","last_peered":"2024-09-14T11:59:15.094453+0000","last_clean":"2024-09-14T11:59:15.094453+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:59:15.094453+0000","last_undegraded":"2024-09-14T11:59:15.094453+0000","last_fullsized":"2024-09-14T11:59:15.094453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.094317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.094317+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.094317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:47.776493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'142","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.012932+0000","last_change":"2024-09-14T11:59:33.012932+0000","last_active":"2024-09-14T11:59:33.012932+0000","last_peered":"2024-09-14T11:59:33.012932+0000","last_clean":"2024-09-14T11:59:33.012932+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:59:33.012932+0000","last_undegraded":"2024-09-14T11:59:33.012932+0000","last_fullsized":"2024-09-14T11:59:33.012932+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-14T11:59:33.012838+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-14T11:59:33.012838+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.012838+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:43.338371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'748","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.939963+0000","last_change":"2024-09-14T11:59:05.939875+0000","last_active":"2024-09-14T11:59:05.939963+0000","last_peered":"2024-09-14T11:59:05.939963+0000","last_clean":"2024-09-14T11:59:05.939963+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:59:05.939963+0000","last_undegraded":"2024-09-14T11:59:05.939963+0000","last_fullsized":"2024-09-14T11:59:05.939963+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'748","last_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_deep_scrub":"262'748","last_deep_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.939748+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:27.001770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'247","reported_seq":1006,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.848888+0000","last_change":"2024-09-14T11:58:58.848888+0000","last_active":"2024-09-14T11:58:58.848888+0000","last_peered":"2024-09-14T11:58:58.848888+0000","last_clean":"2024-09-14T11:58:58.848888+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:58:58.848888+0000","last_undegraded":"2024-09-14T11:58:58.848888+0000","last_fullsized":"2024-09-14T11:58:58.848888+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.848767+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.657561+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":149417,"num_write":1050,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.027336+0000","last_change":"2024-09-14T11:59:17.027336+0000","last_active":"2024-09-14T11:59:17.027336+0000","last_peered":"2024-09-14T11:59:17.027336+0000","last_clean":"2024-09-14T11:59:17.027336+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:59:17.027336+0000","last_undegraded":"2024-09-14T11:59:17.027336+0000","last_fullsized":"2024-09-14T11:59:17.027336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.027224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.027224+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.027224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:18.134951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'100","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.017978+0000","last_change":"2024-09-14T11:59:24.017978+0000","last_active":"2024-09-14T11:59:24.017978+0000","last_peered":"2024-09-14T11:59:24.017978+0000","last_clean":"2024-09-14T11:59:24.017978+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:59:24.017978+0000","last_undegraded":"2024-09-14T11:59:24.017978+0000","last_fullsized":"2024-09-14T11:59:24.017978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-14T11:59:24.017891+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-14T11:59:24.017891+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.017891+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:45.397131+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8817,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":183,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.982762+0000","last_change":"2024-09-14T11:59:25.982762+0000","last_active":"2024-09-14T11:59:25.982762+0000","last_peered":"2024-09-14T11:59:25.982762+0000","last_clean":"2024-09-14T11:59:25.982762+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:59:25.982762+0000","last_undegraded":"2024-09-14T11:59:25.982762+0000","last_fullsized":"2024-09-14T11:59:25.982762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.982662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.982662+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.982662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:16.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'157","reported_seq":1264,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.038615+0000","last_change":"2024-09-14T11:59:28.038615+0000","last_active":"2024-09-14T11:59:28.038615+0000","last_peered":"2024-09-14T11:59:28.038615+0000","last_clean":"2024-09-14T11:59:28.038615+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:59:28.038615+0000","last_undegraded":"2024-09-14T11:59:28.038615+0000","last_fullsized":"2024-09-14T11:59:28.038615+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'157","last_scrub_stamp":"2024-09-14T11:59:28.038525+0000","last_deep_scrub":"262'157","last_deep_scrub_stamp":"2024-09-14T11:59:28.038525+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.038525+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:28.806077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'448","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.209413+0000","last_change":"2024-09-14T11:59:05.209413+0000","last_active":"2024-09-14T11:59:05.209413+0000","last_peered":"2024-09-14T11:59:05.209413+0000","last_clean":"2024-09-14T11:59:05.209413+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:59:05.209413+0000","last_undegraded":"2024-09-14T11:59:05.209413+0000","last_fullsized":"2024-09-14T11:59:05.209413+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.209323+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.492011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'212","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.268719+0000","last_change":"2024-09-14T11:58:57.268656+0000","last_active":"2024-09-14T11:58:57.268719+0000","last_peered":"2024-09-14T11:58:57.268719+0000","last_clean":"2024-09-14T11:58:57.268719+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:58:57.268719+0000","last_undegraded":"2024-09-14T11:58:57.268719+0000","last_fullsized":"2024-09-14T11:58:57.268719+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.268554+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:41.545725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":36694,"num_write":987,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.609596+0000","last_change":"2024-09-14T11:59:10.609493+0000","last_active":"2024-09-14T11:59:10.609596+0000","last_peered":"2024-09-14T11:59:10.609596+0000","last_clean":"2024-09-14T11:59:10.609596+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:59:10.609596+0000","last_undegraded":"2024-09-14T11:59:10.609596+0000","last_fullsized":"2024-09-14T11:59:10.609596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.609353+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.175042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'153","reported_seq":735,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.009705+0000","last_change":"2024-09-14T11:59:21.009705+0000","last_active":"2024-09-14T11:59:21.009705+0000","last_peered":"2024-09-14T11:59:21.009705+0000","last_clean":"2024-09-14T11:59:21.009705+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:59:21.009705+0000","last_undegraded":"2024-09-14T11:59:21.009705+0000","last_fullsized":"2024-09-14T11:59:21.009705+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'153","last_scrub_stamp":"2024-09-14T11:59:21.009610+0000","last_deep_scrub":"262'153","last_deep_scrub_stamp":"2024-09-14T11:59:21.009610+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.009610+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:05.738105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":283,"num_write":116,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.464785+0000","last_change":"2024-09-14T11:59:25.464785+0000","last_active":"2024-09-14T11:59:25.464785+0000","last_peered":"2024-09-14T11:59:25.464785+0000","last_clean":"2024-09-14T11:59:25.464785+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:59:25.464785+0000","last_undegraded":"2024-09-14T11:59:25.464785+0000","last_fullsized":"2024-09-14T11:59:25.464785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.464686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.464686+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.464686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:35.385135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'96","reported_seq":581,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.005809+0000","last_change":"2024-09-14T11:59:28.005809+0000","last_active":"2024-09-14T11:59:28.005809+0000","last_peered":"2024-09-14T11:59:28.005809+0000","last_clean":"2024-09-14T11:59:28.005809+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:59:28.005809+0000","last_undegraded":"2024-09-14T11:59:28.005809+0000","last_fullsized":"2024-09-14T11:59:28.005809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'96","last_scrub_stamp":"2024-09-14T11:59:28.005725+0000","last_deep_scrub":"262'96","last_deep_scrub_stamp":"2024-09-14T11:59:28.005725+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.005725+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:05.667233+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'423","reported_seq":1881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.669190+0000","last_change":"2024-09-14T11:59:07.669190+0000","last_active":"2024-09-14T11:59:07.669190+0000","last_peered":"2024-09-14T11:59:07.669190+0000","last_clean":"2024-09-14T11:59:07.669190+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:59:07.669190+0000","last_undegraded":"2024-09-14T11:59:07.669190+0000","last_fullsized":"2024-09-14T11:59:07.669190+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'423","last_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_deep_scrub":"262'423","last_deep_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.669106+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:58.372550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.260315+0000","last_change":"2024-09-14T11:58:59.260260+0000","last_active":"2024-09-14T11:58:59.260315+0000","last_peered":"2024-09-14T11:58:59.260315+0000","last_clean":"2024-09-14T11:58:59.260315+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:58:59.260315+0000","last_undegraded":"2024-09-14T11:58:59.260315+0000","last_fullsized":"2024-09-14T11:58:59.260315+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.260175+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:36.438178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":66072,"num_write":894,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2356,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.610576+0000","last_change":"2024-09-14T11:59:05.610576+0000","last_active":"2024-09-14T11:59:05.610576+0000","last_peered":"2024-09-14T11:59:05.610576+0000","last_clean":"2024-09-14T11:59:05.610576+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:59:05.610576+0000","last_undegraded":"2024-09-14T11:59:05.610576+0000","last_fullsized":"2024-09-14T11:59:05.610576+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'841","last_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_deep_scrub":"262'841","last_deep_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.610487+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:37.527850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'213","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.279743+0000","last_change":"2024-09-14T11:58:56.279698+0000","last_active":"2024-09-14T11:58:56.279743+0000","last_peered":"2024-09-14T11:58:56.279743+0000","last_clean":"2024-09-14T11:58:56.279743+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:58:56.279743+0000","last_undegraded":"2024-09-14T11:58:56.279743+0000","last_fullsized":"2024-09-14T11:58:56.279743+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.279629+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:33.552917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":30107,"num_write":970,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'540","reported_seq":2215,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.796673+0000","last_change":"2024-09-14T11:59:13.796673+0000","last_active":"2024-09-14T11:59:13.796673+0000","last_peered":"2024-09-14T11:59:13.796673+0000","last_clean":"2024-09-14T11:59:13.796673+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:59:13.796673+0000","last_undegraded":"2024-09-14T11:59:13.796673+0000","last_fullsized":"2024-09-14T11:59:13.796673+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.796567+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.630324+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'185","reported_seq":774,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.767529+0000","last_change":"2024-09-14T11:58:58.767475+0000","last_active":"2024-09-14T11:58:58.767529+0000","last_peered":"2024-09-14T11:58:58.767529+0000","last_clean":"2024-09-14T11:58:58.767529+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:58:58.767529+0000","last_undegraded":"2024-09-14T11:58:58.767529+0000","last_fullsized":"2024-09-14T11:58:58.767529+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.767391+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:27.127746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":397,"num_read_kb":13678,"num_write":826,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'689","reported_seq":2137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.570572+0000","last_change":"2024-09-14T11:59:04.570572+0000","last_active":"2024-09-14T11:59:04.570572+0000","last_peered":"2024-09-14T11:59:04.570572+0000","last_clean":"2024-09-14T11:59:04.570572+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:59:04.570572+0000","last_undegraded":"2024-09-14T11:59:04.570572+0000","last_fullsized":"2024-09-14T11:59:04.570572+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'689","last_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_deep_scrub":"262'689","last_deep_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.570481+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":600,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:50.385676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'226","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.251393+0000","last_change":"2024-09-14T11:58:58.251319+0000","last_active":"2024-09-14T11:58:58.251393+0000","last_peered":"2024-09-14T11:58:58.251393+0000","last_clean":"2024-09-14T11:58:58.251393+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:58:58.251393+0000","last_undegraded":"2024-09-14T11:58:58.251393+0000","last_fullsized":"2024-09-14T11:58:58.251393+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.251228+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:43.426816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":673,"num_read_kb":8461,"num_write":1067,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'578","reported_seq":2184,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.873360+0000","last_change":"2024-09-14T11:59:14.873290+0000","last_active":"2024-09-14T11:59:14.873360+0000","last_peered":"2024-09-14T11:59:14.873360+0000","last_clean":"2024-09-14T11:59:14.873360+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:59:14.873360+0000","last_undegraded":"2024-09-14T11:59:14.873360+0000","last_fullsized":"2024-09-14T11:59:14.873360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'578","last_scrub_stamp":"2024-09-14T11:59:14.873200+0000","last_deep_scrub":"262'578","last_deep_scrub_stamp":"2024-09-14T11:59:14.873200+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.873200+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.941909+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'263","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.887387+0000","last_change":"2024-09-14T11:58:59.887387+0000","last_active":"2024-09-14T11:58:59.887387+0000","last_peered":"2024-09-14T11:58:59.887387+0000","last_clean":"2024-09-14T11:58:59.887387+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:58:59.887387+0000","last_undegraded":"2024-09-14T11:58:59.887387+0000","last_fullsized":"2024-09-14T11:58:59.887387+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.887284+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:57.682098+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":625,"num_read_kb":65552,"num_write":1161,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1211","reported_seq":2823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.196603+0000","last_change":"2024-09-14T11:59:10.196538+0000","last_active":"2024-09-14T11:59:10.196603+0000","last_peered":"2024-09-14T11:59:10.196603+0000","last_clean":"2024-09-14T11:59:10.196603+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:59:10.196603+0000","last_undegraded":"2024-09-14T11:59:10.196603+0000","last_fullsized":"2024-09-14T11:59:10.196603+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1211","last_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_deep_scrub":"262'1211","last_deep_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.196453+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":1100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:27.768853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'200","reported_seq":824,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.627940+0000","last_change":"2024-09-14T11:58:57.627940+0000","last_active":"2024-09-14T11:58:57.627940+0000","last_peered":"2024-09-14T11:58:57.627940+0000","last_clean":"2024-09-14T11:58:57.627940+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:58:57.627940+0000","last_undegraded":"2024-09-14T11:58:57.627940+0000","last_fullsized":"2024-09-14T11:58:57.627940+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.627846+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:24.951020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":515,"num_read_kb":18867,"num_write":899,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'490","reported_seq":2147,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.977350+0000","last_change":"2024-09-14T11:59:09.977291+0000","last_active":"2024-09-14T11:59:09.977350+0000","last_peered":"2024-09-14T11:59:09.977350+0000","last_clean":"2024-09-14T11:59:09.977350+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:59:09.977350+0000","last_undegraded":"2024-09-14T11:59:09.977350+0000","last_fullsized":"2024-09-14T11:59:09.977350+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'490","last_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_deep_scrub":"262'490","last_deep_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.977199+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.685268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'183","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.292435+0000","last_change":"2024-09-14T11:58:57.292435+0000","last_active":"2024-09-14T11:58:57.292435+0000","last_peered":"2024-09-14T11:58:57.292435+0000","last_clean":"2024-09-14T11:58:57.292435+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:58:57.292435+0000","last_undegraded":"2024-09-14T11:58:57.292435+0000","last_fullsized":"2024-09-14T11:58:57.292435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'183","last_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_deep_scrub":"262'183","last_deep_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.292341+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:17.394532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":3776,"num_write":815,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'443","reported_seq":1981,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.158496+0000","last_change":"2024-09-14T11:59:06.158439+0000","last_active":"2024-09-14T11:59:06.158496+0000","last_peered":"2024-09-14T11:59:06.158496+0000","last_clean":"2024-09-14T11:59:06.158496+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:59:06.158496+0000","last_undegraded":"2024-09-14T11:59:06.158496+0000","last_fullsized":"2024-09-14T11:59:06.158496+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'443","last_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_deep_scrub":"262'443","last_deep_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.158355+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:22.012200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'273","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.844697+0000","last_change":"2024-09-14T11:59:00.844697+0000","last_active":"2024-09-14T11:59:00.844697+0000","last_peered":"2024-09-14T11:59:00.844697+0000","last_clean":"2024-09-14T11:59:00.844697+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:59:00.844697+0000","last_undegraded":"2024-09-14T11:59:00.844697+0000","last_fullsized":"2024-09-14T11:59:00.844697+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'273","last_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_deep_scrub":"262'273","last_deep_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.844576+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:17.221784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":36414,"num_write":1104,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'493","reported_seq":2015,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.415356+0000","last_change":"2024-09-14T11:59:08.415356+0000","last_active":"2024-09-14T11:59:08.415356+0000","last_peered":"2024-09-14T11:59:08.415356+0000","last_clean":"2024-09-14T11:59:08.415356+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:59:08.415356+0000","last_undegraded":"2024-09-14T11:59:08.415356+0000","last_fullsized":"2024-09-14T11:59:08.415356+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.415265+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:13.317609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'284","reported_seq":939,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.837101+0000","last_change":"2024-09-14T11:59:00.836991+0000","last_active":"2024-09-14T11:59:00.837101+0000","last_peered":"2024-09-14T11:59:00.837101+0000","last_clean":"2024-09-14T11:59:00.837101+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:59:00.837101+0000","last_undegraded":"2024-09-14T11:59:00.837101+0000","last_fullsized":"2024-09-14T11:59:00.837101+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.836878+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:32.971543+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":728,"num_read_kb":57965,"num_write":1175,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'750","reported_seq":2331,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.237837+0000","last_change":"2024-09-14T11:59:09.237837+0000","last_active":"2024-09-14T11:59:09.237837+0000","last_peered":"2024-09-14T11:59:09.237837+0000","last_clean":"2024-09-14T11:59:09.237837+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:59:09.237837+0000","last_undegraded":"2024-09-14T11:59:09.237837+0000","last_fullsized":"2024-09-14T11:59:09.237837+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'750","last_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_deep_scrub":"262'750","last_deep_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.237718+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:11.504189+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'205","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.894568+0000","last_change":"2024-09-14T11:59:01.894568+0000","last_active":"2024-09-14T11:59:01.894568+0000","last_peered":"2024-09-14T11:59:01.894568+0000","last_clean":"2024-09-14T11:59:01.894568+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:59:01.894568+0000","last_undegraded":"2024-09-14T11:59:01.894568+0000","last_fullsized":"2024-09-14T11:59:01.894568+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.894440+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:58.772928+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":27346,"num_write":953,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.278891+0000","last_change":"2024-09-14T11:58:58.278891+0000","last_active":"2024-09-14T11:58:58.278891+0000","last_peered":"2024-09-14T11:58:58.278891+0000","last_clean":"2024-09-14T11:58:58.278891+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:58:58.278891+0000","last_undegraded":"2024-09-14T11:58:58.278891+0000","last_fullsized":"2024-09-14T11:58:58.278891+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'500","last_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_deep_scrub":"262'500","last_deep_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.278804+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:28.836107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.804411+0000","last_change":"2024-09-14T11:59:01.804411+0000","last_active":"2024-09-14T11:59:01.804411+0000","last_peered":"2024-09-14T11:59:01.804411+0000","last_clean":"2024-09-14T11:59:01.804411+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:59:01.804411+0000","last_undegraded":"2024-09-14T11:59:01.804411+0000","last_fullsized":"2024-09-14T11:59:01.804411+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.804299+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:14.419727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":6791,"num_write":1023,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1092","reported_seq":2586,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.266010+0000","last_change":"2024-09-14T11:59:08.266010+0000","last_active":"2024-09-14T11:59:08.266010+0000","last_peered":"2024-09-14T11:59:08.266010+0000","last_clean":"2024-09-14T11:59:08.266010+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:59:08.266010+0000","last_undegraded":"2024-09-14T11:59:08.266010+0000","last_fullsized":"2024-09-14T11:59:08.266010+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1092","last_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_deep_scrub":"262'1092","last_deep_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.265911+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:12.673036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'198","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.255530+0000","last_change":"2024-09-14T11:58:59.255530+0000","last_active":"2024-09-14T11:58:59.255530+0000","last_peered":"2024-09-14T11:58:59.255530+0000","last_clean":"2024-09-14T11:58:59.255530+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:58:59.255530+0000","last_undegraded":"2024-09-14T11:58:59.255530+0000","last_fullsized":"2024-09-14T11:58:59.255530+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.255428+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.960737+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":8671,"num_write":968,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'891","reported_seq":2805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.966742+0000","last_change":"2024-09-14T11:59:09.966742+0000","last_active":"2024-09-14T11:59:09.966742+0000","last_peered":"2024-09-14T11:59:09.966742+0000","last_clean":"2024-09-14T11:59:09.966742+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:59:09.966742+0000","last_undegraded":"2024-09-14T11:59:09.966742+0000","last_fullsized":"2024-09-14T11:59:09.966742+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'891","last_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_deep_scrub":"262'891","last_deep_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.966645+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.534651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'217","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.223498+0000","last_change":"2024-09-14T11:59:00.223498+0000","last_active":"2024-09-14T11:59:00.223498+0000","last_peered":"2024-09-14T11:59:00.223498+0000","last_clean":"2024-09-14T11:59:00.223498+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:59:00.223498+0000","last_undegraded":"2024-09-14T11:59:00.223498+0000","last_fullsized":"2024-09-14T11:59:00.223498+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.223379+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:54.749010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":9098,"num_write":1061,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2083,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.374724+0000","last_change":"2024-09-14T11:59:07.374724+0000","last_active":"2024-09-14T11:59:07.374724+0000","last_peered":"2024-09-14T11:59:07.374724+0000","last_clean":"2024-09-14T11:59:07.374724+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:59:07.374724+0000","last_undegraded":"2024-09-14T11:59:07.374724+0000","last_fullsized":"2024-09-14T11:59:07.374724+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'510","last_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_deep_scrub":"262'510","last_deep_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.374631+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:49.746178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'229","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.873293+0000","last_change":"2024-09-14T11:59:03.873293+0000","last_active":"2024-09-14T11:59:03.873293+0000","last_peered":"2024-09-14T11:59:03.873293+0000","last_clean":"2024-09-14T11:59:03.873293+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:59:03.873293+0000","last_undegraded":"2024-09-14T11:59:03.873293+0000","last_fullsized":"2024-09-14T11:59:03.873293+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.873191+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:41.942314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":2234,"num_write":1097,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1088","reported_seq":2862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.960382+0000","last_change":"2024-09-14T11:59:12.960382+0000","last_active":"2024-09-14T11:59:12.960382+0000","last_peered":"2024-09-14T11:59:12.960382+0000","last_clean":"2024-09-14T11:59:12.960382+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:59:12.960382+0000","last_undegraded":"2024-09-14T11:59:12.960382+0000","last_fullsized":"2024-09-14T11:59:12.960382+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1088","last_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_deep_scrub":"262'1088","last_deep_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.960278+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":1000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:21.372173+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'210","reported_seq":852,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.309896+0000","last_change":"2024-09-14T11:59:06.309896+0000","last_active":"2024-09-14T11:59:06.309896+0000","last_peered":"2024-09-14T11:59:06.309896+0000","last_clean":"2024-09-14T11:59:06.309896+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:59:06.309896+0000","last_undegraded":"2024-09-14T11:59:06.309896+0000","last_fullsized":"2024-09-14T11:59:06.309896+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.309806+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:19.118262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":34303,"num_write":987,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.917735+0000","last_change":"2024-09-14T11:59:08.917735+0000","last_active":"2024-09-14T11:59:08.917735+0000","last_peered":"2024-09-14T11:59:08.917735+0000","last_clean":"2024-09-14T11:59:08.917735+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:59:08.917735+0000","last_undegraded":"2024-09-14T11:59:08.917735+0000","last_fullsized":"2024-09-14T11:59:08.917735+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'475","last_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_deep_scrub":"262'475","last_deep_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.917635+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:56.114023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'254","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.828398+0000","last_change":"2024-09-14T11:59:02.828398+0000","last_active":"2024-09-14T11:59:02.828398+0000","last_peered":"2024-09-14T11:59:02.828398+0000","last_clean":"2024-09-14T11:59:02.828398+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:59:02.828398+0000","last_undegraded":"2024-09-14T11:59:02.828398+0000","last_fullsized":"2024-09-14T11:59:02.828398+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'254","last_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_deep_scrub":"262'254","last_deep_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.828297+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:11.803512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":43532,"num_write":1122,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'188","reported_seq":794,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.832260+0000","last_change":"2024-09-14T11:59:03.832260+0000","last_active":"2024-09-14T11:59:03.832260+0000","last_peered":"2024-09-14T11:59:03.832260+0000","last_clean":"2024-09-14T11:59:03.832260+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:59:03.832260+0000","last_undegraded":"2024-09-14T11:59:03.832260+0000","last_fullsized":"2024-09-14T11:59:03.832260+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.832145+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:54.524505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":29604,"num_write":903,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'414","reported_seq":1890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.403282+0000","last_change":"2024-09-14T11:59:09.403282+0000","last_active":"2024-09-14T11:59:09.403282+0000","last_peered":"2024-09-14T11:59:09.403282+0000","last_clean":"2024-09-14T11:59:09.403282+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:59:09.403282+0000","last_undegraded":"2024-09-14T11:59:09.403282+0000","last_fullsized":"2024-09-14T11:59:09.403282+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'414","last_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_deep_scrub":"262'414","last_deep_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.403191+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:28.990413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'282","reported_seq":1062,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.669653+0000","last_change":"2024-09-14T11:58:58.669653+0000","last_active":"2024-09-14T11:58:58.669653+0000","last_peered":"2024-09-14T11:58:58.669653+0000","last_clean":"2024-09-14T11:58:58.669653+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:58:58.669653+0000","last_undegraded":"2024-09-14T11:58:58.669653+0000","last_fullsized":"2024-09-14T11:58:58.669653+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.669555+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:27.928077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1009,"num_read_kb":66938,"num_write":1373,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'577","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.874845+0000","last_change":"2024-09-14T11:59:09.874845+0000","last_active":"2024-09-14T11:59:09.874845+0000","last_peered":"2024-09-14T11:59:09.874845+0000","last_clean":"2024-09-14T11:59:09.874845+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:59:09.874845+0000","last_undegraded":"2024-09-14T11:59:09.874845+0000","last_fullsized":"2024-09-14T11:59:09.874845+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'577","last_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_deep_scrub":"262'577","last_deep_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.874761+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:07.437905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2626,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1754,"ondisk_log_size":1754,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":377666,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8331,"num_read_kb":10588,"num_write":5619,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701918,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1802,"ondisk_log_size":1802,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35729,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4129,"ondisk_log_size":4129,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42836797,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38922,"num_read_kb":2111716,"num_write":64484,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86687744,"data_stored":85673594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4000,"ondisk_log_size":4000,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":180487,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":169164,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509977,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":233200,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94138640,"statfs":{"total":96636764160,"available":96397967360,"internally_reserved":0,"allocated":13533184,"data_stored":11861887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509977,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229032,"kb_used_data":9048,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94142808,"statfs":{"total":96636764160,"available":96402235392,"internally_reserved":0,"allocated":9265152,"data_stored":7716819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509978,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105944,"kb_used_data":12360,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94265896,"statfs":{"total":96636764160,"available":96528277504,"internally_reserved":0,"allocated":12656640,"data_stored":10956578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509977,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97660,"kb_used_data":17900,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94274180,"statfs":{"total":96636764160,"available":96536760320,"internally_reserved":0,"allocated":18329600,"data_stored":16701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509979,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248296,"kb_used_data":18584,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123544,"statfs":{"total":96636764160,"available":96382509056,"internally_reserved":0,"allocated":19030016,"data_stored":17385395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509977,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75936,"kb_used_data":8656,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295904,"statfs":{"total":96636764160,"available":96559005696,"internally_reserved":0,"allocated":8863744,"data_stored":7316623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509975,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252032,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94119808,"statfs":{"total":96636764160,"available":96378683392,"internally_reserved":0,"allocated":22855680,"data_stored":21154199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575383,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137572,"kb_used_data":12052,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94234268,"statfs":{"total":96636764160,"available":96495890432,"internally_reserved":0,"allocated":12341248,"data_stored":10776464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":18434939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8728576,"data_stored":8650845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5275648,"data_stored":5190678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15388672,"data_stored":15257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8986624,"data_stored":8830204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5656576,"data_stored":5589626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9293824,"data_stored":9144278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:59:36.736 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.736 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.736 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.736 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.736 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.736 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.736 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.737 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.738 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.739 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.740 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.741 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.741 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.741 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.741 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.741 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.741 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.741 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.742 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:30:44.157075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.743 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.744 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:32:28.529160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.745 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:32:31.553098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.746 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.747 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.748 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.748 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:15:41.330688+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:36.749 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:59:56.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:59:57.103 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T11:59:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T11:59:57.116 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1598,"stamp":"2024-09-14T11:59:56.812698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43821918,"num_objects":628,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":628,"num_whiteouts":0,"num_read":296215,"num_read_kb":2700212,"num_write":146664,"num_write_kb":2447739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741213,"num_omap_keys":1786,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13511,"ondisk_log_size":13511,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1379672,"kb_used_data":114136,"kb_used_omap":12,"kb_used_meta":1265395,"kb_avail":753595048,"statfs":{"total":773094113280,"available":771681329152,"internally_reserved":0,"allocated":116875264,"data_stored":103868988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1295765040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005823"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.774431+0000","last_change":"2024-09-14T11:59:40.774431+0000","last_active":"2024-09-14T11:59:40.774431+0000","last_peered":"2024-09-14T11:59:40.774431+0000","last_clean":"2024-09-14T11:59:40.774431+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:59:40.774431+0000","last_undegraded":"2024-09-14T11:59:40.774431+0000","last_fullsized":"2024-09-14T11:59:40.774431+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:40.774316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:40.774316+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.774316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:25.627022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.876258+0000","last_change":"2024-09-14T11:59:36.876258+0000","last_active":"2024-09-14T11:59:36.876258+0000","last_peered":"2024-09-14T11:59:36.876258+0000","last_clean":"2024-09-14T11:59:36.876258+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:59:36.876258+0000","last_undegraded":"2024-09-14T11:59:36.876258+0000","last_fullsized":"2024-09-14T11:59:36.876258+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:36.876159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:36.876159+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.876159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:48:10.997823+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.959228+0000","last_change":"2024-09-14T11:59:43.959228+0000","last_active":"2024-09-14T11:59:43.959228+0000","last_peered":"2024-09-14T11:59:43.959228+0000","last_clean":"2024-09-14T11:59:43.959228+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:59:43.959228+0000","last_undegraded":"2024-09-14T11:59:43.959228+0000","last_fullsized":"2024-09-14T11:59:43.959228+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:43.959141+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:43.959141+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.959141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:15.447458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":211,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.620404+0000","last_change":"2024-09-14T11:59:38.620404+0000","last_active":"2024-09-14T11:59:38.620404+0000","last_peered":"2024-09-14T11:59:38.620404+0000","last_clean":"2024-09-14T11:59:38.620404+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:59:38.620404+0000","last_undegraded":"2024-09-14T11:59:38.620404+0000","last_fullsized":"2024-09-14T11:59:38.620404+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'59","last_scrub_stamp":"2024-09-14T11:59:38.620309+0000","last_deep_scrub":"262'59","last_deep_scrub_stamp":"2024-09-14T11:59:38.620309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.620309+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:30.817671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.256443+0000","last_change":"2024-09-14T11:59:20.256443+0000","last_active":"2024-09-14T11:59:20.256443+0000","last_peered":"2024-09-14T11:59:20.256443+0000","last_clean":"2024-09-14T11:59:20.256443+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:59:20.256443+0000","last_undegraded":"2024-09-14T11:59:20.256443+0000","last_fullsized":"2024-09-14T11:59:20.256443+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.256349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.256349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.256349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:22.982220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'6","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.855286+0000","last_change":"2024-09-14T11:59:41.855286+0000","last_active":"2024-09-14T11:59:41.855286+0000","last_peered":"2024-09-14T11:59:41.855286+0000","last_clean":"2024-09-14T11:59:41.855286+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:59:41.855286+0000","last_undegraded":"2024-09-14T11:59:41.855286+0000","last_fullsized":"2024-09-14T11:59:41.855286+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:41.855177+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:41.855177+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.855177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:05.168113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.447897+0000","last_change":"2024-09-14T11:59:34.447897+0000","last_active":"2024-09-14T11:59:34.447897+0000","last_peered":"2024-09-14T11:59:34.447897+0000","last_clean":"2024-09-14T11:59:34.447897+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:59:34.447897+0000","last_undegraded":"2024-09-14T11:59:34.447897+0000","last_fullsized":"2024-09-14T11:59:34.447897+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-14T11:59:34.447760+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-14T11:59:34.447760+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.447760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:57.623046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.320376+0000","last_change":"2024-09-14T11:59:13.320376+0000","last_active":"2024-09-14T11:59:13.320376+0000","last_peered":"2024-09-14T11:59:13.320376+0000","last_clean":"2024-09-14T11:59:13.320376+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:59:13.320376+0000","last_undegraded":"2024-09-14T11:59:13.320376+0000","last_fullsized":"2024-09-14T11:59:13.320376+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'59","last_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_deep_scrub":"262'59","last_deep_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.320284+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:41.355939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.078463+0000","last_change":"2024-09-14T11:59:32.078463+0000","last_active":"2024-09-14T11:59:32.078463+0000","last_peered":"2024-09-14T11:59:32.078463+0000","last_clean":"2024-09-14T11:59:32.078463+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:59:32.078463+0000","last_undegraded":"2024-09-14T11:59:32.078463+0000","last_fullsized":"2024-09-14T11:59:32.078463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.078369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.078369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.078369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:18.744142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'8","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:45.646128+0000","last_change":"2024-09-14T11:59:45.646128+0000","last_active":"2024-09-14T11:59:45.646128+0000","last_peered":"2024-09-14T11:59:45.646128+0000","last_clean":"2024-09-14T11:59:45.646128+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:59:45.646128+0000","last_undegraded":"2024-09-14T11:59:45.646128+0000","last_fullsized":"2024-09-14T11:59:45.646128+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-14T11:59:45.646035+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-14T11:59:45.646035+0000","last_clean_scrub_stamp":"2024-09-14T11:59:45.646035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:11.310432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13314,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'9","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.249375+0000","last_change":"2024-09-14T11:59:17.249375+0000","last_active":"2024-09-14T11:59:17.249375+0000","last_peered":"2024-09-14T11:59:17.249375+0000","last_clean":"2024-09-14T11:59:17.249375+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:59:17.249375+0000","last_undegraded":"2024-09-14T11:59:17.249375+0000","last_fullsized":"2024-09-14T11:59:17.249375+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:17.249272+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:17.249272+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.249272+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:50.213143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":117,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.622963+0000","last_change":"2024-09-14T11:59:37.622963+0000","last_active":"2024-09-14T11:59:37.622963+0000","last_peered":"2024-09-14T11:59:37.622963+0000","last_clean":"2024-09-14T11:59:37.622963+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:59:37.622963+0000","last_undegraded":"2024-09-14T11:59:37.622963+0000","last_fullsized":"2024-09-14T11:59:37.622963+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-14T11:59:37.622872+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-14T11:59:37.622872+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.622872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:29.036538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:48.875479+0000","last_change":"2024-09-14T11:43:35.603929+0000","last_active":"2024-09-14T11:55:48.875479+0000","last_peered":"2024-09-14T11:55:48.875479+0000","last_clean":"2024-09-14T11:55:48.875479+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:55:48.875479+0000","last_undegraded":"2024-09-14T11:55:48.875479+0000","last_fullsized":"2024-09-14T11:55:48.875479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:33.024397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'4","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:52.931337+0000","last_change":"2024-09-14T11:59:52.931337+0000","last_active":"2024-09-14T11:59:52.931337+0000","last_peered":"2024-09-14T11:59:52.931337+0000","last_clean":"2024-09-14T11:59:52.931337+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:59:52.931337+0000","last_undegraded":"2024-09-14T11:59:52.931337+0000","last_fullsized":"2024-09-14T11:59:52.931337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:52.931251+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:52.931251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:52.931251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:40.528627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.934699+0000","last_change":"2024-09-14T11:59:37.934699+0000","last_active":"2024-09-14T11:59:37.934699+0000","last_peered":"2024-09-14T11:59:37.934699+0000","last_clean":"2024-09-14T11:59:37.934699+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:59:37.934699+0000","last_undegraded":"2024-09-14T11:59:37.934699+0000","last_fullsized":"2024-09-14T11:59:37.934699+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:37.934613+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:37.934613+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.934613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.043252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.990003+0000","last_change":"2024-09-14T11:59:40.990003+0000","last_active":"2024-09-14T11:59:40.990003+0000","last_peered":"2024-09-14T11:59:40.990003+0000","last_clean":"2024-09-14T11:59:40.990003+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:59:40.990003+0000","last_undegraded":"2024-09-14T11:59:40.990003+0000","last_fullsized":"2024-09-14T11:59:40.990003+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-14T11:59:40.989900+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-14T11:59:40.989900+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.989900+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.390185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":21,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:43.891559+0000","last_change":"2024-09-14T11:43:35.601032+0000","last_active":"2024-09-14T11:57:43.891559+0000","last_peered":"2024-09-14T11:57:43.891559+0000","last_clean":"2024-09-14T11:57:43.891559+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:57:43.891559+0000","last_undegraded":"2024-09-14T11:57:43.891559+0000","last_fullsized":"2024-09-14T11:57:43.891559+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.800824+0000","last_change":"2024-09-14T11:59:38.800824+0000","last_active":"2024-09-14T11:59:38.800824+0000","last_peered":"2024-09-14T11:59:38.800824+0000","last_clean":"2024-09-14T11:59:38.800824+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:59:38.800824+0000","last_undegraded":"2024-09-14T11:59:38.800824+0000","last_fullsized":"2024-09-14T11:59:38.800824+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:38.800733+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:38.800733+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.800733+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:27.373255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.612789+0000","last_change":"2024-09-14T11:59:43.612789+0000","last_active":"2024-09-14T11:59:43.612789+0000","last_peered":"2024-09-14T11:59:43.612789+0000","last_clean":"2024-09-14T11:59:43.612789+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:59:43.612789+0000","last_undegraded":"2024-09-14T11:59:43.612789+0000","last_fullsized":"2024-09-14T11:59:43.612789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-14T11:59:43.612681+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-14T11:59:43.612681+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.612681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:35.014553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:46.965885+0000","last_change":"2024-09-14T11:59:46.965885+0000","last_active":"2024-09-14T11:59:46.965885+0000","last_peered":"2024-09-14T11:59:46.965885+0000","last_clean":"2024-09-14T11:59:46.965885+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:59:46.965885+0000","last_undegraded":"2024-09-14T11:59:46.965885+0000","last_fullsized":"2024-09-14T11:59:46.965885+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:46.965790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:46.965790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:46.965790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:24.755436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.439423+0000","last_change":"2024-09-14T11:59:35.439423+0000","last_active":"2024-09-14T11:59:35.439423+0000","last_peered":"2024-09-14T11:59:35.439423+0000","last_clean":"2024-09-14T11:59:35.439423+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:59:35.439423+0000","last_undegraded":"2024-09-14T11:59:35.439423+0000","last_fullsized":"2024-09-14T11:59:35.439423+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.439333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.439333+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.439333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:26.023147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.131931+0000","last_change":"2024-09-14T11:59:29.131931+0000","last_active":"2024-09-14T11:59:29.131931+0000","last_peered":"2024-09-14T11:59:29.131931+0000","last_clean":"2024-09-14T11:59:29.131931+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:59:29.131931+0000","last_undegraded":"2024-09-14T11:59:29.131931+0000","last_fullsized":"2024-09-14T11:59:29.131931+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:29.131829+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.131829+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.131829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.210029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.952970+0000","last_change":"2024-09-14T11:59:34.952970+0000","last_active":"2024-09-14T11:59:34.952970+0000","last_peered":"2024-09-14T11:59:34.952970+0000","last_clean":"2024-09-14T11:59:34.952970+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:59:34.952970+0000","last_undegraded":"2024-09-14T11:59:34.952970+0000","last_fullsized":"2024-09-14T11:59:34.952970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:34.952892+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:34.952892+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.952892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:57:35.043886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.107584+0000","last_change":"2024-09-14T11:59:23.107584+0000","last_active":"2024-09-14T11:59:23.107584+0000","last_peered":"2024-09-14T11:59:23.107584+0000","last_clean":"2024-09-14T11:59:23.107584+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:59:23.107584+0000","last_undegraded":"2024-09-14T11:59:23.107584+0000","last_fullsized":"2024-09-14T11:59:23.107584+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'26","last_scrub_stamp":"2024-09-14T11:59:23.107479+0000","last_deep_scrub":"262'26","last_deep_scrub_stamp":"2024-09-14T11:59:23.107479+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.107479+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:53.674864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'2","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:50.899232+0000","last_change":"2024-09-14T11:59:50.899232+0000","last_active":"2024-09-14T11:59:50.899232+0000","last_peered":"2024-09-14T11:59:50.899232+0000","last_clean":"2024-09-14T11:59:50.899232+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:59:50.899232+0000","last_undegraded":"2024-09-14T11:59:50.899232+0000","last_fullsized":"2024-09-14T11:59:50.899232+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:50.899146+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:50.899146+0000","last_clean_scrub_stamp":"2024-09-14T11:59:50.899146+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:12.376290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.129766+0000","last_change":"2024-09-14T11:59:30.129766+0000","last_active":"2024-09-14T11:59:30.129766+0000","last_peered":"2024-09-14T11:59:30.129766+0000","last_clean":"2024-09-14T11:59:30.129766+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:59:30.129766+0000","last_undegraded":"2024-09-14T11:59:30.129766+0000","last_fullsized":"2024-09-14T11:59:30.129766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-14T11:59:30.129669+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-14T11:59:30.129669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.129669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:43.105203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.921806+0000","last_change":"2024-09-14T11:59:35.921806+0000","last_active":"2024-09-14T11:59:35.921806+0000","last_peered":"2024-09-14T11:59:35.921806+0000","last_clean":"2024-09-14T11:59:35.921806+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:59:35.921806+0000","last_undegraded":"2024-09-14T11:59:35.921806+0000","last_fullsized":"2024-09-14T11:59:35.921806+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'9","last_scrub_stamp":"2024-09-14T11:59:35.921708+0000","last_deep_scrub":"259'9","last_deep_scrub_stamp":"2024-09-14T11:59:35.921708+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.921708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:10.658428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":212,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.580389+0000","last_change":"2024-09-14T11:59:36.580318+0000","last_active":"2024-09-14T11:59:36.580389+0000","last_peered":"2024-09-14T11:59:36.580389+0000","last_clean":"2024-09-14T11:59:36.580389+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:59:36.580389+0000","last_undegraded":"2024-09-14T11:59:36.580389+0000","last_fullsized":"2024-09-14T11:59:36.580389+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'56","last_scrub_stamp":"2024-09-14T11:59:36.580239+0000","last_deep_scrub":"262'56","last_deep_scrub_stamp":"2024-09-14T11:59:36.580239+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.580239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:26.724447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:51.941241+0000","last_change":"2024-09-14T11:59:51.941241+0000","last_active":"2024-09-14T11:59:51.941241+0000","last_peered":"2024-09-14T11:59:51.941241+0000","last_clean":"2024-09-14T11:59:51.941241+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:59:51.941241+0000","last_undegraded":"2024-09-14T11:59:51.941241+0000","last_fullsized":"2024-09-14T11:59:51.941241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:51.941110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:51.941110+0000","last_clean_scrub_stamp":"2024-09-14T11:59:51.941110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:24.448416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:50.934317+0000","last_change":"2024-09-14T11:59:50.934317+0000","last_active":"2024-09-14T11:59:50.934317+0000","last_peered":"2024-09-14T11:59:50.934317+0000","last_clean":"2024-09-14T11:59:50.934317+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:59:50.934317+0000","last_undegraded":"2024-09-14T11:59:50.934317+0000","last_fullsized":"2024-09-14T11:59:50.934317+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:50.934222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:50.934222+0000","last_clean_scrub_stamp":"2024-09-14T11:59:50.934222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.411703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:51.641297+0000","last_change":"2024-09-14T11:59:51.641297+0000","last_active":"2024-09-14T11:59:51.641297+0000","last_peered":"2024-09-14T11:59:51.641297+0000","last_clean":"2024-09-14T11:59:51.641297+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:59:51.641297+0000","last_undegraded":"2024-09-14T11:59:51.641297+0000","last_fullsized":"2024-09-14T11:59:51.641297+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:51.641194+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:51.641194+0000","last_clean_scrub_stamp":"2024-09-14T11:59:51.641194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:25.376683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.423143+0000","last_change":"2024-09-14T11:59:23.423063+0000","last_active":"2024-09-14T11:59:23.423143+0000","last_peered":"2024-09-14T11:59:23.423143+0000","last_clean":"2024-09-14T11:59:23.423143+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:59:23.423143+0000","last_undegraded":"2024-09-14T11:59:23.423143+0000","last_fullsized":"2024-09-14T11:59:23.423143+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-14T11:59:23.422970+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-14T11:59:23.422970+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.422970+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:59.982789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.412789+0000","last_change":"2024-09-14T11:59:31.412667+0000","last_active":"2024-09-14T11:59:31.412789+0000","last_peered":"2024-09-14T11:59:31.412789+0000","last_clean":"2024-09-14T11:59:31.412789+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:59:31.412789+0000","last_undegraded":"2024-09-14T11:59:31.412789+0000","last_fullsized":"2024-09-14T11:59:31.412789+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.412565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.412565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.412565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:01.646119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:51.950666+0000","last_change":"2024-09-14T11:59:51.950666+0000","last_active":"2024-09-14T11:59:51.950666+0000","last_peered":"2024-09-14T11:59:51.950666+0000","last_clean":"2024-09-14T11:59:51.950666+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:59:51.950666+0000","last_undegraded":"2024-09-14T11:59:51.950666+0000","last_fullsized":"2024-09-14T11:59:51.950666+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:51.950570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:51.950570+0000","last_clean_scrub_stamp":"2024-09-14T11:59:51.950570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:43.836922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.859688+0000","last_change":"2024-09-14T11:59:34.859688+0000","last_active":"2024-09-14T11:59:34.859688+0000","last_peered":"2024-09-14T11:59:34.859688+0000","last_clean":"2024-09-14T11:59:34.859688+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:59:34.859688+0000","last_undegraded":"2024-09-14T11:59:34.859688+0000","last_fullsized":"2024-09-14T11:59:34.859688+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:34.859595+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:34.859595+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.859595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:37.485335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":465,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.631570+0000","last_change":"2024-09-14T11:59:34.631503+0000","last_active":"2024-09-14T11:59:34.631570+0000","last_peered":"2024-09-14T11:59:34.631570+0000","last_clean":"2024-09-14T11:59:34.631570+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:59:34.631570+0000","last_undegraded":"2024-09-14T11:59:34.631570+0000","last_fullsized":"2024-09-14T11:59:34.631570+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:34.631395+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:34.631395+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.631395+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:00.463948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.224414+0000","last_change":"2024-09-14T11:59:19.224414+0000","last_active":"2024-09-14T11:59:19.224414+0000","last_peered":"2024-09-14T11:59:19.224414+0000","last_clean":"2024-09-14T11:59:19.224414+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:59:19.224414+0000","last_undegraded":"2024-09-14T11:59:19.224414+0000","last_fullsized":"2024-09-14T11:59:19.224414+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:19.224326+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:19.224326+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.224326+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:10.820830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:48.947494+0000","last_change":"2024-09-14T11:59:48.947494+0000","last_active":"2024-09-14T11:59:48.947494+0000","last_peered":"2024-09-14T11:59:48.947494+0000","last_clean":"2024-09-14T11:59:48.947494+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:59:48.947494+0000","last_undegraded":"2024-09-14T11:59:48.947494+0000","last_fullsized":"2024-09-14T11:59:48.947494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:48.947377+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:48.947377+0000","last_clean_scrub_stamp":"2024-09-14T11:59:48.947377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:19.118167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.966207+0000","last_change":"2024-09-14T11:59:37.966207+0000","last_active":"2024-09-14T11:59:37.966207+0000","last_peered":"2024-09-14T11:59:37.966207+0000","last_clean":"2024-09-14T11:59:37.966207+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:59:37.966207+0000","last_undegraded":"2024-09-14T11:59:37.966207+0000","last_fullsized":"2024-09-14T11:59:37.966207+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:37.966126+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:37.966126+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.966126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:12.840377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":241,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.960467+0000","last_change":"2024-09-14T11:59:39.960384+0000","last_active":"2024-09-14T11:59:39.960467+0000","last_peered":"2024-09-14T11:59:39.960467+0000","last_clean":"2024-09-14T11:59:39.960467+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:59:39.960467+0000","last_undegraded":"2024-09-14T11:59:39.960467+0000","last_fullsized":"2024-09-14T11:59:39.960467+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'72","last_scrub_stamp":"2024-09-14T11:59:39.960296+0000","last_deep_scrub":"262'72","last_deep_scrub_stamp":"2024-09-14T11:59:39.960296+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.960296+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:12.552194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.933514+0000","last_change":"2024-09-14T11:59:49.933514+0000","last_active":"2024-09-14T11:59:49.933514+0000","last_peered":"2024-09-14T11:59:49.933514+0000","last_clean":"2024-09-14T11:59:49.933514+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:59:49.933514+0000","last_undegraded":"2024-09-14T11:59:49.933514+0000","last_fullsized":"2024-09-14T11:59:49.933514+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:49.933413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:49.933413+0000","last_clean_scrub_stamp":"2024-09-14T11:59:49.933413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:21.581558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.959289+0000","last_change":"2024-09-14T11:59:49.959289+0000","last_active":"2024-09-14T11:59:49.959289+0000","last_peered":"2024-09-14T11:59:49.959289+0000","last_clean":"2024-09-14T11:59:49.959289+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:59:49.959289+0000","last_undegraded":"2024-09-14T11:59:49.959289+0000","last_fullsized":"2024-09-14T11:59:49.959289+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:49.959192+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:49.959192+0000","last_clean_scrub_stamp":"2024-09-14T11:59:49.959192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:11.948375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.289244+0000","last_change":"2024-09-14T11:59:15.289244+0000","last_active":"2024-09-14T11:59:15.289244+0000","last_peered":"2024-09-14T11:59:15.289244+0000","last_clean":"2024-09-14T11:59:15.289244+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:59:15.289244+0000","last_undegraded":"2024-09-14T11:59:15.289244+0000","last_fullsized":"2024-09-14T11:59:15.289244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:15.289158+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:15.289158+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.289158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:54.409715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.341001+0000","last_change":"2024-09-14T11:59:07.340892+0000","last_active":"2024-09-14T11:59:07.341001+0000","last_peered":"2024-09-14T11:59:07.341001+0000","last_clean":"2024-09-14T11:59:07.341001+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:59:07.341001+0000","last_undegraded":"2024-09-14T11:59:07.341001+0000","last_fullsized":"2024-09-14T11:59:07.341001+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.340795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:53.630134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.812690+0000","last_change":"2024-09-14T11:59:39.812690+0000","last_active":"2024-09-14T11:59:39.812690+0000","last_peered":"2024-09-14T11:59:39.812690+0000","last_clean":"2024-09-14T11:59:39.812690+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:59:39.812690+0000","last_undegraded":"2024-09-14T11:59:39.812690+0000","last_fullsized":"2024-09-14T11:59:39.812690+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:39.812602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:39.812602+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.812602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:51.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.849133+0000","last_change":"2024-09-14T11:59:40.849133+0000","last_active":"2024-09-14T11:59:40.849133+0000","last_peered":"2024-09-14T11:59:40.849133+0000","last_clean":"2024-09-14T11:59:40.849133+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:59:40.849133+0000","last_undegraded":"2024-09-14T11:59:40.849133+0000","last_fullsized":"2024-09-14T11:59:40.849133+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-14T11:59:40.849047+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-14T11:59:40.849047+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.849047+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:09.791831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.569390+0000","last_change":"2024-09-14T11:59:42.569390+0000","last_active":"2024-09-14T11:59:42.569390+0000","last_peered":"2024-09-14T11:59:42.569390+0000","last_clean":"2024-09-14T11:59:42.569390+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:59:42.569390+0000","last_undegraded":"2024-09-14T11:59:42.569390+0000","last_fullsized":"2024-09-14T11:59:42.569390+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.569282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.569282+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.569282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:22.670783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.017045+0000","last_change":"2024-09-14T11:59:34.017045+0000","last_active":"2024-09-14T11:59:34.017045+0000","last_peered":"2024-09-14T11:59:34.017045+0000","last_clean":"2024-09-14T11:59:34.017045+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:59:34.017045+0000","last_undegraded":"2024-09-14T11:59:34.017045+0000","last_fullsized":"2024-09-14T11:59:34.017045+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-14T11:59:34.016940+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-14T11:59:34.016940+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.016940+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:32.338525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874909+0000","last_change":"2024-09-14T11:43:35.603719+0000","last_active":"2024-09-14T11:55:43.874909+0000","last_peered":"2024-09-14T11:55:43.874909+0000","last_clean":"2024-09-14T11:55:43.874909+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:55:43.874909+0000","last_undegraded":"2024-09-14T11:55:43.874909+0000","last_fullsized":"2024-09-14T11:55:43.874909+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:21.587122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'5","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.396750+0000","last_change":"2024-09-14T11:59:30.396750+0000","last_active":"2024-09-14T11:59:30.396750+0000","last_peered":"2024-09-14T11:59:30.396750+0000","last_clean":"2024-09-14T11:59:30.396750+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:59:30.396750+0000","last_undegraded":"2024-09-14T11:59:30.396750+0000","last_fullsized":"2024-09-14T11:59:30.396750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:30.396650+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:30.396650+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.396650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:35.714644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'7","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.967981+0000","last_change":"2024-09-14T11:59:32.967981+0000","last_active":"2024-09-14T11:59:32.967981+0000","last_peered":"2024-09-14T11:59:32.967981+0000","last_clean":"2024-09-14T11:59:32.967981+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:59:32.967981+0000","last_undegraded":"2024-09-14T11:59:32.967981+0000","last_fullsized":"2024-09-14T11:59:32.967981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-14T11:59:32.967882+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-14T11:59:32.967882+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.967882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:45.922771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7227,"num_write":12,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":182,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.055155+0000","last_change":"2024-09-14T11:59:33.055155+0000","last_active":"2024-09-14T11:59:33.055155+0000","last_peered":"2024-09-14T11:59:33.055155+0000","last_clean":"2024-09-14T11:59:33.055155+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:59:33.055155+0000","last_undegraded":"2024-09-14T11:59:33.055155+0000","last_fullsized":"2024-09-14T11:59:33.055155+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-14T11:59:33.055047+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-14T11:59:33.055047+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.055047+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:25.316879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:52.681885+0000","last_change":"2024-09-14T11:59:52.681885+0000","last_active":"2024-09-14T11:59:52.681885+0000","last_peered":"2024-09-14T11:59:52.681885+0000","last_clean":"2024-09-14T11:59:52.681885+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:59:52.681885+0000","last_undegraded":"2024-09-14T11:59:52.681885+0000","last_fullsized":"2024-09-14T11:59:52.681885+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:52.681789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:52.681789+0000","last_clean_scrub_stamp":"2024-09-14T11:59:52.681789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:16.586683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'6","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.415769+0000","last_change":"2024-09-14T11:59:32.415769+0000","last_active":"2024-09-14T11:59:32.415769+0000","last_peered":"2024-09-14T11:59:32.415769+0000","last_clean":"2024-09-14T11:59:32.415769+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:59:32.415769+0000","last_undegraded":"2024-09-14T11:59:32.415769+0000","last_fullsized":"2024-09-14T11:59:32.415769+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:32.415674+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:32.415674+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.415674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:41.216734+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.985163+0000","last_change":"2024-09-14T11:59:41.985163+0000","last_active":"2024-09-14T11:59:41.985163+0000","last_peered":"2024-09-14T11:59:41.985163+0000","last_clean":"2024-09-14T11:59:41.985163+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:59:41.985163+0000","last_undegraded":"2024-09-14T11:59:41.985163+0000","last_fullsized":"2024-09-14T11:59:41.985163+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:41.985076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:41.985076+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.985076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:24.613003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.619952+0000","last_change":"2024-09-14T11:59:33.619952+0000","last_active":"2024-09-14T11:59:33.619952+0000","last_peered":"2024-09-14T11:59:33.619952+0000","last_clean":"2024-09-14T11:59:33.619952+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:59:33.619952+0000","last_undegraded":"2024-09-14T11:59:33.619952+0000","last_fullsized":"2024-09-14T11:59:33.619952+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-14T11:59:33.619863+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-14T11:59:33.619863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.619863+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:49.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'2","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.685187+0000","last_change":"2024-09-14T11:59:49.685187+0000","last_active":"2024-09-14T11:59:49.685187+0000","last_peered":"2024-09-14T11:59:49.685187+0000","last_clean":"2024-09-14T11:59:49.685187+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:59:49.685187+0000","last_undegraded":"2024-09-14T11:59:49.685187+0000","last_fullsized":"2024-09-14T11:59:49.685187+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:49.685090+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:49.685090+0000","last_clean_scrub_stamp":"2024-09-14T11:59:49.685090+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:12.211268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:47.983533+0000","last_change":"2024-09-14T11:59:47.983533+0000","last_active":"2024-09-14T11:59:47.983533+0000","last_peered":"2024-09-14T11:59:47.983533+0000","last_clean":"2024-09-14T11:59:47.983533+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:59:47.983533+0000","last_undegraded":"2024-09-14T11:59:47.983533+0000","last_fullsized":"2024-09-14T11:59:47.983533+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:59:47.983430+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:59:47.983430+0000","last_clean_scrub_stamp":"2024-09-14T11:59:47.983430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:29.715191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.067586+0000","last_change":"2024-09-14T11:59:25.067586+0000","last_active":"2024-09-14T11:59:25.067586+0000","last_peered":"2024-09-14T11:59:25.067586+0000","last_clean":"2024-09-14T11:59:25.067586+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:59:25.067586+0000","last_undegraded":"2024-09-14T11:59:25.067586+0000","last_fullsized":"2024-09-14T11:59:25.067586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.067506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.067506+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.067506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:06.589318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.918900+0000","last_change":"2024-09-14T11:59:31.918900+0000","last_active":"2024-09-14T11:59:31.918900+0000","last_peered":"2024-09-14T11:59:31.918900+0000","last_clean":"2024-09-14T11:59:31.918900+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:59:31.918900+0000","last_undegraded":"2024-09-14T11:59:31.918900+0000","last_fullsized":"2024-09-14T11:59:31.918900+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-14T11:59:31.918814+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-14T11:59:31.918814+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.918814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:45.012003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.874873+0000","last_change":"2024-09-14T11:43:35.603573+0000","last_active":"2024-09-14T11:55:43.874873+0000","last_peered":"2024-09-14T11:55:43.874873+0000","last_clean":"2024-09-14T11:55:43.874873+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:55:43.874873+0000","last_undegraded":"2024-09-14T11:55:43.874873+0000","last_fullsized":"2024-09-14T11:55:43.874873+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:21.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.094352+0000","last_change":"2024-09-14T11:59:28.094352+0000","last_active":"2024-09-14T11:59:28.094352+0000","last_peered":"2024-09-14T11:59:28.094352+0000","last_clean":"2024-09-14T11:59:28.094352+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:59:28.094352+0000","last_undegraded":"2024-09-14T11:59:28.094352+0000","last_fullsized":"2024-09-14T11:59:28.094352+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-14T11:59:28.094268+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-14T11:59:28.094268+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.094268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:35.495083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.863794+0000","last_change":"2024-09-14T11:59:33.863794+0000","last_active":"2024-09-14T11:59:33.863794+0000","last_peered":"2024-09-14T11:59:33.863794+0000","last_clean":"2024-09-14T11:59:33.863794+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:59:33.863794+0000","last_undegraded":"2024-09-14T11:59:33.863794+0000","last_fullsized":"2024-09-14T11:59:33.863794+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:33.863688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:33.863688+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.863688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:57.260259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":88,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.945752+0000","last_change":"2024-09-14T11:59:38.945752+0000","last_active":"2024-09-14T11:59:38.945752+0000","last_peered":"2024-09-14T11:59:38.945752+0000","last_clean":"2024-09-14T11:59:38.945752+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:59:38.945752+0000","last_undegraded":"2024-09-14T11:59:38.945752+0000","last_fullsized":"2024-09-14T11:59:38.945752+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'12","last_scrub_stamp":"2024-09-14T11:59:38.945662+0000","last_deep_scrub":"262'12","last_deep_scrub_stamp":"2024-09-14T11:59:38.945662+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.945662+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:33.924726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.240252+0000","last_change":"2024-09-14T11:59:16.240252+0000","last_active":"2024-09-14T11:59:16.240252+0000","last_peered":"2024-09-14T11:59:16.240252+0000","last_clean":"2024-09-14T11:59:16.240252+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:59:16.240252+0000","last_undegraded":"2024-09-14T11:59:16.240252+0000","last_fullsized":"2024-09-14T11:59:16.240252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.240178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.240178+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.240178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:44.441783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.966684+0000","last_change":"2024-09-14T11:59:42.966684+0000","last_active":"2024-09-14T11:59:42.966684+0000","last_peered":"2024-09-14T11:59:42.966684+0000","last_clean":"2024-09-14T11:59:42.966684+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:59:42.966684+0000","last_undegraded":"2024-09-14T11:59:42.966684+0000","last_fullsized":"2024-09-14T11:59:42.966684+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.966598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.966598+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.966598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:39.678108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.975886+0000","last_change":"2024-09-14T11:59:38.975886+0000","last_active":"2024-09-14T11:59:38.975886+0000","last_peered":"2024-09-14T11:59:38.975886+0000","last_clean":"2024-09-14T11:59:38.975886+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:59:38.975886+0000","last_undegraded":"2024-09-14T11:59:38.975886+0000","last_fullsized":"2024-09-14T11:59:38.975886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-14T11:59:38.975780+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-14T11:59:38.975780+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.975780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:29.895205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.985675+0000","last_change":"2024-09-14T11:59:37.985675+0000","last_active":"2024-09-14T11:59:37.985675+0000","last_peered":"2024-09-14T11:59:37.985675+0000","last_clean":"2024-09-14T11:59:37.985675+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:59:37.985675+0000","last_undegraded":"2024-09-14T11:59:37.985675+0000","last_fullsized":"2024-09-14T11:59:37.985675+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-14T11:59:37.985583+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-14T11:59:37.985583+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.985583+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:17.803911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:46.945805+0000","last_change":"2024-09-14T11:59:46.945805+0000","last_active":"2024-09-14T11:59:46.945805+0000","last_peered":"2024-09-14T11:59:46.945805+0000","last_clean":"2024-09-14T11:59:46.945805+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:59:46.945805+0000","last_undegraded":"2024-09-14T11:59:46.945805+0000","last_fullsized":"2024-09-14T11:59:46.945805+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:46.945669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:46.945669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:46.945669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:37.470073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:45.952311+0000","last_change":"2024-09-14T11:59:45.952311+0000","last_active":"2024-09-14T11:59:45.952311+0000","last_peered":"2024-09-14T11:59:45.952311+0000","last_clean":"2024-09-14T11:59:45.952311+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:59:45.952311+0000","last_undegraded":"2024-09-14T11:59:45.952311+0000","last_fullsized":"2024-09-14T11:59:45.952311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:45.952224+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:45.952224+0000","last_clean_scrub_stamp":"2024-09-14T11:59:45.952224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:30.136201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.321965+0000","last_change":"2024-09-14T11:59:10.321896+0000","last_active":"2024-09-14T11:59:10.321965+0000","last_peered":"2024-09-14T11:59:10.321965+0000","last_clean":"2024-09-14T11:59:10.321965+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:59:10.321965+0000","last_undegraded":"2024-09-14T11:59:10.321965+0000","last_fullsized":"2024-09-14T11:59:10.321965+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.321802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:41.521238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":140,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.834444+0000","last_change":"2024-09-14T11:59:31.834444+0000","last_active":"2024-09-14T11:59:31.834444+0000","last_peered":"2024-09-14T11:59:31.834444+0000","last_clean":"2024-09-14T11:59:31.834444+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:59:31.834444+0000","last_undegraded":"2024-09-14T11:59:31.834444+0000","last_fullsized":"2024-09-14T11:59:31.834444+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-14T11:59:31.834343+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-14T11:59:31.834343+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.834343+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:24.480004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.089349+0000","last_change":"2024-09-14T11:59:31.089349+0000","last_active":"2024-09-14T11:59:31.089349+0000","last_peered":"2024-09-14T11:59:31.089349+0000","last_clean":"2024-09-14T11:59:31.089349+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:59:31.089349+0000","last_undegraded":"2024-09-14T11:59:31.089349+0000","last_fullsized":"2024-09-14T11:59:31.089349+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.089230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.089230+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.089230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:18.598347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.419904+0000","last_change":"2024-09-14T11:59:29.419841+0000","last_active":"2024-09-14T11:59:29.419904+0000","last_peered":"2024-09-14T11:59:29.419904+0000","last_clean":"2024-09-14T11:59:29.419904+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:59:29.419904+0000","last_undegraded":"2024-09-14T11:59:29.419904+0000","last_fullsized":"2024-09-14T11:59:29.419904+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-14T11:59:29.419750+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-14T11:59:29.419750+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.419750+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:22.031323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.584697+0000","last_change":"2024-09-14T11:59:41.584697+0000","last_active":"2024-09-14T11:59:41.584697+0000","last_peered":"2024-09-14T11:59:41.584697+0000","last_clean":"2024-09-14T11:59:41.584697+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:59:41.584697+0000","last_undegraded":"2024-09-14T11:59:41.584697+0000","last_fullsized":"2024-09-14T11:59:41.584697+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:41.584583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:41.584583+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.584583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:18.850493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":110,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.062089+0000","last_change":"2024-09-14T11:59:22.062089+0000","last_active":"2024-09-14T11:59:22.062089+0000","last_peered":"2024-09-14T11:59:22.062089+0000","last_clean":"2024-09-14T11:59:22.062089+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:59:22.062089+0000","last_undegraded":"2024-09-14T11:59:22.062089+0000","last_fullsized":"2024-09-14T11:59:22.062089+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'20","last_scrub_stamp":"2024-09-14T11:59:22.062012+0000","last_deep_scrub":"259'20","last_deep_scrub_stamp":"2024-09-14T11:59:22.062012+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.062012+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:14.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:45.989558+0000","last_change":"2024-09-14T11:59:45.989558+0000","last_active":"2024-09-14T11:59:45.989558+0000","last_peered":"2024-09-14T11:59:45.989558+0000","last_clean":"2024-09-14T11:59:45.989558+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:59:45.989558+0000","last_undegraded":"2024-09-14T11:59:45.989558+0000","last_fullsized":"2024-09-14T11:59:45.989558+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:45.989467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:45.989467+0000","last_clean_scrub_stamp":"2024-09-14T11:59:45.989467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:15.120497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'5","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.911515+0000","last_change":"2024-09-14T11:59:44.911515+0000","last_active":"2024-09-14T11:59:44.911515+0000","last_peered":"2024-09-14T11:59:44.911515+0000","last_clean":"2024-09-14T11:59:44.911515+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:59:44.911515+0000","last_undegraded":"2024-09-14T11:59:44.911515+0000","last_fullsized":"2024-09-14T11:59:44.911515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:44.911412+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:44.911412+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.911412+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:46.964265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.473102+0000","last_change":"2024-09-14T11:59:26.473019+0000","last_active":"2024-09-14T11:59:26.473102+0000","last_peered":"2024-09-14T11:59:26.473102+0000","last_clean":"2024-09-14T11:59:26.473102+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:59:26.473102+0000","last_undegraded":"2024-09-14T11:59:26.473102+0000","last_fullsized":"2024-09-14T11:59:26.473102+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:26.472928+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:26.472928+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.472928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:48.714852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":180,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.201785+0000","last_change":"2024-09-14T11:59:22.201785+0000","last_active":"2024-09-14T11:59:22.201785+0000","last_peered":"2024-09-14T11:59:22.201785+0000","last_clean":"2024-09-14T11:59:22.201785+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:59:22.201785+0000","last_undegraded":"2024-09-14T11:59:22.201785+0000","last_fullsized":"2024-09-14T11:59:22.201785+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'47","last_scrub_stamp":"2024-09-14T11:59:22.201694+0000","last_deep_scrub":"262'47","last_deep_scrub_stamp":"2024-09-14T11:59:22.201694+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.201694+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:46.966633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.885183+0000","last_change":"2024-09-14T11:43:35.607826+0000","last_active":"2024-09-14T11:57:08.885183+0000","last_peered":"2024-09-14T11:57:08.885183+0000","last_clean":"2024-09-14T11:57:08.885183+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:57:08.885183+0000","last_undegraded":"2024-09-14T11:57:08.885183+0000","last_fullsized":"2024-09-14T11:57:08.885183+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:43:34.577118+0000","last_clean_scrub_stamp":"2024-09-14T11:43:34.577118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.845333+0000","last_change":"2024-09-14T11:59:39.845333+0000","last_active":"2024-09-14T11:59:39.845333+0000","last_peered":"2024-09-14T11:59:39.845333+0000","last_clean":"2024-09-14T11:59:39.845333+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:59:39.845333+0000","last_undegraded":"2024-09-14T11:59:39.845333+0000","last_fullsized":"2024-09-14T11:59:39.845333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:39.845212+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:39.845212+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.845212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:45.668109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.603039+0000","last_change":"2024-09-14T11:59:39.603039+0000","last_active":"2024-09-14T11:59:39.603039+0000","last_peered":"2024-09-14T11:59:39.603039+0000","last_clean":"2024-09-14T11:59:39.603039+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:59:39.603039+0000","last_undegraded":"2024-09-14T11:59:39.603039+0000","last_fullsized":"2024-09-14T11:59:39.603039+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-14T11:59:39.602947+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-14T11:59:39.602947+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.602947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:15.230528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.619581+0000","last_change":"2024-09-14T11:59:32.619581+0000","last_active":"2024-09-14T11:59:32.619581+0000","last_peered":"2024-09-14T11:59:32.619581+0000","last_clean":"2024-09-14T11:59:32.619581+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:59:32.619581+0000","last_undegraded":"2024-09-14T11:59:32.619581+0000","last_fullsized":"2024-09-14T11:59:32.619581+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'50","last_scrub_stamp":"2024-09-14T11:59:32.619489+0000","last_deep_scrub":"262'50","last_deep_scrub_stamp":"2024-09-14T11:59:32.619489+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.619489+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:05.263730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:48.935603+0000","last_change":"2024-09-14T11:59:48.935603+0000","last_active":"2024-09-14T11:59:48.935603+0000","last_peered":"2024-09-14T11:59:48.935603+0000","last_clean":"2024-09-14T11:59:48.935603+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:59:48.935603+0000","last_undegraded":"2024-09-14T11:59:48.935603+0000","last_fullsized":"2024-09-14T11:59:48.935603+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:48.935507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:48.935507+0000","last_clean_scrub_stamp":"2024-09-14T11:59:48.935507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:51.443099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.985023+0000","last_change":"2024-09-14T11:59:41.985023+0000","last_active":"2024-09-14T11:59:41.985023+0000","last_peered":"2024-09-14T11:59:41.985023+0000","last_clean":"2024-09-14T11:59:41.985023+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:59:41.985023+0000","last_undegraded":"2024-09-14T11:59:41.985023+0000","last_fullsized":"2024-09-14T11:59:41.985023+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-14T11:59:41.984907+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-14T11:59:41.984907+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.984907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:59.259613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.504802+0000","last_change":"2024-09-14T11:59:25.504802+0000","last_active":"2024-09-14T11:59:25.504802+0000","last_peered":"2024-09-14T11:59:25.504802+0000","last_clean":"2024-09-14T11:59:25.504802+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:59:25.504802+0000","last_undegraded":"2024-09-14T11:59:25.504802+0000","last_fullsized":"2024-09-14T11:59:25.504802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:25.504716+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:25.504716+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.504716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:37.246547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.019477+0000","last_change":"2024-09-14T11:59:32.019477+0000","last_active":"2024-09-14T11:59:32.019477+0000","last_peered":"2024-09-14T11:59:32.019477+0000","last_clean":"2024-09-14T11:59:32.019477+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:59:32.019477+0000","last_undegraded":"2024-09-14T11:59:32.019477+0000","last_fullsized":"2024-09-14T11:59:32.019477+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:32.019366+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:32.019366+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.019366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:07.050689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'2","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:47.967963+0000","last_change":"2024-09-14T11:59:47.967963+0000","last_active":"2024-09-14T11:59:47.967963+0000","last_peered":"2024-09-14T11:59:47.967963+0000","last_clean":"2024-09-14T11:59:47.967963+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:59:47.967963+0000","last_undegraded":"2024-09-14T11:59:47.967963+0000","last_fullsized":"2024-09-14T11:59:47.967963+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:47.967883+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:47.967883+0000","last_clean_scrub_stamp":"2024-09-14T11:59:47.967883+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:39.297353+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.435922+0000","last_change":"2024-09-14T11:59:28.435854+0000","last_active":"2024-09-14T11:59:28.435922+0000","last_peered":"2024-09-14T11:59:28.435922+0000","last_clean":"2024-09-14T11:59:28.435922+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:59:28.435922+0000","last_undegraded":"2024-09-14T11:59:28.435922+0000","last_fullsized":"2024-09-14T11:59:28.435922+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:28.435763+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:28.435763+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.435763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:40.532008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.553861+0000","last_change":"2024-09-14T11:59:40.553861+0000","last_active":"2024-09-14T11:59:40.553861+0000","last_peered":"2024-09-14T11:59:40.553861+0000","last_clean":"2024-09-14T11:59:40.553861+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:59:40.553861+0000","last_undegraded":"2024-09-14T11:59:40.553861+0000","last_fullsized":"2024-09-14T11:59:40.553861+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:40.553767+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:40.553767+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.553767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:06.496916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.019398+0000","last_change":"2024-09-14T11:59:37.019398+0000","last_active":"2024-09-14T11:59:37.019398+0000","last_peered":"2024-09-14T11:59:37.019398+0000","last_clean":"2024-09-14T11:59:37.019398+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:59:37.019398+0000","last_undegraded":"2024-09-14T11:59:37.019398+0000","last_fullsized":"2024-09-14T11:59:37.019398+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'35","last_scrub_stamp":"2024-09-14T11:59:37.019326+0000","last_deep_scrub":"262'35","last_deep_scrub_stamp":"2024-09-14T11:59:37.019326+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.019326+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:00.845836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:48.695072+0000","last_change":"2024-09-14T11:59:48.695072+0000","last_active":"2024-09-14T11:59:48.695072+0000","last_peered":"2024-09-14T11:59:48.695072+0000","last_clean":"2024-09-14T11:59:48.695072+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:59:48.695072+0000","last_undegraded":"2024-09-14T11:59:48.695072+0000","last_fullsized":"2024-09-14T11:59:48.695072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:48.694975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:48.694975+0000","last_clean_scrub_stamp":"2024-09-14T11:59:48.694975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:42.323289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.007278+0000","last_change":"2024-09-14T11:59:43.007278+0000","last_active":"2024-09-14T11:59:43.007278+0000","last_peered":"2024-09-14T11:59:43.007278+0000","last_clean":"2024-09-14T11:59:43.007278+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:59:43.007278+0000","last_undegraded":"2024-09-14T11:59:43.007278+0000","last_fullsized":"2024-09-14T11:59:43.007278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-14T11:59:43.007195+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-14T11:59:43.007195+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.007195+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:03.587870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.985379+0000","last_change":"2024-09-14T11:59:33.985379+0000","last_active":"2024-09-14T11:59:33.985379+0000","last_peered":"2024-09-14T11:59:33.985379+0000","last_clean":"2024-09-14T11:59:33.985379+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:59:33.985379+0000","last_undegraded":"2024-09-14T11:59:33.985379+0000","last_fullsized":"2024-09-14T11:59:33.985379+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:33.985290+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:33.985290+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.985290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:00.777872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.098732+0000","last_change":"2024-09-14T11:59:24.098732+0000","last_active":"2024-09-14T11:59:24.098732+0000","last_peered":"2024-09-14T11:59:24.098732+0000","last_clean":"2024-09-14T11:59:24.098732+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:59:24.098732+0000","last_undegraded":"2024-09-14T11:59:24.098732+0000","last_fullsized":"2024-09-14T11:59:24.098732+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'34","last_scrub_stamp":"2024-09-14T11:59:24.098645+0000","last_deep_scrub":"262'34","last_deep_scrub_stamp":"2024-09-14T11:59:24.098645+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.098645+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:48.529776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.018406+0000","last_change":"2024-09-14T11:59:44.018406+0000","last_active":"2024-09-14T11:59:44.018406+0000","last_peered":"2024-09-14T11:59:44.018406+0000","last_clean":"2024-09-14T11:59:44.018406+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:59:44.018406+0000","last_undegraded":"2024-09-14T11:59:44.018406+0000","last_fullsized":"2024-09-14T11:59:44.018406+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:44.018264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:44.018264+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.018264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:00.715021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'6","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.658544+0000","last_change":"2024-09-14T11:59:44.658544+0000","last_active":"2024-09-14T11:59:44.658544+0000","last_peered":"2024-09-14T11:59:44.658544+0000","last_clean":"2024-09-14T11:59:44.658544+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:59:44.658544+0000","last_undegraded":"2024-09-14T11:59:44.658544+0000","last_fullsized":"2024-09-14T11:59:44.658544+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:44.658424+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:44.658424+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.658424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:13.817599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'6","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.994429+0000","last_change":"2024-09-14T11:59:39.994429+0000","last_active":"2024-09-14T11:59:39.994429+0000","last_peered":"2024-09-14T11:59:39.994429+0000","last_clean":"2024-09-14T11:59:39.994429+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:59:39.994429+0000","last_undegraded":"2024-09-14T11:59:39.994429+0000","last_fullsized":"2024-09-14T11:59:39.994429+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:39.994339+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:39.994339+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.994339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:43.575163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.609733+0000","last_change":"2024-09-14T11:59:31.609733+0000","last_active":"2024-09-14T11:59:31.609733+0000","last_peered":"2024-09-14T11:59:31.609733+0000","last_clean":"2024-09-14T11:59:31.609733+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:59:31.609733+0000","last_undegraded":"2024-09-14T11:59:31.609733+0000","last_fullsized":"2024-09-14T11:59:31.609733+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'33","last_scrub_stamp":"2024-09-14T11:59:31.609589+0000","last_deep_scrub":"262'33","last_deep_scrub_stamp":"2024-09-14T11:59:31.609589+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.609589+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:33.099218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.828111+0000","last_change":"2024-09-14T11:59:37.828111+0000","last_active":"2024-09-14T11:59:37.828111+0000","last_peered":"2024-09-14T11:59:37.828111+0000","last_clean":"2024-09-14T11:59:37.828111+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:59:37.828111+0000","last_undegraded":"2024-09-14T11:59:37.828111+0000","last_fullsized":"2024-09-14T11:59:37.828111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:37.828019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:37.828019+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.828019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:35.582571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:47.731141+0000","last_change":"2024-09-14T11:59:47.731141+0000","last_active":"2024-09-14T11:59:47.731141+0000","last_peered":"2024-09-14T11:59:47.731141+0000","last_clean":"2024-09-14T11:59:47.731141+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:59:47.731141+0000","last_undegraded":"2024-09-14T11:59:47.731141+0000","last_fullsized":"2024-09-14T11:59:47.731141+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:47.731049+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:47.731049+0000","last_clean_scrub_stamp":"2024-09-14T11:59:47.731049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:31.297199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.289996+0000","last_change":"2024-09-14T11:59:09.289933+0000","last_active":"2024-09-14T11:59:09.289996+0000","last_peered":"2024-09-14T11:59:09.289996+0000","last_clean":"2024-09-14T11:59:09.289996+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:59:09.289996+0000","last_undegraded":"2024-09-14T11:59:09.289996+0000","last_fullsized":"2024-09-14T11:59:09.289996+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.289838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.777305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.048046+0000","last_change":"2024-09-14T11:59:21.048046+0000","last_active":"2024-09-14T11:59:21.048046+0000","last_peered":"2024-09-14T11:59:21.048046+0000","last_clean":"2024-09-14T11:59:21.048046+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:59:21.048046+0000","last_undegraded":"2024-09-14T11:59:21.048046+0000","last_fullsized":"2024-09-14T11:59:21.048046+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'35","last_scrub_stamp":"2024-09-14T11:59:21.047929+0000","last_deep_scrub":"262'35","last_deep_scrub_stamp":"2024-09-14T11:59:21.047929+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.047929+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:37.654983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.403279+0000","last_change":"2024-09-14T11:59:33.403218+0000","last_active":"2024-09-14T11:59:33.403279+0000","last_peered":"2024-09-14T11:59:33.403279+0000","last_clean":"2024-09-14T11:59:33.403279+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:59:33.403279+0000","last_undegraded":"2024-09-14T11:59:33.403279+0000","last_fullsized":"2024-09-14T11:59:33.403279+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:33.403119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:33.403119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.403119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:45.973227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.017372+0000","last_change":"2024-09-14T11:59:41.017372+0000","last_active":"2024-09-14T11:59:41.017372+0000","last_peered":"2024-09-14T11:59:41.017372+0000","last_clean":"2024-09-14T11:59:41.017372+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:59:41.017372+0000","last_undegraded":"2024-09-14T11:59:41.017372+0000","last_fullsized":"2024-09-14T11:59:41.017372+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:59:41.017278+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:59:41.017278+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.017278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:36.570555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.854047+0000","last_change":"2024-09-14T11:59:32.854047+0000","last_active":"2024-09-14T11:59:32.854047+0000","last_peered":"2024-09-14T11:59:32.854047+0000","last_clean":"2024-09-14T11:59:32.854047+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:59:32.854047+0000","last_undegraded":"2024-09-14T11:59:32.854047+0000","last_fullsized":"2024-09-14T11:59:32.854047+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:32.853953+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:32.853953+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.853953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:49.712176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":64,"num_write":4,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":168,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.066717+0000","last_change":"2024-09-14T11:59:31.066717+0000","last_active":"2024-09-14T11:59:31.066717+0000","last_peered":"2024-09-14T11:59:31.066717+0000","last_clean":"2024-09-14T11:59:31.066717+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:59:31.066717+0000","last_undegraded":"2024-09-14T11:59:31.066717+0000","last_fullsized":"2024-09-14T11:59:31.066717+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'41","last_scrub_stamp":"2024-09-14T11:59:31.066595+0000","last_deep_scrub":"262'41","last_deep_scrub_stamp":"2024-09-14T11:59:31.066595+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.066595+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:17.470858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.850364+0000","last_change":"2024-09-14T11:59:42.850364+0000","last_active":"2024-09-14T11:59:42.850364+0000","last_peered":"2024-09-14T11:59:42.850364+0000","last_clean":"2024-09-14T11:59:42.850364+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:59:42.850364+0000","last_undegraded":"2024-09-14T11:59:42.850364+0000","last_fullsized":"2024-09-14T11:59:42.850364+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.850243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.850243+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.850243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:57.175327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.894679+0000","last_change":"2024-09-14T11:59:38.894679+0000","last_active":"2024-09-14T11:59:38.894679+0000","last_peered":"2024-09-14T11:59:38.894679+0000","last_clean":"2024-09-14T11:59:38.894679+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:59:38.894679+0000","last_undegraded":"2024-09-14T11:59:38.894679+0000","last_fullsized":"2024-09-14T11:59:38.894679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:38.894593+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:38.894593+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.894593+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:06.945693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2088,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.998449+0000","last_change":"2024-09-14T11:59:36.998449+0000","last_active":"2024-09-14T11:59:36.998449+0000","last_peered":"2024-09-14T11:59:36.998449+0000","last_clean":"2024-09-14T11:59:36.998449+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:59:36.998449+0000","last_undegraded":"2024-09-14T11:59:36.998449+0000","last_fullsized":"2024-09-14T11:59:36.998449+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:36.998366+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:36.998366+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.998366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:42.976733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.446107+0000","last_change":"2024-09-14T11:59:22.446042+0000","last_active":"2024-09-14T11:59:22.446107+0000","last_peered":"2024-09-14T11:59:22.446107+0000","last_clean":"2024-09-14T11:59:22.446107+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:59:22.446107+0000","last_undegraded":"2024-09-14T11:59:22.446107+0000","last_fullsized":"2024-09-14T11:59:22.446107+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-14T11:59:22.445945+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-14T11:59:22.445945+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.445945+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:04.877896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.243954+0000","last_change":"2024-09-14T11:59:21.243954+0000","last_active":"2024-09-14T11:59:21.243954+0000","last_peered":"2024-09-14T11:59:21.243954+0000","last_clean":"2024-09-14T11:59:21.243954+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:59:21.243954+0000","last_undegraded":"2024-09-14T11:59:21.243954+0000","last_fullsized":"2024-09-14T11:59:21.243954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:21.243865+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:21.243865+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.243865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:13.809248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'3","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.445096+0000","last_change":"2024-09-14T11:59:27.445022+0000","last_active":"2024-09-14T11:59:27.445096+0000","last_peered":"2024-09-14T11:59:27.445096+0000","last_clean":"2024-09-14T11:59:27.445096+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:59:27.445096+0000","last_undegraded":"2024-09-14T11:59:27.445096+0000","last_fullsized":"2024-09-14T11:59:27.445096+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:59:27.444927+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:59:27.444927+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.444927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:58.758281+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'2","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.974174+0000","last_change":"2024-09-14T11:59:34.974174+0000","last_active":"2024-09-14T11:59:34.974174+0000","last_peered":"2024-09-14T11:59:34.974174+0000","last_clean":"2024-09-14T11:59:34.974174+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:59:34.974174+0000","last_undegraded":"2024-09-14T11:59:34.974174+0000","last_fullsized":"2024-09-14T11:59:34.974174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:34.974047+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:34.974047+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.974047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:51.505506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":117,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.878884+0000","last_change":"2024-09-14T11:59:30.878884+0000","last_active":"2024-09-14T11:59:30.878884+0000","last_peered":"2024-09-14T11:59:30.878884+0000","last_clean":"2024-09-14T11:59:30.878884+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:59:30.878884+0000","last_undegraded":"2024-09-14T11:59:30.878884+0000","last_fullsized":"2024-09-14T11:59:30.878884+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-14T11:59:30.878792+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-14T11:59:30.878792+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.878792+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:54.392687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:50.658044+0000","last_change":"2024-09-14T11:59:50.658044+0000","last_active":"2024-09-14T11:59:50.658044+0000","last_peered":"2024-09-14T11:59:50.658044+0000","last_clean":"2024-09-14T11:59:50.658044+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:59:50.658044+0000","last_undegraded":"2024-09-14T11:59:50.658044+0000","last_fullsized":"2024-09-14T11:59:50.658044+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:50.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:50.657939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:50.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:38.174382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.841072+0000","last_change":"2024-09-14T11:59:35.841072+0000","last_active":"2024-09-14T11:59:35.841072+0000","last_peered":"2024-09-14T11:59:35.841072+0000","last_clean":"2024-09-14T11:59:35.841072+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:59:35.841072+0000","last_undegraded":"2024-09-14T11:59:35.841072+0000","last_fullsized":"2024-09-14T11:59:35.841072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.840986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.840986+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.840986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:52.832033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.980107+0000","last_change":"2024-09-14T11:59:35.980107+0000","last_active":"2024-09-14T11:59:35.980107+0000","last_peered":"2024-09-14T11:59:35.980107+0000","last_clean":"2024-09-14T11:59:35.980107+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:59:35.980107+0000","last_undegraded":"2024-09-14T11:59:35.980107+0000","last_fullsized":"2024-09-14T11:59:35.980107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-14T11:59:35.980011+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-14T11:59:35.980011+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.980011+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:17.207486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":218,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.963563+0000","last_change":"2024-09-14T11:59:30.963563+0000","last_active":"2024-09-14T11:59:30.963563+0000","last_peered":"2024-09-14T11:59:30.963563+0000","last_clean":"2024-09-14T11:59:30.963563+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:59:30.963563+0000","last_undegraded":"2024-09-14T11:59:30.963563+0000","last_fullsized":"2024-09-14T11:59:30.963563+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-14T11:59:30.963471+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-14T11:59:30.963471+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.963471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:36.019135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:46.690669+0000","last_change":"2024-09-14T11:59:46.690669+0000","last_active":"2024-09-14T11:59:46.690669+0000","last_peered":"2024-09-14T11:59:46.690669+0000","last_clean":"2024-09-14T11:59:46.690669+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:59:46.690669+0000","last_undegraded":"2024-09-14T11:59:46.690669+0000","last_fullsized":"2024-09-14T11:59:46.690669+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:46.690577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:46.690577+0000","last_clean_scrub_stamp":"2024-09-14T11:59:46.690577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:08.820306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.102627+0000","last_change":"2024-09-14T11:59:27.102523+0000","last_active":"2024-09-14T11:59:27.102627+0000","last_peered":"2024-09-14T11:59:27.102627+0000","last_clean":"2024-09-14T11:59:27.102627+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:59:27.102627+0000","last_undegraded":"2024-09-14T11:59:27.102627+0000","last_fullsized":"2024-09-14T11:59:27.102627+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:27.102426+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:27.102426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.102426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:07.537658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2166,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'9","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.472528+0000","last_change":"2024-09-14T11:59:24.472471+0000","last_active":"2024-09-14T11:59:24.472528+0000","last_peered":"2024-09-14T11:59:24.472528+0000","last_clean":"2024-09-14T11:59:24.472528+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:59:24.472528+0000","last_undegraded":"2024-09-14T11:59:24.472528+0000","last_fullsized":"2024-09-14T11:59:24.472528+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:24.472369+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:24.472369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.472369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:15.661067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":95,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.077000+0000","last_change":"2024-09-14T11:59:20.077000+0000","last_active":"2024-09-14T11:59:20.077000+0000","last_peered":"2024-09-14T11:59:20.077000+0000","last_clean":"2024-09-14T11:59:20.077000+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:59:20.077000+0000","last_undegraded":"2024-09-14T11:59:20.077000+0000","last_fullsized":"2024-09-14T11:59:20.077000+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'14","last_scrub_stamp":"2024-09-14T11:59:20.076891+0000","last_deep_scrub":"259'14","last_deep_scrub_stamp":"2024-09-14T11:59:20.076891+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.076891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:23.782744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.974502+0000","last_change":"2024-09-14T11:59:44.974502+0000","last_active":"2024-09-14T11:59:44.974502+0000","last_peered":"2024-09-14T11:59:44.974502+0000","last_clean":"2024-09-14T11:59:44.974502+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:59:44.974502+0000","last_undegraded":"2024-09-14T11:59:44.974502+0000","last_fullsized":"2024-09-14T11:59:44.974502+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:44.974415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:44.974415+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.974415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:27.555563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'14","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.904922+0000","last_change":"2024-09-14T11:59:36.904828+0000","last_active":"2024-09-14T11:59:36.904922+0000","last_peered":"2024-09-14T11:59:36.904922+0000","last_clean":"2024-09-14T11:59:36.904922+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:59:36.904922+0000","last_undegraded":"2024-09-14T11:59:36.904922+0000","last_fullsized":"2024-09-14T11:59:36.904922+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'14","last_scrub_stamp":"2024-09-14T11:59:36.904733+0000","last_deep_scrub":"262'14","last_deep_scrub_stamp":"2024-09-14T11:59:36.904733+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.904733+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:00.013220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19460,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'6","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.112669+0000","last_change":"2024-09-14T11:59:26.112579+0000","last_active":"2024-09-14T11:59:26.112669+0000","last_peered":"2024-09-14T11:59:26.112669+0000","last_clean":"2024-09-14T11:59:26.112669+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:59:26.112669+0000","last_undegraded":"2024-09-14T11:59:26.112669+0000","last_fullsized":"2024-09-14T11:59:26.112669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:26.112465+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:26.112465+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.112465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:09.125649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.039315+0000","last_change":"2024-09-14T11:59:30.039315+0000","last_active":"2024-09-14T11:59:30.039315+0000","last_peered":"2024-09-14T11:59:30.039315+0000","last_clean":"2024-09-14T11:59:30.039315+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:59:30.039315+0000","last_undegraded":"2024-09-14T11:59:30.039315+0000","last_fullsized":"2024-09-14T11:59:30.039315+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-14T11:59:30.039235+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-14T11:59:30.039235+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.039235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:10.445538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'201","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.924265+0000","last_change":"2024-09-14T11:59:06.924210+0000","last_active":"2024-09-14T11:59:06.924265+0000","last_peered":"2024-09-14T11:59:06.924265+0000","last_clean":"2024-09-14T11:59:06.924265+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:59:06.924265+0000","last_undegraded":"2024-09-14T11:59:06.924265+0000","last_fullsized":"2024-09-14T11:59:06.924265+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.924116+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:26.609676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":502,"num_read_kb":68162,"num_write":958,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'448","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.842355+0000","last_change":"2024-09-14T11:59:10.842355+0000","last_active":"2024-09-14T11:59:10.842355+0000","last_peered":"2024-09-14T11:59:10.842355+0000","last_clean":"2024-09-14T11:59:10.842355+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:59:10.842355+0000","last_undegraded":"2024-09-14T11:59:10.842355+0000","last_fullsized":"2024-09-14T11:59:10.842355+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.842253+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:51.500139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'208","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.657549+0000","last_change":"2024-09-14T11:58:59.657477+0000","last_active":"2024-09-14T11:58:59.657549+0000","last_peered":"2024-09-14T11:58:59.657549+0000","last_clean":"2024-09-14T11:58:59.657549+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:58:59.657549+0000","last_undegraded":"2024-09-14T11:58:59.657549+0000","last_fullsized":"2024-09-14T11:58:59.657549+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.657360+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:27.452025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":84679,"num_write":950,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.017097+0000","last_change":"2024-09-14T11:59:12.017097+0000","last_active":"2024-09-14T11:59:12.017097+0000","last_peered":"2024-09-14T11:59:12.017097+0000","last_clean":"2024-09-14T11:59:12.017097+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:59:12.017097+0000","last_undegraded":"2024-09-14T11:59:12.017097+0000","last_fullsized":"2024-09-14T11:59:12.017097+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'440","last_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_deep_scrub":"262'440","last_deep_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.016980+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:59.528853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'217","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.294101+0000","last_change":"2024-09-14T11:59:01.294031+0000","last_active":"2024-09-14T11:59:01.294101+0000","last_peered":"2024-09-14T11:59:01.294101+0000","last_clean":"2024-09-14T11:59:01.294101+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:59:01.294101+0000","last_undegraded":"2024-09-14T11:59:01.294101+0000","last_fullsized":"2024-09-14T11:59:01.294101+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.293939+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:45.221973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":1085,"num_write":1018,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'744","reported_seq":2205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.053192+0000","last_change":"2024-09-14T11:59:14.053192+0000","last_active":"2024-09-14T11:59:14.053192+0000","last_peered":"2024-09-14T11:59:14.053192+0000","last_clean":"2024-09-14T11:59:14.053192+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:59:14.053192+0000","last_undegraded":"2024-09-14T11:59:14.053192+0000","last_fullsized":"2024-09-14T11:59:14.053192+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'744","last_scrub_stamp":"2024-09-14T11:59:14.053105+0000","last_deep_scrub":"262'744","last_deep_scrub_stamp":"2024-09-14T11:59:14.053105+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.053105+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:11.427182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'243","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.828166+0000","last_change":"2024-09-14T11:59:05.828088+0000","last_active":"2024-09-14T11:59:05.828166+0000","last_peered":"2024-09-14T11:59:05.828166+0000","last_clean":"2024-09-14T11:59:05.828166+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:59:05.828166+0000","last_undegraded":"2024-09-14T11:59:05.828166+0000","last_fullsized":"2024-09-14T11:59:05.828166+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'243","last_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_deep_scrub":"262'243","last_deep_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.827996+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:32.370355+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30923,"num_write":1131,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.390988+0000","last_change":"2024-09-14T11:59:10.390988+0000","last_active":"2024-09-14T11:59:10.390988+0000","last_peered":"2024-09-14T11:59:10.390988+0000","last_clean":"2024-09-14T11:59:10.390988+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:59:10.390988+0000","last_undegraded":"2024-09-14T11:59:10.390988+0000","last_fullsized":"2024-09-14T11:59:10.390988+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'684","last_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_deep_scrub":"262'684","last_deep_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.390898+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:20.267647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.925437+0000","last_change":"2024-09-14T11:59:07.925437+0000","last_active":"2024-09-14T11:59:07.925437+0000","last_peered":"2024-09-14T11:59:07.925437+0000","last_clean":"2024-09-14T11:59:07.925437+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:59:07.925437+0000","last_undegraded":"2024-09-14T11:59:07.925437+0000","last_fullsized":"2024-09-14T11:59:07.925437+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.925347+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.275783+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'970","reported_seq":2620,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.160238+0000","last_change":"2024-09-14T11:59:07.160176+0000","last_active":"2024-09-14T11:59:07.160238+0000","last_peered":"2024-09-14T11:59:07.160238+0000","last_clean":"2024-09-14T11:59:07.160238+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:59:07.160238+0000","last_undegraded":"2024-09-14T11:59:07.160238+0000","last_fullsized":"2024-09-14T11:59:07.160238+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'970","last_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_deep_scrub":"262'970","last_deep_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.160091+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.347228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'188","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.854866+0000","last_change":"2024-09-14T11:59:04.854866+0000","last_active":"2024-09-14T11:59:04.854866+0000","last_peered":"2024-09-14T11:59:04.854866+0000","last_clean":"2024-09-14T11:59:04.854866+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:59:04.854866+0000","last_undegraded":"2024-09-14T11:59:04.854866+0000","last_fullsized":"2024-09-14T11:59:04.854866+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.854773+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:26.093727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":10177,"num_write":901,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.100837+0000","last_change":"2024-09-14T11:59:13.100750+0000","last_active":"2024-09-14T11:59:13.100837+0000","last_peered":"2024-09-14T11:59:13.100837+0000","last_clean":"2024-09-14T11:59:13.100837+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:59:13.100837+0000","last_undegraded":"2024-09-14T11:59:13.100837+0000","last_fullsized":"2024-09-14T11:59:13.100837+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1496","last_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_deep_scrub":"262'1496","last_deep_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.100637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:52.980892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'197","reported_seq":819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.941409+0000","last_change":"2024-09-14T11:59:05.941409+0000","last_active":"2024-09-14T11:59:05.941409+0000","last_peered":"2024-09-14T11:59:05.941409+0000","last_clean":"2024-09-14T11:59:05.941409+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:59:05.941409+0000","last_undegraded":"2024-09-14T11:59:05.941409+0000","last_fullsized":"2024-09-14T11:59:05.941409+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.941309+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.587968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":12539,"num_write":927,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'493","reported_seq":2330,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.833178+0000","last_change":"2024-09-14T11:59:11.833080+0000","last_active":"2024-09-14T11:59:11.833178+0000","last_peered":"2024-09-14T11:59:11.833178+0000","last_clean":"2024-09-14T11:59:11.833178+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:59:11.833178+0000","last_undegraded":"2024-09-14T11:59:11.833178+0000","last_fullsized":"2024-09-14T11:59:11.833178+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.832989+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:47.359326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4847,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'221","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.012282+0000","last_change":"2024-09-14T11:59:09.012282+0000","last_active":"2024-09-14T11:59:09.012282+0000","last_peered":"2024-09-14T11:59:09.012282+0000","last_clean":"2024-09-14T11:59:09.012282+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:59:09.012282+0000","last_undegraded":"2024-09-14T11:59:09.012282+0000","last_fullsized":"2024-09-14T11:59:09.012282+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'221","last_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_deep_scrub":"262'221","last_deep_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.012189+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:02.767488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":31152,"num_write":983,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'599","reported_seq":2472,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.267344+0000","last_change":"2024-09-14T11:59:01.267217+0000","last_active":"2024-09-14T11:59:01.267344+0000","last_peered":"2024-09-14T11:59:01.267344+0000","last_clean":"2024-09-14T11:59:01.267344+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:59:01.267344+0000","last_undegraded":"2024-09-14T11:59:01.267344+0000","last_fullsized":"2024-09-14T11:59:01.267344+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'599","last_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_deep_scrub":"262'599","last_deep_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.267099+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:01.732306+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'761","reported_seq":2284,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.160272+0000","last_change":"2024-09-14T11:59:11.160143+0000","last_active":"2024-09-14T11:59:11.160272+0000","last_peered":"2024-09-14T11:59:11.160272+0000","last_clean":"2024-09-14T11:59:11.160272+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:59:11.160272+0000","last_undegraded":"2024-09-14T11:59:11.160272+0000","last_fullsized":"2024-09-14T11:59:11.160272+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'761","last_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_deep_scrub":"262'761","last_deep_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.160044+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:20.157724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'231","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.918014+0000","last_change":"2024-09-14T11:59:04.917960+0000","last_active":"2024-09-14T11:59:04.918014+0000","last_peered":"2024-09-14T11:59:04.918014+0000","last_clean":"2024-09-14T11:59:04.918014+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:59:04.918014+0000","last_undegraded":"2024-09-14T11:59:04.918014+0000","last_fullsized":"2024-09-14T11:59:04.918014+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.917863+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.312915+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493146,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":8015,"num_write":1062,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'458","reported_seq":2054,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.977822+0000","last_change":"2024-09-14T11:59:10.977768+0000","last_active":"2024-09-14T11:59:10.977822+0000","last_peered":"2024-09-14T11:59:10.977822+0000","last_clean":"2024-09-14T11:59:10.977822+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:59:10.977822+0000","last_undegraded":"2024-09-14T11:59:10.977822+0000","last_fullsized":"2024-09-14T11:59:10.977822+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'458","last_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_deep_scrub":"262'458","last_deep_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.977676+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:08.362285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2530,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'231","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.220440+0000","last_change":"2024-09-14T11:59:02.220381+0000","last_active":"2024-09-14T11:59:02.220440+0000","last_peered":"2024-09-14T11:59:02.220440+0000","last_clean":"2024-09-14T11:59:02.220440+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:59:02.220440+0000","last_undegraded":"2024-09-14T11:59:02.220440+0000","last_fullsized":"2024-09-14T11:59:02.220440+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.220287+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:16.151277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":595,"num_read_kb":24969,"num_write":1057,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'444","reported_seq":1997,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.859552+0000","last_change":"2024-09-14T11:59:08.859552+0000","last_active":"2024-09-14T11:59:08.859552+0000","last_peered":"2024-09-14T11:59:08.859552+0000","last_clean":"2024-09-14T11:59:08.859552+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:59:08.859552+0000","last_undegraded":"2024-09-14T11:59:08.859552+0000","last_fullsized":"2024-09-14T11:59:08.859552+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.859468+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.056045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'222","reported_seq":855,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.221736+0000","last_change":"2024-09-14T11:59:01.221670+0000","last_active":"2024-09-14T11:59:01.221736+0000","last_peered":"2024-09-14T11:59:01.221736+0000","last_clean":"2024-09-14T11:59:01.221736+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:59:01.221736+0000","last_undegraded":"2024-09-14T11:59:01.221736+0000","last_fullsized":"2024-09-14T11:59:01.221736+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.221555+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:14.230182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":17269,"num_write":968,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'396","reported_seq":1870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.318870+0000","last_change":"2024-09-14T11:58:59.318739+0000","last_active":"2024-09-14T11:58:59.318870+0000","last_peered":"2024-09-14T11:58:59.318870+0000","last_clean":"2024-09-14T11:58:59.318870+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:58:59.318870+0000","last_undegraded":"2024-09-14T11:58:59.318870+0000","last_fullsized":"2024-09-14T11:58:59.318870+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.318633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:40.556708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'264","reported_seq":907,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.105757+0000","last_change":"2024-09-14T11:58:55.105686+0000","last_active":"2024-09-14T11:58:55.105757+0000","last_peered":"2024-09-14T11:58:55.105757+0000","last_clean":"2024-09-14T11:58:55.105757+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:58:55.105757+0000","last_undegraded":"2024-09-14T11:58:55.105757+0000","last_fullsized":"2024-09-14T11:58:55.105757+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'264","last_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_deep_scrub":"262'264","last_deep_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.105587+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:06.894664+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730148,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":20644,"num_write":1068,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.290767+0000","last_change":"2024-09-14T11:59:00.290708+0000","last_active":"2024-09-14T11:59:00.290767+0000","last_peered":"2024-09-14T11:59:00.290767+0000","last_clean":"2024-09-14T11:59:00.290767+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:59:00.290767+0000","last_undegraded":"2024-09-14T11:59:00.290767+0000","last_fullsized":"2024-09-14T11:59:00.290767+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'348","last_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_deep_scrub":"262'348","last_deep_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.290615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:28.191506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'292","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.884033+0000","last_change":"2024-09-14T11:59:02.883970+0000","last_active":"2024-09-14T11:59:02.884033+0000","last_peered":"2024-09-14T11:59:02.884033+0000","last_clean":"2024-09-14T11:59:02.884033+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:59:02.884033+0000","last_undegraded":"2024-09-14T11:59:02.884033+0000","last_fullsized":"2024-09-14T11:59:02.884033+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.883867+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.038831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1018,"num_read_kb":39546,"num_write":1294,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'574","reported_seq":2426,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.119802+0000","last_change":"2024-09-14T11:59:12.119802+0000","last_active":"2024-09-14T11:59:12.119802+0000","last_peered":"2024-09-14T11:59:12.119802+0000","last_clean":"2024-09-14T11:59:12.119802+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:59:12.119802+0000","last_undegraded":"2024-09-14T11:59:12.119802+0000","last_fullsized":"2024-09-14T11:59:12.119802+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.119675+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:52.499284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2946,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'231","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.260419+0000","last_change":"2024-09-14T11:59:00.260419+0000","last_active":"2024-09-14T11:59:00.260419+0000","last_peered":"2024-09-14T11:59:00.260419+0000","last_clean":"2024-09-14T11:59:00.260419+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:59:00.260419+0000","last_undegraded":"2024-09-14T11:59:00.260419+0000","last_fullsized":"2024-09-14T11:59:00.260419+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.260330+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:44.587761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":555,"num_read_kb":31277,"num_write":1077,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'149","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.979528+0000","last_change":"2024-09-14T11:59:28.979528+0000","last_active":"2024-09-14T11:59:28.979528+0000","last_peered":"2024-09-14T11:59:28.979528+0000","last_clean":"2024-09-14T11:59:28.979528+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:59:28.979528+0000","last_undegraded":"2024-09-14T11:59:28.979528+0000","last_fullsized":"2024-09-14T11:59:28.979528+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'149","last_scrub_stamp":"2024-09-14T11:59:28.979448+0000","last_deep_scrub":"262'149","last_deep_scrub_stamp":"2024-09-14T11:59:28.979448+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.979448+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:48.568665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'826","reported_seq":2539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.890292+0000","last_change":"2024-09-14T11:59:04.890292+0000","last_active":"2024-09-14T11:59:04.890292+0000","last_peered":"2024-09-14T11:59:04.890292+0000","last_clean":"2024-09-14T11:59:04.890292+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:59:04.890292+0000","last_undegraded":"2024-09-14T11:59:04.890292+0000","last_fullsized":"2024-09-14T11:59:04.890292+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'826","last_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_deep_scrub":"262'826","last_deep_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.890191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:04.714390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'201","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.806851+0000","last_change":"2024-09-14T11:59:01.806796+0000","last_active":"2024-09-14T11:59:01.806851+0000","last_peered":"2024-09-14T11:59:01.806851+0000","last_clean":"2024-09-14T11:59:01.806851+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:59:01.806851+0000","last_undegraded":"2024-09-14T11:59:01.806851+0000","last_fullsized":"2024-09-14T11:59:01.806851+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.806682+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:50.717629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":885,"num_read_kb":29517,"num_write":954,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.781055+0000","last_change":"2024-09-14T11:59:16.781055+0000","last_active":"2024-09-14T11:59:16.781055+0000","last_peered":"2024-09-14T11:59:16.781055+0000","last_clean":"2024-09-14T11:59:16.781055+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:59:16.781055+0000","last_undegraded":"2024-09-14T11:59:16.781055+0000","last_fullsized":"2024-09-14T11:59:16.781055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.780961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.780961+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.780961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:11.751745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'205","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.379232+0000","last_change":"2024-09-14T11:59:17.379232+0000","last_active":"2024-09-14T11:59:17.379232+0000","last_peered":"2024-09-14T11:59:17.379232+0000","last_clean":"2024-09-14T11:59:17.379232+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:59:17.379232+0000","last_undegraded":"2024-09-14T11:59:17.379232+0000","last_fullsized":"2024-09-14T11:59:17.379232+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-14T11:59:17.379120+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-14T11:59:17.379120+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.379120+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:58.370741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":271,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.047620+0000","last_change":"2024-09-14T11:59:27.047620+0000","last_active":"2024-09-14T11:59:27.047620+0000","last_peered":"2024-09-14T11:59:27.047620+0000","last_clean":"2024-09-14T11:59:27.047620+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:59:27.047620+0000","last_undegraded":"2024-09-14T11:59:27.047620+0000","last_fullsized":"2024-09-14T11:59:27.047620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.047536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.047536+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.047536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:44.276081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2484","reported_seq":4325,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.887173+0000","last_change":"2024-09-14T11:59:28.887173+0000","last_active":"2024-09-14T11:59:28.887173+0000","last_peered":"2024-09-14T11:59:28.887173+0000","last_clean":"2024-09-14T11:59:28.887173+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:59:28.887173+0000","last_undegraded":"2024-09-14T11:59:28.887173+0000","last_fullsized":"2024-09-14T11:59:28.887173+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2484","last_scrub_stamp":"2024-09-14T11:59:28.887087+0000","last_deep_scrub":"262'2484","last_deep_scrub_stamp":"2024-09-14T11:59:28.887087+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.887087+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":2400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:50.361126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'435","reported_seq":2275,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.898976+0000","last_change":"2024-09-14T11:59:07.898976+0000","last_active":"2024-09-14T11:59:07.898976+0000","last_peered":"2024-09-14T11:59:07.898976+0000","last_clean":"2024-09-14T11:59:07.898976+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:59:07.898976+0000","last_undegraded":"2024-09-14T11:59:07.898976+0000","last_fullsized":"2024-09-14T11:59:07.898976+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'435","last_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_deep_scrub":"262'435","last_deep_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.898878+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.901107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2558,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'274","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.272151+0000","last_change":"2024-09-14T11:58:54.272095+0000","last_active":"2024-09-14T11:58:54.272151+0000","last_peered":"2024-09-14T11:58:54.272151+0000","last_clean":"2024-09-14T11:58:54.272151+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:58:54.272151+0000","last_undegraded":"2024-09-14T11:58:54.272151+0000","last_fullsized":"2024-09-14T11:58:54.272151+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'274","last_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_deep_scrub":"262'274","last_deep_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.272007+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:31.710416+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":744,"num_read_kb":16466,"num_write":1204,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.875681+0000","last_change":"2024-09-14T11:59:15.875681+0000","last_active":"2024-09-14T11:59:15.875681+0000","last_peered":"2024-09-14T11:59:15.875681+0000","last_clean":"2024-09-14T11:59:15.875681+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:59:15.875681+0000","last_undegraded":"2024-09-14T11:59:15.875681+0000","last_fullsized":"2024-09-14T11:59:15.875681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.875565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.875565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.875565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:09.206961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'94","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.028546+0000","last_change":"2024-09-14T11:59:20.028546+0000","last_active":"2024-09-14T11:59:20.028546+0000","last_peered":"2024-09-14T11:59:20.028546+0000","last_clean":"2024-09-14T11:59:20.028546+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:59:20.028546+0000","last_undegraded":"2024-09-14T11:59:20.028546+0000","last_fullsized":"2024-09-14T11:59:20.028546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-14T11:59:20.028458+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-14T11:59:20.028458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.028458+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:16.850564+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.018594+0000","last_change":"2024-09-14T11:59:23.018594+0000","last_active":"2024-09-14T11:59:23.018594+0000","last_peered":"2024-09-14T11:59:23.018594+0000","last_clean":"2024-09-14T11:59:23.018594+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:59:23.018594+0000","last_undegraded":"2024-09-14T11:59:23.018594+0000","last_fullsized":"2024-09-14T11:59:23.018594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.018469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.018469+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.018469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:52.119047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'111","reported_seq":607,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.514971+0000","last_change":"2024-09-14T11:59:28.514971+0000","last_active":"2024-09-14T11:59:28.514971+0000","last_peered":"2024-09-14T11:59:28.514971+0000","last_clean":"2024-09-14T11:59:28.514971+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:59:28.514971+0000","last_undegraded":"2024-09-14T11:59:28.514971+0000","last_fullsized":"2024-09-14T11:59:28.514971+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-14T11:59:28.514880+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-14T11:59:28.514880+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.514880+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:19.271522+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'425","reported_seq":1999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.318212+0000","last_change":"2024-09-14T11:59:05.318212+0000","last_active":"2024-09-14T11:59:05.318212+0000","last_peered":"2024-09-14T11:59:05.318212+0000","last_clean":"2024-09-14T11:59:05.318212+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:59:05.318212+0000","last_undegraded":"2024-09-14T11:59:05.318212+0000","last_fullsized":"2024-09-14T11:59:05.318212+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'425","last_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_deep_scrub":"262'425","last_deep_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.318119+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:41.523199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'190","reported_seq":809,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.782831+0000","last_change":"2024-09-14T11:59:00.782772+0000","last_active":"2024-09-14T11:59:00.782831+0000","last_peered":"2024-09-14T11:59:00.782831+0000","last_clean":"2024-09-14T11:59:00.782831+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:59:00.782831+0000","last_undegraded":"2024-09-14T11:59:00.782831+0000","last_fullsized":"2024-09-14T11:59:00.782831+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.782673+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.605643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":30179,"num_write":922,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"262'4","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.951530+0000","last_change":"2024-09-14T11:59:17.951530+0000","last_active":"2024-09-14T11:59:17.951530+0000","last_peered":"2024-09-14T11:59:17.951530+0000","last_clean":"2024-09-14T11:59:17.951530+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:59:17.951530+0000","last_undegraded":"2024-09-14T11:59:17.951530+0000","last_fullsized":"2024-09-14T11:59:17.951530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:17.951434+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:17.951434+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.951434+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:12.495312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'120","reported_seq":657,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.240509+0000","last_change":"2024-09-14T11:59:18.240509+0000","last_active":"2024-09-14T11:59:18.240509+0000","last_peered":"2024-09-14T11:59:18.240509+0000","last_clean":"2024-09-14T11:59:18.240509+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:59:18.240509+0000","last_undegraded":"2024-09-14T11:59:18.240509+0000","last_fullsized":"2024-09-14T11:59:18.240509+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-14T11:59:18.240402+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-14T11:59:18.240402+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.240402+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:59.012310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'752","reported_seq":2535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.017067+0000","last_change":"2024-09-14T11:59:25.017067+0000","last_active":"2024-09-14T11:59:25.017067+0000","last_peered":"2024-09-14T11:59:25.017067+0000","last_clean":"2024-09-14T11:59:25.017067+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:59:25.017067+0000","last_undegraded":"2024-09-14T11:59:25.017067+0000","last_fullsized":"2024-09-14T11:59:25.017067+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'752","last_scrub_stamp":"2024-09-14T11:59:25.016990+0000","last_deep_scrub":"262'752","last_deep_scrub_stamp":"2024-09-14T11:59:25.016990+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.016990+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:57.991473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'196","reported_seq":1016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.948019+0000","last_change":"2024-09-14T11:59:29.948019+0000","last_active":"2024-09-14T11:59:29.948019+0000","last_peered":"2024-09-14T11:59:29.948019+0000","last_clean":"2024-09-14T11:59:29.948019+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:59:29.948019+0000","last_undegraded":"2024-09-14T11:59:29.948019+0000","last_fullsized":"2024-09-14T11:59:29.948019+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'196","last_scrub_stamp":"2024-09-14T11:59:29.947935+0000","last_deep_scrub":"262'196","last_deep_scrub_stamp":"2024-09-14T11:59:29.947935+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.947935+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:34.985820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1029","reported_seq":2598,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.984926+0000","last_change":"2024-09-14T11:59:06.984926+0000","last_active":"2024-09-14T11:59:06.984926+0000","last_peered":"2024-09-14T11:59:06.984926+0000","last_clean":"2024-09-14T11:59:06.984926+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:59:06.984926+0000","last_undegraded":"2024-09-14T11:59:06.984926+0000","last_fullsized":"2024-09-14T11:59:06.984926+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1029","last_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_deep_scrub":"262'1029","last_deep_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.984839+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":1000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:57.478127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'194","reported_seq":782,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.258205+0000","last_change":"2024-09-14T11:58:58.258145+0000","last_active":"2024-09-14T11:58:58.258205+0000","last_peered":"2024-09-14T11:58:58.258205+0000","last_clean":"2024-09-14T11:58:58.258205+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:58:58.258205+0000","last_undegraded":"2024-09-14T11:58:58.258205+0000","last_fullsized":"2024-09-14T11:58:58.258205+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.258058+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:41.203458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399062,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":441,"num_read_kb":5281,"num_write":856,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.793009+0000","last_change":"2024-09-14T11:59:15.793009+0000","last_active":"2024-09-14T11:59:15.793009+0000","last_peered":"2024-09-14T11:59:15.793009+0000","last_clean":"2024-09-14T11:59:15.793009+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:59:15.793009+0000","last_undegraded":"2024-09-14T11:59:15.793009+0000","last_fullsized":"2024-09-14T11:59:15.793009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.792911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.792911+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.792911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:11.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'127","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.988911+0000","last_change":"2024-09-14T11:59:20.988911+0000","last_active":"2024-09-14T11:59:20.988911+0000","last_peered":"2024-09-14T11:59:20.988911+0000","last_clean":"2024-09-14T11:59:20.988911+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:59:20.988911+0000","last_undegraded":"2024-09-14T11:59:20.988911+0000","last_fullsized":"2024-09-14T11:59:20.988911+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'127","last_scrub_stamp":"2024-09-14T11:59:20.988790+0000","last_deep_scrub":"262'127","last_deep_scrub_stamp":"2024-09-14T11:59:20.988790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.988790+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:38.988128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":190,"num_write":76,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'813","reported_seq":2236,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.998533+0000","last_change":"2024-09-14T11:59:31.998533+0000","last_active":"2024-09-14T11:59:31.998533+0000","last_peered":"2024-09-14T11:59:31.998533+0000","last_clean":"2024-09-14T11:59:31.998533+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:59:31.998533+0000","last_undegraded":"2024-09-14T11:59:31.998533+0000","last_fullsized":"2024-09-14T11:59:31.998533+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'813","last_scrub_stamp":"2024-09-14T11:59:31.998436+0000","last_deep_scrub":"262'813","last_deep_scrub_stamp":"2024-09-14T11:59:31.998436+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.998436+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:58.220089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'737","reported_seq":2289,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.860018+0000","last_change":"2024-09-14T11:59:06.860018+0000","last_active":"2024-09-14T11:59:06.860018+0000","last_peered":"2024-09-14T11:59:06.860018+0000","last_clean":"2024-09-14T11:59:06.860018+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:59:06.860018+0000","last_undegraded":"2024-09-14T11:59:06.860018+0000","last_fullsized":"2024-09-14T11:59:06.860018+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.859938+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:44.442477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'207","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.703945+0000","last_change":"2024-09-14T11:58:57.703945+0000","last_active":"2024-09-14T11:58:57.703945+0000","last_peered":"2024-09-14T11:58:57.703945+0000","last_clean":"2024-09-14T11:58:57.703945+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:57.703945+0000","last_undegraded":"2024-09-14T11:58:57.703945+0000","last_fullsized":"2024-09-14T11:58:57.703945+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.703856+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:11.335540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":729,"num_read_kb":30459,"num_write":898,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.963904+0000","last_change":"2024-09-14T11:59:13.963904+0000","last_active":"2024-09-14T11:59:13.963904+0000","last_peered":"2024-09-14T11:59:13.963904+0000","last_clean":"2024-09-14T11:59:13.963904+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:59:13.963904+0000","last_undegraded":"2024-09-14T11:59:13.963904+0000","last_fullsized":"2024-09-14T11:59:13.963904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.963802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.963802+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.963802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:21.806765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'223","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.792410+0000","last_change":"2024-09-14T11:59:19.792410+0000","last_active":"2024-09-14T11:59:19.792410+0000","last_peered":"2024-09-14T11:59:19.792410+0000","last_clean":"2024-09-14T11:59:19.792410+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:59:19.792410+0000","last_undegraded":"2024-09-14T11:59:19.792410+0000","last_fullsized":"2024-09-14T11:59:19.792410+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-14T11:59:19.792309+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-14T11:59:19.792309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.792309+0000","objects_scrubbed":10,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:30.265360+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12526,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":287,"num_read_kb":357,"num_write":170,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.594914+0000","last_change":"2024-09-14T11:59:15.594914+0000","last_active":"2024-09-14T11:59:15.594914+0000","last_peered":"2024-09-14T11:59:15.594914+0000","last_clean":"2024-09-14T11:59:15.594914+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:59:15.594914+0000","last_undegraded":"2024-09-14T11:59:15.594914+0000","last_fullsized":"2024-09-14T11:59:15.594914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.594816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.594816+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.594816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.054516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'557","reported_seq":1361,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.843588+0000","last_change":"2024-09-14T11:59:24.843524+0000","last_active":"2024-09-14T11:59:24.843588+0000","last_peered":"2024-09-14T11:59:24.843588+0000","last_clean":"2024-09-14T11:59:24.843588+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:59:24.843588+0000","last_undegraded":"2024-09-14T11:59:24.843588+0000","last_fullsized":"2024-09-14T11:59:24.843588+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'557","last_scrub_stamp":"2024-09-14T11:59:24.843428+0000","last_deep_scrub":"262'557","last_deep_scrub_stamp":"2024-09-14T11:59:24.843428+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.843428+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:59.354050+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'839","reported_seq":2332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.167101+0000","last_change":"2024-09-14T11:59:00.167101+0000","last_active":"2024-09-14T11:59:00.167101+0000","last_peered":"2024-09-14T11:59:00.167101+0000","last_clean":"2024-09-14T11:59:00.167101+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:59:00.167101+0000","last_undegraded":"2024-09-14T11:59:00.167101+0000","last_fullsized":"2024-09-14T11:59:00.167101+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'839","last_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_deep_scrub":"262'839","last_deep_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.167013+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.391900+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'287","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.738135+0000","last_change":"2024-09-14T11:58:58.738135+0000","last_active":"2024-09-14T11:58:58.738135+0000","last_peered":"2024-09-14T11:58:58.738135+0000","last_clean":"2024-09-14T11:58:58.738135+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:58:58.738135+0000","last_undegraded":"2024-09-14T11:58:58.738135+0000","last_fullsized":"2024-09-14T11:58:58.738135+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'287","last_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_deep_scrub":"262'287","last_deep_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.738053+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:39.322669+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":15958,"num_write":1147,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.282011+0000","last_change":"2024-09-14T11:59:12.282011+0000","last_active":"2024-09-14T11:59:12.282011+0000","last_peered":"2024-09-14T11:59:12.282011+0000","last_clean":"2024-09-14T11:59:12.282011+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:59:12.282011+0000","last_undegraded":"2024-09-14T11:59:12.282011+0000","last_fullsized":"2024-09-14T11:59:12.282011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.281919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:33.989125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'124","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.037813+0000","last_change":"2024-09-14T11:59:22.037813+0000","last_active":"2024-09-14T11:59:22.037813+0000","last_peered":"2024-09-14T11:59:22.037813+0000","last_clean":"2024-09-14T11:59:22.037813+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:59:22.037813+0000","last_undegraded":"2024-09-14T11:59:22.037813+0000","last_fullsized":"2024-09-14T11:59:22.037813+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-14T11:59:22.037722+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-14T11:59:22.037722+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.037722+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:56.451683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":194,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.956799+0000","last_change":"2024-09-14T11:59:27.956799+0000","last_active":"2024-09-14T11:59:27.956799+0000","last_peered":"2024-09-14T11:59:27.956799+0000","last_clean":"2024-09-14T11:59:27.956799+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:59:27.956799+0000","last_undegraded":"2024-09-14T11:59:27.956799+0000","last_fullsized":"2024-09-14T11:59:27.956799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.956713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.956713+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.956713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.243127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'125","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.069959+0000","last_change":"2024-09-14T11:59:16.069904+0000","last_active":"2024-09-14T11:59:16.069959+0000","last_peered":"2024-09-14T11:59:16.069959+0000","last_clean":"2024-09-14T11:59:16.069959+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:59:16.069959+0000","last_undegraded":"2024-09-14T11:59:16.069959+0000","last_fullsized":"2024-09-14T11:59:16.069959+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'125","last_scrub_stamp":"2024-09-14T11:59:16.069819+0000","last_deep_scrub":"262'125","last_deep_scrub_stamp":"2024-09-14T11:59:16.069819+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.069819+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.120386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'695","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.215163+0000","last_change":"2024-09-14T11:59:04.215163+0000","last_active":"2024-09-14T11:59:04.215163+0000","last_peered":"2024-09-14T11:59:04.215163+0000","last_clean":"2024-09-14T11:59:04.215163+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:59:04.215163+0000","last_undegraded":"2024-09-14T11:59:04.215163+0000","last_fullsized":"2024-09-14T11:59:04.215163+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'695","last_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_deep_scrub":"262'695","last_deep_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.215080+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:28.285334+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":241,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'236","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.244348+0000","last_change":"2024-09-14T11:58:55.244348+0000","last_active":"2024-09-14T11:58:55.244348+0000","last_peered":"2024-09-14T11:58:55.244348+0000","last_clean":"2024-09-14T11:58:55.244348+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:58:55.244348+0000","last_undegraded":"2024-09-14T11:58:55.244348+0000","last_fullsized":"2024-09-14T11:58:55.244348+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'236","last_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_deep_scrub":"262'236","last_deep_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.244245+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:50.597423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":32200,"num_write":1033,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.276886+0000","last_change":"2024-09-14T11:59:03.276886+0000","last_active":"2024-09-14T11:59:03.276886+0000","last_peered":"2024-09-14T11:59:03.276886+0000","last_clean":"2024-09-14T11:59:03.276886+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:59:03.276886+0000","last_undegraded":"2024-09-14T11:59:03.276886+0000","last_fullsized":"2024-09-14T11:59:03.276886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.276755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:59.224975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'175","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.935132+0000","last_change":"2024-09-14T11:59:18.935132+0000","last_active":"2024-09-14T11:59:18.935132+0000","last_peered":"2024-09-14T11:59:18.935132+0000","last_clean":"2024-09-14T11:59:18.935132+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:59:18.935132+0000","last_undegraded":"2024-09-14T11:59:18.935132+0000","last_fullsized":"2024-09-14T11:59:18.935132+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'175","last_scrub_stamp":"2024-09-14T11:59:18.935016+0000","last_deep_scrub":"262'175","last_deep_scrub_stamp":"2024-09-14T11:59:18.935016+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.935016+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:06.444815+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":303,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'804","reported_seq":4169,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.452341+0000","last_change":"2024-09-14T11:59:21.452341+0000","last_active":"2024-09-14T11:59:21.452341+0000","last_peered":"2024-09-14T11:59:21.452341+0000","last_clean":"2024-09-14T11:59:21.452341+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:59:21.452341+0000","last_undegraded":"2024-09-14T11:59:21.452341+0000","last_fullsized":"2024-09-14T11:59:21.452341+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'804","last_scrub_stamp":"2024-09-14T11:59:21.452251+0000","last_deep_scrub":"262'804","last_deep_scrub_stamp":"2024-09-14T11:59:21.452251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.452251+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:50.712137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'142","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.469961+0000","last_change":"2024-09-14T11:59:27.469961+0000","last_active":"2024-09-14T11:59:27.469961+0000","last_peered":"2024-09-14T11:59:27.469961+0000","last_clean":"2024-09-14T11:59:27.469961+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:59:27.469961+0000","last_undegraded":"2024-09-14T11:59:27.469961+0000","last_fullsized":"2024-09-14T11:59:27.469961+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-14T11:59:27.469878+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-14T11:59:27.469878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.469878+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:26.963886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.286153+0000","last_change":"2024-09-14T11:59:04.286153+0000","last_active":"2024-09-14T11:59:04.286153+0000","last_peered":"2024-09-14T11:59:04.286153+0000","last_clean":"2024-09-14T11:59:04.286153+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:59:04.286153+0000","last_undegraded":"2024-09-14T11:59:04.286153+0000","last_fullsized":"2024-09-14T11:59:04.286153+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'842","last_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_deep_scrub":"262'842","last_deep_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.286054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:06.803501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'270","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.198507+0000","last_change":"2024-09-14T11:58:54.198507+0000","last_active":"2024-09-14T11:58:54.198507+0000","last_peered":"2024-09-14T11:58:54.198507+0000","last_clean":"2024-09-14T11:58:54.198507+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:54.198507+0000","last_undegraded":"2024-09-14T11:58:54.198507+0000","last_fullsized":"2024-09-14T11:58:54.198507+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'270","last_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_deep_scrub":"262'270","last_deep_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.198407+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:41.502019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":40477,"num_write":1093,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.246881+0000","last_change":"2024-09-14T11:59:02.246809+0000","last_active":"2024-09-14T11:59:02.246881+0000","last_peered":"2024-09-14T11:59:02.246881+0000","last_clean":"2024-09-14T11:59:02.246881+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:59:02.246881+0000","last_undegraded":"2024-09-14T11:59:02.246881+0000","last_fullsized":"2024-09-14T11:59:02.246881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.246720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:43.335103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'207","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.338673+0000","last_change":"2024-09-14T11:59:14.338673+0000","last_active":"2024-09-14T11:59:14.338673+0000","last_peered":"2024-09-14T11:59:14.338673+0000","last_clean":"2024-09-14T11:59:14.338673+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:59:14.338673+0000","last_undegraded":"2024-09-14T11:59:14.338673+0000","last_fullsized":"2024-09-14T11:59:14.338673+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-14T11:59:14.338559+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-14T11:59:14.338559+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.338559+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:25.967619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":292,"num_read_kb":532,"num_write":152,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.338348+0000","last_change":"2024-09-14T11:59:14.338348+0000","last_active":"2024-09-14T11:59:14.338348+0000","last_peered":"2024-09-14T11:59:14.338348+0000","last_clean":"2024-09-14T11:59:14.338348+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:59:14.338348+0000","last_undegraded":"2024-09-14T11:59:14.338348+0000","last_fullsized":"2024-09-14T11:59:14.338348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.338219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.338219+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.338219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:18.751994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'133","reported_seq":655,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.491087+0000","last_change":"2024-09-14T11:59:20.491087+0000","last_active":"2024-09-14T11:59:20.491087+0000","last_peered":"2024-09-14T11:59:20.491087+0000","last_clean":"2024-09-14T11:59:20.491087+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:59:20.491087+0000","last_undegraded":"2024-09-14T11:59:20.491087+0000","last_fullsized":"2024-09-14T11:59:20.491087+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'133","last_scrub_stamp":"2024-09-14T11:59:20.490994+0000","last_deep_scrub":"262'133","last_deep_scrub_stamp":"2024-09-14T11:59:20.490994+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.490994+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:34.944128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'489","reported_seq":2098,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.170207+0000","last_change":"2024-09-14T11:59:01.170207+0000","last_active":"2024-09-14T11:59:01.170207+0000","last_peered":"2024-09-14T11:59:01.170207+0000","last_clean":"2024-09-14T11:59:01.170207+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:59:01.170207+0000","last_undegraded":"2024-09-14T11:59:01.170207+0000","last_fullsized":"2024-09-14T11:59:01.170207+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'489","last_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_deep_scrub":"262'489","last_deep_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.170127+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:23.040904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":957,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'233","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.841862+0000","last_change":"2024-09-14T11:58:56.841862+0000","last_active":"2024-09-14T11:58:56.841862+0000","last_peered":"2024-09-14T11:58:56.841862+0000","last_clean":"2024-09-14T11:58:56.841862+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:58:56.841862+0000","last_undegraded":"2024-09-14T11:58:56.841862+0000","last_fullsized":"2024-09-14T11:58:56.841862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'233","last_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_deep_scrub":"262'233","last_deep_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.841768+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:37.320911+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":679,"num_read_kb":211577,"num_write":961,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.271674+0000","last_change":"2024-09-14T11:59:04.271674+0000","last_active":"2024-09-14T11:59:04.271674+0000","last_peered":"2024-09-14T11:59:04.271674+0000","last_clean":"2024-09-14T11:59:04.271674+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:59:04.271674+0000","last_undegraded":"2024-09-14T11:59:04.271674+0000","last_fullsized":"2024-09-14T11:59:04.271674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.271581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:18.845590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'150","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.000067+0000","last_change":"2024-09-14T11:59:19.000067+0000","last_active":"2024-09-14T11:59:19.000067+0000","last_peered":"2024-09-14T11:59:19.000067+0000","last_clean":"2024-09-14T11:59:19.000067+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:59:19.000067+0000","last_undegraded":"2024-09-14T11:59:19.000067+0000","last_fullsized":"2024-09-14T11:59:19.000067+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'150","last_scrub_stamp":"2024-09-14T11:59:18.999983+0000","last_deep_scrub":"262'150","last_deep_scrub_stamp":"2024-09-14T11:59:18.999983+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.999983+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:30.082383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":279,"num_write":168,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.482082+0000","last_change":"2024-09-14T11:59:22.482082+0000","last_active":"2024-09-14T11:59:22.482082+0000","last_peered":"2024-09-14T11:59:22.482082+0000","last_clean":"2024-09-14T11:59:22.482082+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:59:22.482082+0000","last_undegraded":"2024-09-14T11:59:22.482082+0000","last_fullsized":"2024-09-14T11:59:22.482082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.481998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.481998+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.481998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:30.175507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'123","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.047690+0000","last_change":"2024-09-14T11:59:35.047625+0000","last_active":"2024-09-14T11:59:35.047690+0000","last_peered":"2024-09-14T11:59:35.047690+0000","last_clean":"2024-09-14T11:59:35.047690+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:59:35.047690+0000","last_undegraded":"2024-09-14T11:59:35.047690+0000","last_fullsized":"2024-09-14T11:59:35.047690+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-14T11:59:35.047541+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-14T11:59:35.047541+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.047541+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:40.404587+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'401","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.146653+0000","last_change":"2024-09-14T11:59:02.146653+0000","last_active":"2024-09-14T11:59:02.146653+0000","last_peered":"2024-09-14T11:59:02.146653+0000","last_clean":"2024-09-14T11:59:02.146653+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:59:02.146653+0000","last_undegraded":"2024-09-14T11:59:02.146653+0000","last_fullsized":"2024-09-14T11:59:02.146653+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'401","last_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_deep_scrub":"262'401","last_deep_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.146555+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:42.384227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'223","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.241638+0000","last_change":"2024-09-14T11:58:56.241556+0000","last_active":"2024-09-14T11:58:56.241638+0000","last_peered":"2024-09-14T11:58:56.241638+0000","last_clean":"2024-09-14T11:58:56.241638+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:56.241638+0000","last_undegraded":"2024-09-14T11:58:56.241638+0000","last_fullsized":"2024-09-14T11:58:56.241638+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.241416+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:27.853420+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1176,"num_read_kb":14840,"num_write":1005,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.643614+0000","last_change":"2024-09-14T11:59:08.643614+0000","last_active":"2024-09-14T11:59:08.643614+0000","last_peered":"2024-09-14T11:59:08.643614+0000","last_clean":"2024-09-14T11:59:08.643614+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:59:08.643614+0000","last_undegraded":"2024-09-14T11:59:08.643614+0000","last_fullsized":"2024-09-14T11:59:08.643614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.643511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:00.185539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'169","reported_seq":756,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.269583+0000","last_change":"2024-09-14T11:59:05.269583+0000","last_active":"2024-09-14T11:59:05.269583+0000","last_peered":"2024-09-14T11:59:05.269583+0000","last_clean":"2024-09-14T11:59:05.269583+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:59:05.269583+0000","last_undegraded":"2024-09-14T11:59:05.269583+0000","last_fullsized":"2024-09-14T11:59:05.269583+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'169","last_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_deep_scrub":"262'169","last_deep_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.269486+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:22.201735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9189,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":308,"num_write":130,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.312182+0000","last_change":"2024-09-14T11:59:11.312182+0000","last_active":"2024-09-14T11:59:11.312182+0000","last_peered":"2024-09-14T11:59:11.312182+0000","last_clean":"2024-09-14T11:59:11.312182+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:59:11.312182+0000","last_undegraded":"2024-09-14T11:59:11.312182+0000","last_fullsized":"2024-09-14T11:59:11.312182+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.312094+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:03.384832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'140","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.496372+0000","last_change":"2024-09-14T11:59:18.496302+0000","last_active":"2024-09-14T11:59:18.496372+0000","last_peered":"2024-09-14T11:59:18.496372+0000","last_clean":"2024-09-14T11:59:18.496372+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:59:18.496372+0000","last_undegraded":"2024-09-14T11:59:18.496372+0000","last_fullsized":"2024-09-14T11:59:18.496372+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:18.496205+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:18.496205+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.496205+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:21.623170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1226","reported_seq":2799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.175076+0000","last_change":"2024-09-14T11:59:03.175076+0000","last_active":"2024-09-14T11:59:03.175076+0000","last_peered":"2024-09-14T11:59:03.175076+0000","last_clean":"2024-09-14T11:59:03.175076+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:59:03.175076+0000","last_undegraded":"2024-09-14T11:59:03.175076+0000","last_fullsized":"2024-09-14T11:59:03.175076+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1226","last_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_deep_scrub":"262'1226","last_deep_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.174965+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.571515+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'203","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.140005+0000","last_change":"2024-09-14T11:58:58.140005+0000","last_active":"2024-09-14T11:58:58.140005+0000","last_peered":"2024-09-14T11:58:58.140005+0000","last_clean":"2024-09-14T11:58:58.140005+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:58:58.140005+0000","last_undegraded":"2024-09-14T11:58:58.140005+0000","last_fullsized":"2024-09-14T11:58:58.140005+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.139868+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:54.848038+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":33043,"num_write":876,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1446,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.781031+0000","last_change":"2024-09-14T11:59:14.781031+0000","last_active":"2024-09-14T11:59:14.781031+0000","last_peered":"2024-09-14T11:59:14.781031+0000","last_clean":"2024-09-14T11:59:14.781031+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:59:14.781031+0000","last_undegraded":"2024-09-14T11:59:14.781031+0000","last_fullsized":"2024-09-14T11:59:14.781031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:14.780939+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:14.780939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.780939+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:39.596476+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":951,"num_read_kb":951,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'94","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.988876+0000","last_change":"2024-09-14T11:59:19.988876+0000","last_active":"2024-09-14T11:59:19.988876+0000","last_peered":"2024-09-14T11:59:19.988876+0000","last_clean":"2024-09-14T11:59:19.988876+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:59:19.988876+0000","last_undegraded":"2024-09-14T11:59:19.988876+0000","last_fullsized":"2024-09-14T11:59:19.988876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-14T11:59:19.988779+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-14T11:59:19.988779+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.988779+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:05.383676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'769","reported_seq":2241,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.136534+0000","last_change":"2024-09-14T11:59:13.136534+0000","last_active":"2024-09-14T11:59:13.136534+0000","last_peered":"2024-09-14T11:59:13.136534+0000","last_clean":"2024-09-14T11:59:13.136534+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:59:13.136534+0000","last_undegraded":"2024-09-14T11:59:13.136534+0000","last_fullsized":"2024-09-14T11:59:13.136534+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'769","last_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_deep_scrub":"262'769","last_deep_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.136434+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:03.613925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'150","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.010097+0000","last_change":"2024-09-14T11:59:27.010015+0000","last_active":"2024-09-14T11:59:27.010097+0000","last_peered":"2024-09-14T11:59:27.010097+0000","last_clean":"2024-09-14T11:59:27.010097+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:59:27.010097+0000","last_undegraded":"2024-09-14T11:59:27.010097+0000","last_fullsized":"2024-09-14T11:59:27.010097+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'150","last_scrub_stamp":"2024-09-14T11:59:27.009930+0000","last_deep_scrub":"262'150","last_deep_scrub_stamp":"2024-09-14T11:59:27.009930+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.009930+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.093068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'426","reported_seq":2152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.612965+0000","last_change":"2024-09-14T11:59:03.612965+0000","last_active":"2024-09-14T11:59:03.612965+0000","last_peered":"2024-09-14T11:59:03.612965+0000","last_clean":"2024-09-14T11:59:03.612965+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:59:03.612965+0000","last_undegraded":"2024-09-14T11:59:03.612965+0000","last_fullsized":"2024-09-14T11:59:03.612965+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'426","last_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_deep_scrub":"262'426","last_deep_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.612866+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:46.847404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'177","reported_seq":791,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.824967+0000","last_change":"2024-09-14T11:58:55.824967+0000","last_active":"2024-09-14T11:58:55.824967+0000","last_peered":"2024-09-14T11:58:55.824967+0000","last_clean":"2024-09-14T11:58:55.824967+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:58:55.824967+0000","last_undegraded":"2024-09-14T11:58:55.824967+0000","last_fullsized":"2024-09-14T11:58:55.824967+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.824891+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.305401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":26947,"num_write":787,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.055419+0000","last_change":"2024-09-14T11:59:16.055419+0000","last_active":"2024-09-14T11:59:16.055419+0000","last_peered":"2024-09-14T11:59:16.055419+0000","last_clean":"2024-09-14T11:59:16.055419+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:59:16.055419+0000","last_undegraded":"2024-09-14T11:59:16.055419+0000","last_fullsized":"2024-09-14T11:59:16.055419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.055322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.055322+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.055322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:34.773506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'219","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.822193+0000","last_change":"2024-09-14T11:59:20.822193+0000","last_active":"2024-09-14T11:59:20.822193+0000","last_peered":"2024-09-14T11:59:20.822193+0000","last_clean":"2024-09-14T11:59:20.822193+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:59:20.822193+0000","last_undegraded":"2024-09-14T11:59:20.822193+0000","last_fullsized":"2024-09-14T11:59:20.822193+0000","mapping_epoch":30,"log_start":"262'201","ondisk_log_start":"262'201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:20.822090+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:20.822090+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.822090+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":201,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:07.759480+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":896,"num_read_kb":967,"num_write":1418,"num_write_kb":1294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.100560+0000","last_change":"2024-09-14T11:59:11.100560+0000","last_active":"2024-09-14T11:59:11.100560+0000","last_peered":"2024-09-14T11:59:11.100560+0000","last_clean":"2024-09-14T11:59:11.100560+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:59:11.100560+0000","last_undegraded":"2024-09-14T11:59:11.100560+0000","last_fullsized":"2024-09-14T11:59:11.100560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.100464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.020435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'148","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.456666+0000","last_change":"2024-09-14T11:59:19.456602+0000","last_active":"2024-09-14T11:59:19.456666+0000","last_peered":"2024-09-14T11:59:19.456666+0000","last_clean":"2024-09-14T11:59:19.456666+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:59:19.456666+0000","last_undegraded":"2024-09-14T11:59:19.456666+0000","last_fullsized":"2024-09-14T11:59:19.456666+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-14T11:59:19.456498+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-14T11:59:19.456498+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.456498+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:21.465056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'801","reported_seq":2325,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.230985+0000","last_change":"2024-09-14T11:59:03.230934+0000","last_active":"2024-09-14T11:59:03.230985+0000","last_peered":"2024-09-14T11:59:03.230985+0000","last_clean":"2024-09-14T11:59:03.230985+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:59:03.230985+0000","last_undegraded":"2024-09-14T11:59:03.230985+0000","last_fullsized":"2024-09-14T11:59:03.230985+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'801","last_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_deep_scrub":"262'801","last_deep_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.230846+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:04.064474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.760564+0000","last_change":"2024-09-14T11:58:59.760463+0000","last_active":"2024-09-14T11:58:59.760564+0000","last_peered":"2024-09-14T11:58:59.760564+0000","last_clean":"2024-09-14T11:58:59.760564+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:58:59.760564+0000","last_undegraded":"2024-09-14T11:58:59.760564+0000","last_fullsized":"2024-09-14T11:58:59.760564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.760359+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.092864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":518,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.827346+0000","last_change":"2024-09-14T11:58:54.827283+0000","last_active":"2024-09-14T11:58:54.827346+0000","last_peered":"2024-09-14T11:58:54.827346+0000","last_clean":"2024-09-14T11:58:54.827346+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:58:54.827346+0000","last_undegraded":"2024-09-14T11:58:54.827346+0000","last_fullsized":"2024-09-14T11:58:54.827346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.827191+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:45.032950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'242","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.815480+0000","last_change":"2024-09-14T11:58:53.815404+0000","last_active":"2024-09-14T11:58:53.815480+0000","last_peered":"2024-09-14T11:58:53.815480+0000","last_clean":"2024-09-14T11:58:53.815480+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:58:53.815480+0000","last_undegraded":"2024-09-14T11:58:53.815480+0000","last_fullsized":"2024-09-14T11:58:53.815480+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'242","last_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_deep_scrub":"262'242","last_deep_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.815334+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:37.358269+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":31904,"num_write":1129,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.000087+0000","last_change":"2024-09-14T11:59:12.999968+0000","last_active":"2024-09-14T11:59:13.000087+0000","last_peered":"2024-09-14T11:59:13.000087+0000","last_clean":"2024-09-14T11:59:13.000087+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:59:13.000087+0000","last_undegraded":"2024-09-14T11:59:13.000087+0000","last_fullsized":"2024-09-14T11:59:13.000087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.999868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:32.858382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'311","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.744516+0000","last_change":"2024-09-14T11:59:18.744516+0000","last_active":"2024-09-14T11:59:18.744516+0000","last_peered":"2024-09-14T11:59:18.744516+0000","last_clean":"2024-09-14T11:59:18.744516+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:59:18.744516+0000","last_undegraded":"2024-09-14T11:59:18.744516+0000","last_fullsized":"2024-09-14T11:59:18.744516+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'311","last_scrub_stamp":"2024-09-14T11:59:18.744428+0000","last_deep_scrub":"262'311","last_deep_scrub_stamp":"2024-09-14T11:59:18.744428+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.744428+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:34.923657+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36736,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":789,"num_write":500,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107196,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.415321+0000","last_change":"2024-09-14T11:59:20.415321+0000","last_active":"2024-09-14T11:59:20.415321+0000","last_peered":"2024-09-14T11:59:20.415321+0000","last_clean":"2024-09-14T11:59:20.415321+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:59:20.415321+0000","last_undegraded":"2024-09-14T11:59:20.415321+0000","last_fullsized":"2024-09-14T11:59:20.415321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.415213+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'191","reported_seq":885,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.044608+0000","last_change":"2024-09-14T11:59:18.044608+0000","last_active":"2024-09-14T11:59:18.044608+0000","last_peered":"2024-09-14T11:59:18.044608+0000","last_clean":"2024-09-14T11:59:18.044608+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:59:18.044608+0000","last_undegraded":"2024-09-14T11:59:18.044608+0000","last_fullsized":"2024-09-14T11:59:18.044608+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-14T11:59:18.044511+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-14T11:59:18.044511+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.044511+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.155679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'496","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.319385+0000","last_change":"2024-09-14T11:59:03.319385+0000","last_active":"2024-09-14T11:59:03.319385+0000","last_peered":"2024-09-14T11:59:03.319385+0000","last_clean":"2024-09-14T11:59:03.319385+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:59:03.319385+0000","last_undegraded":"2024-09-14T11:59:03.319385+0000","last_fullsized":"2024-09-14T11:59:03.319385+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.319251+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.665879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751184+0000","last_change":"2024-09-14T11:58:56.751104+0000","last_active":"2024-09-14T11:58:56.751184+0000","last_peered":"2024-09-14T11:58:56.751184+0000","last_clean":"2024-09-14T11:58:56.751184+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:58:56.751184+0000","last_undegraded":"2024-09-14T11:58:56.751184+0000","last_fullsized":"2024-09-14T11:58:56.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:51.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'197","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.272150+0000","last_change":"2024-09-14T11:58:52.272045+0000","last_active":"2024-09-14T11:58:52.272150+0000","last_peered":"2024-09-14T11:58:52.272150+0000","last_clean":"2024-09-14T11:58:52.272150+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:58:52.272150+0000","last_undegraded":"2024-09-14T11:58:52.272150+0000","last_fullsized":"2024-09-14T11:58:52.272150+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.271906+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:15.088566+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":761,"num_read_kb":134470,"num_write":901,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.833801+0000","last_change":"2024-09-14T11:59:12.833801+0000","last_active":"2024-09-14T11:59:12.833801+0000","last_peered":"2024-09-14T11:59:12.833801+0000","last_clean":"2024-09-14T11:59:12.833801+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:59:12.833801+0000","last_undegraded":"2024-09-14T11:59:12.833801+0000","last_fullsized":"2024-09-14T11:59:12.833801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.833667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:02.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'862","reported_seq":2317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.614930+0000","last_change":"2024-09-14T11:59:13.614856+0000","last_active":"2024-09-14T11:59:13.614930+0000","last_peered":"2024-09-14T11:59:13.614930+0000","last_clean":"2024-09-14T11:59:13.614930+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:59:13.614930+0000","last_undegraded":"2024-09-14T11:59:13.614930+0000","last_fullsized":"2024-09-14T11:59:13.614930+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'862","last_scrub_stamp":"2024-09-14T11:59:13.614752+0000","last_deep_scrub":"262'862","last_deep_scrub_stamp":"2024-09-14T11:59:13.614752+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.614752+0000","objects_scrubbed":11,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:53.390048+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34835,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1171,"num_read_kb":1364,"num_write":276,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.049133+0000","last_change":"2024-09-14T11:59:24.049072+0000","last_active":"2024-09-14T11:59:24.049133+0000","last_peered":"2024-09-14T11:59:24.049133+0000","last_clean":"2024-09-14T11:59:24.049133+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:59:24.049133+0000","last_undegraded":"2024-09-14T11:59:24.049133+0000","last_fullsized":"2024-09-14T11:59:24.049133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.048995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.048995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.048995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:26.759832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'101","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.469896+0000","last_change":"2024-09-14T11:59:21.469896+0000","last_active":"2024-09-14T11:59:21.469896+0000","last_peered":"2024-09-14T11:59:21.469896+0000","last_clean":"2024-09-14T11:59:21.469896+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:59:21.469896+0000","last_undegraded":"2024-09-14T11:59:21.469896+0000","last_fullsized":"2024-09-14T11:59:21.469896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'101","last_scrub_stamp":"2024-09-14T11:59:21.469788+0000","last_deep_scrub":"262'101","last_deep_scrub_stamp":"2024-09-14T11:59:21.469788+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.469788+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.182457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'540","reported_seq":2069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.642068+0000","last_change":"2024-09-14T11:59:02.642068+0000","last_active":"2024-09-14T11:59:02.642068+0000","last_peered":"2024-09-14T11:59:02.642068+0000","last_clean":"2024-09-14T11:59:02.642068+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:59:02.642068+0000","last_undegraded":"2024-09-14T11:59:02.642068+0000","last_fullsized":"2024-09-14T11:59:02.642068+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.641963+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:17.604167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.235879+0000","last_change":"2024-09-14T11:58:53.235819+0000","last_active":"2024-09-14T11:58:53.235879+0000","last_peered":"2024-09-14T11:58:53.235879+0000","last_clean":"2024-09-14T11:58:53.235879+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:58:53.235879+0000","last_undegraded":"2024-09-14T11:58:53.235879+0000","last_fullsized":"2024-09-14T11:58:53.235879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.235741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:53.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'177","reported_seq":779,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.608108+0000","last_change":"2024-09-14T11:58:54.608013+0000","last_active":"2024-09-14T11:58:54.608108+0000","last_peered":"2024-09-14T11:58:54.608108+0000","last_clean":"2024-09-14T11:58:54.608108+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:58:54.608108+0000","last_undegraded":"2024-09-14T11:58:54.608108+0000","last_fullsized":"2024-09-14T11:58:54.608108+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.607889+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:25.551492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":27621,"num_write":841,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.323218+0000","last_change":"2024-09-14T11:59:08.323218+0000","last_active":"2024-09-14T11:59:08.323218+0000","last_peered":"2024-09-14T11:59:08.323218+0000","last_clean":"2024-09-14T11:59:08.323218+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:59:08.323218+0000","last_undegraded":"2024-09-14T11:59:08.323218+0000","last_fullsized":"2024-09-14T11:59:08.323218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.323133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:08.984207+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'222","reported_seq":1284,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.974923+0000","last_change":"2024-09-14T11:59:17.974864+0000","last_active":"2024-09-14T11:59:17.974923+0000","last_peered":"2024-09-14T11:59:17.974923+0000","last_clean":"2024-09-14T11:59:17.974923+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:59:17.974923+0000","last_undegraded":"2024-09-14T11:59:17.974923+0000","last_fullsized":"2024-09-14T11:59:17.974923+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-14T11:59:17.974770+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-14T11:59:17.974770+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.974770+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:43.176252+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.437525+0000","last_change":"2024-09-14T11:59:19.437398+0000","last_active":"2024-09-14T11:59:19.437525+0000","last_peered":"2024-09-14T11:59:19.437525+0000","last_clean":"2024-09-14T11:59:19.437525+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:59:19.437525+0000","last_undegraded":"2024-09-14T11:59:19.437525+0000","last_fullsized":"2024-09-14T11:59:19.437525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:19.437292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:19.437292+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.437292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:35.303402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'283","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.985762+0000","last_change":"2024-09-14T11:59:29.985762+0000","last_active":"2024-09-14T11:59:29.985762+0000","last_peered":"2024-09-14T11:59:29.985762+0000","last_clean":"2024-09-14T11:59:29.985762+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:59:29.985762+0000","last_undegraded":"2024-09-14T11:59:29.985762+0000","last_fullsized":"2024-09-14T11:59:29.985762+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'283","last_scrub_stamp":"2024-09-14T11:59:29.985661+0000","last_deep_scrub":"262'283","last_deep_scrub_stamp":"2024-09-14T11:59:29.985661+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.985661+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:10.995876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'558","reported_seq":2139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.639462+0000","last_change":"2024-09-14T11:59:01.639356+0000","last_active":"2024-09-14T11:59:01.639462+0000","last_peered":"2024-09-14T11:59:01.639462+0000","last_clean":"2024-09-14T11:59:01.639462+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:59:01.639462+0000","last_undegraded":"2024-09-14T11:59:01.639462+0000","last_fullsized":"2024-09-14T11:59:01.639462+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'558","last_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_deep_scrub":"262'558","last_deep_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.639211+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:58.123592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":519,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.779905+0000","last_change":"2024-09-14T11:58:55.779846+0000","last_active":"2024-09-14T11:58:55.779905+0000","last_peered":"2024-09-14T11:58:55.779905+0000","last_clean":"2024-09-14T11:58:55.779905+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:58:55.779905+0000","last_undegraded":"2024-09-14T11:58:55.779905+0000","last_fullsized":"2024-09-14T11:58:55.779905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.779753+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:41.730972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'218","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.148995+0000","last_change":"2024-09-14T11:58:54.148939+0000","last_active":"2024-09-14T11:58:54.148995+0000","last_peered":"2024-09-14T11:58:54.148995+0000","last_clean":"2024-09-14T11:58:54.148995+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:58:54.148995+0000","last_undegraded":"2024-09-14T11:58:54.148995+0000","last_fullsized":"2024-09-14T11:58:54.148995+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.148824+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:26.080263+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":21127,"num_write":1026,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.399101+0000","last_change":"2024-09-14T11:59:12.398988+0000","last_active":"2024-09-14T11:59:12.399101+0000","last_peered":"2024-09-14T11:59:12.399101+0000","last_clean":"2024-09-14T11:59:12.399101+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:59:12.399101+0000","last_undegraded":"2024-09-14T11:59:12.399101+0000","last_fullsized":"2024-09-14T11:59:12.399101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.398880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.920892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'131","reported_seq":674,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.989487+0000","last_change":"2024-09-14T11:59:18.989487+0000","last_active":"2024-09-14T11:59:18.989487+0000","last_peered":"2024-09-14T11:59:18.989487+0000","last_clean":"2024-09-14T11:59:18.989487+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:59:18.989487+0000","last_undegraded":"2024-09-14T11:59:18.989487+0000","last_fullsized":"2024-09-14T11:59:18.989487+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-14T11:59:18.989375+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-14T11:59:18.989375+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.989375+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:46.747353+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.128482+0000","last_change":"2024-09-14T11:59:12.128482+0000","last_active":"2024-09-14T11:59:12.128482+0000","last_peered":"2024-09-14T11:59:12.128482+0000","last_clean":"2024-09-14T11:59:12.128482+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:59:12.128482+0000","last_undegraded":"2024-09-14T11:59:12.128482+0000","last_fullsized":"2024-09-14T11:59:12.128482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.128387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:35.793136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'168","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.854061+0000","last_change":"2024-09-14T11:59:25.854061+0000","last_active":"2024-09-14T11:59:25.854061+0000","last_peered":"2024-09-14T11:59:25.854061+0000","last_clean":"2024-09-14T11:59:25.854061+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:59:25.854061+0000","last_undegraded":"2024-09-14T11:59:25.854061+0000","last_fullsized":"2024-09-14T11:59:25.854061+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-14T11:59:25.853968+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-14T11:59:25.853968+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.853968+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:16.886940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'893","reported_seq":2637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.605858+0000","last_change":"2024-09-14T11:59:00.605777+0000","last_active":"2024-09-14T11:59:00.605858+0000","last_peered":"2024-09-14T11:59:00.605858+0000","last_clean":"2024-09-14T11:59:00.605858+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:59:00.605858+0000","last_undegraded":"2024-09-14T11:59:00.605858+0000","last_fullsized":"2024-09-14T11:59:00.605858+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'893","last_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_deep_scrub":"262'893","last_deep_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.605689+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:06.292394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'214","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.779435+0000","last_change":"2024-09-14T11:58:56.779368+0000","last_active":"2024-09-14T11:58:56.779435+0000","last_peered":"2024-09-14T11:58:56.779435+0000","last_clean":"2024-09-14T11:58:56.779435+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:58:56.779435+0000","last_undegraded":"2024-09-14T11:58:56.779435+0000","last_fullsized":"2024-09-14T11:58:56.779435+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'214","last_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_deep_scrub":"262'214","last_deep_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.779283+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:05.019231+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146072,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":7241,"num_write":969,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.671249+0000","last_change":"2024-09-14T11:58:52.671195+0000","last_active":"2024-09-14T11:58:52.671249+0000","last_peered":"2024-09-14T11:58:52.671249+0000","last_clean":"2024-09-14T11:58:52.671249+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:58:52.671249+0000","last_undegraded":"2024-09-14T11:58:52.671249+0000","last_fullsized":"2024-09-14T11:58:52.671249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.671120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:36.505369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.404792+0000","last_change":"2024-09-14T11:59:11.404674+0000","last_active":"2024-09-14T11:59:11.404792+0000","last_peered":"2024-09-14T11:59:11.404792+0000","last_clean":"2024-09-14T11:59:11.404792+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:59:11.404792+0000","last_undegraded":"2024-09-14T11:59:11.404792+0000","last_fullsized":"2024-09-14T11:59:11.404792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.404575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:53.428957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'278","reported_seq":937,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.375942+0000","last_change":"2024-09-14T11:59:15.375871+0000","last_active":"2024-09-14T11:59:15.375942+0000","last_peered":"2024-09-14T11:59:15.375942+0000","last_clean":"2024-09-14T11:59:15.375942+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:59:15.375942+0000","last_undegraded":"2024-09-14T11:59:15.375942+0000","last_fullsized":"2024-09-14T11:59:15.375942+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'278","last_scrub_stamp":"2024-09-14T11:59:15.375762+0000","last_deep_scrub":"262'278","last_deep_scrub_stamp":"2024-09-14T11:59:15.375762+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.375762+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:58.310749+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16117,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":365,"num_read_kb":486,"num_write":204,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.010139+0000","last_change":"2024-09-14T11:59:24.010050+0000","last_active":"2024-09-14T11:59:24.010139+0000","last_peered":"2024-09-14T11:59:24.010139+0000","last_clean":"2024-09-14T11:59:24.010139+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:59:24.010139+0000","last_undegraded":"2024-09-14T11:59:24.010139+0000","last_fullsized":"2024-09-14T11:59:24.010139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.009956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.009956+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.009956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:37.498313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'174","reported_seq":671,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.614163+0000","last_change":"2024-09-14T11:59:35.614163+0000","last_active":"2024-09-14T11:59:35.614163+0000","last_peered":"2024-09-14T11:59:35.614163+0000","last_clean":"2024-09-14T11:59:35.614163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:59:35.614163+0000","last_undegraded":"2024-09-14T11:59:35.614163+0000","last_fullsized":"2024-09-14T11:59:35.614163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'174","last_scrub_stamp":"2024-09-14T11:59:35.614051+0000","last_deep_scrub":"262'174","last_deep_scrub_stamp":"2024-09-14T11:59:35.614051+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.614051+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:29.097052+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'774","reported_seq":2195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.277548+0000","last_change":"2024-09-14T11:59:02.277485+0000","last_active":"2024-09-14T11:59:02.277548+0000","last_peered":"2024-09-14T11:59:02.277548+0000","last_clean":"2024-09-14T11:59:02.277548+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:59:02.277548+0000","last_undegraded":"2024-09-14T11:59:02.277548+0000","last_fullsized":"2024-09-14T11:59:02.277548+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.277389+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:34.730626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'268","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.656930+0000","last_change":"2024-09-14T11:58:55.656880+0000","last_active":"2024-09-14T11:58:55.656930+0000","last_peered":"2024-09-14T11:58:55.656930+0000","last_clean":"2024-09-14T11:58:55.656930+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:58:55.656930+0000","last_undegraded":"2024-09-14T11:58:55.656930+0000","last_fullsized":"2024-09-14T11:58:55.656930+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'268","last_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_deep_scrub":"262'268","last_deep_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.656804+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.470057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":40043,"num_write":1045,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.713853+0000","last_change":"2024-09-14T11:58:55.713779+0000","last_active":"2024-09-14T11:58:55.713853+0000","last_peered":"2024-09-14T11:58:55.713853+0000","last_clean":"2024-09-14T11:58:55.713853+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:58:55.713853+0000","last_undegraded":"2024-09-14T11:58:55.713853+0000","last_fullsized":"2024-09-14T11:58:55.713853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.713672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:50.890524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"262'5","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.148314+0000","last_change":"2024-09-14T11:59:08.148251+0000","last_active":"2024-09-14T11:59:08.148314+0000","last_peered":"2024-09-14T11:59:08.148314+0000","last_clean":"2024-09-14T11:59:08.148314+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:59:08.148314+0000","last_undegraded":"2024-09-14T11:59:08.148314+0000","last_fullsized":"2024-09-14T11:59:08.148314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.148173+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:01.374450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'175","reported_seq":740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.609529+0000","last_change":"2024-09-14T11:59:12.609466+0000","last_active":"2024-09-14T11:59:12.609529+0000","last_peered":"2024-09-14T11:59:12.609529+0000","last_clean":"2024-09-14T11:59:12.609529+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:59:12.609529+0000","last_undegraded":"2024-09-14T11:59:12.609529+0000","last_fullsized":"2024-09-14T11:59:12.609529+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'175","last_scrub_stamp":"2024-09-14T11:59:12.609349+0000","last_deep_scrub":"262'175","last_deep_scrub_stamp":"2024-09-14T11:59:12.609349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.609349+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:57.156455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'800","reported_seq":4709,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.850116+0000","last_change":"2024-09-14T11:59:21.850044+0000","last_active":"2024-09-14T11:59:21.850116+0000","last_peered":"2024-09-14T11:59:21.850116+0000","last_clean":"2024-09-14T11:59:21.850116+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:59:21.850116+0000","last_undegraded":"2024-09-14T11:59:21.850116+0000","last_fullsized":"2024-09-14T11:59:21.850116+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'800","last_scrub_stamp":"2024-09-14T11:59:21.849956+0000","last_deep_scrub":"262'800","last_deep_scrub_stamp":"2024-09-14T11:59:21.849956+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.849956+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:50.151179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'134","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.987423+0000","last_change":"2024-09-14T11:59:30.987423+0000","last_active":"2024-09-14T11:59:30.987423+0000","last_peered":"2024-09-14T11:59:30.987423+0000","last_clean":"2024-09-14T11:59:30.987423+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:59:30.987423+0000","last_undegraded":"2024-09-14T11:59:30.987423+0000","last_fullsized":"2024-09-14T11:59:30.987423+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-14T11:59:30.987323+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-14T11:59:30.987323+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.987323+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:35.943996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'892","reported_seq":2481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.989934+0000","last_change":"2024-09-14T11:59:10.989877+0000","last_active":"2024-09-14T11:59:10.989934+0000","last_peered":"2024-09-14T11:59:10.989934+0000","last_clean":"2024-09-14T11:59:10.989934+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:59:10.989934+0000","last_undegraded":"2024-09-14T11:59:10.989934+0000","last_fullsized":"2024-09-14T11:59:10.989934+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'892","last_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_deep_scrub":"262'892","last_deep_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.989791+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:39.808429+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'247","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.849696+0000","last_change":"2024-09-14T11:58:54.849696+0000","last_active":"2024-09-14T11:58:54.849696+0000","last_peered":"2024-09-14T11:58:54.849696+0000","last_clean":"2024-09-14T11:58:54.849696+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:58:54.849696+0000","last_undegraded":"2024-09-14T11:58:54.849696+0000","last_fullsized":"2024-09-14T11:58:54.849696+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.849617+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:59.404448+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460231,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":25317,"num_write":1130,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.648824+0000","last_change":"2024-09-14T11:58:53.648824+0000","last_active":"2024-09-14T11:58:53.648824+0000","last_peered":"2024-09-14T11:58:53.648824+0000","last_clean":"2024-09-14T11:58:53.648824+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:58:53.648824+0000","last_undegraded":"2024-09-14T11:58:53.648824+0000","last_fullsized":"2024-09-14T11:58:53.648824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.648747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:10.973858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.094595+0000","last_change":"2024-09-14T11:59:15.094514+0000","last_active":"2024-09-14T11:59:15.094595+0000","last_peered":"2024-09-14T11:59:15.094595+0000","last_clean":"2024-09-14T11:59:15.094595+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:59:15.094595+0000","last_undegraded":"2024-09-14T11:59:15.094595+0000","last_fullsized":"2024-09-14T11:59:15.094595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.094426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.094426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:27.096812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'117","reported_seq":653,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.038533+0000","last_change":"2024-09-14T11:59:18.038476+0000","last_active":"2024-09-14T11:59:18.038533+0000","last_peered":"2024-09-14T11:59:18.038533+0000","last_clean":"2024-09-14T11:59:18.038533+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:59:18.038533+0000","last_undegraded":"2024-09-14T11:59:18.038533+0000","last_fullsized":"2024-09-14T11:59:18.038533+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-14T11:59:18.038350+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-14T11:59:18.038350+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.038350+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.051109+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'813","reported_seq":2440,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.969645+0000","last_change":"2024-09-14T11:59:25.969585+0000","last_active":"2024-09-14T11:59:25.969645+0000","last_peered":"2024-09-14T11:59:25.969645+0000","last_clean":"2024-09-14T11:59:25.969645+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:59:25.969645+0000","last_undegraded":"2024-09-14T11:59:25.969645+0000","last_fullsized":"2024-09-14T11:59:25.969645+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'813","last_scrub_stamp":"2024-09-14T11:59:25.969495+0000","last_deep_scrub":"262'813","last_deep_scrub_stamp":"2024-09-14T11:59:25.969495+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.969495+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:30.507066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'287","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.424508+0000","last_change":"2024-09-14T11:59:26.424508+0000","last_active":"2024-09-14T11:59:26.424508+0000","last_peered":"2024-09-14T11:59:26.424508+0000","last_clean":"2024-09-14T11:59:26.424508+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:59:26.424508+0000","last_undegraded":"2024-09-14T11:59:26.424508+0000","last_fullsized":"2024-09-14T11:59:26.424508+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'287","last_scrub_stamp":"2024-09-14T11:59:26.424403+0000","last_deep_scrub":"262'287","last_deep_scrub_stamp":"2024-09-14T11:59:26.424403+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.424403+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:31.538298+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'405","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.182110+0000","last_change":"2024-09-14T11:58:59.182039+0000","last_active":"2024-09-14T11:58:59.182110+0000","last_peered":"2024-09-14T11:58:59.182110+0000","last_clean":"2024-09-14T11:58:59.182110+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:58:59.182110+0000","last_undegraded":"2024-09-14T11:58:59.182110+0000","last_fullsized":"2024-09-14T11:58:59.182110+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.181953+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:02.301110+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'220","reported_seq":847,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.306793+0000","last_change":"2024-09-14T11:58:53.306687+0000","last_active":"2024-09-14T11:58:53.306793+0000","last_peered":"2024-09-14T11:58:53.306793+0000","last_clean":"2024-09-14T11:58:53.306793+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:58:53.306793+0000","last_undegraded":"2024-09-14T11:58:53.306793+0000","last_fullsized":"2024-09-14T11:58:53.306793+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.306580+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.561679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":11363,"num_write":1017,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.267522+0000","last_change":"2024-09-14T11:58:55.267522+0000","last_active":"2024-09-14T11:58:55.267522+0000","last_peered":"2024-09-14T11:58:55.267522+0000","last_clean":"2024-09-14T11:58:55.267522+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:58:55.267522+0000","last_undegraded":"2024-09-14T11:58:55.267522+0000","last_fullsized":"2024-09-14T11:58:55.267522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.267441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:53.067234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.911560+0000","last_change":"2024-09-14T11:59:13.911455+0000","last_active":"2024-09-14T11:59:13.911560+0000","last_peered":"2024-09-14T11:59:13.911560+0000","last_clean":"2024-09-14T11:59:13.911560+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:59:13.911560+0000","last_undegraded":"2024-09-14T11:59:13.911560+0000","last_fullsized":"2024-09-14T11:59:13.911560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.911349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.911349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.911349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:57.497967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'312","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.958336+0000","last_change":"2024-09-14T11:59:15.958245+0000","last_active":"2024-09-14T11:59:15.958336+0000","last_peered":"2024-09-14T11:59:15.958336+0000","last_clean":"2024-09-14T11:59:15.958336+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:59:15.958336+0000","last_undegraded":"2024-09-14T11:59:15.958336+0000","last_fullsized":"2024-09-14T11:59:15.958336+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'312","last_scrub_stamp":"2024-09-14T11:59:15.958147+0000","last_deep_scrub":"262'312","last_deep_scrub_stamp":"2024-09-14T11:59:15.958147+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.958147+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:20.078226+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":677,"num_write":230,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.940845+0000","last_change":"2024-09-14T11:59:26.940781+0000","last_active":"2024-09-14T11:59:26.940845+0000","last_peered":"2024-09-14T11:59:26.940845+0000","last_clean":"2024-09-14T11:59:26.940845+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:59:26.940845+0000","last_undegraded":"2024-09-14T11:59:26.940845+0000","last_fullsized":"2024-09-14T11:59:26.940845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:26.940679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:26.940679+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.940679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:03.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'138","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.818284+0000","last_change":"2024-09-14T11:59:26.818284+0000","last_active":"2024-09-14T11:59:26.818284+0000","last_peered":"2024-09-14T11:59:26.818284+0000","last_clean":"2024-09-14T11:59:26.818284+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:59:26.818284+0000","last_undegraded":"2024-09-14T11:59:26.818284+0000","last_fullsized":"2024-09-14T11:59:26.818284+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'138","last_scrub_stamp":"2024-09-14T11:59:26.818190+0000","last_deep_scrub":"262'138","last_deep_scrub_stamp":"2024-09-14T11:59:26.818190+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.818190+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:40.337971+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'147","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.573600+0000","last_change":"2024-09-14T11:59:30.573600+0000","last_active":"2024-09-14T11:59:30.573600+0000","last_peered":"2024-09-14T11:59:30.573600+0000","last_clean":"2024-09-14T11:59:30.573600+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:59:30.573600+0000","last_undegraded":"2024-09-14T11:59:30.573600+0000","last_fullsized":"2024-09-14T11:59:30.573600+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-14T11:59:30.573508+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-14T11:59:30.573508+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.573508+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:59.632163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'566","reported_seq":2437,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.169676+0000","last_change":"2024-09-14T11:59:04.169611+0000","last_active":"2024-09-14T11:59:04.169676+0000","last_peered":"2024-09-14T11:59:04.169676+0000","last_clean":"2024-09-14T11:59:04.169676+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:59:04.169676+0000","last_undegraded":"2024-09-14T11:59:04.169676+0000","last_fullsized":"2024-09-14T11:59:04.169676+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'566","last_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_deep_scrub":"262'566","last_deep_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.169517+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:42.390726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'204","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.091134+0000","last_change":"2024-09-14T11:58:57.091134+0000","last_active":"2024-09-14T11:58:57.091134+0000","last_peered":"2024-09-14T11:58:57.091134+0000","last_clean":"2024-09-14T11:58:57.091134+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:58:57.091134+0000","last_undegraded":"2024-09-14T11:58:57.091134+0000","last_fullsized":"2024-09-14T11:58:57.091134+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.091049+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:22.628478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":19870,"num_write":904,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.621566+0000","last_change":"2024-09-14T11:59:09.621484+0000","last_active":"2024-09-14T11:59:09.621566+0000","last_peered":"2024-09-14T11:59:09.621566+0000","last_clean":"2024-09-14T11:59:09.621566+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:59:09.621566+0000","last_undegraded":"2024-09-14T11:59:09.621566+0000","last_fullsized":"2024-09-14T11:59:09.621566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.621385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:21.637776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'162","reported_seq":737,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.015768+0000","last_change":"2024-09-14T11:59:21.015768+0000","last_active":"2024-09-14T11:59:21.015768+0000","last_peered":"2024-09-14T11:59:21.015768+0000","last_clean":"2024-09-14T11:59:21.015768+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:59:21.015768+0000","last_undegraded":"2024-09-14T11:59:21.015768+0000","last_fullsized":"2024-09-14T11:59:21.015768+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-14T11:59:21.015653+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-14T11:59:21.015653+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.015653+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:32.632601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":267,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.981394+0000","last_change":"2024-09-14T11:59:28.981394+0000","last_active":"2024-09-14T11:59:28.981394+0000","last_peered":"2024-09-14T11:59:28.981394+0000","last_clean":"2024-09-14T11:59:28.981394+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:59:28.981394+0000","last_undegraded":"2024-09-14T11:59:28.981394+0000","last_fullsized":"2024-09-14T11:59:28.981394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:28.981308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:28.981308+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.981308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:52.423936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.997195+0000","last_change":"2024-09-14T11:59:35.997065+0000","last_active":"2024-09-14T11:59:35.997195+0000","last_peered":"2024-09-14T11:59:35.997195+0000","last_clean":"2024-09-14T11:59:35.997195+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:59:35.997195+0000","last_undegraded":"2024-09-14T11:59:35.997195+0000","last_fullsized":"2024-09-14T11:59:35.997195+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'157","last_scrub_stamp":"2024-09-14T11:59:35.996972+0000","last_deep_scrub":"262'157","last_deep_scrub_stamp":"2024-09-14T11:59:35.996972+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.996972+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:51.564966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1372","reported_seq":3016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.656428+0000","last_change":"2024-09-14T11:59:06.656353+0000","last_active":"2024-09-14T11:59:06.656428+0000","last_peered":"2024-09-14T11:59:06.656428+0000","last_clean":"2024-09-14T11:59:06.656428+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:59:06.656428+0000","last_undegraded":"2024-09-14T11:59:06.656428+0000","last_fullsized":"2024-09-14T11:59:06.656428+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1372","last_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_deep_scrub":"262'1372","last_deep_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.656260+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":1300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:59.071627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'177","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.826463+0000","last_change":"2024-09-14T11:59:02.826361+0000","last_active":"2024-09-14T11:59:02.826463+0000","last_peered":"2024-09-14T11:59:02.826463+0000","last_clean":"2024-09-14T11:59:02.826463+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:59:02.826463+0000","last_undegraded":"2024-09-14T11:59:02.826463+0000","last_fullsized":"2024-09-14T11:59:02.826463+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.826225+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:54.230672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":363,"num_read_kb":34037,"num_write":744,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.913452+0000","last_change":"2024-09-14T11:59:16.913452+0000","last_active":"2024-09-14T11:59:16.913452+0000","last_peered":"2024-09-14T11:59:16.913452+0000","last_clean":"2024-09-14T11:59:16.913452+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:59:16.913452+0000","last_undegraded":"2024-09-14T11:59:16.913452+0000","last_fullsized":"2024-09-14T11:59:16.913452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.913365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.913365+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.913365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:59.099290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'46","reported_seq":545,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.402834+0000","last_change":"2024-09-14T11:59:16.402834+0000","last_active":"2024-09-14T11:59:16.402834+0000","last_peered":"2024-09-14T11:59:16.402834+0000","last_clean":"2024-09-14T11:59:16.402834+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:59:16.402834+0000","last_undegraded":"2024-09-14T11:59:16.402834+0000","last_fullsized":"2024-09-14T11:59:16.402834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-14T11:59:16.402762+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-14T11:59:16.402762+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.402762+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:11.461190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.050407+0000","last_change":"2024-09-14T11:59:23.050407+0000","last_active":"2024-09-14T11:59:23.050407+0000","last_peered":"2024-09-14T11:59:23.050407+0000","last_clean":"2024-09-14T11:59:23.050407+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:59:23.050407+0000","last_undegraded":"2024-09-14T11:59:23.050407+0000","last_fullsized":"2024-09-14T11:59:23.050407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.050311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.050311+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.050311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:36.878476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'217","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.543879+0000","last_change":"2024-09-14T11:59:29.543879+0000","last_active":"2024-09-14T11:59:29.543879+0000","last_peered":"2024-09-14T11:59:29.543879+0000","last_clean":"2024-09-14T11:59:29.543879+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:59:29.543879+0000","last_undegraded":"2024-09-14T11:59:29.543879+0000","last_fullsized":"2024-09-14T11:59:29.543879+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:29.543784+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:29.543784+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.543784+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:15.150493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'457","reported_seq":2000,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.857974+0000","last_change":"2024-09-14T11:59:03.857852+0000","last_active":"2024-09-14T11:59:03.857974+0000","last_peered":"2024-09-14T11:59:03.857974+0000","last_clean":"2024-09-14T11:59:03.857974+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:59:03.857974+0000","last_undegraded":"2024-09-14T11:59:03.857974+0000","last_fullsized":"2024-09-14T11:59:03.857974+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.857750+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:10.626306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'357","reported_seq":1010,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.206349+0000","last_change":"2024-09-14T11:59:23.206298+0000","last_active":"2024-09-14T11:59:23.206349+0000","last_peered":"2024-09-14T11:59:23.206349+0000","last_clean":"2024-09-14T11:59:23.206349+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:59:23.206349+0000","last_undegraded":"2024-09-14T11:59:23.206349+0000","last_fullsized":"2024-09-14T11:59:23.206349+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'357","last_scrub_stamp":"2024-09-14T11:59:23.206216+0000","last_deep_scrub":"262'357","last_deep_scrub_stamp":"2024-09-14T11:59:23.206216+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.206216+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:29.712357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":986,"num_read_kb":18905,"num_write":1307,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.991490+0000","last_change":"2024-09-14T11:59:14.991490+0000","last_active":"2024-09-14T11:59:14.991490+0000","last_peered":"2024-09-14T11:59:14.991490+0000","last_clean":"2024-09-14T11:59:14.991490+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:59:14.991490+0000","last_undegraded":"2024-09-14T11:59:14.991490+0000","last_fullsized":"2024-09-14T11:59:14.991490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.991406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.991406+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.991406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.178425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'164","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.010383+0000","last_change":"2024-09-14T11:59:23.010383+0000","last_active":"2024-09-14T11:59:23.010383+0000","last_peered":"2024-09-14T11:59:23.010383+0000","last_clean":"2024-09-14T11:59:23.010383+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:59:23.010383+0000","last_undegraded":"2024-09-14T11:59:23.010383+0000","last_fullsized":"2024-09-14T11:59:23.010383+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'164","last_scrub_stamp":"2024-09-14T11:59:23.010289+0000","last_deep_scrub":"262'164","last_deep_scrub_stamp":"2024-09-14T11:59:23.010289+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.010289+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:06.750831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":270,"num_write":114,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.138330+0000","last_change":"2024-09-14T11:59:14.138330+0000","last_active":"2024-09-14T11:59:14.138330+0000","last_peered":"2024-09-14T11:59:14.138330+0000","last_clean":"2024-09-14T11:59:14.138330+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:59:14.138330+0000","last_undegraded":"2024-09-14T11:59:14.138330+0000","last_fullsized":"2024-09-14T11:59:14.138330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.138251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.138251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.138251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:56.076443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'117","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.929825+0000","last_change":"2024-09-14T11:59:29.929825+0000","last_active":"2024-09-14T11:59:29.929825+0000","last_peered":"2024-09-14T11:59:29.929825+0000","last_clean":"2024-09-14T11:59:29.929825+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:59:29.929825+0000","last_undegraded":"2024-09-14T11:59:29.929825+0000","last_fullsized":"2024-09-14T11:59:29.929825+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-14T11:59:29.929714+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-14T11:59:29.929714+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.929714+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:47.615152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'812","reported_seq":2491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.010485+0000","last_change":"2024-09-14T11:59:12.010369+0000","last_active":"2024-09-14T11:59:12.010485+0000","last_peered":"2024-09-14T11:59:12.010485+0000","last_clean":"2024-09-14T11:59:12.010485+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:59:12.010485+0000","last_undegraded":"2024-09-14T11:59:12.010485+0000","last_fullsized":"2024-09-14T11:59:12.010485+0000","mapping_epoch":26,"log_start":"262'801","ondisk_log_start":"262'801","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'812","last_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_deep_scrub":"262'812","last_deep_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.010264+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:55.948418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'266","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.277392+0000","last_change":"2024-09-14T11:58:55.277324+0000","last_active":"2024-09-14T11:58:55.277392+0000","last_peered":"2024-09-14T11:58:55.277392+0000","last_clean":"2024-09-14T11:58:55.277392+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:58:55.277392+0000","last_undegraded":"2024-09-14T11:58:55.277392+0000","last_fullsized":"2024-09-14T11:58:55.277392+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'266","last_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_deep_scrub":"262'266","last_deep_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.277222+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:42.232250+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730159,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":14443,"num_write":1155,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.121731+0000","last_change":"2024-09-14T11:59:10.121731+0000","last_active":"2024-09-14T11:59:10.121731+0000","last_peered":"2024-09-14T11:59:10.121731+0000","last_clean":"2024-09-14T11:59:10.121731+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:59:10.121731+0000","last_undegraded":"2024-09-14T11:59:10.121731+0000","last_fullsized":"2024-09-14T11:59:10.121731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.121629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:35.666450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'140","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.942378+0000","last_change":"2024-09-14T11:59:19.942378+0000","last_active":"2024-09-14T11:59:19.942378+0000","last_peered":"2024-09-14T11:59:19.942378+0000","last_clean":"2024-09-14T11:59:19.942378+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:59:19.942378+0000","last_undegraded":"2024-09-14T11:59:19.942378+0000","last_fullsized":"2024-09-14T11:59:19.942378+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:19.942291+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:19.942291+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.942291+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:17.318683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44743,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":353,"num_write":106,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.437817+0000","last_change":"2024-09-14T11:59:23.437817+0000","last_active":"2024-09-14T11:59:23.437817+0000","last_peered":"2024-09-14T11:59:23.437817+0000","last_clean":"2024-09-14T11:59:23.437817+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:59:23.437817+0000","last_undegraded":"2024-09-14T11:59:23.437817+0000","last_fullsized":"2024-09-14T11:59:23.437817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.437727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.437727+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.437727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:36.382250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'852","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.204861+0000","last_change":"2024-09-14T11:59:05.204800+0000","last_active":"2024-09-14T11:59:05.204861+0000","last_peered":"2024-09-14T11:59:05.204861+0000","last_clean":"2024-09-14T11:59:05.204861+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:59:05.204861+0000","last_undegraded":"2024-09-14T11:59:05.204861+0000","last_fullsized":"2024-09-14T11:59:05.204861+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.204698+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:33.564491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'204","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.874744+0000","last_change":"2024-09-14T11:58:57.874630+0000","last_active":"2024-09-14T11:58:57.874744+0000","last_peered":"2024-09-14T11:58:57.874744+0000","last_clean":"2024-09-14T11:58:57.874744+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:58:57.874744+0000","last_undegraded":"2024-09-14T11:58:57.874744+0000","last_fullsized":"2024-09-14T11:58:57.874744+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.874491+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:32.927288+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":38166,"num_write":911,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.378276+0000","last_change":"2024-09-14T11:59:13.378224+0000","last_active":"2024-09-14T11:59:13.378276+0000","last_peered":"2024-09-14T11:59:13.378276+0000","last_clean":"2024-09-14T11:59:13.378276+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:59:13.378276+0000","last_undegraded":"2024-09-14T11:59:13.378276+0000","last_fullsized":"2024-09-14T11:59:13.378276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.378137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:53.165338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'203","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.597243+0000","last_change":"2024-09-14T11:59:14.597243+0000","last_active":"2024-09-14T11:59:14.597243+0000","last_peered":"2024-09-14T11:59:14.597243+0000","last_clean":"2024-09-14T11:59:14.597243+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:59:14.597243+0000","last_undegraded":"2024-09-14T11:59:14.597243+0000","last_fullsized":"2024-09-14T11:59:14.597243+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-14T11:59:14.597139+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-14T11:59:14.597139+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.597139+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:21.520459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14688,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":397,"num_write":180,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.884004+0000","last_change":"2024-09-14T11:59:23.884004+0000","last_active":"2024-09-14T11:59:23.884004+0000","last_peered":"2024-09-14T11:59:23.884004+0000","last_clean":"2024-09-14T11:59:23.884004+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:59:23.884004+0000","last_undegraded":"2024-09-14T11:59:23.884004+0000","last_fullsized":"2024-09-14T11:59:23.884004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.883920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.883920+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.883920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:02.477946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'162","reported_seq":680,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.005005+0000","last_change":"2024-09-14T11:59:34.005005+0000","last_active":"2024-09-14T11:59:34.005005+0000","last_peered":"2024-09-14T11:59:34.005005+0000","last_clean":"2024-09-14T11:59:34.005005+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:59:34.005005+0000","last_undegraded":"2024-09-14T11:59:34.005005+0000","last_fullsized":"2024-09-14T11:59:34.005005+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-14T11:59:34.004895+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-14T11:59:34.004895+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.004895+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:16.336948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.337630+0000","last_change":"2024-09-14T11:59:06.337559+0000","last_active":"2024-09-14T11:59:06.337630+0000","last_peered":"2024-09-14T11:59:06.337630+0000","last_clean":"2024-09-14T11:59:06.337630+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:59:06.337630+0000","last_undegraded":"2024-09-14T11:59:06.337630+0000","last_fullsized":"2024-09-14T11:59:06.337630+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'451","last_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_deep_scrub":"262'451","last_deep_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.337474+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:21.970696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'228","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.646609+0000","last_change":"2024-09-14T11:58:56.646544+0000","last_active":"2024-09-14T11:58:56.646609+0000","last_peered":"2024-09-14T11:58:56.646609+0000","last_clean":"2024-09-14T11:58:56.646609+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:58:56.646609+0000","last_undegraded":"2024-09-14T11:58:56.646609+0000","last_fullsized":"2024-09-14T11:58:56.646609+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'228","last_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_deep_scrub":"262'228","last_deep_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.646441+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:26.476328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":613,"num_read_kb":11802,"num_write":1015,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.110861+0000","last_change":"2024-09-14T11:59:09.110795+0000","last_active":"2024-09-14T11:59:09.110861+0000","last_peered":"2024-09-14T11:59:09.110861+0000","last_clean":"2024-09-14T11:59:09.110861+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:59:09.110861+0000","last_undegraded":"2024-09-14T11:59:09.110861+0000","last_fullsized":"2024-09-14T11:59:09.110861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.110702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.995238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'165","reported_seq":744,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.021469+0000","last_change":"2024-09-14T11:59:22.021469+0000","last_active":"2024-09-14T11:59:22.021469+0000","last_peered":"2024-09-14T11:59:22.021469+0000","last_clean":"2024-09-14T11:59:22.021469+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:59:22.021469+0000","last_undegraded":"2024-09-14T11:59:22.021469+0000","last_fullsized":"2024-09-14T11:59:22.021469+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-14T11:59:22.021375+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-14T11:59:22.021375+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.021375+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:46.273089+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":272,"num_write":132,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.584120+0000","last_change":"2024-09-14T11:59:16.584120+0000","last_active":"2024-09-14T11:59:16.584120+0000","last_peered":"2024-09-14T11:59:16.584120+0000","last_clean":"2024-09-14T11:59:16.584120+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:59:16.584120+0000","last_undegraded":"2024-09-14T11:59:16.584120+0000","last_fullsized":"2024-09-14T11:59:16.584120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.584048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.584048+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.584048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:32.202317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'263","reported_seq":1134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.058263+0000","last_change":"2024-09-14T11:59:19.058263+0000","last_active":"2024-09-14T11:59:19.058263+0000","last_peered":"2024-09-14T11:59:19.058263+0000","last_clean":"2024-09-14T11:59:19.058263+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:59:19.058263+0000","last_undegraded":"2024-09-14T11:59:19.058263+0000","last_fullsized":"2024-09-14T11:59:19.058263+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-14T11:59:19.058169+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-14T11:59:19.058169+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.058169+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:10.548056+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'852","reported_seq":2428,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.986861+0000","last_change":"2024-09-14T11:59:07.986861+0000","last_active":"2024-09-14T11:59:07.986861+0000","last_peered":"2024-09-14T11:59:07.986861+0000","last_clean":"2024-09-14T11:59:07.986861+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:59:07.986861+0000","last_undegraded":"2024-09-14T11:59:07.986861+0000","last_fullsized":"2024-09-14T11:59:07.986861+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.986754+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:08.810573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'197","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.093051+0000","last_change":"2024-09-14T11:58:56.093051+0000","last_active":"2024-09-14T11:58:56.093051+0000","last_peered":"2024-09-14T11:58:56.093051+0000","last_clean":"2024-09-14T11:58:56.093051+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:58:56.093051+0000","last_undegraded":"2024-09-14T11:58:56.093051+0000","last_fullsized":"2024-09-14T11:58:56.093051+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.092935+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.174953+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.987803+0000","last_change":"2024-09-14T11:59:24.987803+0000","last_active":"2024-09-14T11:59:24.987803+0000","last_peered":"2024-09-14T11:59:24.987803+0000","last_clean":"2024-09-14T11:59:24.987803+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:59:24.987803+0000","last_undegraded":"2024-09-14T11:59:24.987803+0000","last_fullsized":"2024-09-14T11:59:24.987803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.987710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.987710+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.987710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:45.341975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'136","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.019921+0000","last_change":"2024-09-14T11:59:25.019921+0000","last_active":"2024-09-14T11:59:25.019921+0000","last_peered":"2024-09-14T11:59:25.019921+0000","last_clean":"2024-09-14T11:59:25.019921+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:59:25.019921+0000","last_undegraded":"2024-09-14T11:59:25.019921+0000","last_fullsized":"2024-09-14T11:59:25.019921+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'136","last_scrub_stamp":"2024-09-14T11:59:25.019830+0000","last_deep_scrub":"262'136","last_deep_scrub_stamp":"2024-09-14T11:59:25.019830+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.019830+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:22.545522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":266,"num_write":100,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.537455+0000","last_change":"2024-09-14T11:59:17.537358+0000","last_active":"2024-09-14T11:59:17.537455+0000","last_peered":"2024-09-14T11:59:17.537455+0000","last_clean":"2024-09-14T11:59:17.537455+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:59:17.537455+0000","last_undegraded":"2024-09-14T11:59:17.537455+0000","last_fullsized":"2024-09-14T11:59:17.537455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.537163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.537163+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.537163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:38.017897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'148","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.841819+0000","last_change":"2024-09-14T11:59:27.841819+0000","last_active":"2024-09-14T11:59:27.841819+0000","last_peered":"2024-09-14T11:59:27.841819+0000","last_clean":"2024-09-14T11:59:27.841819+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:59:27.841819+0000","last_undegraded":"2024-09-14T11:59:27.841819+0000","last_fullsized":"2024-09-14T11:59:27.841819+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-14T11:59:27.841705+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-14T11:59:27.841705+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.841705+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:58.669872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'428","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.288212+0000","last_change":"2024-09-14T11:58:57.288212+0000","last_active":"2024-09-14T11:58:57.288212+0000","last_peered":"2024-09-14T11:58:57.288212+0000","last_clean":"2024-09-14T11:58:57.288212+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:57.288212+0000","last_undegraded":"2024-09-14T11:58:57.288212+0000","last_fullsized":"2024-09-14T11:58:57.288212+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'428","last_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_deep_scrub":"262'428","last_deep_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.288124+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:39.134746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'224","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.269287+0000","last_change":"2024-09-14T11:58:56.269287+0000","last_active":"2024-09-14T11:58:56.269287+0000","last_peered":"2024-09-14T11:58:56.269287+0000","last_clean":"2024-09-14T11:58:56.269287+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:58:56.269287+0000","last_undegraded":"2024-09-14T11:58:56.269287+0000","last_fullsized":"2024-09-14T11:58:56.269287+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'224","last_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_deep_scrub":"262'224","last_deep_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.269178+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.507042+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":12620,"num_write":955,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.640793+0000","last_change":"2024-09-14T11:59:11.640793+0000","last_active":"2024-09-14T11:59:11.640793+0000","last_peered":"2024-09-14T11:59:11.640793+0000","last_clean":"2024-09-14T11:59:11.640793+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:59:11.640793+0000","last_undegraded":"2024-09-14T11:59:11.640793+0000","last_fullsized":"2024-09-14T11:59:11.640793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.640690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.640690+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.640690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:43.026373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'105","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.046790+0000","last_change":"2024-09-14T11:59:22.046732+0000","last_active":"2024-09-14T11:59:22.046790+0000","last_peered":"2024-09-14T11:59:22.046790+0000","last_clean":"2024-09-14T11:59:22.046790+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:59:22.046790+0000","last_undegraded":"2024-09-14T11:59:22.046790+0000","last_fullsized":"2024-09-14T11:59:22.046790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'105","last_scrub_stamp":"2024-09-14T11:59:22.046632+0000","last_deep_scrub":"262'105","last_deep_scrub_stamp":"2024-09-14T11:59:22.046632+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.046632+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:39.768126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'769","reported_seq":2189,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.053730+0000","last_change":"2024-09-14T11:59:17.053667+0000","last_active":"2024-09-14T11:59:17.053730+0000","last_peered":"2024-09-14T11:59:17.053730+0000","last_clean":"2024-09-14T11:59:17.053730+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:59:17.053730+0000","last_undegraded":"2024-09-14T11:59:17.053730+0000","last_fullsized":"2024-09-14T11:59:17.053730+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'769","last_scrub_stamp":"2024-09-14T11:59:17.053591+0000","last_deep_scrub":"262'769","last_deep_scrub_stamp":"2024-09-14T11:59:17.053591+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.053591+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:45.573158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":612,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.047452+0000","last_change":"2024-09-14T11:59:26.047452+0000","last_active":"2024-09-14T11:59:26.047452+0000","last_peered":"2024-09-14T11:59:26.047452+0000","last_clean":"2024-09-14T11:59:26.047452+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:59:26.047452+0000","last_undegraded":"2024-09-14T11:59:26.047452+0000","last_fullsized":"2024-09-14T11:59:26.047452+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-14T11:59:26.047364+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-14T11:59:26.047364+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.047364+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:04.775167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'895","reported_seq":2475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.225811+0000","last_change":"2024-09-14T11:59:07.225811+0000","last_active":"2024-09-14T11:59:07.225811+0000","last_peered":"2024-09-14T11:59:07.225811+0000","last_clean":"2024-09-14T11:59:07.225811+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:59:07.225811+0000","last_undegraded":"2024-09-14T11:59:07.225811+0000","last_fullsized":"2024-09-14T11:59:07.225811+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'895","last_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_deep_scrub":"262'895","last_deep_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.225717+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:52.394209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'218","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.793958+0000","last_change":"2024-09-14T11:58:57.793958+0000","last_active":"2024-09-14T11:58:57.793958+0000","last_peered":"2024-09-14T11:58:57.793958+0000","last_clean":"2024-09-14T11:58:57.793958+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:58:57.793958+0000","last_undegraded":"2024-09-14T11:58:57.793958+0000","last_fullsized":"2024-09-14T11:58:57.793958+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.793829+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:47.418639+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":930,"num_read_kb":28634,"num_write":971,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.937493+0000","last_change":"2024-09-14T11:59:16.937493+0000","last_active":"2024-09-14T11:59:16.937493+0000","last_peered":"2024-09-14T11:59:16.937493+0000","last_clean":"2024-09-14T11:59:16.937493+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:59:16.937493+0000","last_undegraded":"2024-09-14T11:59:16.937493+0000","last_fullsized":"2024-09-14T11:59:16.937493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.937391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.937391+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.937391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:57.487607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'163","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.844530+0000","last_change":"2024-09-14T11:59:22.844530+0000","last_active":"2024-09-14T11:59:22.844530+0000","last_peered":"2024-09-14T11:59:22.844530+0000","last_clean":"2024-09-14T11:59:22.844530+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:59:22.844530+0000","last_undegraded":"2024-09-14T11:59:22.844530+0000","last_fullsized":"2024-09-14T11:59:22.844530+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'163","last_scrub_stamp":"2024-09-14T11:59:22.844408+0000","last_deep_scrub":"262'163","last_deep_scrub_stamp":"2024-09-14T11:59:22.844408+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.844408+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.099842+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7170,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":208,"num_read_kb":287,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.475465+0000","last_change":"2024-09-14T11:59:24.475465+0000","last_active":"2024-09-14T11:59:24.475465+0000","last_peered":"2024-09-14T11:59:24.475465+0000","last_clean":"2024-09-14T11:59:24.475465+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:59:24.475465+0000","last_undegraded":"2024-09-14T11:59:24.475465+0000","last_fullsized":"2024-09-14T11:59:24.475465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.475369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.475369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.475369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:08.026060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'107","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.067092+0000","last_change":"2024-09-14T11:59:29.067092+0000","last_active":"2024-09-14T11:59:29.067092+0000","last_peered":"2024-09-14T11:59:29.067092+0000","last_clean":"2024-09-14T11:59:29.067092+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:59:29.067092+0000","last_undegraded":"2024-09-14T11:59:29.067092+0000","last_fullsized":"2024-09-14T11:59:29.067092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'107","last_scrub_stamp":"2024-09-14T11:59:29.066989+0000","last_deep_scrub":"262'107","last_deep_scrub_stamp":"2024-09-14T11:59:29.066989+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.066989+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:05.501581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'660","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.203014+0000","last_change":"2024-09-14T11:59:06.203014+0000","last_active":"2024-09-14T11:59:06.203014+0000","last_peered":"2024-09-14T11:59:06.203014+0000","last_clean":"2024-09-14T11:59:06.203014+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:59:06.203014+0000","last_undegraded":"2024-09-14T11:59:06.203014+0000","last_fullsized":"2024-09-14T11:59:06.203014+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'660","last_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_deep_scrub":"262'660","last_deep_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.202929+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:52.793955+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3256,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'201","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.792801+0000","last_change":"2024-09-14T11:58:59.792801+0000","last_active":"2024-09-14T11:58:59.792801+0000","last_peered":"2024-09-14T11:58:59.792801+0000","last_clean":"2024-09-14T11:58:59.792801+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:58:59.792801+0000","last_undegraded":"2024-09-14T11:58:59.792801+0000","last_fullsized":"2024-09-14T11:58:59.792801+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.792678+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:48.220393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":24057,"num_write":879,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.753252+0000","last_change":"2024-09-14T11:59:17.753252+0000","last_active":"2024-09-14T11:59:17.753252+0000","last_peered":"2024-09-14T11:59:17.753252+0000","last_clean":"2024-09-14T11:59:17.753252+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:59:17.753252+0000","last_undegraded":"2024-09-14T11:59:17.753252+0000","last_fullsized":"2024-09-14T11:59:17.753252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.753121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.753121+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.753121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:23.129023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'151","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.396500+0000","last_change":"2024-09-14T11:59:18.396500+0000","last_active":"2024-09-14T11:59:18.396500+0000","last_peered":"2024-09-14T11:59:18.396500+0000","last_clean":"2024-09-14T11:59:18.396500+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:59:18.396500+0000","last_undegraded":"2024-09-14T11:59:18.396500+0000","last_fullsized":"2024-09-14T11:59:18.396500+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'151","last_scrub_stamp":"2024-09-14T11:59:18.396392+0000","last_deep_scrub":"262'151","last_deep_scrub_stamp":"2024-09-14T11:59:18.396392+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.396392+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:50.867281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":267,"num_write":100,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.094453+0000","last_change":"2024-09-14T11:59:15.094399+0000","last_active":"2024-09-14T11:59:15.094453+0000","last_peered":"2024-09-14T11:59:15.094453+0000","last_clean":"2024-09-14T11:59:15.094453+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:59:15.094453+0000","last_undegraded":"2024-09-14T11:59:15.094453+0000","last_fullsized":"2024-09-14T11:59:15.094453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.094317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.094317+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.094317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:47.776493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'142","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.012932+0000","last_change":"2024-09-14T11:59:33.012932+0000","last_active":"2024-09-14T11:59:33.012932+0000","last_peered":"2024-09-14T11:59:33.012932+0000","last_clean":"2024-09-14T11:59:33.012932+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:59:33.012932+0000","last_undegraded":"2024-09-14T11:59:33.012932+0000","last_fullsized":"2024-09-14T11:59:33.012932+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-14T11:59:33.012838+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-14T11:59:33.012838+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.012838+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:43.338371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'748","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.939963+0000","last_change":"2024-09-14T11:59:05.939875+0000","last_active":"2024-09-14T11:59:05.939963+0000","last_peered":"2024-09-14T11:59:05.939963+0000","last_clean":"2024-09-14T11:59:05.939963+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:59:05.939963+0000","last_undegraded":"2024-09-14T11:59:05.939963+0000","last_fullsized":"2024-09-14T11:59:05.939963+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'748","last_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_deep_scrub":"262'748","last_deep_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.939748+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:27.001770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'247","reported_seq":1007,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.848986+0000","last_change":"2024-09-14T11:58:58.848888+0000","last_active":"2024-09-14T11:58:58.848986+0000","last_peered":"2024-09-14T11:58:58.848986+0000","last_clean":"2024-09-14T11:58:58.848986+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:58:58.848986+0000","last_undegraded":"2024-09-14T11:58:58.848986+0000","last_fullsized":"2024-09-14T11:58:58.848986+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.848767+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.657561+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":149417,"num_write":1050,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.027336+0000","last_change":"2024-09-14T11:59:17.027336+0000","last_active":"2024-09-14T11:59:17.027336+0000","last_peered":"2024-09-14T11:59:17.027336+0000","last_clean":"2024-09-14T11:59:17.027336+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:59:17.027336+0000","last_undegraded":"2024-09-14T11:59:17.027336+0000","last_fullsized":"2024-09-14T11:59:17.027336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.027224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.027224+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.027224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:18.134951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'100","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.017978+0000","last_change":"2024-09-14T11:59:24.017978+0000","last_active":"2024-09-14T11:59:24.017978+0000","last_peered":"2024-09-14T11:59:24.017978+0000","last_clean":"2024-09-14T11:59:24.017978+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:59:24.017978+0000","last_undegraded":"2024-09-14T11:59:24.017978+0000","last_fullsized":"2024-09-14T11:59:24.017978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-14T11:59:24.017891+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-14T11:59:24.017891+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.017891+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:45.397131+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8817,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":183,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.982762+0000","last_change":"2024-09-14T11:59:25.982762+0000","last_active":"2024-09-14T11:59:25.982762+0000","last_peered":"2024-09-14T11:59:25.982762+0000","last_clean":"2024-09-14T11:59:25.982762+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:59:25.982762+0000","last_undegraded":"2024-09-14T11:59:25.982762+0000","last_fullsized":"2024-09-14T11:59:25.982762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.982662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.982662+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.982662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:16.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'157","reported_seq":1264,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.038615+0000","last_change":"2024-09-14T11:59:28.038615+0000","last_active":"2024-09-14T11:59:28.038615+0000","last_peered":"2024-09-14T11:59:28.038615+0000","last_clean":"2024-09-14T11:59:28.038615+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:59:28.038615+0000","last_undegraded":"2024-09-14T11:59:28.038615+0000","last_fullsized":"2024-09-14T11:59:28.038615+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'157","last_scrub_stamp":"2024-09-14T11:59:28.038525+0000","last_deep_scrub":"262'157","last_deep_scrub_stamp":"2024-09-14T11:59:28.038525+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.038525+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:28.806077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'448","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.209413+0000","last_change":"2024-09-14T11:59:05.209413+0000","last_active":"2024-09-14T11:59:05.209413+0000","last_peered":"2024-09-14T11:59:05.209413+0000","last_clean":"2024-09-14T11:59:05.209413+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:59:05.209413+0000","last_undegraded":"2024-09-14T11:59:05.209413+0000","last_fullsized":"2024-09-14T11:59:05.209413+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.209323+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.492011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'212","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.268719+0000","last_change":"2024-09-14T11:58:57.268656+0000","last_active":"2024-09-14T11:58:57.268719+0000","last_peered":"2024-09-14T11:58:57.268719+0000","last_clean":"2024-09-14T11:58:57.268719+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:58:57.268719+0000","last_undegraded":"2024-09-14T11:58:57.268719+0000","last_fullsized":"2024-09-14T11:58:57.268719+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.268554+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:41.545725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":36694,"num_write":987,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.609596+0000","last_change":"2024-09-14T11:59:10.609493+0000","last_active":"2024-09-14T11:59:10.609596+0000","last_peered":"2024-09-14T11:59:10.609596+0000","last_clean":"2024-09-14T11:59:10.609596+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:59:10.609596+0000","last_undegraded":"2024-09-14T11:59:10.609596+0000","last_fullsized":"2024-09-14T11:59:10.609596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.609353+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.175042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'153","reported_seq":735,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.009705+0000","last_change":"2024-09-14T11:59:21.009705+0000","last_active":"2024-09-14T11:59:21.009705+0000","last_peered":"2024-09-14T11:59:21.009705+0000","last_clean":"2024-09-14T11:59:21.009705+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:59:21.009705+0000","last_undegraded":"2024-09-14T11:59:21.009705+0000","last_fullsized":"2024-09-14T11:59:21.009705+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'153","last_scrub_stamp":"2024-09-14T11:59:21.009610+0000","last_deep_scrub":"262'153","last_deep_scrub_stamp":"2024-09-14T11:59:21.009610+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.009610+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:05.738105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":283,"num_write":116,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.464785+0000","last_change":"2024-09-14T11:59:25.464785+0000","last_active":"2024-09-14T11:59:25.464785+0000","last_peered":"2024-09-14T11:59:25.464785+0000","last_clean":"2024-09-14T11:59:25.464785+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:59:25.464785+0000","last_undegraded":"2024-09-14T11:59:25.464785+0000","last_fullsized":"2024-09-14T11:59:25.464785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.464686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.464686+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.464686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:35.385135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'96","reported_seq":581,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.005809+0000","last_change":"2024-09-14T11:59:28.005809+0000","last_active":"2024-09-14T11:59:28.005809+0000","last_peered":"2024-09-14T11:59:28.005809+0000","last_clean":"2024-09-14T11:59:28.005809+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:59:28.005809+0000","last_undegraded":"2024-09-14T11:59:28.005809+0000","last_fullsized":"2024-09-14T11:59:28.005809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'96","last_scrub_stamp":"2024-09-14T11:59:28.005725+0000","last_deep_scrub":"262'96","last_deep_scrub_stamp":"2024-09-14T11:59:28.005725+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.005725+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:05.667233+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'423","reported_seq":1881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.669190+0000","last_change":"2024-09-14T11:59:07.669190+0000","last_active":"2024-09-14T11:59:07.669190+0000","last_peered":"2024-09-14T11:59:07.669190+0000","last_clean":"2024-09-14T11:59:07.669190+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:59:07.669190+0000","last_undegraded":"2024-09-14T11:59:07.669190+0000","last_fullsized":"2024-09-14T11:59:07.669190+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'423","last_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_deep_scrub":"262'423","last_deep_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.669106+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:58.372550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.260315+0000","last_change":"2024-09-14T11:58:59.260260+0000","last_active":"2024-09-14T11:58:59.260315+0000","last_peered":"2024-09-14T11:58:59.260315+0000","last_clean":"2024-09-14T11:58:59.260315+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:58:59.260315+0000","last_undegraded":"2024-09-14T11:58:59.260315+0000","last_fullsized":"2024-09-14T11:58:59.260315+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.260175+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:36.438178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":66072,"num_write":894,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2356,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.610576+0000","last_change":"2024-09-14T11:59:05.610576+0000","last_active":"2024-09-14T11:59:05.610576+0000","last_peered":"2024-09-14T11:59:05.610576+0000","last_clean":"2024-09-14T11:59:05.610576+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:59:05.610576+0000","last_undegraded":"2024-09-14T11:59:05.610576+0000","last_fullsized":"2024-09-14T11:59:05.610576+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'841","last_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_deep_scrub":"262'841","last_deep_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.610487+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:37.527850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'213","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.279743+0000","last_change":"2024-09-14T11:58:56.279698+0000","last_active":"2024-09-14T11:58:56.279743+0000","last_peered":"2024-09-14T11:58:56.279743+0000","last_clean":"2024-09-14T11:58:56.279743+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:58:56.279743+0000","last_undegraded":"2024-09-14T11:58:56.279743+0000","last_fullsized":"2024-09-14T11:58:56.279743+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.279629+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:33.552917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":30107,"num_write":970,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'540","reported_seq":2215,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.796673+0000","last_change":"2024-09-14T11:59:13.796673+0000","last_active":"2024-09-14T11:59:13.796673+0000","last_peered":"2024-09-14T11:59:13.796673+0000","last_clean":"2024-09-14T11:59:13.796673+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:59:13.796673+0000","last_undegraded":"2024-09-14T11:59:13.796673+0000","last_fullsized":"2024-09-14T11:59:13.796673+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.796567+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.630324+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'185","reported_seq":774,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.767529+0000","last_change":"2024-09-14T11:58:58.767475+0000","last_active":"2024-09-14T11:58:58.767529+0000","last_peered":"2024-09-14T11:58:58.767529+0000","last_clean":"2024-09-14T11:58:58.767529+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:58:58.767529+0000","last_undegraded":"2024-09-14T11:58:58.767529+0000","last_fullsized":"2024-09-14T11:58:58.767529+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.767391+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:27.127746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":397,"num_read_kb":13678,"num_write":826,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'689","reported_seq":2137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.570572+0000","last_change":"2024-09-14T11:59:04.570572+0000","last_active":"2024-09-14T11:59:04.570572+0000","last_peered":"2024-09-14T11:59:04.570572+0000","last_clean":"2024-09-14T11:59:04.570572+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:59:04.570572+0000","last_undegraded":"2024-09-14T11:59:04.570572+0000","last_fullsized":"2024-09-14T11:59:04.570572+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'689","last_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_deep_scrub":"262'689","last_deep_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.570481+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":600,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:50.385676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'226","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.251393+0000","last_change":"2024-09-14T11:58:58.251319+0000","last_active":"2024-09-14T11:58:58.251393+0000","last_peered":"2024-09-14T11:58:58.251393+0000","last_clean":"2024-09-14T11:58:58.251393+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:58:58.251393+0000","last_undegraded":"2024-09-14T11:58:58.251393+0000","last_fullsized":"2024-09-14T11:58:58.251393+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.251228+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:43.426816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":673,"num_read_kb":8461,"num_write":1067,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'578","reported_seq":2184,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.873360+0000","last_change":"2024-09-14T11:59:14.873290+0000","last_active":"2024-09-14T11:59:14.873360+0000","last_peered":"2024-09-14T11:59:14.873360+0000","last_clean":"2024-09-14T11:59:14.873360+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:59:14.873360+0000","last_undegraded":"2024-09-14T11:59:14.873360+0000","last_fullsized":"2024-09-14T11:59:14.873360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'578","last_scrub_stamp":"2024-09-14T11:59:14.873200+0000","last_deep_scrub":"262'578","last_deep_scrub_stamp":"2024-09-14T11:59:14.873200+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.873200+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.941909+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'263","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.887387+0000","last_change":"2024-09-14T11:58:59.887387+0000","last_active":"2024-09-14T11:58:59.887387+0000","last_peered":"2024-09-14T11:58:59.887387+0000","last_clean":"2024-09-14T11:58:59.887387+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:58:59.887387+0000","last_undegraded":"2024-09-14T11:58:59.887387+0000","last_fullsized":"2024-09-14T11:58:59.887387+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.887284+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:57.682098+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":625,"num_read_kb":65552,"num_write":1161,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1211","reported_seq":2823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.196603+0000","last_change":"2024-09-14T11:59:10.196538+0000","last_active":"2024-09-14T11:59:10.196603+0000","last_peered":"2024-09-14T11:59:10.196603+0000","last_clean":"2024-09-14T11:59:10.196603+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:59:10.196603+0000","last_undegraded":"2024-09-14T11:59:10.196603+0000","last_fullsized":"2024-09-14T11:59:10.196603+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1211","last_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_deep_scrub":"262'1211","last_deep_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.196453+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":1100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:27.768853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'200","reported_seq":824,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.627940+0000","last_change":"2024-09-14T11:58:57.627940+0000","last_active":"2024-09-14T11:58:57.627940+0000","last_peered":"2024-09-14T11:58:57.627940+0000","last_clean":"2024-09-14T11:58:57.627940+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:58:57.627940+0000","last_undegraded":"2024-09-14T11:58:57.627940+0000","last_fullsized":"2024-09-14T11:58:57.627940+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.627846+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:24.951020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":515,"num_read_kb":18867,"num_write":899,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'490","reported_seq":2147,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.977350+0000","last_change":"2024-09-14T11:59:09.977291+0000","last_active":"2024-09-14T11:59:09.977350+0000","last_peered":"2024-09-14T11:59:09.977350+0000","last_clean":"2024-09-14T11:59:09.977350+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:59:09.977350+0000","last_undegraded":"2024-09-14T11:59:09.977350+0000","last_fullsized":"2024-09-14T11:59:09.977350+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'490","last_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_deep_scrub":"262'490","last_deep_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.977199+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.685268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'183","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.292435+0000","last_change":"2024-09-14T11:58:57.292435+0000","last_active":"2024-09-14T11:58:57.292435+0000","last_peered":"2024-09-14T11:58:57.292435+0000","last_clean":"2024-09-14T11:58:57.292435+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:58:57.292435+0000","last_undegraded":"2024-09-14T11:58:57.292435+0000","last_fullsized":"2024-09-14T11:58:57.292435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'183","last_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_deep_scrub":"262'183","last_deep_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.292341+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:17.394532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":3776,"num_write":815,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'443","reported_seq":1981,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.158496+0000","last_change":"2024-09-14T11:59:06.158439+0000","last_active":"2024-09-14T11:59:06.158496+0000","last_peered":"2024-09-14T11:59:06.158496+0000","last_clean":"2024-09-14T11:59:06.158496+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:59:06.158496+0000","last_undegraded":"2024-09-14T11:59:06.158496+0000","last_fullsized":"2024-09-14T11:59:06.158496+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'443","last_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_deep_scrub":"262'443","last_deep_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.158355+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:22.012200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'273","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.844697+0000","last_change":"2024-09-14T11:59:00.844697+0000","last_active":"2024-09-14T11:59:00.844697+0000","last_peered":"2024-09-14T11:59:00.844697+0000","last_clean":"2024-09-14T11:59:00.844697+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:59:00.844697+0000","last_undegraded":"2024-09-14T11:59:00.844697+0000","last_fullsized":"2024-09-14T11:59:00.844697+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'273","last_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_deep_scrub":"262'273","last_deep_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.844576+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:17.221784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":36414,"num_write":1104,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'493","reported_seq":2016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.415412+0000","last_change":"2024-09-14T11:59:08.415356+0000","last_active":"2024-09-14T11:59:08.415412+0000","last_peered":"2024-09-14T11:59:08.415412+0000","last_clean":"2024-09-14T11:59:08.415412+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:59:08.415412+0000","last_undegraded":"2024-09-14T11:59:08.415412+0000","last_fullsized":"2024-09-14T11:59:08.415412+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.415265+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:13.317609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'284","reported_seq":939,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.837101+0000","last_change":"2024-09-14T11:59:00.836991+0000","last_active":"2024-09-14T11:59:00.837101+0000","last_peered":"2024-09-14T11:59:00.837101+0000","last_clean":"2024-09-14T11:59:00.837101+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:59:00.837101+0000","last_undegraded":"2024-09-14T11:59:00.837101+0000","last_fullsized":"2024-09-14T11:59:00.837101+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.836878+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:32.971543+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":728,"num_read_kb":57965,"num_write":1175,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'750","reported_seq":2332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.237893+0000","last_change":"2024-09-14T11:59:09.237837+0000","last_active":"2024-09-14T11:59:09.237893+0000","last_peered":"2024-09-14T11:59:09.237893+0000","last_clean":"2024-09-14T11:59:09.237893+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:59:09.237893+0000","last_undegraded":"2024-09-14T11:59:09.237893+0000","last_fullsized":"2024-09-14T11:59:09.237893+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'750","last_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_deep_scrub":"262'750","last_deep_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.237718+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:11.504189+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'205","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.894568+0000","last_change":"2024-09-14T11:59:01.894568+0000","last_active":"2024-09-14T11:59:01.894568+0000","last_peered":"2024-09-14T11:59:01.894568+0000","last_clean":"2024-09-14T11:59:01.894568+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:59:01.894568+0000","last_undegraded":"2024-09-14T11:59:01.894568+0000","last_fullsized":"2024-09-14T11:59:01.894568+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.894440+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:58.772928+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":27346,"num_write":953,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.278891+0000","last_change":"2024-09-14T11:58:58.278891+0000","last_active":"2024-09-14T11:58:58.278891+0000","last_peered":"2024-09-14T11:58:58.278891+0000","last_clean":"2024-09-14T11:58:58.278891+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:58:58.278891+0000","last_undegraded":"2024-09-14T11:58:58.278891+0000","last_fullsized":"2024-09-14T11:58:58.278891+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'500","last_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_deep_scrub":"262'500","last_deep_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.278804+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:28.836107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.804411+0000","last_change":"2024-09-14T11:59:01.804411+0000","last_active":"2024-09-14T11:59:01.804411+0000","last_peered":"2024-09-14T11:59:01.804411+0000","last_clean":"2024-09-14T11:59:01.804411+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:59:01.804411+0000","last_undegraded":"2024-09-14T11:59:01.804411+0000","last_fullsized":"2024-09-14T11:59:01.804411+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.804299+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:14.419727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":6791,"num_write":1023,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1092","reported_seq":2586,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.266010+0000","last_change":"2024-09-14T11:59:08.266010+0000","last_active":"2024-09-14T11:59:08.266010+0000","last_peered":"2024-09-14T11:59:08.266010+0000","last_clean":"2024-09-14T11:59:08.266010+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:59:08.266010+0000","last_undegraded":"2024-09-14T11:59:08.266010+0000","last_fullsized":"2024-09-14T11:59:08.266010+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1092","last_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_deep_scrub":"262'1092","last_deep_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.265911+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:12.673036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'198","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.255530+0000","last_change":"2024-09-14T11:58:59.255530+0000","last_active":"2024-09-14T11:58:59.255530+0000","last_peered":"2024-09-14T11:58:59.255530+0000","last_clean":"2024-09-14T11:58:59.255530+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:58:59.255530+0000","last_undegraded":"2024-09-14T11:58:59.255530+0000","last_fullsized":"2024-09-14T11:58:59.255530+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.255428+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.960737+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":8671,"num_write":968,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'891","reported_seq":2805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.966742+0000","last_change":"2024-09-14T11:59:09.966742+0000","last_active":"2024-09-14T11:59:09.966742+0000","last_peered":"2024-09-14T11:59:09.966742+0000","last_clean":"2024-09-14T11:59:09.966742+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:59:09.966742+0000","last_undegraded":"2024-09-14T11:59:09.966742+0000","last_fullsized":"2024-09-14T11:59:09.966742+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'891","last_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_deep_scrub":"262'891","last_deep_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.966645+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.534651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'217","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.223498+0000","last_change":"2024-09-14T11:59:00.223498+0000","last_active":"2024-09-14T11:59:00.223498+0000","last_peered":"2024-09-14T11:59:00.223498+0000","last_clean":"2024-09-14T11:59:00.223498+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:59:00.223498+0000","last_undegraded":"2024-09-14T11:59:00.223498+0000","last_fullsized":"2024-09-14T11:59:00.223498+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.223379+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:54.749010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":9098,"num_write":1061,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2083,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.374724+0000","last_change":"2024-09-14T11:59:07.374724+0000","last_active":"2024-09-14T11:59:07.374724+0000","last_peered":"2024-09-14T11:59:07.374724+0000","last_clean":"2024-09-14T11:59:07.374724+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:59:07.374724+0000","last_undegraded":"2024-09-14T11:59:07.374724+0000","last_fullsized":"2024-09-14T11:59:07.374724+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'510","last_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_deep_scrub":"262'510","last_deep_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.374631+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:49.746178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'229","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.873293+0000","last_change":"2024-09-14T11:59:03.873293+0000","last_active":"2024-09-14T11:59:03.873293+0000","last_peered":"2024-09-14T11:59:03.873293+0000","last_clean":"2024-09-14T11:59:03.873293+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:59:03.873293+0000","last_undegraded":"2024-09-14T11:59:03.873293+0000","last_fullsized":"2024-09-14T11:59:03.873293+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.873191+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:41.942314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":2234,"num_write":1097,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1088","reported_seq":2862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.960382+0000","last_change":"2024-09-14T11:59:12.960382+0000","last_active":"2024-09-14T11:59:12.960382+0000","last_peered":"2024-09-14T11:59:12.960382+0000","last_clean":"2024-09-14T11:59:12.960382+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:59:12.960382+0000","last_undegraded":"2024-09-14T11:59:12.960382+0000","last_fullsized":"2024-09-14T11:59:12.960382+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1088","last_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_deep_scrub":"262'1088","last_deep_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.960278+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":1000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:21.372173+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'210","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.309962+0000","last_change":"2024-09-14T11:59:06.309896+0000","last_active":"2024-09-14T11:59:06.309962+0000","last_peered":"2024-09-14T11:59:06.309962+0000","last_clean":"2024-09-14T11:59:06.309962+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:59:06.309962+0000","last_undegraded":"2024-09-14T11:59:06.309962+0000","last_fullsized":"2024-09-14T11:59:06.309962+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.309806+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:19.118262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":34303,"num_write":987,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.917735+0000","last_change":"2024-09-14T11:59:08.917735+0000","last_active":"2024-09-14T11:59:08.917735+0000","last_peered":"2024-09-14T11:59:08.917735+0000","last_clean":"2024-09-14T11:59:08.917735+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:59:08.917735+0000","last_undegraded":"2024-09-14T11:59:08.917735+0000","last_fullsized":"2024-09-14T11:59:08.917735+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'475","last_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_deep_scrub":"262'475","last_deep_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.917635+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:56.114023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'254","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.828459+0000","last_change":"2024-09-14T11:59:02.828398+0000","last_active":"2024-09-14T11:59:02.828459+0000","last_peered":"2024-09-14T11:59:02.828459+0000","last_clean":"2024-09-14T11:59:02.828459+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:59:02.828459+0000","last_undegraded":"2024-09-14T11:59:02.828459+0000","last_fullsized":"2024-09-14T11:59:02.828459+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'254","last_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_deep_scrub":"262'254","last_deep_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.828297+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:11.803512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":43532,"num_write":1122,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'188","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.832354+0000","last_change":"2024-09-14T11:59:03.832260+0000","last_active":"2024-09-14T11:59:03.832354+0000","last_peered":"2024-09-14T11:59:03.832354+0000","last_clean":"2024-09-14T11:59:03.832354+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:59:03.832354+0000","last_undegraded":"2024-09-14T11:59:03.832354+0000","last_fullsized":"2024-09-14T11:59:03.832354+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.832145+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:54.524505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":29604,"num_write":903,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'414","reported_seq":1890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.403282+0000","last_change":"2024-09-14T11:59:09.403282+0000","last_active":"2024-09-14T11:59:09.403282+0000","last_peered":"2024-09-14T11:59:09.403282+0000","last_clean":"2024-09-14T11:59:09.403282+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:59:09.403282+0000","last_undegraded":"2024-09-14T11:59:09.403282+0000","last_fullsized":"2024-09-14T11:59:09.403282+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'414","last_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_deep_scrub":"262'414","last_deep_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.403191+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:28.990413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'282","reported_seq":1063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.669713+0000","last_change":"2024-09-14T11:58:58.669653+0000","last_active":"2024-09-14T11:58:58.669713+0000","last_peered":"2024-09-14T11:58:58.669713+0000","last_clean":"2024-09-14T11:58:58.669713+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:58:58.669713+0000","last_undegraded":"2024-09-14T11:58:58.669713+0000","last_fullsized":"2024-09-14T11:58:58.669713+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.669555+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:27.928077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1009,"num_read_kb":66938,"num_write":1373,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'577","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.874845+0000","last_change":"2024-09-14T11:59:09.874845+0000","last_active":"2024-09-14T11:59:09.874845+0000","last_peered":"2024-09-14T11:59:09.874845+0000","last_clean":"2024-09-14T11:59:09.874845+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:59:09.874845+0000","last_undegraded":"2024-09-14T11:59:09.874845+0000","last_fullsized":"2024-09-14T11:59:09.874845+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'577","last_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_deep_scrub":"262'577","last_deep_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.874761+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:07.437905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2626,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1765,"ondisk_log_size":1765,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":377666,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8331,"num_read_kb":10588,"num_write":5619,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701918,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1802,"ondisk_log_size":1802,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35729,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4129,"ondisk_log_size":4129,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42836797,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38922,"num_read_kb":2111716,"num_write":64484,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86687744,"data_stored":85673594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4000,"ondisk_log_size":4000,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":180487,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":169164,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509981,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":233200,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94138640,"statfs":{"total":96636764160,"available":96397967360,"internally_reserved":0,"allocated":13533184,"data_stored":11861887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509981,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229032,"kb_used_data":9048,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94142808,"statfs":{"total":96636764160,"available":96402235392,"internally_reserved":0,"allocated":9265152,"data_stored":7716819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509982,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105944,"kb_used_data":12360,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94265896,"statfs":{"total":96636764160,"available":96528277504,"internally_reserved":0,"allocated":12656640,"data_stored":10956578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509981,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97660,"kb_used_data":17900,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94274180,"statfs":{"total":96636764160,"available":96536760320,"internally_reserved":0,"allocated":18329600,"data_stored":16701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509983,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248296,"kb_used_data":18584,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123544,"statfs":{"total":96636764160,"available":96382509056,"internally_reserved":0,"allocated":19030016,"data_stored":17385395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509981,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75936,"kb_used_data":8656,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295904,"statfs":{"total":96636764160,"available":96559005696,"internally_reserved":0,"allocated":8863744,"data_stored":7316623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509979,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252032,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94119808,"statfs":{"total":96636764160,"available":96378683392,"internally_reserved":0,"allocated":22855680,"data_stored":21154199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575388,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137572,"kb_used_data":12052,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94234268,"statfs":{"total":96636764160,"available":96495890432,"internally_reserved":0,"allocated":12341248,"data_stored":10776464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":18434939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8728576,"data_stored":8650845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5275648,"data_stored":5190678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15388672,"data_stored":15257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8986624,"data_stored":8830204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5656576,"data_stored":5589626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9293824,"data_stored":9144278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:59:57.131 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:57.131 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:57.132 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:57.132 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:57.132 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:43:34.577118+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=43, tm_sec=34, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:57.135 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:00:17.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:00:17.489 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-14T12:00:17.500 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-14T12:00:17.502 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":1608,"stamp":"2024-09-14T12:00:16.821755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43821918,"num_objects":628,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":628,"num_whiteouts":0,"num_read":296215,"num_read_kb":2700212,"num_write":146664,"num_write_kb":2447739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741401,"num_omap_keys":1788,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13512,"ondisk_log_size":13512,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1379672,"kb_used_data":114136,"kb_used_omap":12,"kb_used_meta":1265395,"kb_avail":753595048,"statfs":{"total":773094113280,"available":771681329152,"internally_reserved":0,"allocated":116875264,"data_stored":103868988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1295765040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005852"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.774431+0000","last_change":"2024-09-14T11:59:40.774431+0000","last_active":"2024-09-14T11:59:40.774431+0000","last_peered":"2024-09-14T11:59:40.774431+0000","last_clean":"2024-09-14T11:59:40.774431+0000","last_became_active":"2024-09-14T11:43:35.602642+0000","last_became_peered":"2024-09-14T11:43:35.602642+0000","last_unstale":"2024-09-14T11:59:40.774431+0000","last_undegraded":"2024-09-14T11:59:40.774431+0000","last_fullsized":"2024-09-14T11:59:40.774431+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:40.774316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:40.774316+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.774316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:25.627022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.876370+0000","last_change":"2024-09-14T11:59:36.876258+0000","last_active":"2024-09-14T11:59:36.876370+0000","last_peered":"2024-09-14T11:59:36.876370+0000","last_clean":"2024-09-14T11:59:36.876370+0000","last_became_active":"2024-09-14T11:32:32.583496+0000","last_became_peered":"2024-09-14T11:32:32.583496+0000","last_unstale":"2024-09-14T11:59:36.876370+0000","last_undegraded":"2024-09-14T11:59:36.876370+0000","last_fullsized":"2024-09-14T11:59:36.876370+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:36.876159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:36.876159+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.876159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:48:10.997823+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.959314+0000","last_change":"2024-09-14T11:59:43.959228+0000","last_active":"2024-09-14T11:59:43.959314+0000","last_peered":"2024-09-14T11:59:43.959314+0000","last_clean":"2024-09-14T11:59:43.959314+0000","last_became_active":"2024-09-14T11:32:29.554341+0000","last_became_peered":"2024-09-14T11:32:29.554341+0000","last_unstale":"2024-09-14T11:59:43.959314+0000","last_undegraded":"2024-09-14T11:59:43.959314+0000","last_fullsized":"2024-09-14T11:59:43.959314+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:43.959141+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:43.959141+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.959141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:15.447458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'59","reported_seq":212,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.620492+0000","last_change":"2024-09-14T11:59:38.620404+0000","last_active":"2024-09-14T11:59:38.620492+0000","last_peered":"2024-09-14T11:59:38.620492+0000","last_clean":"2024-09-14T11:59:38.620492+0000","last_became_active":"2024-09-14T11:30:45.179052+0000","last_became_peered":"2024-09-14T11:30:45.179052+0000","last_unstale":"2024-09-14T11:59:38.620492+0000","last_undegraded":"2024-09-14T11:59:38.620492+0000","last_fullsized":"2024-09-14T11:59:38.620492+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'59","last_scrub_stamp":"2024-09-14T11:59:38.620309+0000","last_deep_scrub":"262'59","last_deep_scrub_stamp":"2024-09-14T11:59:38.620309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.620309+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:30.817671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":305,"num_write":155,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.256443+0000","last_change":"2024-09-14T11:59:20.256443+0000","last_active":"2024-09-14T11:59:20.256443+0000","last_peered":"2024-09-14T11:59:20.256443+0000","last_clean":"2024-09-14T11:59:20.256443+0000","last_became_active":"2024-09-14T11:43:35.602553+0000","last_became_peered":"2024-09-14T11:43:35.602553+0000","last_unstale":"2024-09-14T11:59:20.256443+0000","last_undegraded":"2024-09-14T11:59:20.256443+0000","last_fullsized":"2024-09-14T11:59:20.256443+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.256349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.256349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.256349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:22.982220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'6","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.855406+0000","last_change":"2024-09-14T11:59:41.855286+0000","last_active":"2024-09-14T11:59:41.855406+0000","last_peered":"2024-09-14T11:59:41.855406+0000","last_clean":"2024-09-14T11:59:41.855406+0000","last_became_active":"2024-09-14T11:32:32.581984+0000","last_became_peered":"2024-09-14T11:32:32.581984+0000","last_unstale":"2024-09-14T11:59:41.855406+0000","last_undegraded":"2024-09-14T11:59:41.855406+0000","last_fullsized":"2024-09-14T11:59:41.855406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:41.855177+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:41.855177+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.855177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:05.168113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"259'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.448007+0000","last_change":"2024-09-14T11:59:34.447897+0000","last_active":"2024-09-14T11:59:34.448007+0000","last_peered":"2024-09-14T11:59:34.448007+0000","last_clean":"2024-09-14T11:59:34.448007+0000","last_became_active":"2024-09-14T11:32:29.557743+0000","last_became_peered":"2024-09-14T11:32:29.557743+0000","last_unstale":"2024-09-14T11:59:34.448007+0000","last_undegraded":"2024-09-14T11:59:34.448007+0000","last_fullsized":"2024-09-14T11:59:34.448007+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-14T11:59:34.447760+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-14T11:59:34.447760+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.447760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:57.623046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'59","reported_seq":220,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.320376+0000","last_change":"2024-09-14T11:59:13.320376+0000","last_active":"2024-09-14T11:59:13.320376+0000","last_peered":"2024-09-14T11:59:13.320376+0000","last_clean":"2024-09-14T11:59:13.320376+0000","last_became_active":"2024-09-14T11:30:45.184761+0000","last_became_peered":"2024-09-14T11:30:45.184761+0000","last_unstale":"2024-09-14T11:59:13.320376+0000","last_undegraded":"2024-09-14T11:59:13.320376+0000","last_fullsized":"2024-09-14T11:59:13.320376+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'59","last_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_deep_scrub":"262'59","last_deep_scrub_stamp":"2024-09-14T11:59:13.320284+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.320284+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:41.355939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":506,"num_read_kb":357,"num_write":138,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.078463+0000","last_change":"2024-09-14T11:59:32.078463+0000","last_active":"2024-09-14T11:59:32.078463+0000","last_peered":"2024-09-14T11:59:32.078463+0000","last_clean":"2024-09-14T11:59:32.078463+0000","last_became_active":"2024-09-14T11:43:35.597430+0000","last_became_peered":"2024-09-14T11:43:35.597430+0000","last_unstale":"2024-09-14T11:59:32.078463+0000","last_undegraded":"2024-09-14T11:59:32.078463+0000","last_fullsized":"2024-09-14T11:59:32.078463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.078369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.078369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.078369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:18.744142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"262'8","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:45.646128+0000","last_change":"2024-09-14T11:59:45.646128+0000","last_active":"2024-09-14T11:59:45.646128+0000","last_peered":"2024-09-14T11:59:45.646128+0000","last_clean":"2024-09-14T11:59:45.646128+0000","last_became_active":"2024-09-14T11:32:32.577745+0000","last_became_peered":"2024-09-14T11:32:32.577745+0000","last_unstale":"2024-09-14T11:59:45.646128+0000","last_undegraded":"2024-09-14T11:59:45.646128+0000","last_fullsized":"2024-09-14T11:59:45.646128+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-14T11:59:45.646035+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-14T11:59:45.646035+0000","last_clean_scrub_stamp":"2024-09-14T11:59:45.646035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:11.310432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13314,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'9","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.249375+0000","last_change":"2024-09-14T11:59:17.249375+0000","last_active":"2024-09-14T11:59:17.249375+0000","last_peered":"2024-09-14T11:59:17.249375+0000","last_clean":"2024-09-14T11:59:17.249375+0000","last_became_active":"2024-09-14T11:32:29.549786+0000","last_became_peered":"2024-09-14T11:32:29.549786+0000","last_unstale":"2024-09-14T11:59:17.249375+0000","last_undegraded":"2024-09-14T11:59:17.249375+0000","last_fullsized":"2024-09-14T11:59:17.249375+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:17.249272+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:17.249272+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.249272+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:50.213143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'23","reported_seq":117,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.622963+0000","last_change":"2024-09-14T11:59:37.622963+0000","last_active":"2024-09-14T11:59:37.622963+0000","last_peered":"2024-09-14T11:59:37.622963+0000","last_clean":"2024-09-14T11:59:37.622963+0000","last_became_active":"2024-09-14T11:30:45.185894+0000","last_became_peered":"2024-09-14T11:30:45.185894+0000","last_unstale":"2024-09-14T11:59:37.622963+0000","last_undegraded":"2024-09-14T11:59:37.622963+0000","last_fullsized":"2024-09-14T11:59:37.622963+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-14T11:59:37.622872+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-14T11:59:37.622872+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.622872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:29.036538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":104,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:55.918860+0000","last_change":"2024-09-14T11:59:55.918860+0000","last_active":"2024-09-14T11:59:55.918860+0000","last_peered":"2024-09-14T11:59:55.918860+0000","last_clean":"2024-09-14T11:59:55.918860+0000","last_became_active":"2024-09-14T11:43:35.603337+0000","last_became_peered":"2024-09-14T11:43:35.603337+0000","last_unstale":"2024-09-14T11:59:55.918860+0000","last_undegraded":"2024-09-14T11:59:55.918860+0000","last_fullsized":"2024-09-14T11:59:55.918860+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:55.918772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:55.918772+0000","last_clean_scrub_stamp":"2024-09-14T11:59:55.918772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:18.569398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"262'4","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:52.931337+0000","last_change":"2024-09-14T11:59:52.931337+0000","last_active":"2024-09-14T11:59:52.931337+0000","last_peered":"2024-09-14T11:59:52.931337+0000","last_clean":"2024-09-14T11:59:52.931337+0000","last_became_active":"2024-09-14T11:32:32.588389+0000","last_became_peered":"2024-09-14T11:32:32.588389+0000","last_unstale":"2024-09-14T11:59:52.931337+0000","last_undegraded":"2024-09-14T11:59:52.931337+0000","last_fullsized":"2024-09-14T11:59:52.931337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:52.931251+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:52.931251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:52.931251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:40.528627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":4,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.934699+0000","last_change":"2024-09-14T11:59:37.934699+0000","last_active":"2024-09-14T11:59:37.934699+0000","last_peered":"2024-09-14T11:59:37.934699+0000","last_clean":"2024-09-14T11:59:37.934699+0000","last_became_active":"2024-09-14T11:32:29.549189+0000","last_became_peered":"2024-09-14T11:32:29.549189+0000","last_unstale":"2024-09-14T11:59:37.934699+0000","last_undegraded":"2024-09-14T11:59:37.934699+0000","last_fullsized":"2024-09-14T11:59:37.934699+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:37.934613+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:37.934613+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.934613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.043252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.990003+0000","last_change":"2024-09-14T11:59:40.990003+0000","last_active":"2024-09-14T11:59:40.990003+0000","last_peered":"2024-09-14T11:59:40.990003+0000","last_clean":"2024-09-14T11:59:40.990003+0000","last_became_active":"2024-09-14T11:30:45.187077+0000","last_became_peered":"2024-09-14T11:30:45.187077+0000","last_unstale":"2024-09-14T11:59:40.990003+0000","last_undegraded":"2024-09-14T11:59:40.990003+0000","last_fullsized":"2024-09-14T11:59:40.990003+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-14T11:59:40.989900+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-14T11:59:40.989900+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.989900+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.390185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":92,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:57.941106+0000","last_change":"2024-09-14T11:59:57.941106+0000","last_active":"2024-09-14T11:59:57.941106+0000","last_peered":"2024-09-14T11:59:57.941106+0000","last_clean":"2024-09-14T11:59:57.941106+0000","last_became_active":"2024-09-14T11:43:35.600713+0000","last_became_peered":"2024-09-14T11:43:35.600713+0000","last_unstale":"2024-09-14T11:59:57.941106+0000","last_undegraded":"2024-09-14T11:59:57.941106+0000","last_fullsized":"2024-09-14T11:59:57.941106+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:57.941013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:57.941013+0000","last_clean_scrub_stamp":"2024-09-14T11:59:57.941013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:16.685035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.800824+0000","last_change":"2024-09-14T11:59:38.800824+0000","last_active":"2024-09-14T11:59:38.800824+0000","last_peered":"2024-09-14T11:59:38.800824+0000","last_clean":"2024-09-14T11:59:38.800824+0000","last_became_active":"2024-09-14T11:33:08.804785+0000","last_became_peered":"2024-09-14T11:33:08.804785+0000","last_unstale":"2024-09-14T11:59:38.800824+0000","last_undegraded":"2024-09-14T11:59:38.800824+0000","last_fullsized":"2024-09-14T11:59:38.800824+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:38.800733+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:38.800733+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.800733+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:27.373255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.612789+0000","last_change":"2024-09-14T11:59:43.612789+0000","last_active":"2024-09-14T11:59:43.612789+0000","last_peered":"2024-09-14T11:59:43.612789+0000","last_clean":"2024-09-14T11:59:43.612789+0000","last_became_active":"2024-09-14T11:32:29.557857+0000","last_became_peered":"2024-09-14T11:32:29.557857+0000","last_unstale":"2024-09-14T11:59:43.612789+0000","last_undegraded":"2024-09-14T11:59:43.612789+0000","last_fullsized":"2024-09-14T11:59:43.612789+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-14T11:59:43.612681+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-14T11:59:43.612681+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.612681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:35.014553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:46.965885+0000","last_change":"2024-09-14T11:59:46.965885+0000","last_active":"2024-09-14T11:59:46.965885+0000","last_peered":"2024-09-14T11:59:46.965885+0000","last_clean":"2024-09-14T11:59:46.965885+0000","last_became_active":"2024-09-14T11:30:45.183842+0000","last_became_peered":"2024-09-14T11:30:45.183842+0000","last_unstale":"2024-09-14T11:59:46.965885+0000","last_undegraded":"2024-09-14T11:59:46.965885+0000","last_fullsized":"2024-09-14T11:59:46.965885+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:46.965790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:46.965790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:46.965790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:24.755436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.439490+0000","last_change":"2024-09-14T11:59:35.439423+0000","last_active":"2024-09-14T11:59:35.439490+0000","last_peered":"2024-09-14T11:59:35.439490+0000","last_clean":"2024-09-14T11:59:35.439490+0000","last_became_active":"2024-09-14T11:43:35.605437+0000","last_became_peered":"2024-09-14T11:43:35.605437+0000","last_unstale":"2024-09-14T11:59:35.439490+0000","last_undegraded":"2024-09-14T11:59:35.439490+0000","last_fullsized":"2024-09-14T11:59:35.439490+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.439333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.439333+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.439333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:26.023147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'2","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.131931+0000","last_change":"2024-09-14T11:59:29.131931+0000","last_active":"2024-09-14T11:59:29.131931+0000","last_peered":"2024-09-14T11:59:29.131931+0000","last_clean":"2024-09-14T11:59:29.131931+0000","last_became_active":"2024-09-14T11:32:32.581928+0000","last_became_peered":"2024-09-14T11:32:32.581928+0000","last_unstale":"2024-09-14T11:59:29.131931+0000","last_undegraded":"2024-09-14T11:59:29.131931+0000","last_fullsized":"2024-09-14T11:59:29.131931+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:29.131829+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.131829+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.131829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.210029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.952970+0000","last_change":"2024-09-14T11:59:34.952970+0000","last_active":"2024-09-14T11:59:34.952970+0000","last_peered":"2024-09-14T11:59:34.952970+0000","last_clean":"2024-09-14T11:59:34.952970+0000","last_became_active":"2024-09-14T11:32:29.549826+0000","last_became_peered":"2024-09-14T11:32:29.549826+0000","last_unstale":"2024-09-14T11:59:34.952970+0000","last_undegraded":"2024-09-14T11:59:34.952970+0000","last_fullsized":"2024-09-14T11:59:34.952970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:34.952892+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:34.952892+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.952892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:57:35.043886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'26","reported_seq":123,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.107584+0000","last_change":"2024-09-14T11:59:23.107584+0000","last_active":"2024-09-14T11:59:23.107584+0000","last_peered":"2024-09-14T11:59:23.107584+0000","last_clean":"2024-09-14T11:59:23.107584+0000","last_became_active":"2024-09-14T11:30:45.178683+0000","last_became_peered":"2024-09-14T11:30:45.178683+0000","last_unstale":"2024-09-14T11:59:23.107584+0000","last_undegraded":"2024-09-14T11:59:23.107584+0000","last_fullsized":"2024-09-14T11:59:23.107584+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'26","last_scrub_stamp":"2024-09-14T11:59:23.107479+0000","last_deep_scrub":"262'26","last_deep_scrub_stamp":"2024-09-14T11:59:23.107479+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.107479+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:53.674864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":134,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'2","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:50.899232+0000","last_change":"2024-09-14T11:59:50.899232+0000","last_active":"2024-09-14T11:59:50.899232+0000","last_peered":"2024-09-14T11:59:50.899232+0000","last_clean":"2024-09-14T11:59:50.899232+0000","last_became_active":"2024-09-14T11:43:35.605472+0000","last_became_peered":"2024-09-14T11:43:35.605472+0000","last_unstale":"2024-09-14T11:59:50.899232+0000","last_undegraded":"2024-09-14T11:59:50.899232+0000","last_fullsized":"2024-09-14T11:59:50.899232+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:50.899146+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:50.899146+0000","last_clean_scrub_stamp":"2024-09-14T11:59:50.899146+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:12.376290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"259'6","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.129826+0000","last_change":"2024-09-14T11:59:30.129766+0000","last_active":"2024-09-14T11:59:30.129826+0000","last_peered":"2024-09-14T11:59:30.129826+0000","last_clean":"2024-09-14T11:59:30.129826+0000","last_became_active":"2024-09-14T11:32:32.579961+0000","last_became_peered":"2024-09-14T11:32:32.579961+0000","last_unstale":"2024-09-14T11:59:30.129826+0000","last_undegraded":"2024-09-14T11:59:30.129826+0000","last_fullsized":"2024-09-14T11:59:30.129826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-14T11:59:30.129669+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-14T11:59:30.129669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.129669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:43.105203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16413,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'9","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.921878+0000","last_change":"2024-09-14T11:59:35.921806+0000","last_active":"2024-09-14T11:59:35.921878+0000","last_peered":"2024-09-14T11:59:35.921878+0000","last_clean":"2024-09-14T11:59:35.921878+0000","last_became_active":"2024-09-14T11:32:29.555057+0000","last_became_peered":"2024-09-14T11:32:29.555057+0000","last_unstale":"2024-09-14T11:59:35.921878+0000","last_undegraded":"2024-09-14T11:59:35.921878+0000","last_fullsized":"2024-09-14T11:59:35.921878+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'9","last_scrub_stamp":"2024-09-14T11:59:35.921708+0000","last_deep_scrub":"259'9","last_deep_scrub_stamp":"2024-09-14T11:59:35.921708+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.921708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:10.658428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24580,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'56","reported_seq":212,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.580389+0000","last_change":"2024-09-14T11:59:36.580318+0000","last_active":"2024-09-14T11:59:36.580389+0000","last_peered":"2024-09-14T11:59:36.580389+0000","last_clean":"2024-09-14T11:59:36.580389+0000","last_became_active":"2024-09-14T11:30:45.174790+0000","last_became_peered":"2024-09-14T11:30:45.174790+0000","last_unstale":"2024-09-14T11:59:36.580389+0000","last_undegraded":"2024-09-14T11:59:36.580389+0000","last_fullsized":"2024-09-14T11:59:36.580389+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'56","last_scrub_stamp":"2024-09-14T11:59:36.580239+0000","last_deep_scrub":"262'56","last_deep_scrub_stamp":"2024-09-14T11:59:36.580239+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.580239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:26.724447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":324,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:51.941241+0000","last_change":"2024-09-14T11:59:51.941241+0000","last_active":"2024-09-14T11:59:51.941241+0000","last_peered":"2024-09-14T11:59:51.941241+0000","last_clean":"2024-09-14T11:59:51.941241+0000","last_became_active":"2024-09-14T11:43:35.607209+0000","last_became_peered":"2024-09-14T11:43:35.607209+0000","last_unstale":"2024-09-14T11:59:51.941241+0000","last_undegraded":"2024-09-14T11:59:51.941241+0000","last_fullsized":"2024-09-14T11:59:51.941241+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:51.941110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:51.941110+0000","last_clean_scrub_stamp":"2024-09-14T11:59:51.941110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:24.448416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:50.934389+0000","last_change":"2024-09-14T11:59:50.934317+0000","last_active":"2024-09-14T11:59:50.934389+0000","last_peered":"2024-09-14T11:59:50.934389+0000","last_clean":"2024-09-14T11:59:50.934389+0000","last_became_active":"2024-09-14T11:32:32.585339+0000","last_became_peered":"2024-09-14T11:32:32.585339+0000","last_unstale":"2024-09-14T11:59:50.934389+0000","last_undegraded":"2024-09-14T11:59:50.934389+0000","last_fullsized":"2024-09-14T11:59:50.934389+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:50.934222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:50.934222+0000","last_clean_scrub_stamp":"2024-09-14T11:59:50.934222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.411703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:51.641386+0000","last_change":"2024-09-14T11:59:51.641297+0000","last_active":"2024-09-14T11:59:51.641386+0000","last_peered":"2024-09-14T11:59:51.641386+0000","last_clean":"2024-09-14T11:59:51.641386+0000","last_became_active":"2024-09-14T11:32:29.555265+0000","last_became_peered":"2024-09-14T11:32:29.555265+0000","last_unstale":"2024-09-14T11:59:51.641386+0000","last_undegraded":"2024-09-14T11:59:51.641386+0000","last_fullsized":"2024-09-14T11:59:51.641386+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:51.641194+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:51.641194+0000","last_clean_scrub_stamp":"2024-09-14T11:59:51.641194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:25.376683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'21","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.423143+0000","last_change":"2024-09-14T11:59:23.423063+0000","last_active":"2024-09-14T11:59:23.423143+0000","last_peered":"2024-09-14T11:59:23.423143+0000","last_clean":"2024-09-14T11:59:23.423143+0000","last_became_active":"2024-09-14T11:30:45.181767+0000","last_became_peered":"2024-09-14T11:30:45.181767+0000","last_unstale":"2024-09-14T11:59:23.423143+0000","last_undegraded":"2024-09-14T11:59:23.423143+0000","last_fullsized":"2024-09-14T11:59:23.423143+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-14T11:59:23.422970+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-14T11:59:23.422970+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.422970+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:59.982789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":63,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.412789+0000","last_change":"2024-09-14T11:59:31.412667+0000","last_active":"2024-09-14T11:59:31.412789+0000","last_peered":"2024-09-14T11:59:31.412789+0000","last_clean":"2024-09-14T11:59:31.412789+0000","last_became_active":"2024-09-14T11:43:35.603013+0000","last_became_peered":"2024-09-14T11:43:35.603013+0000","last_unstale":"2024-09-14T11:59:31.412789+0000","last_undegraded":"2024-09-14T11:59:31.412789+0000","last_fullsized":"2024-09-14T11:59:31.412789+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.412565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.412565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.412565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:01.646119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":42,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:51.950666+0000","last_change":"2024-09-14T11:59:51.950666+0000","last_active":"2024-09-14T11:59:51.950666+0000","last_peered":"2024-09-14T11:59:51.950666+0000","last_clean":"2024-09-14T11:59:51.950666+0000","last_became_active":"2024-09-14T11:32:32.585528+0000","last_became_peered":"2024-09-14T11:32:32.585528+0000","last_unstale":"2024-09-14T11:59:51.950666+0000","last_undegraded":"2024-09-14T11:59:51.950666+0000","last_fullsized":"2024-09-14T11:59:51.950666+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:51.950570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:51.950570+0000","last_clean_scrub_stamp":"2024-09-14T11:59:51.950570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:43.836922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.859688+0000","last_change":"2024-09-14T11:59:34.859688+0000","last_active":"2024-09-14T11:59:34.859688+0000","last_peered":"2024-09-14T11:59:34.859688+0000","last_clean":"2024-09-14T11:59:34.859688+0000","last_became_active":"2024-09-14T11:32:29.555958+0000","last_became_peered":"2024-09-14T11:32:29.555958+0000","last_unstale":"2024-09-14T11:59:34.859688+0000","last_undegraded":"2024-09-14T11:59:34.859688+0000","last_fullsized":"2024-09-14T11:59:34.859688+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:34.859595+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:34.859595+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.859595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:37.485335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'140","reported_seq":465,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.631570+0000","last_change":"2024-09-14T11:59:34.631503+0000","last_active":"2024-09-14T11:59:34.631570+0000","last_peered":"2024-09-14T11:59:34.631570+0000","last_clean":"2024-09-14T11:59:34.631570+0000","last_became_active":"2024-09-14T11:30:45.180958+0000","last_became_peered":"2024-09-14T11:30:45.180958+0000","last_unstale":"2024-09-14T11:59:34.631570+0000","last_undegraded":"2024-09-14T11:59:34.631570+0000","last_fullsized":"2024-09-14T11:59:34.631570+0000","mapping_epoch":249,"log_start":"259'100","ondisk_log_start":"259'100","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:34.631395+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:34.631395+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.631395+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:00.463948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1284,"num_read_kb":984,"num_write":312,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.224506+0000","last_change":"2024-09-14T11:59:19.224414+0000","last_active":"2024-09-14T11:59:19.224506+0000","last_peered":"2024-09-14T11:59:19.224506+0000","last_clean":"2024-09-14T11:59:19.224506+0000","last_became_active":"2024-09-14T11:43:35.601649+0000","last_became_peered":"2024-09-14T11:43:35.601649+0000","last_unstale":"2024-09-14T11:59:19.224506+0000","last_undegraded":"2024-09-14T11:59:19.224506+0000","last_fullsized":"2024-09-14T11:59:19.224506+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:19.224326+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:19.224326+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.224326+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:10.820830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"259'2","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:48.947494+0000","last_change":"2024-09-14T11:59:48.947494+0000","last_active":"2024-09-14T11:59:48.947494+0000","last_peered":"2024-09-14T11:59:48.947494+0000","last_clean":"2024-09-14T11:59:48.947494+0000","last_became_active":"2024-09-14T11:32:32.588096+0000","last_became_peered":"2024-09-14T11:32:32.588096+0000","last_unstale":"2024-09-14T11:59:48.947494+0000","last_undegraded":"2024-09-14T11:59:48.947494+0000","last_fullsized":"2024-09-14T11:59:48.947494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:48.947377+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:48.947377+0000","last_clean_scrub_stamp":"2024-09-14T11:59:48.947377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:19.118167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.966207+0000","last_change":"2024-09-14T11:59:37.966207+0000","last_active":"2024-09-14T11:59:37.966207+0000","last_peered":"2024-09-14T11:59:37.966207+0000","last_clean":"2024-09-14T11:59:37.966207+0000","last_became_active":"2024-09-14T11:32:29.553407+0000","last_became_peered":"2024-09-14T11:32:29.553407+0000","last_unstale":"2024-09-14T11:59:37.966207+0000","last_undegraded":"2024-09-14T11:59:37.966207+0000","last_fullsized":"2024-09-14T11:59:37.966207+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:37.966126+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:37.966126+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.966126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:12.840377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'72","reported_seq":241,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.960467+0000","last_change":"2024-09-14T11:59:39.960384+0000","last_active":"2024-09-14T11:59:39.960467+0000","last_peered":"2024-09-14T11:59:39.960467+0000","last_clean":"2024-09-14T11:59:39.960467+0000","last_became_active":"2024-09-14T11:30:45.186027+0000","last_became_peered":"2024-09-14T11:30:45.186027+0000","last_unstale":"2024-09-14T11:59:39.960467+0000","last_undegraded":"2024-09-14T11:59:39.960467+0000","last_fullsized":"2024-09-14T11:59:39.960467+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'72","last_scrub_stamp":"2024-09-14T11:59:39.960296+0000","last_deep_scrub":"262'72","last_deep_scrub_stamp":"2024-09-14T11:59:39.960296+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.960296+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:12.552194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":368,"num_write":180,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.933575+0000","last_change":"2024-09-14T11:59:49.933514+0000","last_active":"2024-09-14T11:59:49.933575+0000","last_peered":"2024-09-14T11:59:49.933575+0000","last_clean":"2024-09-14T11:59:49.933575+0000","last_became_active":"2024-09-14T11:43:35.602481+0000","last_became_peered":"2024-09-14T11:43:35.602481+0000","last_unstale":"2024-09-14T11:59:49.933575+0000","last_undegraded":"2024-09-14T11:59:49.933575+0000","last_fullsized":"2024-09-14T11:59:49.933575+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:49.933413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:49.933413+0000","last_clean_scrub_stamp":"2024-09-14T11:59:49.933413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:21.581558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'2","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.959289+0000","last_change":"2024-09-14T11:59:49.959289+0000","last_active":"2024-09-14T11:59:49.959289+0000","last_peered":"2024-09-14T11:59:49.959289+0000","last_clean":"2024-09-14T11:59:49.959289+0000","last_became_active":"2024-09-14T11:32:32.582713+0000","last_became_peered":"2024-09-14T11:32:32.582713+0000","last_unstale":"2024-09-14T11:59:49.959289+0000","last_undegraded":"2024-09-14T11:59:49.959289+0000","last_fullsized":"2024-09-14T11:59:49.959289+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:49.959192+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:49.959192+0000","last_clean_scrub_stamp":"2024-09-14T11:59:49.959192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:11.948375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.289244+0000","last_change":"2024-09-14T11:59:15.289244+0000","last_active":"2024-09-14T11:59:15.289244+0000","last_peered":"2024-09-14T11:59:15.289244+0000","last_clean":"2024-09-14T11:59:15.289244+0000","last_became_active":"2024-09-14T11:32:29.543661+0000","last_became_peered":"2024-09-14T11:32:29.543661+0000","last_unstale":"2024-09-14T11:59:15.289244+0000","last_undegraded":"2024-09-14T11:59:15.289244+0000","last_fullsized":"2024-09-14T11:59:15.289244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:15.289158+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:15.289158+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.289158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:54.409715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'4","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.341001+0000","last_change":"2024-09-14T11:59:07.340892+0000","last_active":"2024-09-14T11:59:07.341001+0000","last_peered":"2024-09-14T11:59:07.341001+0000","last_clean":"2024-09-14T11:59:07.341001+0000","last_became_active":"2024-09-14T11:30:45.184065+0000","last_became_peered":"2024-09-14T11:30:45.184065+0000","last_unstale":"2024-09-14T11:59:07.341001+0000","last_undegraded":"2024-09-14T11:59:07.341001+0000","last_fullsized":"2024-09-14T11:59:07.341001+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:07.340795+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.340795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:53.630134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.812771+0000","last_change":"2024-09-14T11:59:39.812690+0000","last_active":"2024-09-14T11:59:39.812771+0000","last_peered":"2024-09-14T11:59:39.812771+0000","last_clean":"2024-09-14T11:59:39.812771+0000","last_became_active":"2024-09-14T11:43:35.600981+0000","last_became_peered":"2024-09-14T11:43:35.600981+0000","last_unstale":"2024-09-14T11:59:39.812771+0000","last_undegraded":"2024-09-14T11:59:39.812771+0000","last_fullsized":"2024-09-14T11:59:39.812771+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:39.812602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:39.812602+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.812602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:51.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"259'5","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.849133+0000","last_change":"2024-09-14T11:59:40.849133+0000","last_active":"2024-09-14T11:59:40.849133+0000","last_peered":"2024-09-14T11:59:40.849133+0000","last_clean":"2024-09-14T11:59:40.849133+0000","last_became_active":"2024-09-14T11:32:32.581293+0000","last_became_peered":"2024-09-14T11:32:32.581293+0000","last_unstale":"2024-09-14T11:59:40.849133+0000","last_undegraded":"2024-09-14T11:59:40.849133+0000","last_fullsized":"2024-09-14T11:59:40.849133+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-14T11:59:40.849047+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-14T11:59:40.849047+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.849047+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:09.791831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.569390+0000","last_change":"2024-09-14T11:59:42.569390+0000","last_active":"2024-09-14T11:59:42.569390+0000","last_peered":"2024-09-14T11:59:42.569390+0000","last_clean":"2024-09-14T11:59:42.569390+0000","last_became_active":"2024-09-14T11:32:29.549717+0000","last_became_peered":"2024-09-14T11:32:29.549717+0000","last_unstale":"2024-09-14T11:59:42.569390+0000","last_undegraded":"2024-09-14T11:59:42.569390+0000","last_fullsized":"2024-09-14T11:59:42.569390+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.569282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.569282+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.569282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:22.670783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'237","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.017045+0000","last_change":"2024-09-14T11:59:34.017045+0000","last_active":"2024-09-14T11:59:34.017045+0000","last_peered":"2024-09-14T11:59:34.017045+0000","last_clean":"2024-09-14T11:59:34.017045+0000","last_became_active":"2024-09-14T11:30:45.185102+0000","last_became_peered":"2024-09-14T11:30:45.185102+0000","last_unstale":"2024-09-14T11:59:34.017045+0000","last_undegraded":"2024-09-14T11:59:34.017045+0000","last_fullsized":"2024-09-14T11:59:34.017045+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-14T11:59:34.016940+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-14T11:59:34.016940+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.016940+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:32.338525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2288,"num_read_kb":3251,"num_write":461,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:56.941599+0000","last_change":"2024-09-14T11:59:56.941599+0000","last_active":"2024-09-14T11:59:56.941599+0000","last_peered":"2024-09-14T11:59:56.941599+0000","last_clean":"2024-09-14T11:59:56.941599+0000","last_became_active":"2024-09-14T11:43:35.603413+0000","last_became_peered":"2024-09-14T11:43:35.603413+0000","last_unstale":"2024-09-14T11:59:56.941599+0000","last_undegraded":"2024-09-14T11:59:56.941599+0000","last_fullsized":"2024-09-14T11:59:56.941599+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:56.941533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:56.941533+0000","last_clean_scrub_stamp":"2024-09-14T11:59:56.941533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:59.695957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'5","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.396750+0000","last_change":"2024-09-14T11:59:30.396750+0000","last_active":"2024-09-14T11:59:30.396750+0000","last_peered":"2024-09-14T11:59:30.396750+0000","last_clean":"2024-09-14T11:59:30.396750+0000","last_became_active":"2024-09-14T11:32:32.583072+0000","last_became_peered":"2024-09-14T11:32:32.583072+0000","last_unstale":"2024-09-14T11:59:30.396750+0000","last_undegraded":"2024-09-14T11:59:30.396750+0000","last_fullsized":"2024-09-14T11:59:30.396750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:30.396650+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:30.396650+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.396650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:35.714644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'7","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.967981+0000","last_change":"2024-09-14T11:59:32.967981+0000","last_active":"2024-09-14T11:59:32.967981+0000","last_peered":"2024-09-14T11:59:32.967981+0000","last_clean":"2024-09-14T11:59:32.967981+0000","last_became_active":"2024-09-14T11:32:29.555639+0000","last_became_peered":"2024-09-14T11:32:29.555639+0000","last_unstale":"2024-09-14T11:59:32.967981+0000","last_undegraded":"2024-09-14T11:59:32.967981+0000","last_fullsized":"2024-09-14T11:59:32.967981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-14T11:59:32.967882+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-14T11:59:32.967882+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.967882+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:45.922771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7227,"num_write":12,"num_write_kb":7227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'46","reported_seq":182,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.055155+0000","last_change":"2024-09-14T11:59:33.055155+0000","last_active":"2024-09-14T11:59:33.055155+0000","last_peered":"2024-09-14T11:59:33.055155+0000","last_clean":"2024-09-14T11:59:33.055155+0000","last_became_active":"2024-09-14T11:30:45.184613+0000","last_became_peered":"2024-09-14T11:30:45.184613+0000","last_unstale":"2024-09-14T11:59:33.055155+0000","last_undegraded":"2024-09-14T11:59:33.055155+0000","last_fullsized":"2024-09-14T11:59:33.055155+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-14T11:59:33.055047+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-14T11:59:33.055047+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.055047+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:25.316879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":256,"num_write":112,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:52.681885+0000","last_change":"2024-09-14T11:59:52.681885+0000","last_active":"2024-09-14T11:59:52.681885+0000","last_peered":"2024-09-14T11:59:52.681885+0000","last_clean":"2024-09-14T11:59:52.681885+0000","last_became_active":"2024-09-14T11:43:35.605682+0000","last_became_peered":"2024-09-14T11:43:35.605682+0000","last_unstale":"2024-09-14T11:59:52.681885+0000","last_undegraded":"2024-09-14T11:59:52.681885+0000","last_fullsized":"2024-09-14T11:59:52.681885+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:52.681789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:52.681789+0000","last_clean_scrub_stamp":"2024-09-14T11:59:52.681789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:16.586683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'6","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.415769+0000","last_change":"2024-09-14T11:59:32.415769+0000","last_active":"2024-09-14T11:59:32.415769+0000","last_peered":"2024-09-14T11:59:32.415769+0000","last_clean":"2024-09-14T11:59:32.415769+0000","last_became_active":"2024-09-14T11:32:32.580893+0000","last_became_peered":"2024-09-14T11:32:32.580893+0000","last_unstale":"2024-09-14T11:59:32.415769+0000","last_undegraded":"2024-09-14T11:59:32.415769+0000","last_fullsized":"2024-09-14T11:59:32.415769+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:32.415674+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:32.415674+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.415674+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:41.216734+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.985163+0000","last_change":"2024-09-14T11:59:41.985163+0000","last_active":"2024-09-14T11:59:41.985163+0000","last_peered":"2024-09-14T11:59:41.985163+0000","last_clean":"2024-09-14T11:59:41.985163+0000","last_became_active":"2024-09-14T11:32:29.542761+0000","last_became_peered":"2024-09-14T11:32:29.542761+0000","last_unstale":"2024-09-14T11:59:41.985163+0000","last_undegraded":"2024-09-14T11:59:41.985163+0000","last_fullsized":"2024-09-14T11:59:41.985163+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:41.985076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:41.985076+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.985076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:24.613003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'11","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.619952+0000","last_change":"2024-09-14T11:59:33.619952+0000","last_active":"2024-09-14T11:59:33.619952+0000","last_peered":"2024-09-14T11:59:33.619952+0000","last_clean":"2024-09-14T11:59:33.619952+0000","last_became_active":"2024-09-14T11:30:45.186828+0000","last_became_peered":"2024-09-14T11:30:45.186828+0000","last_unstale":"2024-09-14T11:59:33.619952+0000","last_undegraded":"2024-09-14T11:59:33.619952+0000","last_fullsized":"2024-09-14T11:59:33.619952+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-14T11:59:33.619863+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-14T11:59:33.619863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.619863+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:49.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":39,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'2","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:49.685290+0000","last_change":"2024-09-14T11:59:49.685187+0000","last_active":"2024-09-14T11:59:49.685290+0000","last_peered":"2024-09-14T11:59:49.685290+0000","last_clean":"2024-09-14T11:59:49.685290+0000","last_became_active":"2024-09-14T11:43:35.608054+0000","last_became_peered":"2024-09-14T11:43:35.608054+0000","last_unstale":"2024-09-14T11:59:49.685290+0000","last_undegraded":"2024-09-14T11:59:49.685290+0000","last_fullsized":"2024-09-14T11:59:49.685290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:49.685090+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:49.685090+0000","last_clean_scrub_stamp":"2024-09-14T11:59:49.685090+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:12.211268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:47.983533+0000","last_change":"2024-09-14T11:59:47.983533+0000","last_active":"2024-09-14T11:59:47.983533+0000","last_peered":"2024-09-14T11:59:47.983533+0000","last_clean":"2024-09-14T11:59:47.983533+0000","last_became_active":"2024-09-14T11:32:32.589942+0000","last_became_peered":"2024-09-14T11:32:32.589942+0000","last_unstale":"2024-09-14T11:59:47.983533+0000","last_undegraded":"2024-09-14T11:59:47.983533+0000","last_fullsized":"2024-09-14T11:59:47.983533+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:59:47.983430+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:59:47.983430+0000","last_clean_scrub_stamp":"2024-09-14T11:59:47.983430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:29.715191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.067586+0000","last_change":"2024-09-14T11:59:25.067586+0000","last_active":"2024-09-14T11:59:25.067586+0000","last_peered":"2024-09-14T11:59:25.067586+0000","last_clean":"2024-09-14T11:59:25.067586+0000","last_became_active":"2024-09-14T11:32:29.557356+0000","last_became_peered":"2024-09-14T11:32:29.557356+0000","last_unstale":"2024-09-14T11:59:25.067586+0000","last_undegraded":"2024-09-14T11:59:25.067586+0000","last_fullsized":"2024-09-14T11:59:25.067586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.067506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.067506+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.067506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:06.589318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"259'8","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.918900+0000","last_change":"2024-09-14T11:59:31.918900+0000","last_active":"2024-09-14T11:59:31.918900+0000","last_peered":"2024-09-14T11:59:31.918900+0000","last_clean":"2024-09-14T11:59:31.918900+0000","last_became_active":"2024-09-14T11:30:45.181481+0000","last_became_peered":"2024-09-14T11:30:45.181481+0000","last_unstale":"2024-09-14T11:59:31.918900+0000","last_undegraded":"2024-09-14T11:59:31.918900+0000","last_fullsized":"2024-09-14T11:59:31.918900+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-14T11:59:31.918814+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-14T11:59:31.918814+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.918814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:45.012003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'2","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:53.969540+0000","last_change":"2024-09-14T11:59:53.969540+0000","last_active":"2024-09-14T11:59:53.969540+0000","last_peered":"2024-09-14T11:59:53.969540+0000","last_clean":"2024-09-14T11:59:53.969540+0000","last_became_active":"2024-09-14T11:43:35.603218+0000","last_became_peered":"2024-09-14T11:43:35.603218+0000","last_unstale":"2024-09-14T11:59:53.969540+0000","last_undegraded":"2024-09-14T11:59:53.969540+0000","last_fullsized":"2024-09-14T11:59:53.969540+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:53.969442+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:53.969442+0000","last_clean_scrub_stamp":"2024-09-14T11:59:53.969442+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:37.886082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"259'5","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.094352+0000","last_change":"2024-09-14T11:59:28.094352+0000","last_active":"2024-09-14T11:59:28.094352+0000","last_peered":"2024-09-14T11:59:28.094352+0000","last_clean":"2024-09-14T11:59:28.094352+0000","last_became_active":"2024-09-14T11:32:32.583153+0000","last_became_peered":"2024-09-14T11:32:32.583153+0000","last_unstale":"2024-09-14T11:59:28.094352+0000","last_undegraded":"2024-09-14T11:59:28.094352+0000","last_fullsized":"2024-09-14T11:59:28.094352+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-14T11:59:28.094268+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-14T11:59:28.094268+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.094268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:35.495083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.863794+0000","last_change":"2024-09-14T11:59:33.863794+0000","last_active":"2024-09-14T11:59:33.863794+0000","last_peered":"2024-09-14T11:59:33.863794+0000","last_clean":"2024-09-14T11:59:33.863794+0000","last_became_active":"2024-09-14T11:32:29.556777+0000","last_became_peered":"2024-09-14T11:32:29.556777+0000","last_unstale":"2024-09-14T11:59:33.863794+0000","last_undegraded":"2024-09-14T11:59:33.863794+0000","last_fullsized":"2024-09-14T11:59:33.863794+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:33.863688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:33.863688+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.863688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:57.260259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'12","reported_seq":88,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.945752+0000","last_change":"2024-09-14T11:59:38.945752+0000","last_active":"2024-09-14T11:59:38.945752+0000","last_peered":"2024-09-14T11:59:38.945752+0000","last_clean":"2024-09-14T11:59:38.945752+0000","last_became_active":"2024-09-14T11:30:45.187368+0000","last_became_peered":"2024-09-14T11:30:45.187368+0000","last_unstale":"2024-09-14T11:59:38.945752+0000","last_undegraded":"2024-09-14T11:59:38.945752+0000","last_fullsized":"2024-09-14T11:59:38.945752+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'12","last_scrub_stamp":"2024-09-14T11:59:38.945662+0000","last_deep_scrub":"262'12","last_deep_scrub_stamp":"2024-09-14T11:59:38.945662+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.945662+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:33.924726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.240252+0000","last_change":"2024-09-14T11:59:16.240252+0000","last_active":"2024-09-14T11:59:16.240252+0000","last_peered":"2024-09-14T11:59:16.240252+0000","last_clean":"2024-09-14T11:59:16.240252+0000","last_became_active":"2024-09-14T11:43:35.600846+0000","last_became_peered":"2024-09-14T11:43:35.600846+0000","last_unstale":"2024-09-14T11:59:16.240252+0000","last_undegraded":"2024-09-14T11:59:16.240252+0000","last_fullsized":"2024-09-14T11:59:16.240252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.240178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.240178+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.240178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:44.441783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.966684+0000","last_change":"2024-09-14T11:59:42.966684+0000","last_active":"2024-09-14T11:59:42.966684+0000","last_peered":"2024-09-14T11:59:42.966684+0000","last_clean":"2024-09-14T11:59:42.966684+0000","last_became_active":"2024-09-14T11:32:32.585395+0000","last_became_peered":"2024-09-14T11:32:32.585395+0000","last_unstale":"2024-09-14T11:59:42.966684+0000","last_undegraded":"2024-09-14T11:59:42.966684+0000","last_fullsized":"2024-09-14T11:59:42.966684+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.966598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.966598+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.966598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:39.678108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"259'6","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.975886+0000","last_change":"2024-09-14T11:59:38.975886+0000","last_active":"2024-09-14T11:59:38.975886+0000","last_peered":"2024-09-14T11:59:38.975886+0000","last_clean":"2024-09-14T11:59:38.975886+0000","last_became_active":"2024-09-14T11:32:29.550094+0000","last_became_peered":"2024-09-14T11:32:29.550094+0000","last_unstale":"2024-09-14T11:59:38.975886+0000","last_undegraded":"2024-09-14T11:59:38.975886+0000","last_fullsized":"2024-09-14T11:59:38.975886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-14T11:59:38.975780+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-14T11:59:38.975780+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.975780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:29.895205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'19","reported_seq":107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.985736+0000","last_change":"2024-09-14T11:59:37.985675+0000","last_active":"2024-09-14T11:59:37.985736+0000","last_peered":"2024-09-14T11:59:37.985736+0000","last_clean":"2024-09-14T11:59:37.985736+0000","last_became_active":"2024-09-14T11:30:45.186884+0000","last_became_peered":"2024-09-14T11:30:45.186884+0000","last_unstale":"2024-09-14T11:59:37.985736+0000","last_undegraded":"2024-09-14T11:59:37.985736+0000","last_fullsized":"2024-09-14T11:59:37.985736+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'19","last_scrub_stamp":"2024-09-14T11:59:37.985583+0000","last_deep_scrub":"262'19","last_deep_scrub_stamp":"2024-09-14T11:59:37.985583+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.985583+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:17.803911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":48,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:46.945805+0000","last_change":"2024-09-14T11:59:46.945805+0000","last_active":"2024-09-14T11:59:46.945805+0000","last_peered":"2024-09-14T11:59:46.945805+0000","last_clean":"2024-09-14T11:59:46.945805+0000","last_became_active":"2024-09-14T11:43:35.607473+0000","last_became_peered":"2024-09-14T11:43:35.607473+0000","last_unstale":"2024-09-14T11:59:46.945805+0000","last_undegraded":"2024-09-14T11:59:46.945805+0000","last_fullsized":"2024-09-14T11:59:46.945805+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:46.945669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:46.945669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:46.945669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:37.470073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'4","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:45.952311+0000","last_change":"2024-09-14T11:59:45.952311+0000","last_active":"2024-09-14T11:59:45.952311+0000","last_peered":"2024-09-14T11:59:45.952311+0000","last_clean":"2024-09-14T11:59:45.952311+0000","last_became_active":"2024-09-14T11:32:32.589408+0000","last_became_peered":"2024-09-14T11:32:32.589408+0000","last_unstale":"2024-09-14T11:59:45.952311+0000","last_undegraded":"2024-09-14T11:59:45.952311+0000","last_fullsized":"2024-09-14T11:59:45.952311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:45.952224+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:45.952224+0000","last_clean_scrub_stamp":"2024-09-14T11:59:45.952224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:30.136201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.321965+0000","last_change":"2024-09-14T11:59:10.321896+0000","last_active":"2024-09-14T11:59:10.321965+0000","last_peered":"2024-09-14T11:59:10.321965+0000","last_clean":"2024-09-14T11:59:10.321965+0000","last_became_active":"2024-09-14T11:32:29.550083+0000","last_became_peered":"2024-09-14T11:32:29.550083+0000","last_unstale":"2024-09-14T11:59:10.321965+0000","last_undegraded":"2024-09-14T11:59:10.321965+0000","last_fullsized":"2024-09-14T11:59:10.321965+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:10.321802+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.321802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:41.521238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'30","reported_seq":141,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.834560+0000","last_change":"2024-09-14T11:59:31.834444+0000","last_active":"2024-09-14T11:59:31.834560+0000","last_peered":"2024-09-14T11:59:31.834560+0000","last_clean":"2024-09-14T11:59:31.834560+0000","last_became_active":"2024-09-14T11:30:45.175502+0000","last_became_peered":"2024-09-14T11:30:45.175502+0000","last_unstale":"2024-09-14T11:59:31.834560+0000","last_undegraded":"2024-09-14T11:59:31.834560+0000","last_fullsized":"2024-09-14T11:59:31.834560+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-14T11:59:31.834343+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-14T11:59:31.834343+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.834343+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:24.480004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":166,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.089349+0000","last_change":"2024-09-14T11:59:31.089349+0000","last_active":"2024-09-14T11:59:31.089349+0000","last_peered":"2024-09-14T11:59:31.089349+0000","last_clean":"2024-09-14T11:59:31.089349+0000","last_became_active":"2024-09-14T11:43:35.603301+0000","last_became_peered":"2024-09-14T11:43:35.603301+0000","last_unstale":"2024-09-14T11:59:31.089349+0000","last_undegraded":"2024-09-14T11:59:31.089349+0000","last_fullsized":"2024-09-14T11:59:31.089349+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.089230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.089230+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.089230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:18.598347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"259'4","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.419904+0000","last_change":"2024-09-14T11:59:29.419841+0000","last_active":"2024-09-14T11:59:29.419904+0000","last_peered":"2024-09-14T11:59:29.419904+0000","last_clean":"2024-09-14T11:59:29.419904+0000","last_became_active":"2024-09-14T11:32:32.581755+0000","last_became_peered":"2024-09-14T11:32:32.581755+0000","last_unstale":"2024-09-14T11:59:29.419904+0000","last_undegraded":"2024-09-14T11:59:29.419904+0000","last_fullsized":"2024-09-14T11:59:29.419904+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'4","last_scrub_stamp":"2024-09-14T11:59:29.419750+0000","last_deep_scrub":"259'4","last_deep_scrub_stamp":"2024-09-14T11:59:29.419750+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.419750+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:22.031323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.584697+0000","last_change":"2024-09-14T11:59:41.584697+0000","last_active":"2024-09-14T11:59:41.584697+0000","last_peered":"2024-09-14T11:59:41.584697+0000","last_clean":"2024-09-14T11:59:41.584697+0000","last_became_active":"2024-09-14T11:32:29.555660+0000","last_became_peered":"2024-09-14T11:32:29.555660+0000","last_unstale":"2024-09-14T11:59:41.584697+0000","last_undegraded":"2024-09-14T11:59:41.584697+0000","last_fullsized":"2024-09-14T11:59:41.584697+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:41.584583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:41.584583+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.584583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:18.850493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'20","reported_seq":111,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.062154+0000","last_change":"2024-09-14T11:59:22.062089+0000","last_active":"2024-09-14T11:59:22.062154+0000","last_peered":"2024-09-14T11:59:22.062154+0000","last_clean":"2024-09-14T11:59:22.062154+0000","last_became_active":"2024-09-14T11:30:45.181341+0000","last_became_peered":"2024-09-14T11:30:45.181341+0000","last_unstale":"2024-09-14T11:59:22.062154+0000","last_undegraded":"2024-09-14T11:59:22.062154+0000","last_fullsized":"2024-09-14T11:59:22.062154+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'20","last_scrub_stamp":"2024-09-14T11:59:22.062012+0000","last_deep_scrub":"259'20","last_deep_scrub_stamp":"2024-09-14T11:59:22.062012+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.062012+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:14.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":100,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:45.989558+0000","last_change":"2024-09-14T11:59:45.989558+0000","last_active":"2024-09-14T11:59:45.989558+0000","last_peered":"2024-09-14T11:59:45.989558+0000","last_clean":"2024-09-14T11:59:45.989558+0000","last_became_active":"2024-09-14T11:43:35.603262+0000","last_became_peered":"2024-09-14T11:43:35.603262+0000","last_unstale":"2024-09-14T11:59:45.989558+0000","last_undegraded":"2024-09-14T11:59:45.989558+0000","last_fullsized":"2024-09-14T11:59:45.989558+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:45.989467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:45.989467+0000","last_clean_scrub_stamp":"2024-09-14T11:59:45.989467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:15.120497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'5","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.911515+0000","last_change":"2024-09-14T11:59:44.911515+0000","last_active":"2024-09-14T11:59:44.911515+0000","last_peered":"2024-09-14T11:59:44.911515+0000","last_clean":"2024-09-14T11:59:44.911515+0000","last_became_active":"2024-09-14T11:32:32.587870+0000","last_became_peered":"2024-09-14T11:32:32.587870+0000","last_unstale":"2024-09-14T11:59:44.911515+0000","last_undegraded":"2024-09-14T11:59:44.911515+0000","last_fullsized":"2024-09-14T11:59:44.911515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:44.911412+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:44.911412+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.911412+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:46.964265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.473102+0000","last_change":"2024-09-14T11:59:26.473019+0000","last_active":"2024-09-14T11:59:26.473102+0000","last_peered":"2024-09-14T11:59:26.473102+0000","last_clean":"2024-09-14T11:59:26.473102+0000","last_became_active":"2024-09-14T11:32:29.558493+0000","last_became_peered":"2024-09-14T11:32:29.558493+0000","last_unstale":"2024-09-14T11:59:26.473102+0000","last_undegraded":"2024-09-14T11:59:26.473102+0000","last_fullsized":"2024-09-14T11:59:26.473102+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:26.472928+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:26.472928+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.472928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:48.714852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'47","reported_seq":181,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.201853+0000","last_change":"2024-09-14T11:59:22.201785+0000","last_active":"2024-09-14T11:59:22.201853+0000","last_peered":"2024-09-14T11:59:22.201853+0000","last_clean":"2024-09-14T11:59:22.201853+0000","last_became_active":"2024-09-14T11:30:45.186035+0000","last_became_peered":"2024-09-14T11:30:45.186035+0000","last_unstale":"2024-09-14T11:59:22.201853+0000","last_undegraded":"2024-09-14T11:59:22.201853+0000","last_fullsized":"2024-09-14T11:59:22.201853+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'47","last_scrub_stamp":"2024-09-14T11:59:22.201694+0000","last_deep_scrub":"262'47","last_deep_scrub_stamp":"2024-09-14T11:59:22.201694+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.201694+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:46.966633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":357,"num_read_kb":247,"num_write":117,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:54.935580+0000","last_change":"2024-09-14T11:59:54.935580+0000","last_active":"2024-09-14T11:59:54.935580+0000","last_peered":"2024-09-14T11:59:54.935580+0000","last_clean":"2024-09-14T11:59:54.935580+0000","last_became_active":"2024-09-14T11:43:35.607478+0000","last_became_peered":"2024-09-14T11:43:35.607478+0000","last_unstale":"2024-09-14T11:59:54.935580+0000","last_undegraded":"2024-09-14T11:59:54.935580+0000","last_fullsized":"2024-09-14T11:59:54.935580+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:54.935489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:54.935489+0000","last_clean_scrub_stamp":"2024-09-14T11:59:54.935489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:48.026505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.845333+0000","last_change":"2024-09-14T11:59:39.845333+0000","last_active":"2024-09-14T11:59:39.845333+0000","last_peered":"2024-09-14T11:59:39.845333+0000","last_clean":"2024-09-14T11:59:39.845333+0000","last_became_active":"2024-09-14T11:32:32.589738+0000","last_became_peered":"2024-09-14T11:32:32.589738+0000","last_unstale":"2024-09-14T11:59:39.845333+0000","last_undegraded":"2024-09-14T11:59:39.845333+0000","last_fullsized":"2024-09-14T11:59:39.845333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:39.845212+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:39.845212+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.845212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:45.668109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"259'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.603039+0000","last_change":"2024-09-14T11:59:39.603039+0000","last_active":"2024-09-14T11:59:39.603039+0000","last_peered":"2024-09-14T11:59:39.603039+0000","last_clean":"2024-09-14T11:59:39.603039+0000","last_became_active":"2024-09-14T11:32:29.556978+0000","last_became_peered":"2024-09-14T11:32:29.556978+0000","last_unstale":"2024-09-14T11:59:39.603039+0000","last_undegraded":"2024-09-14T11:59:39.603039+0000","last_fullsized":"2024-09-14T11:59:39.603039+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-14T11:59:39.602947+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-14T11:59:39.602947+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.602947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:15.230528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'50","reported_seq":186,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.619644+0000","last_change":"2024-09-14T11:59:32.619581+0000","last_active":"2024-09-14T11:59:32.619644+0000","last_peered":"2024-09-14T11:59:32.619644+0000","last_clean":"2024-09-14T11:59:32.619644+0000","last_became_active":"2024-09-14T11:30:45.188503+0000","last_became_peered":"2024-09-14T11:30:45.188503+0000","last_unstale":"2024-09-14T11:59:32.619644+0000","last_undegraded":"2024-09-14T11:59:32.619644+0000","last_fullsized":"2024-09-14T11:59:32.619644+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'50","last_scrub_stamp":"2024-09-14T11:59:32.619489+0000","last_deep_scrub":"262'50","last_deep_scrub_stamp":"2024-09-14T11:59:32.619489+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.619489+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:05.263730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":233,"num_write":124,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:48.935603+0000","last_change":"2024-09-14T11:59:48.935603+0000","last_active":"2024-09-14T11:59:48.935603+0000","last_peered":"2024-09-14T11:59:48.935603+0000","last_clean":"2024-09-14T11:59:48.935603+0000","last_became_active":"2024-09-14T11:43:35.604858+0000","last_became_peered":"2024-09-14T11:43:35.604858+0000","last_unstale":"2024-09-14T11:59:48.935603+0000","last_undegraded":"2024-09-14T11:59:48.935603+0000","last_fullsized":"2024-09-14T11:59:48.935603+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:48.935507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:48.935507+0000","last_clean_scrub_stamp":"2024-09-14T11:59:48.935507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:51.443099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"259'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.985023+0000","last_change":"2024-09-14T11:59:41.985023+0000","last_active":"2024-09-14T11:59:41.985023+0000","last_peered":"2024-09-14T11:59:41.985023+0000","last_clean":"2024-09-14T11:59:41.985023+0000","last_became_active":"2024-09-14T11:32:32.578798+0000","last_became_peered":"2024-09-14T11:32:32.578798+0000","last_unstale":"2024-09-14T11:59:41.985023+0000","last_undegraded":"2024-09-14T11:59:41.985023+0000","last_fullsized":"2024-09-14T11:59:41.985023+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-14T11:59:41.984907+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-14T11:59:41.984907+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.984907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:59.259613+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.504802+0000","last_change":"2024-09-14T11:59:25.504802+0000","last_active":"2024-09-14T11:59:25.504802+0000","last_peered":"2024-09-14T11:59:25.504802+0000","last_clean":"2024-09-14T11:59:25.504802+0000","last_became_active":"2024-09-14T11:32:29.558249+0000","last_became_peered":"2024-09-14T11:32:29.558249+0000","last_unstale":"2024-09-14T11:59:25.504802+0000","last_undegraded":"2024-09-14T11:59:25.504802+0000","last_fullsized":"2024-09-14T11:59:25.504802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:25.504716+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:25.504716+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.504716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:37.246547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.019477+0000","last_change":"2024-09-14T11:59:32.019477+0000","last_active":"2024-09-14T11:59:32.019477+0000","last_peered":"2024-09-14T11:59:32.019477+0000","last_clean":"2024-09-14T11:59:32.019477+0000","last_became_active":"2024-09-14T11:30:45.184393+0000","last_became_peered":"2024-09-14T11:30:45.184393+0000","last_unstale":"2024-09-14T11:59:32.019477+0000","last_undegraded":"2024-09-14T11:59:32.019477+0000","last_fullsized":"2024-09-14T11:59:32.019477+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:32.019366+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:32.019366+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.019366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:07.050689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'2","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:47.967963+0000","last_change":"2024-09-14T11:59:47.967963+0000","last_active":"2024-09-14T11:59:47.967963+0000","last_peered":"2024-09-14T11:59:47.967963+0000","last_clean":"2024-09-14T11:59:47.967963+0000","last_became_active":"2024-09-14T11:43:35.606165+0000","last_became_peered":"2024-09-14T11:43:35.606165+0000","last_unstale":"2024-09-14T11:59:47.967963+0000","last_undegraded":"2024-09-14T11:59:47.967963+0000","last_fullsized":"2024-09-14T11:59:47.967963+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:47.967883+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:47.967883+0000","last_clean_scrub_stamp":"2024-09-14T11:59:47.967883+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:39.297353+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.435922+0000","last_change":"2024-09-14T11:59:28.435854+0000","last_active":"2024-09-14T11:59:28.435922+0000","last_peered":"2024-09-14T11:59:28.435922+0000","last_clean":"2024-09-14T11:59:28.435922+0000","last_became_active":"2024-09-14T11:32:32.582505+0000","last_became_peered":"2024-09-14T11:32:32.582505+0000","last_unstale":"2024-09-14T11:59:28.435922+0000","last_undegraded":"2024-09-14T11:59:28.435922+0000","last_fullsized":"2024-09-14T11:59:28.435922+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-14T11:59:28.435763+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-14T11:59:28.435763+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.435763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:40.532008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.553861+0000","last_change":"2024-09-14T11:59:40.553861+0000","last_active":"2024-09-14T11:59:40.553861+0000","last_peered":"2024-09-14T11:59:40.553861+0000","last_clean":"2024-09-14T11:59:40.553861+0000","last_became_active":"2024-09-14T11:32:29.555741+0000","last_became_peered":"2024-09-14T11:32:29.555741+0000","last_unstale":"2024-09-14T11:59:40.553861+0000","last_undegraded":"2024-09-14T11:59:40.553861+0000","last_fullsized":"2024-09-14T11:59:40.553861+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:40.553767+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:40.553767+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.553767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:06.496916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'35","reported_seq":152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.019398+0000","last_change":"2024-09-14T11:59:37.019398+0000","last_active":"2024-09-14T11:59:37.019398+0000","last_peered":"2024-09-14T11:59:37.019398+0000","last_clean":"2024-09-14T11:59:37.019398+0000","last_became_active":"2024-09-14T11:30:45.185175+0000","last_became_peered":"2024-09-14T11:30:45.185175+0000","last_unstale":"2024-09-14T11:59:37.019398+0000","last_undegraded":"2024-09-14T11:59:37.019398+0000","last_fullsized":"2024-09-14T11:59:37.019398+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'35","last_scrub_stamp":"2024-09-14T11:59:37.019326+0000","last_deep_scrub":"262'35","last_deep_scrub_stamp":"2024-09-14T11:59:37.019326+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.019326+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:00.845836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":166,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:48.695072+0000","last_change":"2024-09-14T11:59:48.695072+0000","last_active":"2024-09-14T11:59:48.695072+0000","last_peered":"2024-09-14T11:59:48.695072+0000","last_clean":"2024-09-14T11:59:48.695072+0000","last_became_active":"2024-09-14T11:43:35.603539+0000","last_became_peered":"2024-09-14T11:43:35.603539+0000","last_unstale":"2024-09-14T11:59:48.695072+0000","last_undegraded":"2024-09-14T11:59:48.695072+0000","last_fullsized":"2024-09-14T11:59:48.695072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:48.694975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:48.694975+0000","last_clean_scrub_stamp":"2024-09-14T11:59:48.694975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:42.323289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"259'7","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.007278+0000","last_change":"2024-09-14T11:59:43.007278+0000","last_active":"2024-09-14T11:59:43.007278+0000","last_peered":"2024-09-14T11:59:43.007278+0000","last_clean":"2024-09-14T11:59:43.007278+0000","last_became_active":"2024-09-14T11:32:32.589694+0000","last_became_peered":"2024-09-14T11:32:32.589694+0000","last_unstale":"2024-09-14T11:59:43.007278+0000","last_undegraded":"2024-09-14T11:59:43.007278+0000","last_fullsized":"2024-09-14T11:59:43.007278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-14T11:59:43.007195+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-14T11:59:43.007195+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.007195+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:03.587870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.985379+0000","last_change":"2024-09-14T11:59:33.985379+0000","last_active":"2024-09-14T11:59:33.985379+0000","last_peered":"2024-09-14T11:59:33.985379+0000","last_clean":"2024-09-14T11:59:33.985379+0000","last_became_active":"2024-09-14T11:32:29.551584+0000","last_became_peered":"2024-09-14T11:32:29.551584+0000","last_unstale":"2024-09-14T11:59:33.985379+0000","last_undegraded":"2024-09-14T11:59:33.985379+0000","last_fullsized":"2024-09-14T11:59:33.985379+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:33.985290+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:33.985290+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.985290+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:00.777872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'34","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.098732+0000","last_change":"2024-09-14T11:59:24.098732+0000","last_active":"2024-09-14T11:59:24.098732+0000","last_peered":"2024-09-14T11:59:24.098732+0000","last_clean":"2024-09-14T11:59:24.098732+0000","last_became_active":"2024-09-14T11:30:45.182972+0000","last_became_peered":"2024-09-14T11:30:45.182972+0000","last_unstale":"2024-09-14T11:59:24.098732+0000","last_undegraded":"2024-09-14T11:59:24.098732+0000","last_fullsized":"2024-09-14T11:59:24.098732+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'34","last_scrub_stamp":"2024-09-14T11:59:24.098645+0000","last_deep_scrub":"262'34","last_deep_scrub_stamp":"2024-09-14T11:59:24.098645+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.098645+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:48.529776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":169,"num_write":90,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.018406+0000","last_change":"2024-09-14T11:59:44.018406+0000","last_active":"2024-09-14T11:59:44.018406+0000","last_peered":"2024-09-14T11:59:44.018406+0000","last_clean":"2024-09-14T11:59:44.018406+0000","last_became_active":"2024-09-14T11:43:35.603009+0000","last_became_peered":"2024-09-14T11:43:35.603009+0000","last_unstale":"2024-09-14T11:59:44.018406+0000","last_undegraded":"2024-09-14T11:59:44.018406+0000","last_fullsized":"2024-09-14T11:59:44.018406+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:44.018264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:44.018264+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.018264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:00.715021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'6","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.658544+0000","last_change":"2024-09-14T11:59:44.658544+0000","last_active":"2024-09-14T11:59:44.658544+0000","last_peered":"2024-09-14T11:59:44.658544+0000","last_clean":"2024-09-14T11:59:44.658544+0000","last_became_active":"2024-09-14T11:32:32.583682+0000","last_became_peered":"2024-09-14T11:32:32.583682+0000","last_unstale":"2024-09-14T11:59:44.658544+0000","last_undegraded":"2024-09-14T11:59:44.658544+0000","last_fullsized":"2024-09-14T11:59:44.658544+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:44.658424+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:44.658424+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.658424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:13.817599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'6","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.994429+0000","last_change":"2024-09-14T11:59:39.994429+0000","last_active":"2024-09-14T11:59:39.994429+0000","last_peered":"2024-09-14T11:59:39.994429+0000","last_clean":"2024-09-14T11:59:39.994429+0000","last_became_active":"2024-09-14T11:32:29.552884+0000","last_became_peered":"2024-09-14T11:32:29.552884+0000","last_unstale":"2024-09-14T11:59:39.994429+0000","last_undegraded":"2024-09-14T11:59:39.994429+0000","last_fullsized":"2024-09-14T11:59:39.994429+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:39.994339+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:39.994339+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.994339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:43.575163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'33","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.609733+0000","last_change":"2024-09-14T11:59:31.609733+0000","last_active":"2024-09-14T11:59:31.609733+0000","last_peered":"2024-09-14T11:59:31.609733+0000","last_clean":"2024-09-14T11:59:31.609733+0000","last_became_active":"2024-09-14T11:30:45.181793+0000","last_became_peered":"2024-09-14T11:30:45.181793+0000","last_unstale":"2024-09-14T11:59:31.609733+0000","last_undegraded":"2024-09-14T11:59:31.609733+0000","last_fullsized":"2024-09-14T11:59:31.609733+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'33","last_scrub_stamp":"2024-09-14T11:59:31.609589+0000","last_deep_scrub":"262'33","last_deep_scrub_stamp":"2024-09-14T11:59:31.609589+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.609589+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:33.099218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":177,"num_write":91,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.828111+0000","last_change":"2024-09-14T11:59:37.828111+0000","last_active":"2024-09-14T11:59:37.828111+0000","last_peered":"2024-09-14T11:59:37.828111+0000","last_clean":"2024-09-14T11:59:37.828111+0000","last_became_active":"2024-09-14T11:43:35.603209+0000","last_became_peered":"2024-09-14T11:43:35.603209+0000","last_unstale":"2024-09-14T11:59:37.828111+0000","last_undegraded":"2024-09-14T11:59:37.828111+0000","last_fullsized":"2024-09-14T11:59:37.828111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:37.828019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:37.828019+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.828019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:35.582571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:47.731141+0000","last_change":"2024-09-14T11:59:47.731141+0000","last_active":"2024-09-14T11:59:47.731141+0000","last_peered":"2024-09-14T11:59:47.731141+0000","last_clean":"2024-09-14T11:59:47.731141+0000","last_became_active":"2024-09-14T11:32:32.575261+0000","last_became_peered":"2024-09-14T11:32:32.575261+0000","last_unstale":"2024-09-14T11:59:47.731141+0000","last_undegraded":"2024-09-14T11:59:47.731141+0000","last_fullsized":"2024-09-14T11:59:47.731141+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:47.731049+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:47.731049+0000","last_clean_scrub_stamp":"2024-09-14T11:59:47.731049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:31.297199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'3","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.289996+0000","last_change":"2024-09-14T11:59:09.289933+0000","last_active":"2024-09-14T11:59:09.289996+0000","last_peered":"2024-09-14T11:59:09.289996+0000","last_clean":"2024-09-14T11:59:09.289996+0000","last_became_active":"2024-09-14T11:32:29.550894+0000","last_became_peered":"2024-09-14T11:32:29.550894+0000","last_unstale":"2024-09-14T11:59:09.289996+0000","last_undegraded":"2024-09-14T11:59:09.289996+0000","last_fullsized":"2024-09-14T11:59:09.289996+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-14T11:59:09.289838+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.289838+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.777305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'35","reported_seq":152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.048046+0000","last_change":"2024-09-14T11:59:21.048046+0000","last_active":"2024-09-14T11:59:21.048046+0000","last_peered":"2024-09-14T11:59:21.048046+0000","last_clean":"2024-09-14T11:59:21.048046+0000","last_became_active":"2024-09-14T11:30:45.183908+0000","last_became_peered":"2024-09-14T11:30:45.183908+0000","last_unstale":"2024-09-14T11:59:21.048046+0000","last_undegraded":"2024-09-14T11:59:21.048046+0000","last_fullsized":"2024-09-14T11:59:21.048046+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'35","last_scrub_stamp":"2024-09-14T11:59:21.047929+0000","last_deep_scrub":"262'35","last_deep_scrub_stamp":"2024-09-14T11:59:21.047929+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.047929+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:37.654983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":202,"num_write":85,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.403279+0000","last_change":"2024-09-14T11:59:33.403218+0000","last_active":"2024-09-14T11:59:33.403279+0000","last_peered":"2024-09-14T11:59:33.403279+0000","last_clean":"2024-09-14T11:59:33.403279+0000","last_became_active":"2024-09-14T11:43:35.606796+0000","last_became_peered":"2024-09-14T11:43:35.606796+0000","last_unstale":"2024-09-14T11:59:33.403279+0000","last_undegraded":"2024-09-14T11:59:33.403279+0000","last_fullsized":"2024-09-14T11:59:33.403279+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:33.403119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:33.403119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.403119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:45.973227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"262'3","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.017372+0000","last_change":"2024-09-14T11:59:41.017372+0000","last_active":"2024-09-14T11:59:41.017372+0000","last_peered":"2024-09-14T11:59:41.017372+0000","last_clean":"2024-09-14T11:59:41.017372+0000","last_became_active":"2024-09-14T11:32:32.583587+0000","last_became_peered":"2024-09-14T11:32:32.583587+0000","last_unstale":"2024-09-14T11:59:41.017372+0000","last_undegraded":"2024-09-14T11:59:41.017372+0000","last_fullsized":"2024-09-14T11:59:41.017372+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:59:41.017278+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:59:41.017278+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.017278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:36.570555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.854047+0000","last_change":"2024-09-14T11:59:32.854047+0000","last_active":"2024-09-14T11:59:32.854047+0000","last_peered":"2024-09-14T11:59:32.854047+0000","last_clean":"2024-09-14T11:59:32.854047+0000","last_became_active":"2024-09-14T11:32:29.554018+0000","last_became_peered":"2024-09-14T11:32:29.554018+0000","last_unstale":"2024-09-14T11:59:32.854047+0000","last_undegraded":"2024-09-14T11:59:32.854047+0000","last_fullsized":"2024-09-14T11:59:32.854047+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:32.853953+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:32.853953+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.853953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:49.712176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":64,"num_write":4,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'41","reported_seq":169,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.066797+0000","last_change":"2024-09-14T11:59:31.066717+0000","last_active":"2024-09-14T11:59:31.066797+0000","last_peered":"2024-09-14T11:59:31.066797+0000","last_clean":"2024-09-14T11:59:31.066797+0000","last_became_active":"2024-09-14T11:30:45.188407+0000","last_became_peered":"2024-09-14T11:30:45.188407+0000","last_unstale":"2024-09-14T11:59:31.066797+0000","last_undegraded":"2024-09-14T11:59:31.066797+0000","last_fullsized":"2024-09-14T11:59:31.066797+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'41","last_scrub_stamp":"2024-09-14T11:59:31.066595+0000","last_deep_scrub":"262'41","last_deep_scrub_stamp":"2024-09-14T11:59:31.066595+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.066595+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:17.470858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":222,"num_write":110,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.850364+0000","last_change":"2024-09-14T11:59:42.850364+0000","last_active":"2024-09-14T11:59:42.850364+0000","last_peered":"2024-09-14T11:59:42.850364+0000","last_clean":"2024-09-14T11:59:42.850364+0000","last_became_active":"2024-09-14T11:43:35.603437+0000","last_became_peered":"2024-09-14T11:43:35.603437+0000","last_unstale":"2024-09-14T11:59:42.850364+0000","last_undegraded":"2024-09-14T11:59:42.850364+0000","last_fullsized":"2024-09-14T11:59:42.850364+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.850243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.850243+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.850243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:57.175327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.894679+0000","last_change":"2024-09-14T11:59:38.894679+0000","last_active":"2024-09-14T11:59:38.894679+0000","last_peered":"2024-09-14T11:59:38.894679+0000","last_clean":"2024-09-14T11:59:38.894679+0000","last_became_active":"2024-09-14T11:32:32.579320+0000","last_became_peered":"2024-09-14T11:32:32.579320+0000","last_unstale":"2024-09-14T11:59:38.894679+0000","last_undegraded":"2024-09-14T11:59:38.894679+0000","last_fullsized":"2024-09-14T11:59:38.894679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:38.894593+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:38.894593+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.894593+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:06.945693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2088,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.998449+0000","last_change":"2024-09-14T11:59:36.998449+0000","last_active":"2024-09-14T11:59:36.998449+0000","last_peered":"2024-09-14T11:59:36.998449+0000","last_clean":"2024-09-14T11:59:36.998449+0000","last_became_active":"2024-09-14T11:32:29.555278+0000","last_became_peered":"2024-09-14T11:32:29.555278+0000","last_unstale":"2024-09-14T11:59:36.998449+0000","last_undegraded":"2024-09-14T11:59:36.998449+0000","last_fullsized":"2024-09-14T11:59:36.998449+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:36.998366+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:36.998366+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.998366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:42.976733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.446107+0000","last_change":"2024-09-14T11:59:22.446042+0000","last_active":"2024-09-14T11:59:22.446107+0000","last_peered":"2024-09-14T11:59:22.446107+0000","last_clean":"2024-09-14T11:59:22.446107+0000","last_became_active":"2024-09-14T11:30:45.176635+0000","last_became_peered":"2024-09-14T11:30:45.176635+0000","last_unstale":"2024-09-14T11:59:22.446107+0000","last_undegraded":"2024-09-14T11:59:22.446107+0000","last_fullsized":"2024-09-14T11:59:22.446107+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-14T11:59:22.445945+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-14T11:59:22.445945+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.445945+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:04.877896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":139,"num_write":68,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.243954+0000","last_change":"2024-09-14T11:59:21.243954+0000","last_active":"2024-09-14T11:59:21.243954+0000","last_peered":"2024-09-14T11:59:21.243954+0000","last_clean":"2024-09-14T11:59:21.243954+0000","last_became_active":"2024-09-14T11:43:35.606193+0000","last_became_peered":"2024-09-14T11:43:35.606193+0000","last_unstale":"2024-09-14T11:59:21.243954+0000","last_undegraded":"2024-09-14T11:59:21.243954+0000","last_fullsized":"2024-09-14T11:59:21.243954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:21.243865+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:21.243865+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.243865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:13.809248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"262'3","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.445096+0000","last_change":"2024-09-14T11:59:27.445022+0000","last_active":"2024-09-14T11:59:27.445096+0000","last_peered":"2024-09-14T11:59:27.445096+0000","last_clean":"2024-09-14T11:59:27.445096+0000","last_became_active":"2024-09-14T11:32:32.586948+0000","last_became_peered":"2024-09-14T11:32:32.586948+0000","last_unstale":"2024-09-14T11:59:27.445096+0000","last_undegraded":"2024-09-14T11:59:27.445096+0000","last_fullsized":"2024-09-14T11:59:27.445096+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:59:27.444927+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:59:27.444927+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.444927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:58.758281+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'2","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.974174+0000","last_change":"2024-09-14T11:59:34.974174+0000","last_active":"2024-09-14T11:59:34.974174+0000","last_peered":"2024-09-14T11:59:34.974174+0000","last_clean":"2024-09-14T11:59:34.974174+0000","last_became_active":"2024-09-14T11:32:29.554368+0000","last_became_peered":"2024-09-14T11:32:29.554368+0000","last_unstale":"2024-09-14T11:59:34.974174+0000","last_undegraded":"2024-09-14T11:59:34.974174+0000","last_fullsized":"2024-09-14T11:59:34.974174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:34.974047+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:34.974047+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.974047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:51.505506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'24","reported_seq":118,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.879013+0000","last_change":"2024-09-14T11:59:30.878884+0000","last_active":"2024-09-14T11:59:30.879013+0000","last_peered":"2024-09-14T11:59:30.879013+0000","last_clean":"2024-09-14T11:59:30.879013+0000","last_became_active":"2024-09-14T11:30:45.181554+0000","last_became_peered":"2024-09-14T11:30:45.181554+0000","last_unstale":"2024-09-14T11:59:30.879013+0000","last_undegraded":"2024-09-14T11:59:30.879013+0000","last_fullsized":"2024-09-14T11:59:30.879013+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'24","last_scrub_stamp":"2024-09-14T11:59:30.878792+0000","last_deep_scrub":"262'24","last_deep_scrub_stamp":"2024-09-14T11:59:30.878792+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.878792+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:54.392687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":117,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:50.658044+0000","last_change":"2024-09-14T11:59:50.658044+0000","last_active":"2024-09-14T11:59:50.658044+0000","last_peered":"2024-09-14T11:59:50.658044+0000","last_clean":"2024-09-14T11:59:50.658044+0000","last_became_active":"2024-09-14T11:43:35.601118+0000","last_became_peered":"2024-09-14T11:43:35.601118+0000","last_unstale":"2024-09-14T11:59:50.658044+0000","last_undegraded":"2024-09-14T11:59:50.658044+0000","last_fullsized":"2024-09-14T11:59:50.658044+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:50.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:50.657939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:50.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:38.174382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.841072+0000","last_change":"2024-09-14T11:59:35.841072+0000","last_active":"2024-09-14T11:59:35.841072+0000","last_peered":"2024-09-14T11:59:35.841072+0000","last_clean":"2024-09-14T11:59:35.841072+0000","last_became_active":"2024-09-14T11:32:32.586964+0000","last_became_peered":"2024-09-14T11:32:32.586964+0000","last_unstale":"2024-09-14T11:59:35.841072+0000","last_undegraded":"2024-09-14T11:59:35.841072+0000","last_fullsized":"2024-09-14T11:59:35.841072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.840986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.840986+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.840986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:52.832033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"259'7","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.980107+0000","last_change":"2024-09-14T11:59:35.980107+0000","last_active":"2024-09-14T11:59:35.980107+0000","last_peered":"2024-09-14T11:59:35.980107+0000","last_clean":"2024-09-14T11:59:35.980107+0000","last_became_active":"2024-09-14T11:32:29.548497+0000","last_became_peered":"2024-09-14T11:32:29.548497+0000","last_unstale":"2024-09-14T11:59:35.980107+0000","last_undegraded":"2024-09-14T11:59:35.980107+0000","last_fullsized":"2024-09-14T11:59:35.980107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-14T11:59:35.980011+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-14T11:59:35.980011+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.980011+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:17.207486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14338,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'60","reported_seq":219,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.963621+0000","last_change":"2024-09-14T11:59:30.963563+0000","last_active":"2024-09-14T11:59:30.963621+0000","last_peered":"2024-09-14T11:59:30.963621+0000","last_clean":"2024-09-14T11:59:30.963621+0000","last_became_active":"2024-09-14T11:30:45.187292+0000","last_became_peered":"2024-09-14T11:30:45.187292+0000","last_unstale":"2024-09-14T11:59:30.963621+0000","last_undegraded":"2024-09-14T11:59:30.963621+0000","last_fullsized":"2024-09-14T11:59:30.963621+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-14T11:59:30.963471+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-14T11:59:30.963471+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.963471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:36.019135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":342,"num_write":148,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:46.690669+0000","last_change":"2024-09-14T11:59:46.690669+0000","last_active":"2024-09-14T11:59:46.690669+0000","last_peered":"2024-09-14T11:59:46.690669+0000","last_clean":"2024-09-14T11:59:46.690669+0000","last_became_active":"2024-09-14T11:43:35.605521+0000","last_became_peered":"2024-09-14T11:43:35.605521+0000","last_unstale":"2024-09-14T11:59:46.690669+0000","last_undegraded":"2024-09-14T11:59:46.690669+0000","last_fullsized":"2024-09-14T11:59:46.690669+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:46.690577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:46.690577+0000","last_clean_scrub_stamp":"2024-09-14T11:59:46.690577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:08.820306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"262'4","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.102627+0000","last_change":"2024-09-14T11:59:27.102523+0000","last_active":"2024-09-14T11:59:27.102627+0000","last_peered":"2024-09-14T11:59:27.102627+0000","last_clean":"2024-09-14T11:59:27.102627+0000","last_became_active":"2024-09-14T11:32:32.590608+0000","last_became_peered":"2024-09-14T11:32:32.590608+0000","last_unstale":"2024-09-14T11:59:27.102627+0000","last_undegraded":"2024-09-14T11:59:27.102627+0000","last_fullsized":"2024-09-14T11:59:27.102627+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:27.102426+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:27.102426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.102426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:07.537658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2166,"num_write":4,"num_write_kb":1083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'9","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.472528+0000","last_change":"2024-09-14T11:59:24.472471+0000","last_active":"2024-09-14T11:59:24.472528+0000","last_peered":"2024-09-14T11:59:24.472528+0000","last_clean":"2024-09-14T11:59:24.472528+0000","last_became_active":"2024-09-14T11:32:29.552768+0000","last_became_peered":"2024-09-14T11:32:29.552768+0000","last_unstale":"2024-09-14T11:59:24.472528+0000","last_undegraded":"2024-09-14T11:59:24.472528+0000","last_fullsized":"2024-09-14T11:59:24.472528+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-14T11:59:24.472369+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-14T11:59:24.472369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.472369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:15.661067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"259'14","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.077091+0000","last_change":"2024-09-14T11:59:20.077000+0000","last_active":"2024-09-14T11:59:20.077091+0000","last_peered":"2024-09-14T11:59:20.077091+0000","last_clean":"2024-09-14T11:59:20.077091+0000","last_became_active":"2024-09-14T11:30:45.182993+0000","last_became_peered":"2024-09-14T11:30:45.182993+0000","last_unstale":"2024-09-14T11:59:20.077091+0000","last_undegraded":"2024-09-14T11:59:20.077091+0000","last_fullsized":"2024-09-14T11:59:20.077091+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'14","last_scrub_stamp":"2024-09-14T11:59:20.076891+0000","last_deep_scrub":"259'14","last_deep_scrub_stamp":"2024-09-14T11:59:20.076891+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.076891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:23.782744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":67,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.974502+0000","last_change":"2024-09-14T11:59:44.974502+0000","last_active":"2024-09-14T11:59:44.974502+0000","last_peered":"2024-09-14T11:59:44.974502+0000","last_clean":"2024-09-14T11:59:44.974502+0000","last_became_active":"2024-09-14T11:43:35.604665+0000","last_became_peered":"2024-09-14T11:43:35.604665+0000","last_unstale":"2024-09-14T11:59:44.974502+0000","last_undegraded":"2024-09-14T11:59:44.974502+0000","last_fullsized":"2024-09-14T11:59:44.974502+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:44.974415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:44.974415+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.974415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:27.555563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'14","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.904922+0000","last_change":"2024-09-14T11:59:36.904828+0000","last_active":"2024-09-14T11:59:36.904922+0000","last_peered":"2024-09-14T11:59:36.904922+0000","last_clean":"2024-09-14T11:59:36.904922+0000","last_became_active":"2024-09-14T11:32:32.584380+0000","last_became_peered":"2024-09-14T11:32:32.584380+0000","last_unstale":"2024-09-14T11:59:36.904922+0000","last_undegraded":"2024-09-14T11:59:36.904922+0000","last_fullsized":"2024-09-14T11:59:36.904922+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'14","last_scrub_stamp":"2024-09-14T11:59:36.904733+0000","last_deep_scrub":"262'14","last_deep_scrub_stamp":"2024-09-14T11:59:36.904733+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.904733+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:00.013220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19460,"num_write":24,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'6","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.112669+0000","last_change":"2024-09-14T11:59:26.112579+0000","last_active":"2024-09-14T11:59:26.112669+0000","last_peered":"2024-09-14T11:59:26.112669+0000","last_clean":"2024-09-14T11:59:26.112669+0000","last_became_active":"2024-09-14T11:32:29.552939+0000","last_became_peered":"2024-09-14T11:32:29.552939+0000","last_unstale":"2024-09-14T11:59:26.112669+0000","last_undegraded":"2024-09-14T11:59:26.112669+0000","last_fullsized":"2024-09-14T11:59:26.112669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-14T11:59:26.112465+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-14T11:59:26.112465+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.112465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:09.125649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'30","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.039315+0000","last_change":"2024-09-14T11:59:30.039315+0000","last_active":"2024-09-14T11:59:30.039315+0000","last_peered":"2024-09-14T11:59:30.039315+0000","last_clean":"2024-09-14T11:59:30.039315+0000","last_became_active":"2024-09-14T11:30:45.182730+0000","last_became_peered":"2024-09-14T11:30:45.182730+0000","last_unstale":"2024-09-14T11:59:30.039315+0000","last_undegraded":"2024-09-14T11:59:30.039315+0000","last_fullsized":"2024-09-14T11:59:30.039315+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-14T11:59:30.039235+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-14T11:59:30.039235+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.039235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:10.445538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":141,"num_write":80,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'201","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.924265+0000","last_change":"2024-09-14T11:59:06.924210+0000","last_active":"2024-09-14T11:59:06.924265+0000","last_peered":"2024-09-14T11:59:06.924265+0000","last_clean":"2024-09-14T11:59:06.924265+0000","last_became_active":"2024-09-14T11:15:32.311665+0000","last_became_peered":"2024-09-14T11:15:32.311665+0000","last_unstale":"2024-09-14T11:59:06.924265+0000","last_undegraded":"2024-09-14T11:59:06.924265+0000","last_fullsized":"2024-09-14T11:59:06.924265+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:06.924116+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.924116+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:26.609676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":502,"num_read_kb":68162,"num_write":958,"num_write_kb":33729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'448","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.842355+0000","last_change":"2024-09-14T11:59:10.842355+0000","last_active":"2024-09-14T11:59:10.842355+0000","last_peered":"2024-09-14T11:59:10.842355+0000","last_clean":"2024-09-14T11:59:10.842355+0000","last_became_active":"2024-09-14T11:15:34.326626+0000","last_became_peered":"2024-09-14T11:15:34.326626+0000","last_unstale":"2024-09-14T11:59:10.842355+0000","last_undegraded":"2024-09-14T11:59:10.842355+0000","last_fullsized":"2024-09-14T11:59:10.842355+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:10.842253+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.842253+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:51.500139+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2380,"num_read_kb":2263,"num_write":491,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'208","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.657549+0000","last_change":"2024-09-14T11:58:59.657477+0000","last_active":"2024-09-14T11:58:59.657549+0000","last_peered":"2024-09-14T11:58:59.657549+0000","last_clean":"2024-09-14T11:58:59.657549+0000","last_became_active":"2024-09-14T11:15:32.317071+0000","last_became_peered":"2024-09-14T11:15:32.317071+0000","last_unstale":"2024-09-14T11:58:59.657549+0000","last_undegraded":"2024-09-14T11:58:59.657549+0000","last_fullsized":"2024-09-14T11:58:59.657549+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-14T11:58:59.657360+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.657360+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:27.452025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":84679,"num_write":950,"num_write_kb":36638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'440","reported_seq":1840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.017097+0000","last_change":"2024-09-14T11:59:12.017097+0000","last_active":"2024-09-14T11:59:12.017097+0000","last_peered":"2024-09-14T11:59:12.017097+0000","last_clean":"2024-09-14T11:59:12.017097+0000","last_became_active":"2024-09-14T11:15:34.329926+0000","last_became_peered":"2024-09-14T11:15:34.329926+0000","last_unstale":"2024-09-14T11:59:12.017097+0000","last_undegraded":"2024-09-14T11:59:12.017097+0000","last_fullsized":"2024-09-14T11:59:12.017097+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'440","last_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_deep_scrub":"262'440","last_deep_scrub_stamp":"2024-09-14T11:59:12.016980+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.016980+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:59.528853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2272,"num_read_kb":2097,"num_write":545,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'217","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.294101+0000","last_change":"2024-09-14T11:59:01.294031+0000","last_active":"2024-09-14T11:59:01.294101+0000","last_peered":"2024-09-14T11:59:01.294101+0000","last_clean":"2024-09-14T11:59:01.294101+0000","last_became_active":"2024-09-14T11:15:32.302483+0000","last_became_peered":"2024-09-14T11:15:32.302483+0000","last_unstale":"2024-09-14T11:59:01.294101+0000","last_undegraded":"2024-09-14T11:59:01.294101+0000","last_fullsized":"2024-09-14T11:59:01.294101+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:01.293939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.293939+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:45.221973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":1085,"num_write":1018,"num_write_kb":19701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'744","reported_seq":2205,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.053192+0000","last_change":"2024-09-14T11:59:14.053192+0000","last_active":"2024-09-14T11:59:14.053192+0000","last_peered":"2024-09-14T11:59:14.053192+0000","last_clean":"2024-09-14T11:59:14.053192+0000","last_became_active":"2024-09-14T11:15:34.316730+0000","last_became_peered":"2024-09-14T11:15:34.316730+0000","last_unstale":"2024-09-14T11:59:14.053192+0000","last_undegraded":"2024-09-14T11:59:14.053192+0000","last_fullsized":"2024-09-14T11:59:14.053192+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'744","last_scrub_stamp":"2024-09-14T11:59:14.053105+0000","last_deep_scrub":"262'744","last_deep_scrub_stamp":"2024-09-14T11:59:14.053105+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.053105+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:11.427182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3531,"num_read_kb":3181,"num_write":987,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'243","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.828166+0000","last_change":"2024-09-14T11:59:05.828088+0000","last_active":"2024-09-14T11:59:05.828166+0000","last_peered":"2024-09-14T11:59:05.828166+0000","last_clean":"2024-09-14T11:59:05.828166+0000","last_became_active":"2024-09-14T11:15:32.321823+0000","last_became_peered":"2024-09-14T11:15:32.321823+0000","last_unstale":"2024-09-14T11:59:05.828166+0000","last_undegraded":"2024-09-14T11:59:05.828166+0000","last_fullsized":"2024-09-14T11:59:05.828166+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'243","last_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_deep_scrub":"262'243","last_deep_scrub_stamp":"2024-09-14T11:59:05.827996+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.827996+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:32.370355+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":30923,"num_write":1131,"num_write_kb":27857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'684","reported_seq":2093,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.390988+0000","last_change":"2024-09-14T11:59:10.390988+0000","last_active":"2024-09-14T11:59:10.390988+0000","last_peered":"2024-09-14T11:59:10.390988+0000","last_clean":"2024-09-14T11:59:10.390988+0000","last_became_active":"2024-09-14T11:15:34.323349+0000","last_became_peered":"2024-09-14T11:15:34.323349+0000","last_unstale":"2024-09-14T11:59:10.390988+0000","last_undegraded":"2024-09-14T11:59:10.390988+0000","last_fullsized":"2024-09-14T11:59:10.390988+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'684","last_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_deep_scrub":"262'684","last_deep_scrub_stamp":"2024-09-14T11:59:10.390898+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.390898+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:20.267647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3305,"num_read_kb":2989,"num_write":908,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.925437+0000","last_change":"2024-09-14T11:59:07.925437+0000","last_active":"2024-09-14T11:59:07.925437+0000","last_peered":"2024-09-14T11:59:07.925437+0000","last_clean":"2024-09-14T11:59:07.925437+0000","last_became_active":"2024-09-14T11:15:32.312939+0000","last_became_peered":"2024-09-14T11:15:32.312939+0000","last_unstale":"2024-09-14T11:59:07.925437+0000","last_undegraded":"2024-09-14T11:59:07.925437+0000","last_fullsized":"2024-09-14T11:59:07.925437+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:07.925347+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.925347+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.275783+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":582,"num_read_kb":22671,"num_write":1106,"num_write_kb":45554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'970","reported_seq":2620,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.160238+0000","last_change":"2024-09-14T11:59:07.160176+0000","last_active":"2024-09-14T11:59:07.160238+0000","last_peered":"2024-09-14T11:59:07.160238+0000","last_clean":"2024-09-14T11:59:07.160238+0000","last_became_active":"2024-09-14T11:15:34.323514+0000","last_became_peered":"2024-09-14T11:15:34.323514+0000","last_unstale":"2024-09-14T11:59:07.160238+0000","last_undegraded":"2024-09-14T11:59:07.160238+0000","last_fullsized":"2024-09-14T11:59:07.160238+0000","mapping_epoch":26,"log_start":"262'900","ondisk_log_start":"262'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'970","last_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_deep_scrub":"262'970","last_deep_scrub_stamp":"2024-09-14T11:59:07.160091+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.160091+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.347228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4738,"num_read_kb":4204,"num_write":1339,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'188","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.854866+0000","last_change":"2024-09-14T11:59:04.854866+0000","last_active":"2024-09-14T11:59:04.854866+0000","last_peered":"2024-09-14T11:59:04.854866+0000","last_clean":"2024-09-14T11:59:04.854866+0000","last_became_active":"2024-09-14T11:15:32.322527+0000","last_became_peered":"2024-09-14T11:15:32.322527+0000","last_unstale":"2024-09-14T11:59:04.854866+0000","last_undegraded":"2024-09-14T11:59:04.854866+0000","last_fullsized":"2024-09-14T11:59:04.854866+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:04.854773+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.854773+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:26.093727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":10177,"num_write":901,"num_write_kb":8634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'1496","reported_seq":3048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.100837+0000","last_change":"2024-09-14T11:59:13.100750+0000","last_active":"2024-09-14T11:59:13.100837+0000","last_peered":"2024-09-14T11:59:13.100837+0000","last_clean":"2024-09-14T11:59:13.100837+0000","last_became_active":"2024-09-14T11:15:34.316011+0000","last_became_peered":"2024-09-14T11:15:34.316011+0000","last_unstale":"2024-09-14T11:59:13.100837+0000","last_undegraded":"2024-09-14T11:59:13.100837+0000","last_fullsized":"2024-09-14T11:59:13.100837+0000","mapping_epoch":26,"log_start":"262'1400","ondisk_log_start":"262'1400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1496","last_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_deep_scrub":"262'1496","last_deep_scrub_stamp":"2024-09-14T11:59:13.100637+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.100637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:52.980892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6624,"num_read_kb":5775,"num_write":2089,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'197","reported_seq":819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.941409+0000","last_change":"2024-09-14T11:59:05.941409+0000","last_active":"2024-09-14T11:59:05.941409+0000","last_peered":"2024-09-14T11:59:05.941409+0000","last_clean":"2024-09-14T11:59:05.941409+0000","last_became_active":"2024-09-14T11:15:32.317389+0000","last_became_peered":"2024-09-14T11:15:32.317389+0000","last_unstale":"2024-09-14T11:59:05.941409+0000","last_undegraded":"2024-09-14T11:59:05.941409+0000","last_fullsized":"2024-09-14T11:59:05.941409+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:59:05.941309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.941309+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.587968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":12539,"num_write":927,"num_write_kb":23352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'493","reported_seq":2330,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.833178+0000","last_change":"2024-09-14T11:59:11.833080+0000","last_active":"2024-09-14T11:59:11.833178+0000","last_peered":"2024-09-14T11:59:11.833178+0000","last_clean":"2024-09-14T11:59:11.833178+0000","last_became_active":"2024-09-14T11:15:34.328187+0000","last_became_peered":"2024-09-14T11:15:34.328187+0000","last_unstale":"2024-09-14T11:59:11.833178+0000","last_undegraded":"2024-09-14T11:59:11.833178+0000","last_fullsized":"2024-09-14T11:59:11.833178+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:11.832989+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.832989+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:47.359326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3027,"num_read_kb":2875,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4847,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'221","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.012282+0000","last_change":"2024-09-14T11:59:09.012282+0000","last_active":"2024-09-14T11:59:09.012282+0000","last_peered":"2024-09-14T11:59:09.012282+0000","last_clean":"2024-09-14T11:59:09.012282+0000","last_became_active":"2024-09-14T11:15:32.320093+0000","last_became_peered":"2024-09-14T11:15:32.320093+0000","last_unstale":"2024-09-14T11:59:09.012282+0000","last_undegraded":"2024-09-14T11:59:09.012282+0000","last_fullsized":"2024-09-14T11:59:09.012282+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'221","last_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_deep_scrub":"262'221","last_deep_scrub_stamp":"2024-09-14T11:59:09.012189+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.012189+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:02.767488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":31152,"num_write":983,"num_write_kb":35053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'599","reported_seq":2472,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.267344+0000","last_change":"2024-09-14T11:59:01.267217+0000","last_active":"2024-09-14T11:59:01.267344+0000","last_peered":"2024-09-14T11:59:01.267344+0000","last_clean":"2024-09-14T11:59:01.267344+0000","last_became_active":"2024-09-14T11:16:07.517634+0000","last_became_peered":"2024-09-14T11:16:07.517634+0000","last_unstale":"2024-09-14T11:59:01.267344+0000","last_undegraded":"2024-09-14T11:59:01.267344+0000","last_fullsized":"2024-09-14T11:59:01.267344+0000","mapping_epoch":37,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'599","last_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_deep_scrub":"262'599","last_deep_scrub_stamp":"2024-09-14T11:59:01.267099+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.267099+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:01.732306+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3363,"num_read_kb":3157,"num_write":718,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'761","reported_seq":2284,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.160272+0000","last_change":"2024-09-14T11:59:11.160143+0000","last_active":"2024-09-14T11:59:11.160272+0000","last_peered":"2024-09-14T11:59:11.160272+0000","last_clean":"2024-09-14T11:59:11.160272+0000","last_became_active":"2024-09-14T11:15:34.313150+0000","last_became_peered":"2024-09-14T11:15:34.313150+0000","last_unstale":"2024-09-14T11:59:11.160272+0000","last_undegraded":"2024-09-14T11:59:11.160272+0000","last_fullsized":"2024-09-14T11:59:11.160272+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'761","last_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_deep_scrub":"262'761","last_deep_scrub_stamp":"2024-09-14T11:59:11.160044+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.160044+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:20.157724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3385,"num_write":998,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'231","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.918014+0000","last_change":"2024-09-14T11:59:04.917960+0000","last_active":"2024-09-14T11:59:04.918014+0000","last_peered":"2024-09-14T11:59:04.918014+0000","last_clean":"2024-09-14T11:59:04.918014+0000","last_became_active":"2024-09-14T11:15:32.319198+0000","last_became_peered":"2024-09-14T11:15:32.319198+0000","last_unstale":"2024-09-14T11:59:04.918014+0000","last_undegraded":"2024-09-14T11:59:04.918014+0000","last_fullsized":"2024-09-14T11:59:04.918014+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:04.917863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.917863+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.312915+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493146,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":8015,"num_write":1062,"num_write_kb":26752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'458","reported_seq":2054,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.977822+0000","last_change":"2024-09-14T11:59:10.977768+0000","last_active":"2024-09-14T11:59:10.977822+0000","last_peered":"2024-09-14T11:59:10.977822+0000","last_clean":"2024-09-14T11:59:10.977822+0000","last_became_active":"2024-09-14T11:15:34.329877+0000","last_became_peered":"2024-09-14T11:15:34.329877+0000","last_unstale":"2024-09-14T11:59:10.977822+0000","last_undegraded":"2024-09-14T11:59:10.977822+0000","last_fullsized":"2024-09-14T11:59:10.977822+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'458","last_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_deep_scrub":"262'458","last_deep_scrub_stamp":"2024-09-14T11:59:10.977676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.977676+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:08.362285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2724,"num_read_kb":2559,"num_write":591,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2530,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'231","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.220440+0000","last_change":"2024-09-14T11:59:02.220381+0000","last_active":"2024-09-14T11:59:02.220440+0000","last_peered":"2024-09-14T11:59:02.220440+0000","last_clean":"2024-09-14T11:59:02.220440+0000","last_became_active":"2024-09-14T11:15:32.315306+0000","last_became_peered":"2024-09-14T11:15:32.315306+0000","last_unstale":"2024-09-14T11:59:02.220440+0000","last_undegraded":"2024-09-14T11:59:02.220440+0000","last_fullsized":"2024-09-14T11:59:02.220440+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:02.220287+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.220287+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:16.151277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":595,"num_read_kb":24969,"num_write":1057,"num_write_kb":39436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'444","reported_seq":1998,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.859617+0000","last_change":"2024-09-14T11:59:08.859552+0000","last_active":"2024-09-14T11:59:08.859617+0000","last_peered":"2024-09-14T11:59:08.859617+0000","last_clean":"2024-09-14T11:59:08.859617+0000","last_became_active":"2024-09-14T11:15:34.326245+0000","last_became_peered":"2024-09-14T11:15:34.326245+0000","last_unstale":"2024-09-14T11:59:08.859617+0000","last_undegraded":"2024-09-14T11:59:08.859617+0000","last_fullsized":"2024-09-14T11:59:08.859617+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'444","last_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_deep_scrub":"262'444","last_deep_scrub_stamp":"2024-09-14T11:59:08.859468+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.859468+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.056045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2230,"num_write":512,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'222","reported_seq":855,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.221736+0000","last_change":"2024-09-14T11:59:01.221670+0000","last_active":"2024-09-14T11:59:01.221736+0000","last_peered":"2024-09-14T11:59:01.221736+0000","last_clean":"2024-09-14T11:59:01.221736+0000","last_became_active":"2024-09-14T11:15:32.314816+0000","last_became_peered":"2024-09-14T11:15:32.314816+0000","last_unstale":"2024-09-14T11:59:01.221736+0000","last_undegraded":"2024-09-14T11:59:01.221736+0000","last_fullsized":"2024-09-14T11:59:01.221736+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-14T11:59:01.221555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.221555+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:14.230182+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":17269,"num_write":968,"num_write_kb":26642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'396","reported_seq":1870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.318870+0000","last_change":"2024-09-14T11:58:59.318739+0000","last_active":"2024-09-14T11:58:59.318870+0000","last_peered":"2024-09-14T11:58:59.318870+0000","last_clean":"2024-09-14T11:58:59.318870+0000","last_became_active":"2024-09-14T11:15:34.322971+0000","last_became_peered":"2024-09-14T11:15:34.322971+0000","last_unstale":"2024-09-14T11:58:59.318870+0000","last_undegraded":"2024-09-14T11:58:59.318870+0000","last_fullsized":"2024-09-14T11:58:59.318870+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'396","last_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_deep_scrub":"262'396","last_deep_scrub_stamp":"2024-09-14T11:58:59.318633+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.318633+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:40.556708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2096,"num_read_kb":1989,"num_write":447,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'264","reported_seq":907,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.105757+0000","last_change":"2024-09-14T11:58:55.105686+0000","last_active":"2024-09-14T11:58:55.105757+0000","last_peered":"2024-09-14T11:58:55.105757+0000","last_clean":"2024-09-14T11:58:55.105757+0000","last_became_active":"2024-09-14T11:15:32.310612+0000","last_became_peered":"2024-09-14T11:15:32.310612+0000","last_unstale":"2024-09-14T11:58:55.105757+0000","last_undegraded":"2024-09-14T11:58:55.105757+0000","last_fullsized":"2024-09-14T11:58:55.105757+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'264","last_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_deep_scrub":"262'264","last_deep_scrub_stamp":"2024-09-14T11:58:55.105587+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.105587+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:06.894664+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730148,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":652,"num_read_kb":20644,"num_write":1068,"num_write_kb":45377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'348","reported_seq":1851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.290767+0000","last_change":"2024-09-14T11:59:00.290708+0000","last_active":"2024-09-14T11:59:00.290767+0000","last_peered":"2024-09-14T11:59:00.290767+0000","last_clean":"2024-09-14T11:59:00.290767+0000","last_became_active":"2024-09-14T11:15:34.315354+0000","last_became_peered":"2024-09-14T11:15:34.315354+0000","last_unstale":"2024-09-14T11:59:00.290767+0000","last_undegraded":"2024-09-14T11:59:00.290767+0000","last_fullsized":"2024-09-14T11:59:00.290767+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'348","last_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_deep_scrub":"262'348","last_deep_scrub_stamp":"2024-09-14T11:59:00.290615+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.290615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:28.191506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1981,"num_read_kb":1914,"num_write":381,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'292","reported_seq":1041,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.884033+0000","last_change":"2024-09-14T11:59:02.883970+0000","last_active":"2024-09-14T11:59:02.884033+0000","last_peered":"2024-09-14T11:59:02.884033+0000","last_clean":"2024-09-14T11:59:02.884033+0000","last_became_active":"2024-09-14T11:15:32.312206+0000","last_became_peered":"2024-09-14T11:15:32.312206+0000","last_unstale":"2024-09-14T11:59:02.884033+0000","last_undegraded":"2024-09-14T11:59:02.884033+0000","last_fullsized":"2024-09-14T11:59:02.884033+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-14T11:59:02.883867+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.883867+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.038831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1018,"num_read_kb":39546,"num_write":1294,"num_write_kb":39552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'574","reported_seq":2426,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.119802+0000","last_change":"2024-09-14T11:59:12.119802+0000","last_active":"2024-09-14T11:59:12.119802+0000","last_peered":"2024-09-14T11:59:12.119802+0000","last_clean":"2024-09-14T11:59:12.119802+0000","last_became_active":"2024-09-14T11:15:34.327784+0000","last_became_peered":"2024-09-14T11:15:34.327784+0000","last_unstale":"2024-09-14T11:59:12.119802+0000","last_undegraded":"2024-09-14T11:59:12.119802+0000","last_fullsized":"2024-09-14T11:59:12.119802+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'574","last_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_deep_scrub":"262'574","last_deep_scrub_stamp":"2024-09-14T11:59:12.119675+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.119675+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:52.499284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3049,"num_write":670,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2946,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'231","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.260500+0000","last_change":"2024-09-14T11:59:00.260419+0000","last_active":"2024-09-14T11:59:00.260500+0000","last_peered":"2024-09-14T11:59:00.260500+0000","last_clean":"2024-09-14T11:59:00.260500+0000","last_became_active":"2024-09-14T11:15:32.309014+0000","last_became_peered":"2024-09-14T11:15:32.309014+0000","last_unstale":"2024-09-14T11:59:00.260500+0000","last_undegraded":"2024-09-14T11:59:00.260500+0000","last_fullsized":"2024-09-14T11:59:00.260500+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-14T11:59:00.260330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.260330+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:44.587761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":555,"num_read_kb":31277,"num_write":1077,"num_write_kb":37615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'149","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.979528+0000","last_change":"2024-09-14T11:59:28.979528+0000","last_active":"2024-09-14T11:59:28.979528+0000","last_peered":"2024-09-14T11:59:28.979528+0000","last_clean":"2024-09-14T11:59:28.979528+0000","last_became_active":"2024-09-14T11:15:42.348653+0000","last_became_peered":"2024-09-14T11:15:42.348653+0000","last_unstale":"2024-09-14T11:59:28.979528+0000","last_undegraded":"2024-09-14T11:59:28.979528+0000","last_fullsized":"2024-09-14T11:59:28.979528+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'149","last_scrub_stamp":"2024-09-14T11:59:28.979448+0000","last_deep_scrub":"262'149","last_deep_scrub_stamp":"2024-09-14T11:59:28.979448+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.979448+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:48.568665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'826","reported_seq":2540,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.890403+0000","last_change":"2024-09-14T11:59:04.890292+0000","last_active":"2024-09-14T11:59:04.890403+0000","last_peered":"2024-09-14T11:59:04.890403+0000","last_clean":"2024-09-14T11:59:04.890403+0000","last_became_active":"2024-09-14T11:15:34.329544+0000","last_became_peered":"2024-09-14T11:15:34.329544+0000","last_unstale":"2024-09-14T11:59:04.890403+0000","last_undegraded":"2024-09-14T11:59:04.890403+0000","last_fullsized":"2024-09-14T11:59:04.890403+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'826","last_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_deep_scrub":"262'826","last_deep_scrub_stamp":"2024-09-14T11:59:04.890191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.890191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:04.714390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4169,"num_read_kb":3801,"num_write":1068,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'201","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.806851+0000","last_change":"2024-09-14T11:59:01.806796+0000","last_active":"2024-09-14T11:59:01.806851+0000","last_peered":"2024-09-14T11:59:01.806851+0000","last_clean":"2024-09-14T11:59:01.806851+0000","last_became_active":"2024-09-14T11:15:32.318380+0000","last_became_peered":"2024-09-14T11:15:32.318380+0000","last_unstale":"2024-09-14T11:59:01.806851+0000","last_undegraded":"2024-09-14T11:59:01.806851+0000","last_fullsized":"2024-09-14T11:59:01.806851+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:59:01.806682+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.806682+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:50.717629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":885,"num_read_kb":29517,"num_write":954,"num_write_kb":30761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.781055+0000","last_change":"2024-09-14T11:59:16.781055+0000","last_active":"2024-09-14T11:59:16.781055+0000","last_peered":"2024-09-14T11:59:16.781055+0000","last_clean":"2024-09-14T11:59:16.781055+0000","last_became_active":"2024-09-14T11:15:36.329099+0000","last_became_peered":"2024-09-14T11:15:36.329099+0000","last_unstale":"2024-09-14T11:59:16.781055+0000","last_undegraded":"2024-09-14T11:59:16.781055+0000","last_fullsized":"2024-09-14T11:59:16.781055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.780961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.780961+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.780961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:11.751745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'205","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.379232+0000","last_change":"2024-09-14T11:59:17.379232+0000","last_active":"2024-09-14T11:59:17.379232+0000","last_peered":"2024-09-14T11:59:17.379232+0000","last_clean":"2024-09-14T11:59:17.379232+0000","last_became_active":"2024-09-14T11:15:38.335705+0000","last_became_peered":"2024-09-14T11:15:38.335705+0000","last_unstale":"2024-09-14T11:59:17.379232+0000","last_undegraded":"2024-09-14T11:59:17.379232+0000","last_fullsized":"2024-09-14T11:59:17.379232+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-14T11:59:17.379120+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-14T11:59:17.379120+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.379120+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:58.370741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":271,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.047620+0000","last_change":"2024-09-14T11:59:27.047620+0000","last_active":"2024-09-14T11:59:27.047620+0000","last_peered":"2024-09-14T11:59:27.047620+0000","last_clean":"2024-09-14T11:59:27.047620+0000","last_became_active":"2024-09-14T11:15:40.343027+0000","last_became_peered":"2024-09-14T11:15:40.343027+0000","last_unstale":"2024-09-14T11:59:27.047620+0000","last_undegraded":"2024-09-14T11:59:27.047620+0000","last_fullsized":"2024-09-14T11:59:27.047620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.047536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.047536+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.047536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:44.276081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'2484","reported_seq":4325,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.887173+0000","last_change":"2024-09-14T11:59:28.887173+0000","last_active":"2024-09-14T11:59:28.887173+0000","last_peered":"2024-09-14T11:59:28.887173+0000","last_clean":"2024-09-14T11:59:28.887173+0000","last_became_active":"2024-09-14T11:15:42.346441+0000","last_became_peered":"2024-09-14T11:15:42.346441+0000","last_unstale":"2024-09-14T11:59:28.887173+0000","last_undegraded":"2024-09-14T11:59:28.887173+0000","last_fullsized":"2024-09-14T11:59:28.887173+0000","mapping_epoch":34,"log_start":"262'2400","ondisk_log_start":"262'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2484","last_scrub_stamp":"2024-09-14T11:59:28.887087+0000","last_deep_scrub":"262'2484","last_deep_scrub_stamp":"2024-09-14T11:59:28.887087+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.887087+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":2400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:50.361126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6266,"num_read_kb":6243,"num_write":4989,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'435","reported_seq":2275,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.898976+0000","last_change":"2024-09-14T11:59:07.898976+0000","last_active":"2024-09-14T11:59:07.898976+0000","last_peered":"2024-09-14T11:59:07.898976+0000","last_clean":"2024-09-14T11:59:07.898976+0000","last_became_active":"2024-09-14T11:15:34.326190+0000","last_became_peered":"2024-09-14T11:15:34.326190+0000","last_unstale":"2024-09-14T11:59:07.898976+0000","last_undegraded":"2024-09-14T11:59:07.898976+0000","last_fullsized":"2024-09-14T11:59:07.898976+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'435","last_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_deep_scrub":"262'435","last_deep_scrub_stamp":"2024-09-14T11:59:07.898878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.898878+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:39.901107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2851,"num_read_kb":2764,"num_write":488,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2558,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'274","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.272151+0000","last_change":"2024-09-14T11:58:54.272095+0000","last_active":"2024-09-14T11:58:54.272151+0000","last_peered":"2024-09-14T11:58:54.272151+0000","last_clean":"2024-09-14T11:58:54.272151+0000","last_became_active":"2024-09-14T11:15:32.307974+0000","last_became_peered":"2024-09-14T11:15:32.307974+0000","last_unstale":"2024-09-14T11:58:54.272151+0000","last_undegraded":"2024-09-14T11:58:54.272151+0000","last_fullsized":"2024-09-14T11:58:54.272151+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'274","last_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_deep_scrub":"262'274","last_deep_scrub_stamp":"2024-09-14T11:58:54.272007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.272007+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:31.710416+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":744,"num_read_kb":16466,"num_write":1204,"num_write_kb":30267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.875772+0000","last_change":"2024-09-14T11:59:15.875681+0000","last_active":"2024-09-14T11:59:15.875772+0000","last_peered":"2024-09-14T11:59:15.875772+0000","last_clean":"2024-09-14T11:59:15.875772+0000","last_became_active":"2024-09-14T11:15:36.334401+0000","last_became_peered":"2024-09-14T11:15:36.334401+0000","last_unstale":"2024-09-14T11:59:15.875772+0000","last_undegraded":"2024-09-14T11:59:15.875772+0000","last_fullsized":"2024-09-14T11:59:15.875772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.875565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.875565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.875565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:09.206961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'94","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.028546+0000","last_change":"2024-09-14T11:59:20.028546+0000","last_active":"2024-09-14T11:59:20.028546+0000","last_peered":"2024-09-14T11:59:20.028546+0000","last_clean":"2024-09-14T11:59:20.028546+0000","last_became_active":"2024-09-14T11:15:38.333871+0000","last_became_peered":"2024-09-14T11:15:38.333871+0000","last_unstale":"2024-09-14T11:59:20.028546+0000","last_undegraded":"2024-09-14T11:59:20.028546+0000","last_fullsized":"2024-09-14T11:59:20.028546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-14T11:59:20.028458+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-14T11:59:20.028458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.028458+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:16.850564+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":87,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.018594+0000","last_change":"2024-09-14T11:59:23.018594+0000","last_active":"2024-09-14T11:59:23.018594+0000","last_peered":"2024-09-14T11:59:23.018594+0000","last_clean":"2024-09-14T11:59:23.018594+0000","last_became_active":"2024-09-14T11:15:40.345749+0000","last_became_peered":"2024-09-14T11:15:40.345749+0000","last_unstale":"2024-09-14T11:59:23.018594+0000","last_undegraded":"2024-09-14T11:59:23.018594+0000","last_fullsized":"2024-09-14T11:59:23.018594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.018469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.018469+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.018469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:52.119047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'111","reported_seq":607,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.514971+0000","last_change":"2024-09-14T11:59:28.514971+0000","last_active":"2024-09-14T11:59:28.514971+0000","last_peered":"2024-09-14T11:59:28.514971+0000","last_clean":"2024-09-14T11:59:28.514971+0000","last_became_active":"2024-09-14T11:15:42.347022+0000","last_became_peered":"2024-09-14T11:15:42.347022+0000","last_unstale":"2024-09-14T11:59:28.514971+0000","last_undegraded":"2024-09-14T11:59:28.514971+0000","last_fullsized":"2024-09-14T11:59:28.514971+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-14T11:59:28.514880+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-14T11:59:28.514880+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.514880+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:19.271522+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'425","reported_seq":1999,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.318212+0000","last_change":"2024-09-14T11:59:05.318212+0000","last_active":"2024-09-14T11:59:05.318212+0000","last_peered":"2024-09-14T11:59:05.318212+0000","last_clean":"2024-09-14T11:59:05.318212+0000","last_became_active":"2024-09-14T11:15:34.328597+0000","last_became_peered":"2024-09-14T11:15:34.328597+0000","last_unstale":"2024-09-14T11:59:05.318212+0000","last_undegraded":"2024-09-14T11:59:05.318212+0000","last_fullsized":"2024-09-14T11:59:05.318212+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'425","last_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_deep_scrub":"262'425","last_deep_scrub_stamp":"2024-09-14T11:59:05.318119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.318119+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:41.523199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2421,"num_read_kb":2304,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'190","reported_seq":809,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.782831+0000","last_change":"2024-09-14T11:59:00.782772+0000","last_active":"2024-09-14T11:59:00.782831+0000","last_peered":"2024-09-14T11:59:00.782831+0000","last_clean":"2024-09-14T11:59:00.782831+0000","last_became_active":"2024-09-14T11:15:32.316610+0000","last_became_peered":"2024-09-14T11:15:32.316610+0000","last_unstale":"2024-09-14T11:59:00.782831+0000","last_undegraded":"2024-09-14T11:59:00.782831+0000","last_fullsized":"2024-09-14T11:59:00.782831+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-14T11:59:00.782673+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.782673+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.605643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":30179,"num_write":922,"num_write_kb":24059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"262'4","reported_seq":979,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.951530+0000","last_change":"2024-09-14T11:59:17.951530+0000","last_active":"2024-09-14T11:59:17.951530+0000","last_peered":"2024-09-14T11:59:17.951530+0000","last_clean":"2024-09-14T11:59:17.951530+0000","last_became_active":"2024-09-14T11:15:36.332733+0000","last_became_peered":"2024-09-14T11:15:36.332733+0000","last_unstale":"2024-09-14T11:59:17.951530+0000","last_undegraded":"2024-09-14T11:59:17.951530+0000","last_fullsized":"2024-09-14T11:59:17.951530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:17.951434+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:17.951434+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.951434+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:12.495312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'120","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.240570+0000","last_change":"2024-09-14T11:59:18.240509+0000","last_active":"2024-09-14T11:59:18.240570+0000","last_peered":"2024-09-14T11:59:18.240570+0000","last_clean":"2024-09-14T11:59:18.240570+0000","last_became_active":"2024-09-14T11:15:38.336752+0000","last_became_peered":"2024-09-14T11:15:38.336752+0000","last_unstale":"2024-09-14T11:59:18.240570+0000","last_undegraded":"2024-09-14T11:59:18.240570+0000","last_fullsized":"2024-09-14T11:59:18.240570+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-14T11:59:18.240402+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-14T11:59:18.240402+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.240402+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:59.012310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":119,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'752","reported_seq":2535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.017067+0000","last_change":"2024-09-14T11:59:25.017067+0000","last_active":"2024-09-14T11:59:25.017067+0000","last_peered":"2024-09-14T11:59:25.017067+0000","last_clean":"2024-09-14T11:59:25.017067+0000","last_became_active":"2024-09-14T11:15:40.343352+0000","last_became_peered":"2024-09-14T11:15:40.343352+0000","last_unstale":"2024-09-14T11:59:25.017067+0000","last_undegraded":"2024-09-14T11:59:25.017067+0000","last_fullsized":"2024-09-14T11:59:25.017067+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'752","last_scrub_stamp":"2024-09-14T11:59:25.016990+0000","last_deep_scrub":"262'752","last_deep_scrub_stamp":"2024-09-14T11:59:25.016990+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.016990+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:57.991473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'196","reported_seq":1016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.948019+0000","last_change":"2024-09-14T11:59:29.948019+0000","last_active":"2024-09-14T11:59:29.948019+0000","last_peered":"2024-09-14T11:59:29.948019+0000","last_clean":"2024-09-14T11:59:29.948019+0000","last_became_active":"2024-09-14T11:15:42.340210+0000","last_became_peered":"2024-09-14T11:15:42.340210+0000","last_unstale":"2024-09-14T11:59:29.948019+0000","last_undegraded":"2024-09-14T11:59:29.948019+0000","last_fullsized":"2024-09-14T11:59:29.948019+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'196","last_scrub_stamp":"2024-09-14T11:59:29.947935+0000","last_deep_scrub":"262'196","last_deep_scrub_stamp":"2024-09-14T11:59:29.947935+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.947935+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:34.985820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":577,"num_write":414,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'1029","reported_seq":2598,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.984926+0000","last_change":"2024-09-14T11:59:06.984926+0000","last_active":"2024-09-14T11:59:06.984926+0000","last_peered":"2024-09-14T11:59:06.984926+0000","last_clean":"2024-09-14T11:59:06.984926+0000","last_became_active":"2024-09-14T11:15:34.325640+0000","last_became_peered":"2024-09-14T11:15:34.325640+0000","last_unstale":"2024-09-14T11:59:06.984926+0000","last_undegraded":"2024-09-14T11:59:06.984926+0000","last_fullsized":"2024-09-14T11:59:06.984926+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1029","last_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_deep_scrub":"262'1029","last_deep_scrub_stamp":"2024-09-14T11:59:06.984839+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.984839+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":1000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:57.478127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4807,"num_read_kb":4328,"num_write":1491,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'194","reported_seq":782,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.258205+0000","last_change":"2024-09-14T11:58:58.258145+0000","last_active":"2024-09-14T11:58:58.258205+0000","last_peered":"2024-09-14T11:58:58.258205+0000","last_clean":"2024-09-14T11:58:58.258205+0000","last_became_active":"2024-09-14T11:15:32.317138+0000","last_became_peered":"2024-09-14T11:15:32.317138+0000","last_unstale":"2024-09-14T11:58:58.258205+0000","last_undegraded":"2024-09-14T11:58:58.258205+0000","last_fullsized":"2024-09-14T11:58:58.258205+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-14T11:58:58.258058+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.258058+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:41.203458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399062,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":441,"num_read_kb":5281,"num_write":856,"num_write_kb":34506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.793009+0000","last_change":"2024-09-14T11:59:15.793009+0000","last_active":"2024-09-14T11:59:15.793009+0000","last_peered":"2024-09-14T11:59:15.793009+0000","last_clean":"2024-09-14T11:59:15.793009+0000","last_became_active":"2024-09-14T11:15:36.329813+0000","last_became_peered":"2024-09-14T11:15:36.329813+0000","last_unstale":"2024-09-14T11:59:15.793009+0000","last_undegraded":"2024-09-14T11:59:15.793009+0000","last_fullsized":"2024-09-14T11:59:15.793009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.792911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.792911+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.792911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:11.129274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'127","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.988911+0000","last_change":"2024-09-14T11:59:20.988911+0000","last_active":"2024-09-14T11:59:20.988911+0000","last_peered":"2024-09-14T11:59:20.988911+0000","last_clean":"2024-09-14T11:59:20.988911+0000","last_became_active":"2024-09-14T11:15:38.337025+0000","last_became_peered":"2024-09-14T11:15:38.337025+0000","last_unstale":"2024-09-14T11:59:20.988911+0000","last_undegraded":"2024-09-14T11:59:20.988911+0000","last_fullsized":"2024-09-14T11:59:20.988911+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'127","last_scrub_stamp":"2024-09-14T11:59:20.988790+0000","last_deep_scrub":"262'127","last_deep_scrub_stamp":"2024-09-14T11:59:20.988790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.988790+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:38.988128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5939,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":153,"num_read_kb":190,"num_write":76,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'813","reported_seq":2237,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.998605+0000","last_change":"2024-09-14T11:59:31.998533+0000","last_active":"2024-09-14T11:59:31.998605+0000","last_peered":"2024-09-14T11:59:31.998605+0000","last_clean":"2024-09-14T11:59:31.998605+0000","last_became_active":"2024-09-14T11:15:40.348732+0000","last_became_peered":"2024-09-14T11:15:40.348732+0000","last_unstale":"2024-09-14T11:59:31.998605+0000","last_undegraded":"2024-09-14T11:59:31.998605+0000","last_fullsized":"2024-09-14T11:59:31.998605+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'813","last_scrub_stamp":"2024-09-14T11:59:31.998436+0000","last_deep_scrub":"262'813","last_deep_scrub_stamp":"2024-09-14T11:59:31.998436+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.998436+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:58.220089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'737","reported_seq":2289,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.860018+0000","last_change":"2024-09-14T11:59:06.860018+0000","last_active":"2024-09-14T11:59:06.860018+0000","last_peered":"2024-09-14T11:59:06.860018+0000","last_clean":"2024-09-14T11:59:06.860018+0000","last_became_active":"2024-09-14T11:15:34.326339+0000","last_became_peered":"2024-09-14T11:15:34.326339+0000","last_unstale":"2024-09-14T11:59:06.860018+0000","last_undegraded":"2024-09-14T11:59:06.860018+0000","last_fullsized":"2024-09-14T11:59:06.860018+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:06.859938+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.859938+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:44.442477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3540,"num_read_kb":3231,"num_write":959,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'207","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.703945+0000","last_change":"2024-09-14T11:58:57.703945+0000","last_active":"2024-09-14T11:58:57.703945+0000","last_peered":"2024-09-14T11:58:57.703945+0000","last_clean":"2024-09-14T11:58:57.703945+0000","last_became_active":"2024-09-14T11:15:32.318517+0000","last_became_peered":"2024-09-14T11:15:32.318517+0000","last_unstale":"2024-09-14T11:58:57.703945+0000","last_undegraded":"2024-09-14T11:58:57.703945+0000","last_fullsized":"2024-09-14T11:58:57.703945+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-14T11:58:57.703856+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.703856+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:11.335540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":729,"num_read_kb":30459,"num_write":898,"num_write_kb":17234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.963904+0000","last_change":"2024-09-14T11:59:13.963904+0000","last_active":"2024-09-14T11:59:13.963904+0000","last_peered":"2024-09-14T11:59:13.963904+0000","last_clean":"2024-09-14T11:59:13.963904+0000","last_became_active":"2024-09-14T11:15:36.333970+0000","last_became_peered":"2024-09-14T11:15:36.333970+0000","last_unstale":"2024-09-14T11:59:13.963904+0000","last_undegraded":"2024-09-14T11:59:13.963904+0000","last_fullsized":"2024-09-14T11:59:13.963904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.963802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.963802+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.963802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:21.806765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'223","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.792410+0000","last_change":"2024-09-14T11:59:19.792410+0000","last_active":"2024-09-14T11:59:19.792410+0000","last_peered":"2024-09-14T11:59:19.792410+0000","last_clean":"2024-09-14T11:59:19.792410+0000","last_became_active":"2024-09-14T11:15:38.334715+0000","last_became_peered":"2024-09-14T11:15:38.334715+0000","last_unstale":"2024-09-14T11:59:19.792410+0000","last_undegraded":"2024-09-14T11:59:19.792410+0000","last_fullsized":"2024-09-14T11:59:19.792410+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-14T11:59:19.792309+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-14T11:59:19.792309+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.792309+0000","objects_scrubbed":10,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:30.265360+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12526,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":287,"num_read_kb":357,"num_write":170,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.594914+0000","last_change":"2024-09-14T11:59:15.594914+0000","last_active":"2024-09-14T11:59:15.594914+0000","last_peered":"2024-09-14T11:59:15.594914+0000","last_clean":"2024-09-14T11:59:15.594914+0000","last_became_active":"2024-09-14T11:15:40.345538+0000","last_became_peered":"2024-09-14T11:15:40.345538+0000","last_unstale":"2024-09-14T11:59:15.594914+0000","last_undegraded":"2024-09-14T11:59:15.594914+0000","last_fullsized":"2024-09-14T11:59:15.594914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.594816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.594816+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.594816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.054516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'557","reported_seq":1361,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.843588+0000","last_change":"2024-09-14T11:59:24.843524+0000","last_active":"2024-09-14T11:59:24.843588+0000","last_peered":"2024-09-14T11:59:24.843588+0000","last_clean":"2024-09-14T11:59:24.843588+0000","last_became_active":"2024-09-14T11:15:42.349878+0000","last_became_peered":"2024-09-14T11:15:42.349878+0000","last_unstale":"2024-09-14T11:59:24.843588+0000","last_undegraded":"2024-09-14T11:59:24.843588+0000","last_fullsized":"2024-09-14T11:59:24.843588+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'557","last_scrub_stamp":"2024-09-14T11:59:24.843428+0000","last_deep_scrub":"262'557","last_deep_scrub_stamp":"2024-09-14T11:59:24.843428+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.843428+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:59.354050+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1262,"num_read_kb":1261,"num_write":1134,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'839","reported_seq":2332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.167101+0000","last_change":"2024-09-14T11:59:00.167101+0000","last_active":"2024-09-14T11:59:00.167101+0000","last_peered":"2024-09-14T11:59:00.167101+0000","last_clean":"2024-09-14T11:59:00.167101+0000","last_became_active":"2024-09-14T11:15:34.329586+0000","last_became_peered":"2024-09-14T11:15:34.329586+0000","last_unstale":"2024-09-14T11:59:00.167101+0000","last_undegraded":"2024-09-14T11:59:00.167101+0000","last_fullsized":"2024-09-14T11:59:00.167101+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'839","last_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_deep_scrub":"262'839","last_deep_scrub_stamp":"2024-09-14T11:59:00.167013+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.167013+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.391900+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3930,"num_read_kb":3507,"num_write":1121,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'287","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.738135+0000","last_change":"2024-09-14T11:58:58.738135+0000","last_active":"2024-09-14T11:58:58.738135+0000","last_peered":"2024-09-14T11:58:58.738135+0000","last_clean":"2024-09-14T11:58:58.738135+0000","last_became_active":"2024-09-14T11:15:32.321051+0000","last_became_peered":"2024-09-14T11:15:32.321051+0000","last_unstale":"2024-09-14T11:58:58.738135+0000","last_undegraded":"2024-09-14T11:58:58.738135+0000","last_fullsized":"2024-09-14T11:58:58.738135+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'287","last_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_deep_scrub":"262'287","last_deep_scrub_stamp":"2024-09-14T11:58:58.738053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.738053+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:39.322669+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":15958,"num_write":1147,"num_write_kb":31525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.282011+0000","last_change":"2024-09-14T11:59:12.282011+0000","last_active":"2024-09-14T11:59:12.282011+0000","last_peered":"2024-09-14T11:59:12.282011+0000","last_clean":"2024-09-14T11:59:12.282011+0000","last_became_active":"2024-09-14T11:15:36.322809+0000","last_became_peered":"2024-09-14T11:15:36.322809+0000","last_unstale":"2024-09-14T11:59:12.282011+0000","last_undegraded":"2024-09-14T11:59:12.282011+0000","last_fullsized":"2024-09-14T11:59:12.282011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.281919+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.281919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:33.989125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'124","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.037813+0000","last_change":"2024-09-14T11:59:22.037813+0000","last_active":"2024-09-14T11:59:22.037813+0000","last_peered":"2024-09-14T11:59:22.037813+0000","last_clean":"2024-09-14T11:59:22.037813+0000","last_became_active":"2024-09-14T11:15:38.336647+0000","last_became_peered":"2024-09-14T11:15:38.336647+0000","last_unstale":"2024-09-14T11:59:22.037813+0000","last_undegraded":"2024-09-14T11:59:22.037813+0000","last_fullsized":"2024-09-14T11:59:22.037813+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'124","last_scrub_stamp":"2024-09-14T11:59:22.037722+0000","last_deep_scrub":"262'124","last_deep_scrub_stamp":"2024-09-14T11:59:22.037722+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.037722+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:56.451683+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":194,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.956799+0000","last_change":"2024-09-14T11:59:27.956799+0000","last_active":"2024-09-14T11:59:27.956799+0000","last_peered":"2024-09-14T11:59:27.956799+0000","last_clean":"2024-09-14T11:59:27.956799+0000","last_became_active":"2024-09-14T11:15:40.348697+0000","last_became_peered":"2024-09-14T11:15:40.348697+0000","last_unstale":"2024-09-14T11:59:27.956799+0000","last_undegraded":"2024-09-14T11:59:27.956799+0000","last_fullsized":"2024-09-14T11:59:27.956799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.956713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.956713+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.956713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.243127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'125","reported_seq":611,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.069959+0000","last_change":"2024-09-14T11:59:16.069904+0000","last_active":"2024-09-14T11:59:16.069959+0000","last_peered":"2024-09-14T11:59:16.069959+0000","last_clean":"2024-09-14T11:59:16.069959+0000","last_became_active":"2024-09-14T11:15:42.350877+0000","last_became_peered":"2024-09-14T11:15:42.350877+0000","last_unstale":"2024-09-14T11:59:16.069959+0000","last_undegraded":"2024-09-14T11:59:16.069959+0000","last_fullsized":"2024-09-14T11:59:16.069959+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'125","last_scrub_stamp":"2024-09-14T11:59:16.069819+0000","last_deep_scrub":"262'125","last_deep_scrub_stamp":"2024-09-14T11:59:16.069819+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.069819+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:43.120386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'695","reported_seq":2342,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.215163+0000","last_change":"2024-09-14T11:59:04.215163+0000","last_active":"2024-09-14T11:59:04.215163+0000","last_peered":"2024-09-14T11:59:04.215163+0000","last_clean":"2024-09-14T11:59:04.215163+0000","last_became_active":"2024-09-14T11:15:34.331521+0000","last_became_peered":"2024-09-14T11:15:34.331521+0000","last_unstale":"2024-09-14T11:59:04.215163+0000","last_undegraded":"2024-09-14T11:59:04.215163+0000","last_fullsized":"2024-09-14T11:59:04.215163+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'695","last_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_deep_scrub":"262'695","last_deep_scrub_stamp":"2024-09-14T11:59:04.215080+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.215080+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:28.285334+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3540,"num_read_kb":3199,"num_write":964,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":241,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'236","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.244348+0000","last_change":"2024-09-14T11:58:55.244348+0000","last_active":"2024-09-14T11:58:55.244348+0000","last_peered":"2024-09-14T11:58:55.244348+0000","last_clean":"2024-09-14T11:58:55.244348+0000","last_became_active":"2024-09-14T11:16:07.518270+0000","last_became_peered":"2024-09-14T11:16:07.518270+0000","last_unstale":"2024-09-14T11:58:55.244348+0000","last_undegraded":"2024-09-14T11:58:55.244348+0000","last_fullsized":"2024-09-14T11:58:55.244348+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'236","last_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_deep_scrub":"262'236","last_deep_scrub_stamp":"2024-09-14T11:58:55.244245+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.244245+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:50.597423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":32200,"num_write":1033,"num_write_kb":30884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.276886+0000","last_change":"2024-09-14T11:59:03.276886+0000","last_active":"2024-09-14T11:59:03.276886+0000","last_peered":"2024-09-14T11:59:03.276886+0000","last_clean":"2024-09-14T11:59:03.276886+0000","last_became_active":"2024-09-14T11:15:36.324004+0000","last_became_peered":"2024-09-14T11:15:36.324004+0000","last_unstale":"2024-09-14T11:59:03.276886+0000","last_undegraded":"2024-09-14T11:59:03.276886+0000","last_fullsized":"2024-09-14T11:59:03.276886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:03.276755+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.276755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:59.224975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'175","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.935132+0000","last_change":"2024-09-14T11:59:18.935132+0000","last_active":"2024-09-14T11:59:18.935132+0000","last_peered":"2024-09-14T11:59:18.935132+0000","last_clean":"2024-09-14T11:59:18.935132+0000","last_became_active":"2024-09-14T11:15:38.339200+0000","last_became_peered":"2024-09-14T11:15:38.339200+0000","last_unstale":"2024-09-14T11:59:18.935132+0000","last_undegraded":"2024-09-14T11:59:18.935132+0000","last_fullsized":"2024-09-14T11:59:18.935132+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'175","last_scrub_stamp":"2024-09-14T11:59:18.935016+0000","last_deep_scrub":"262'175","last_deep_scrub_stamp":"2024-09-14T11:59:18.935016+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.935016+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:06.444815+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":303,"num_write":122,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'804","reported_seq":4169,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.452341+0000","last_change":"2024-09-14T11:59:21.452341+0000","last_active":"2024-09-14T11:59:21.452341+0000","last_peered":"2024-09-14T11:59:21.452341+0000","last_clean":"2024-09-14T11:59:21.452341+0000","last_became_active":"2024-09-14T11:15:40.343208+0000","last_became_peered":"2024-09-14T11:15:40.343208+0000","last_unstale":"2024-09-14T11:59:21.452341+0000","last_undegraded":"2024-09-14T11:59:21.452341+0000","last_fullsized":"2024-09-14T11:59:21.452341+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'804","last_scrub_stamp":"2024-09-14T11:59:21.452251+0000","last_deep_scrub":"262'804","last_deep_scrub_stamp":"2024-09-14T11:59:21.452251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.452251+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:50.712137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'142","reported_seq":669,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.469961+0000","last_change":"2024-09-14T11:59:27.469961+0000","last_active":"2024-09-14T11:59:27.469961+0000","last_peered":"2024-09-14T11:59:27.469961+0000","last_clean":"2024-09-14T11:59:27.469961+0000","last_became_active":"2024-09-14T11:15:42.354539+0000","last_became_peered":"2024-09-14T11:15:42.354539+0000","last_unstale":"2024-09-14T11:59:27.469961+0000","last_undegraded":"2024-09-14T11:59:27.469961+0000","last_fullsized":"2024-09-14T11:59:27.469961+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-14T11:59:27.469878+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-14T11:59:27.469878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.469878+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:26.963886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":214,"num_write":370,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'842","reported_seq":2513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.286153+0000","last_change":"2024-09-14T11:59:04.286153+0000","last_active":"2024-09-14T11:59:04.286153+0000","last_peered":"2024-09-14T11:59:04.286153+0000","last_clean":"2024-09-14T11:59:04.286153+0000","last_became_active":"2024-09-14T11:15:34.329937+0000","last_became_peered":"2024-09-14T11:15:34.329937+0000","last_unstale":"2024-09-14T11:59:04.286153+0000","last_undegraded":"2024-09-14T11:59:04.286153+0000","last_fullsized":"2024-09-14T11:59:04.286153+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'842","last_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_deep_scrub":"262'842","last_deep_scrub_stamp":"2024-09-14T11:59:04.286054+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.286054+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:06.803501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4001,"num_read_kb":3619,"num_write":1092,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'270","reported_seq":957,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.198507+0000","last_change":"2024-09-14T11:58:54.198507+0000","last_active":"2024-09-14T11:58:54.198507+0000","last_peered":"2024-09-14T11:58:54.198507+0000","last_clean":"2024-09-14T11:58:54.198507+0000","last_became_active":"2024-09-14T11:16:07.389995+0000","last_became_peered":"2024-09-14T11:16:07.389995+0000","last_unstale":"2024-09-14T11:58:54.198507+0000","last_undegraded":"2024-09-14T11:58:54.198507+0000","last_fullsized":"2024-09-14T11:58:54.198507+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'270","last_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_deep_scrub":"262'270","last_deep_scrub_stamp":"2024-09-14T11:58:54.198407+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.198407+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:41.502019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":844,"num_read_kb":40477,"num_write":1093,"num_write_kb":41066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.246881+0000","last_change":"2024-09-14T11:59:02.246809+0000","last_active":"2024-09-14T11:59:02.246881+0000","last_peered":"2024-09-14T11:59:02.246881+0000","last_clean":"2024-09-14T11:59:02.246881+0000","last_became_active":"2024-09-14T11:15:36.329920+0000","last_became_peered":"2024-09-14T11:15:36.329920+0000","last_unstale":"2024-09-14T11:59:02.246881+0000","last_undegraded":"2024-09-14T11:59:02.246881+0000","last_fullsized":"2024-09-14T11:59:02.246881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.246720+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.246720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:43.335103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'207","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.338673+0000","last_change":"2024-09-14T11:59:14.338673+0000","last_active":"2024-09-14T11:59:14.338673+0000","last_peered":"2024-09-14T11:59:14.338673+0000","last_clean":"2024-09-14T11:59:14.338673+0000","last_became_active":"2024-09-14T11:15:38.335003+0000","last_became_peered":"2024-09-14T11:15:38.335003+0000","last_unstale":"2024-09-14T11:59:14.338673+0000","last_undegraded":"2024-09-14T11:59:14.338673+0000","last_fullsized":"2024-09-14T11:59:14.338673+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-14T11:59:14.338559+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-14T11:59:14.338559+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.338559+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:25.967619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65191,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":292,"num_read_kb":532,"num_write":152,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.338348+0000","last_change":"2024-09-14T11:59:14.338348+0000","last_active":"2024-09-14T11:59:14.338348+0000","last_peered":"2024-09-14T11:59:14.338348+0000","last_clean":"2024-09-14T11:59:14.338348+0000","last_became_active":"2024-09-14T11:15:40.341935+0000","last_became_peered":"2024-09-14T11:15:40.341935+0000","last_unstale":"2024-09-14T11:59:14.338348+0000","last_undegraded":"2024-09-14T11:59:14.338348+0000","last_fullsized":"2024-09-14T11:59:14.338348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.338219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.338219+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.338219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:18.751994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'133","reported_seq":655,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.491087+0000","last_change":"2024-09-14T11:59:20.491087+0000","last_active":"2024-09-14T11:59:20.491087+0000","last_peered":"2024-09-14T11:59:20.491087+0000","last_clean":"2024-09-14T11:59:20.491087+0000","last_became_active":"2024-09-14T11:15:42.350487+0000","last_became_peered":"2024-09-14T11:15:42.350487+0000","last_unstale":"2024-09-14T11:59:20.491087+0000","last_undegraded":"2024-09-14T11:59:20.491087+0000","last_fullsized":"2024-09-14T11:59:20.491087+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'133","last_scrub_stamp":"2024-09-14T11:59:20.490994+0000","last_deep_scrub":"262'133","last_deep_scrub_stamp":"2024-09-14T11:59:20.490994+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.490994+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:34.944128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":198,"num_read_kb":179,"num_write":321,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'489","reported_seq":2098,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.170207+0000","last_change":"2024-09-14T11:59:01.170207+0000","last_active":"2024-09-14T11:59:01.170207+0000","last_peered":"2024-09-14T11:59:01.170207+0000","last_clean":"2024-09-14T11:59:01.170207+0000","last_became_active":"2024-09-14T11:15:34.320708+0000","last_became_peered":"2024-09-14T11:15:34.320708+0000","last_unstale":"2024-09-14T11:59:01.170207+0000","last_undegraded":"2024-09-14T11:59:01.170207+0000","last_fullsized":"2024-09-14T11:59:01.170207+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'489","last_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_deep_scrub":"262'489","last_deep_scrub_stamp":"2024-09-14T11:59:01.170127+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.170127+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:23.040904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2657,"num_read_kb":2476,"num_write":581,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":957,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'233","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.841862+0000","last_change":"2024-09-14T11:58:56.841862+0000","last_active":"2024-09-14T11:58:56.841862+0000","last_peered":"2024-09-14T11:58:56.841862+0000","last_clean":"2024-09-14T11:58:56.841862+0000","last_became_active":"2024-09-14T11:15:32.318541+0000","last_became_peered":"2024-09-14T11:15:32.318541+0000","last_unstale":"2024-09-14T11:58:56.841862+0000","last_undegraded":"2024-09-14T11:58:56.841862+0000","last_fullsized":"2024-09-14T11:58:56.841862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'233","last_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_deep_scrub":"262'233","last_deep_scrub_stamp":"2024-09-14T11:58:56.841768+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.841768+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:37.320911+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":679,"num_read_kb":211577,"num_write":961,"num_write_kb":56243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.271674+0000","last_change":"2024-09-14T11:59:04.271674+0000","last_active":"2024-09-14T11:59:04.271674+0000","last_peered":"2024-09-14T11:59:04.271674+0000","last_clean":"2024-09-14T11:59:04.271674+0000","last_became_active":"2024-09-14T11:15:36.333655+0000","last_became_peered":"2024-09-14T11:15:36.333655+0000","last_unstale":"2024-09-14T11:59:04.271674+0000","last_undegraded":"2024-09-14T11:59:04.271674+0000","last_fullsized":"2024-09-14T11:59:04.271674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.271581+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.271581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:18.845590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'150","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.000067+0000","last_change":"2024-09-14T11:59:19.000067+0000","last_active":"2024-09-14T11:59:19.000067+0000","last_peered":"2024-09-14T11:59:19.000067+0000","last_clean":"2024-09-14T11:59:19.000067+0000","last_became_active":"2024-09-14T11:15:38.334865+0000","last_became_peered":"2024-09-14T11:15:38.334865+0000","last_unstale":"2024-09-14T11:59:19.000067+0000","last_undegraded":"2024-09-14T11:59:19.000067+0000","last_fullsized":"2024-09-14T11:59:19.000067+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'150","last_scrub_stamp":"2024-09-14T11:59:18.999983+0000","last_deep_scrub":"262'150","last_deep_scrub_stamp":"2024-09-14T11:59:18.999983+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.999983+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:30.082383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":279,"num_write":168,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.482082+0000","last_change":"2024-09-14T11:59:22.482082+0000","last_active":"2024-09-14T11:59:22.482082+0000","last_peered":"2024-09-14T11:59:22.482082+0000","last_clean":"2024-09-14T11:59:22.482082+0000","last_became_active":"2024-09-14T11:15:40.351210+0000","last_became_peered":"2024-09-14T11:15:40.351210+0000","last_unstale":"2024-09-14T11:59:22.482082+0000","last_undegraded":"2024-09-14T11:59:22.482082+0000","last_fullsized":"2024-09-14T11:59:22.482082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.481998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.481998+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.481998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:30.175507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'123","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.047690+0000","last_change":"2024-09-14T11:59:35.047625+0000","last_active":"2024-09-14T11:59:35.047690+0000","last_peered":"2024-09-14T11:59:35.047690+0000","last_clean":"2024-09-14T11:59:35.047690+0000","last_became_active":"2024-09-14T11:15:42.350367+0000","last_became_peered":"2024-09-14T11:15:42.350367+0000","last_unstale":"2024-09-14T11:59:35.047690+0000","last_undegraded":"2024-09-14T11:59:35.047690+0000","last_fullsized":"2024-09-14T11:59:35.047690+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-14T11:59:35.047541+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-14T11:59:35.047541+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.047541+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:40.404587+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'401","reported_seq":2044,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.146653+0000","last_change":"2024-09-14T11:59:02.146653+0000","last_active":"2024-09-14T11:59:02.146653+0000","last_peered":"2024-09-14T11:59:02.146653+0000","last_clean":"2024-09-14T11:59:02.146653+0000","last_became_active":"2024-09-14T11:15:34.315182+0000","last_became_peered":"2024-09-14T11:15:34.315182+0000","last_unstale":"2024-09-14T11:59:02.146653+0000","last_undegraded":"2024-09-14T11:59:02.146653+0000","last_fullsized":"2024-09-14T11:59:02.146653+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'401","last_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_deep_scrub":"262'401","last_deep_scrub_stamp":"2024-09-14T11:59:02.146555+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.146555+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:42.384227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2388,"num_write":466,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'223","reported_seq":1042,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.241638+0000","last_change":"2024-09-14T11:58:56.241556+0000","last_active":"2024-09-14T11:58:56.241638+0000","last_peered":"2024-09-14T11:58:56.241638+0000","last_clean":"2024-09-14T11:58:56.241638+0000","last_became_active":"2024-09-14T11:15:32.316079+0000","last_became_peered":"2024-09-14T11:15:32.316079+0000","last_unstale":"2024-09-14T11:58:56.241638+0000","last_undegraded":"2024-09-14T11:58:56.241638+0000","last_fullsized":"2024-09-14T11:58:56.241638+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-14T11:58:56.241416+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.241416+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:27.853420+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1176,"num_read_kb":14840,"num_write":1005,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.643614+0000","last_change":"2024-09-14T11:59:08.643614+0000","last_active":"2024-09-14T11:59:08.643614+0000","last_peered":"2024-09-14T11:59:08.643614+0000","last_clean":"2024-09-14T11:59:08.643614+0000","last_became_active":"2024-09-14T11:15:36.331597+0000","last_became_peered":"2024-09-14T11:15:36.331597+0000","last_unstale":"2024-09-14T11:59:08.643614+0000","last_undegraded":"2024-09-14T11:59:08.643614+0000","last_fullsized":"2024-09-14T11:59:08.643614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.643511+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.643511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:00.185539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'169","reported_seq":756,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.269583+0000","last_change":"2024-09-14T11:59:05.269583+0000","last_active":"2024-09-14T11:59:05.269583+0000","last_peered":"2024-09-14T11:59:05.269583+0000","last_clean":"2024-09-14T11:59:05.269583+0000","last_became_active":"2024-09-14T11:15:38.333484+0000","last_became_peered":"2024-09-14T11:15:38.333484+0000","last_unstale":"2024-09-14T11:59:05.269583+0000","last_undegraded":"2024-09-14T11:59:05.269583+0000","last_fullsized":"2024-09-14T11:59:05.269583+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'169","last_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_deep_scrub":"262'169","last_deep_scrub_stamp":"2024-09-14T11:59:05.269486+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.269486+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:22.201735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9189,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":308,"num_write":130,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'737","reported_seq":2526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.312182+0000","last_change":"2024-09-14T11:59:11.312182+0000","last_active":"2024-09-14T11:59:11.312182+0000","last_peered":"2024-09-14T11:59:11.312182+0000","last_clean":"2024-09-14T11:59:11.312182+0000","last_became_active":"2024-09-14T11:15:40.337659+0000","last_became_peered":"2024-09-14T11:15:40.337659+0000","last_unstale":"2024-09-14T11:59:11.312182+0000","last_undegraded":"2024-09-14T11:59:11.312182+0000","last_fullsized":"2024-09-14T11:59:11.312182+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'737","last_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_deep_scrub":"262'737","last_deep_scrub_stamp":"2024-09-14T11:59:11.312094+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.312094+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:03.384832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'140","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.496372+0000","last_change":"2024-09-14T11:59:18.496302+0000","last_active":"2024-09-14T11:59:18.496372+0000","last_peered":"2024-09-14T11:59:18.496372+0000","last_clean":"2024-09-14T11:59:18.496372+0000","last_became_active":"2024-09-14T11:15:42.354986+0000","last_became_peered":"2024-09-14T11:15:42.354986+0000","last_unstale":"2024-09-14T11:59:18.496372+0000","last_undegraded":"2024-09-14T11:59:18.496372+0000","last_fullsized":"2024-09-14T11:59:18.496372+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:18.496205+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:18.496205+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.496205+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:21.623170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":130,"num_write":340,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'1226","reported_seq":2799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.175076+0000","last_change":"2024-09-14T11:59:03.175076+0000","last_active":"2024-09-14T11:59:03.175076+0000","last_peered":"2024-09-14T11:59:03.175076+0000","last_clean":"2024-09-14T11:59:03.175076+0000","last_became_active":"2024-09-14T11:15:34.321752+0000","last_became_peered":"2024-09-14T11:15:34.321752+0000","last_unstale":"2024-09-14T11:59:03.175076+0000","last_undegraded":"2024-09-14T11:59:03.175076+0000","last_fullsized":"2024-09-14T11:59:03.175076+0000","mapping_epoch":26,"log_start":"262'1200","ondisk_log_start":"262'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1226","last_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_deep_scrub":"262'1226","last_deep_scrub_stamp":"2024-09-14T11:59:03.174965+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.174965+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.571515+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5591,"num_read_kb":4937,"num_write":1679,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'203","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.140005+0000","last_change":"2024-09-14T11:58:58.140005+0000","last_active":"2024-09-14T11:58:58.140005+0000","last_peered":"2024-09-14T11:58:58.140005+0000","last_clean":"2024-09-14T11:58:58.140005+0000","last_became_active":"2024-09-14T11:15:32.308347+0000","last_became_peered":"2024-09-14T11:15:32.308347+0000","last_unstale":"2024-09-14T11:58:58.140005+0000","last_undegraded":"2024-09-14T11:58:58.140005+0000","last_fullsized":"2024-09-14T11:58:58.140005+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-14T11:58:58.139868+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.139868+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:54.848038+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":33043,"num_write":876,"num_write_kb":34886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1446,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.781031+0000","last_change":"2024-09-14T11:59:14.781031+0000","last_active":"2024-09-14T11:59:14.781031+0000","last_peered":"2024-09-14T11:59:14.781031+0000","last_clean":"2024-09-14T11:59:14.781031+0000","last_became_active":"2024-09-14T11:15:36.329863+0000","last_became_peered":"2024-09-14T11:15:36.329863+0000","last_unstale":"2024-09-14T11:59:14.781031+0000","last_undegraded":"2024-09-14T11:59:14.781031+0000","last_fullsized":"2024-09-14T11:59:14.781031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-14T11:59:14.780939+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-14T11:59:14.780939+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.780939+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:39.596476+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":951,"num_read_kb":951,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'94","reported_seq":615,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.988876+0000","last_change":"2024-09-14T11:59:19.988876+0000","last_active":"2024-09-14T11:59:19.988876+0000","last_peered":"2024-09-14T11:59:19.988876+0000","last_clean":"2024-09-14T11:59:19.988876+0000","last_became_active":"2024-09-14T11:15:38.335108+0000","last_became_peered":"2024-09-14T11:15:38.335108+0000","last_unstale":"2024-09-14T11:59:19.988876+0000","last_undegraded":"2024-09-14T11:59:19.988876+0000","last_fullsized":"2024-09-14T11:59:19.988876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-14T11:59:19.988779+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-14T11:59:19.988779+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.988779+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:05.383676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":80,"num_read_kb":73,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'769","reported_seq":2241,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.136534+0000","last_change":"2024-09-14T11:59:13.136534+0000","last_active":"2024-09-14T11:59:13.136534+0000","last_peered":"2024-09-14T11:59:13.136534+0000","last_clean":"2024-09-14T11:59:13.136534+0000","last_became_active":"2024-09-14T11:15:40.344278+0000","last_became_peered":"2024-09-14T11:15:40.344278+0000","last_unstale":"2024-09-14T11:59:13.136534+0000","last_undegraded":"2024-09-14T11:59:13.136534+0000","last_fullsized":"2024-09-14T11:59:13.136534+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'769","last_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_deep_scrub":"262'769","last_deep_scrub_stamp":"2024-09-14T11:59:13.136434+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.136434+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:03.613925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'150","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.010097+0000","last_change":"2024-09-14T11:59:27.010015+0000","last_active":"2024-09-14T11:59:27.010097+0000","last_peered":"2024-09-14T11:59:27.010097+0000","last_clean":"2024-09-14T11:59:27.010097+0000","last_became_active":"2024-09-14T11:15:42.354355+0000","last_became_peered":"2024-09-14T11:15:42.354355+0000","last_unstale":"2024-09-14T11:59:27.010097+0000","last_undegraded":"2024-09-14T11:59:27.010097+0000","last_fullsized":"2024-09-14T11:59:27.010097+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'150","last_scrub_stamp":"2024-09-14T11:59:27.009930+0000","last_deep_scrub":"262'150","last_deep_scrub_stamp":"2024-09-14T11:59:27.009930+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.009930+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.093068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":344,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'426","reported_seq":2152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.612965+0000","last_change":"2024-09-14T11:59:03.612965+0000","last_active":"2024-09-14T11:59:03.612965+0000","last_peered":"2024-09-14T11:59:03.612965+0000","last_clean":"2024-09-14T11:59:03.612965+0000","last_became_active":"2024-09-14T11:15:34.334892+0000","last_became_peered":"2024-09-14T11:15:34.334892+0000","last_unstale":"2024-09-14T11:59:03.612965+0000","last_undegraded":"2024-09-14T11:59:03.612965+0000","last_fullsized":"2024-09-14T11:59:03.612965+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'426","last_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_deep_scrub":"262'426","last_deep_scrub_stamp":"2024-09-14T11:59:03.612866+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.612866+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:46.847404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2416,"num_read_kb":2338,"num_write":465,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'177","reported_seq":791,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.824967+0000","last_change":"2024-09-14T11:58:55.824967+0000","last_active":"2024-09-14T11:58:55.824967+0000","last_peered":"2024-09-14T11:58:55.824967+0000","last_clean":"2024-09-14T11:58:55.824967+0000","last_became_active":"2024-09-14T11:15:32.310480+0000","last_became_peered":"2024-09-14T11:15:32.310480+0000","last_unstale":"2024-09-14T11:58:55.824967+0000","last_undegraded":"2024-09-14T11:58:55.824967+0000","last_fullsized":"2024-09-14T11:58:55.824967+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:55.824891+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.824891+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.305401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":460,"num_read_kb":26947,"num_write":787,"num_write_kb":21528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.055419+0000","last_change":"2024-09-14T11:59:16.055419+0000","last_active":"2024-09-14T11:59:16.055419+0000","last_peered":"2024-09-14T11:59:16.055419+0000","last_clean":"2024-09-14T11:59:16.055419+0000","last_became_active":"2024-09-14T11:15:36.334738+0000","last_became_peered":"2024-09-14T11:15:36.334738+0000","last_unstale":"2024-09-14T11:59:16.055419+0000","last_undegraded":"2024-09-14T11:59:16.055419+0000","last_fullsized":"2024-09-14T11:59:16.055419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.055322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.055322+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.055322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:34.773506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'219","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.822193+0000","last_change":"2024-09-14T11:59:20.822193+0000","last_active":"2024-09-14T11:59:20.822193+0000","last_peered":"2024-09-14T11:59:20.822193+0000","last_clean":"2024-09-14T11:59:20.822193+0000","last_became_active":"2024-09-14T11:15:38.333667+0000","last_became_peered":"2024-09-14T11:15:38.333667+0000","last_unstale":"2024-09-14T11:59:20.822193+0000","last_undegraded":"2024-09-14T11:59:20.822193+0000","last_fullsized":"2024-09-14T11:59:20.822193+0000","mapping_epoch":30,"log_start":"262'201","ondisk_log_start":"262'201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:20.822090+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:20.822090+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.822090+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":201,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:07.759480+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":896,"num_read_kb":967,"num_write":1418,"num_write_kb":1294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.100560+0000","last_change":"2024-09-14T11:59:11.100560+0000","last_active":"2024-09-14T11:59:11.100560+0000","last_peered":"2024-09-14T11:59:11.100560+0000","last_clean":"2024-09-14T11:59:11.100560+0000","last_became_active":"2024-09-14T11:15:40.348827+0000","last_became_peered":"2024-09-14T11:15:40.348827+0000","last_unstale":"2024-09-14T11:59:11.100560+0000","last_undegraded":"2024-09-14T11:59:11.100560+0000","last_fullsized":"2024-09-14T11:59:11.100560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.100464+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.100464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:20.020435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'148","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.456666+0000","last_change":"2024-09-14T11:59:19.456602+0000","last_active":"2024-09-14T11:59:19.456666+0000","last_peered":"2024-09-14T11:59:19.456666+0000","last_clean":"2024-09-14T11:59:19.456666+0000","last_became_active":"2024-09-14T11:15:42.351455+0000","last_became_peered":"2024-09-14T11:15:42.351455+0000","last_unstale":"2024-09-14T11:59:19.456666+0000","last_undegraded":"2024-09-14T11:59:19.456666+0000","last_fullsized":"2024-09-14T11:59:19.456666+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-14T11:59:19.456498+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-14T11:59:19.456498+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.456498+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:21.465056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'801","reported_seq":2325,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.230985+0000","last_change":"2024-09-14T11:59:03.230934+0000","last_active":"2024-09-14T11:59:03.230985+0000","last_peered":"2024-09-14T11:59:03.230985+0000","last_clean":"2024-09-14T11:59:03.230985+0000","last_became_active":"2024-09-14T11:15:34.322334+0000","last_became_peered":"2024-09-14T11:15:34.322334+0000","last_unstale":"2024-09-14T11:59:03.230985+0000","last_undegraded":"2024-09-14T11:59:03.230985+0000","last_fullsized":"2024-09-14T11:59:03.230985+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'801","last_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_deep_scrub":"262'801","last_deep_scrub_stamp":"2024-09-14T11:59:03.230846+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.230846+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:04.064474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3807,"num_read_kb":3425,"num_write":1070,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":614,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.760564+0000","last_change":"2024-09-14T11:58:59.760463+0000","last_active":"2024-09-14T11:58:59.760564+0000","last_peered":"2024-09-14T11:58:59.760564+0000","last_clean":"2024-09-14T11:58:59.760564+0000","last_became_active":"2024-09-14T11:15:15.721428+0000","last_became_peered":"2024-09-14T11:15:15.721428+0000","last_unstale":"2024-09-14T11:58:59.760564+0000","last_undegraded":"2024-09-14T11:58:59.760564+0000","last_fullsized":"2024-09-14T11:58:59.760564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-14T11:58:59.760359+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.760359+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.092864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":518,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.827346+0000","last_change":"2024-09-14T11:58:54.827283+0000","last_active":"2024-09-14T11:58:54.827346+0000","last_peered":"2024-09-14T11:58:54.827346+0000","last_clean":"2024-09-14T11:58:54.827346+0000","last_became_active":"2024-09-14T11:15:21.066240+0000","last_became_peered":"2024-09-14T11:15:21.066240+0000","last_unstale":"2024-09-14T11:58:54.827346+0000","last_undegraded":"2024-09-14T11:58:54.827346+0000","last_fullsized":"2024-09-14T11:58:54.827346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:58:54.827191+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.827191+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:45.032950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048924600000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'242","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.815480+0000","last_change":"2024-09-14T11:58:53.815404+0000","last_active":"2024-09-14T11:58:53.815480+0000","last_peered":"2024-09-14T11:58:53.815480+0000","last_clean":"2024-09-14T11:58:53.815480+0000","last_became_active":"2024-09-14T11:15:32.324014+0000","last_became_peered":"2024-09-14T11:15:32.324014+0000","last_unstale":"2024-09-14T11:58:53.815480+0000","last_undegraded":"2024-09-14T11:58:53.815480+0000","last_fullsized":"2024-09-14T11:58:53.815480+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'242","last_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_deep_scrub":"262'242","last_deep_scrub_stamp":"2024-09-14T11:58:53.815334+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.815334+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:37.358269+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":31904,"num_write":1129,"num_write_kb":40613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.000087+0000","last_change":"2024-09-14T11:59:12.999968+0000","last_active":"2024-09-14T11:59:13.000087+0000","last_peered":"2024-09-14T11:59:13.000087+0000","last_clean":"2024-09-14T11:59:13.000087+0000","last_became_active":"2024-09-14T11:15:36.333308+0000","last_became_peered":"2024-09-14T11:15:36.333308+0000","last_unstale":"2024-09-14T11:59:13.000087+0000","last_undegraded":"2024-09-14T11:59:13.000087+0000","last_fullsized":"2024-09-14T11:59:13.000087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.999868+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.999868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:32.858382+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'311","reported_seq":1005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.744516+0000","last_change":"2024-09-14T11:59:18.744516+0000","last_active":"2024-09-14T11:59:18.744516+0000","last_peered":"2024-09-14T11:59:18.744516+0000","last_clean":"2024-09-14T11:59:18.744516+0000","last_became_active":"2024-09-14T11:15:38.335014+0000","last_became_peered":"2024-09-14T11:15:38.335014+0000","last_unstale":"2024-09-14T11:59:18.744516+0000","last_undegraded":"2024-09-14T11:59:18.744516+0000","last_fullsized":"2024-09-14T11:59:18.744516+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'311","last_scrub_stamp":"2024-09-14T11:59:18.744428+0000","last_deep_scrub":"262'311","last_deep_scrub_stamp":"2024-09-14T11:59:18.744428+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.744428+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:34.923657+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36736,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":789,"num_write":500,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107196,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.415321+0000","last_change":"2024-09-14T11:59:20.415321+0000","last_active":"2024-09-14T11:59:20.415321+0000","last_peered":"2024-09-14T11:59:20.415321+0000","last_clean":"2024-09-14T11:59:20.415321+0000","last_became_active":"2024-09-14T11:15:40.350325+0000","last_became_peered":"2024-09-14T11:15:40.350325+0000","last_unstale":"2024-09-14T11:59:20.415321+0000","last_undegraded":"2024-09-14T11:59:20.415321+0000","last_fullsized":"2024-09-14T11:59:20.415321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.415213+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.882772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'191","reported_seq":885,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.044608+0000","last_change":"2024-09-14T11:59:18.044608+0000","last_active":"2024-09-14T11:59:18.044608+0000","last_peered":"2024-09-14T11:59:18.044608+0000","last_clean":"2024-09-14T11:59:18.044608+0000","last_became_active":"2024-09-14T11:15:42.350232+0000","last_became_peered":"2024-09-14T11:15:42.350232+0000","last_unstale":"2024-09-14T11:59:18.044608+0000","last_undegraded":"2024-09-14T11:59:18.044608+0000","last_fullsized":"2024-09-14T11:59:18.044608+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-14T11:59:18.044511+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-14T11:59:18.044511+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.044511+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.155679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":422,"num_read_kb":418,"num_write":378,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'496","reported_seq":2055,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.319385+0000","last_change":"2024-09-14T11:59:03.319385+0000","last_active":"2024-09-14T11:59:03.319385+0000","last_peered":"2024-09-14T11:59:03.319385+0000","last_clean":"2024-09-14T11:59:03.319385+0000","last_became_active":"2024-09-14T11:15:34.330542+0000","last_became_peered":"2024-09-14T11:15:34.330542+0000","last_unstale":"2024-09-14T11:59:03.319385+0000","last_undegraded":"2024-09-14T11:59:03.319385+0000","last_fullsized":"2024-09-14T11:59:03.319385+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'496","last_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_deep_scrub":"262'496","last_deep_scrub_stamp":"2024-09-14T11:59:03.319251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.319251+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.665879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2634,"num_read_kb":2445,"num_write":622,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751184+0000","last_change":"2024-09-14T11:58:56.751104+0000","last_active":"2024-09-14T11:58:56.751184+0000","last_peered":"2024-09-14T11:58:56.751184+0000","last_clean":"2024-09-14T11:58:56.751184+0000","last_became_active":"2024-09-14T11:15:21.067813+0000","last_became_peered":"2024-09-14T11:15:21.067813+0000","last_unstale":"2024-09-14T11:58:56.751184+0000","last_undegraded":"2024-09-14T11:58:56.751184+0000","last_fullsized":"2024-09-14T11:58:56.751184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.751011+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:51.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053146499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'197","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.272150+0000","last_change":"2024-09-14T11:58:52.272045+0000","last_active":"2024-09-14T11:58:52.272150+0000","last_peered":"2024-09-14T11:58:52.272150+0000","last_clean":"2024-09-14T11:58:52.272150+0000","last_became_active":"2024-09-14T11:15:32.305983+0000","last_became_peered":"2024-09-14T11:15:32.305983+0000","last_unstale":"2024-09-14T11:58:52.272150+0000","last_undegraded":"2024-09-14T11:58:52.272150+0000","last_fullsized":"2024-09-14T11:58:52.272150+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:52.271906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.271906+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:15.088566+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":761,"num_read_kb":134470,"num_write":901,"num_write_kb":38143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.833801+0000","last_change":"2024-09-14T11:59:12.833801+0000","last_active":"2024-09-14T11:59:12.833801+0000","last_peered":"2024-09-14T11:59:12.833801+0000","last_clean":"2024-09-14T11:59:12.833801+0000","last_became_active":"2024-09-14T11:15:36.329190+0000","last_became_peered":"2024-09-14T11:15:36.329190+0000","last_unstale":"2024-09-14T11:59:12.833801+0000","last_undegraded":"2024-09-14T11:59:12.833801+0000","last_fullsized":"2024-09-14T11:59:12.833801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.833667+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.833667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:02.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'862","reported_seq":2317,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.614930+0000","last_change":"2024-09-14T11:59:13.614856+0000","last_active":"2024-09-14T11:59:13.614930+0000","last_peered":"2024-09-14T11:59:13.614930+0000","last_clean":"2024-09-14T11:59:13.614930+0000","last_became_active":"2024-09-14T11:15:38.335329+0000","last_became_peered":"2024-09-14T11:15:38.335329+0000","last_unstale":"2024-09-14T11:59:13.614930+0000","last_undegraded":"2024-09-14T11:59:13.614930+0000","last_fullsized":"2024-09-14T11:59:13.614930+0000","mapping_epoch":30,"log_start":"262'800","ondisk_log_start":"262'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'862","last_scrub_stamp":"2024-09-14T11:59:13.614752+0000","last_deep_scrub":"262'862","last_deep_scrub_stamp":"2024-09-14T11:59:13.614752+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.614752+0000","objects_scrubbed":11,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:53.390048+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34835,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1171,"num_read_kb":1364,"num_write":276,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.049133+0000","last_change":"2024-09-14T11:59:24.049072+0000","last_active":"2024-09-14T11:59:24.049133+0000","last_peered":"2024-09-14T11:59:24.049133+0000","last_clean":"2024-09-14T11:59:24.049133+0000","last_became_active":"2024-09-14T11:15:40.344466+0000","last_became_peered":"2024-09-14T11:15:40.344466+0000","last_unstale":"2024-09-14T11:59:24.049133+0000","last_undegraded":"2024-09-14T11:59:24.049133+0000","last_fullsized":"2024-09-14T11:59:24.049133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.048995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.048995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.048995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:26.759832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'101","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.469896+0000","last_change":"2024-09-14T11:59:21.469896+0000","last_active":"2024-09-14T11:59:21.469896+0000","last_peered":"2024-09-14T11:59:21.469896+0000","last_clean":"2024-09-14T11:59:21.469896+0000","last_became_active":"2024-09-14T11:15:42.346418+0000","last_became_peered":"2024-09-14T11:15:42.346418+0000","last_unstale":"2024-09-14T11:59:21.469896+0000","last_undegraded":"2024-09-14T11:59:21.469896+0000","last_fullsized":"2024-09-14T11:59:21.469896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'101","last_scrub_stamp":"2024-09-14T11:59:21.469788+0000","last_deep_scrub":"262'101","last_deep_scrub_stamp":"2024-09-14T11:59:21.469788+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.469788+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:00.182457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'540","reported_seq":2069,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.642068+0000","last_change":"2024-09-14T11:59:02.642068+0000","last_active":"2024-09-14T11:59:02.642068+0000","last_peered":"2024-09-14T11:59:02.642068+0000","last_clean":"2024-09-14T11:59:02.642068+0000","last_became_active":"2024-09-14T11:15:34.328656+0000","last_became_peered":"2024-09-14T11:15:34.328656+0000","last_unstale":"2024-09-14T11:59:02.642068+0000","last_undegraded":"2024-09-14T11:59:02.642068+0000","last_fullsized":"2024-09-14T11:59:02.642068+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:02.641963+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.641963+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:17.604167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2689,"num_read_kb":2462,"num_write":655,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.235879+0000","last_change":"2024-09-14T11:58:53.235819+0000","last_active":"2024-09-14T11:58:53.235879+0000","last_peered":"2024-09-14T11:58:53.235879+0000","last_clean":"2024-09-14T11:58:53.235879+0000","last_became_active":"2024-09-14T11:15:21.177192+0000","last_became_peered":"2024-09-14T11:15:21.177192+0000","last_unstale":"2024-09-14T11:58:53.235879+0000","last_undegraded":"2024-09-14T11:58:53.235879+0000","last_fullsized":"2024-09-14T11:58:53.235879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.235741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.235741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:53.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055021400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'177","reported_seq":779,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.608108+0000","last_change":"2024-09-14T11:58:54.608013+0000","last_active":"2024-09-14T11:58:54.608108+0000","last_peered":"2024-09-14T11:58:54.608108+0000","last_clean":"2024-09-14T11:58:54.608108+0000","last_became_active":"2024-09-14T11:15:32.308181+0000","last_became_peered":"2024-09-14T11:15:32.308181+0000","last_unstale":"2024-09-14T11:58:54.608108+0000","last_undegraded":"2024-09-14T11:58:54.608108+0000","last_fullsized":"2024-09-14T11:58:54.608108+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:58:54.607889+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.607889+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:25.551492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":396,"num_read_kb":27621,"num_write":841,"num_write_kb":26964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.323218+0000","last_change":"2024-09-14T11:59:08.323218+0000","last_active":"2024-09-14T11:59:08.323218+0000","last_peered":"2024-09-14T11:59:08.323218+0000","last_clean":"2024-09-14T11:59:08.323218+0000","last_became_active":"2024-09-14T11:15:36.321983+0000","last_became_peered":"2024-09-14T11:15:36.321983+0000","last_unstale":"2024-09-14T11:59:08.323218+0000","last_undegraded":"2024-09-14T11:59:08.323218+0000","last_fullsized":"2024-09-14T11:59:08.323218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:08.323133+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.323133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:08.984207+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'222","reported_seq":1284,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.974923+0000","last_change":"2024-09-14T11:59:17.974864+0000","last_active":"2024-09-14T11:59:17.974923+0000","last_peered":"2024-09-14T11:59:17.974923+0000","last_clean":"2024-09-14T11:59:17.974923+0000","last_became_active":"2024-09-14T11:15:38.338444+0000","last_became_peered":"2024-09-14T11:15:38.338444+0000","last_unstale":"2024-09-14T11:59:17.974923+0000","last_undegraded":"2024-09-14T11:59:17.974923+0000","last_fullsized":"2024-09-14T11:59:17.974923+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-14T11:59:17.974770+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-14T11:59:17.974770+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.974770+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:43.176252+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":177,"num_read_kb":168,"num_write":143,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.437525+0000","last_change":"2024-09-14T11:59:19.437398+0000","last_active":"2024-09-14T11:59:19.437525+0000","last_peered":"2024-09-14T11:59:19.437525+0000","last_clean":"2024-09-14T11:59:19.437525+0000","last_became_active":"2024-09-14T11:15:40.351087+0000","last_became_peered":"2024-09-14T11:15:40.351087+0000","last_unstale":"2024-09-14T11:59:19.437525+0000","last_undegraded":"2024-09-14T11:59:19.437525+0000","last_fullsized":"2024-09-14T11:59:19.437525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:19.437292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:19.437292+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.437292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:35.303402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'283","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.985762+0000","last_change":"2024-09-14T11:59:29.985762+0000","last_active":"2024-09-14T11:59:29.985762+0000","last_peered":"2024-09-14T11:59:29.985762+0000","last_clean":"2024-09-14T11:59:29.985762+0000","last_became_active":"2024-09-14T11:15:42.351076+0000","last_became_peered":"2024-09-14T11:15:42.351076+0000","last_unstale":"2024-09-14T11:59:29.985762+0000","last_undegraded":"2024-09-14T11:59:29.985762+0000","last_fullsized":"2024-09-14T11:59:29.985762+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'283","last_scrub_stamp":"2024-09-14T11:59:29.985661+0000","last_deep_scrub":"262'283","last_deep_scrub_stamp":"2024-09-14T11:59:29.985661+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.985661+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:10.995876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":524,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'558","reported_seq":2139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.639462+0000","last_change":"2024-09-14T11:59:01.639356+0000","last_active":"2024-09-14T11:59:01.639462+0000","last_peered":"2024-09-14T11:59:01.639462+0000","last_clean":"2024-09-14T11:59:01.639462+0000","last_became_active":"2024-09-14T11:15:34.326676+0000","last_became_peered":"2024-09-14T11:15:34.326676+0000","last_unstale":"2024-09-14T11:59:01.639462+0000","last_undegraded":"2024-09-14T11:59:01.639462+0000","last_fullsized":"2024-09-14T11:59:01.639462+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'558","last_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_deep_scrub":"262'558","last_deep_scrub_stamp":"2024-09-14T11:59:01.639211+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.639211+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:58.123592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2974,"num_read_kb":2716,"num_write":724,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":519,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.779905+0000","last_change":"2024-09-14T11:58:55.779846+0000","last_active":"2024-09-14T11:58:55.779905+0000","last_peered":"2024-09-14T11:58:55.779905+0000","last_clean":"2024-09-14T11:58:55.779905+0000","last_became_active":"2024-09-14T11:15:21.067560+0000","last_became_peered":"2024-09-14T11:15:21.067560+0000","last_unstale":"2024-09-14T11:58:55.779905+0000","last_undegraded":"2024-09-14T11:58:55.779905+0000","last_fullsized":"2024-09-14T11:58:55.779905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T11:58:55.779753+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.779753+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:41.730972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097076499999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'218","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.148995+0000","last_change":"2024-09-14T11:58:54.148939+0000","last_active":"2024-09-14T11:58:54.148995+0000","last_peered":"2024-09-14T11:58:54.148995+0000","last_clean":"2024-09-14T11:58:54.148995+0000","last_became_active":"2024-09-14T11:15:32.303464+0000","last_became_peered":"2024-09-14T11:15:32.303464+0000","last_unstale":"2024-09-14T11:58:54.148995+0000","last_undegraded":"2024-09-14T11:58:54.148995+0000","last_fullsized":"2024-09-14T11:58:54.148995+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:54.148824+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.148824+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:26.080263+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":21127,"num_write":1026,"num_write_kb":31938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.399101+0000","last_change":"2024-09-14T11:59:12.398988+0000","last_active":"2024-09-14T11:59:12.399101+0000","last_peered":"2024-09-14T11:59:12.399101+0000","last_clean":"2024-09-14T11:59:12.399101+0000","last_became_active":"2024-09-14T11:15:36.327617+0000","last_became_peered":"2024-09-14T11:15:36.327617+0000","last_unstale":"2024-09-14T11:59:12.399101+0000","last_undegraded":"2024-09-14T11:59:12.399101+0000","last_fullsized":"2024-09-14T11:59:12.399101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.398880+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.398880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.920892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'131","reported_seq":674,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.989487+0000","last_change":"2024-09-14T11:59:18.989487+0000","last_active":"2024-09-14T11:59:18.989487+0000","last_peered":"2024-09-14T11:59:18.989487+0000","last_clean":"2024-09-14T11:59:18.989487+0000","last_became_active":"2024-09-14T11:15:38.339964+0000","last_became_peered":"2024-09-14T11:15:38.339964+0000","last_unstale":"2024-09-14T11:59:18.989487+0000","last_undegraded":"2024-09-14T11:59:18.989487+0000","last_fullsized":"2024-09-14T11:59:18.989487+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'131","last_scrub_stamp":"2024-09-14T11:59:18.989375+0000","last_deep_scrub":"262'131","last_deep_scrub_stamp":"2024-09-14T11:59:18.989375+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.989375+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:46.747353+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":138,"num_write":108,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.128482+0000","last_change":"2024-09-14T11:59:12.128482+0000","last_active":"2024-09-14T11:59:12.128482+0000","last_peered":"2024-09-14T11:59:12.128482+0000","last_clean":"2024-09-14T11:59:12.128482+0000","last_became_active":"2024-09-14T11:15:40.343623+0000","last_became_peered":"2024-09-14T11:15:40.343623+0000","last_unstale":"2024-09-14T11:59:12.128482+0000","last_undegraded":"2024-09-14T11:59:12.128482+0000","last_fullsized":"2024-09-14T11:59:12.128482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.128387+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.128387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:35.793136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'168","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.854061+0000","last_change":"2024-09-14T11:59:25.854061+0000","last_active":"2024-09-14T11:59:25.854061+0000","last_peered":"2024-09-14T11:59:25.854061+0000","last_clean":"2024-09-14T11:59:25.854061+0000","last_became_active":"2024-09-14T11:15:42.351496+0000","last_became_peered":"2024-09-14T11:15:42.351496+0000","last_unstale":"2024-09-14T11:59:25.854061+0000","last_undegraded":"2024-09-14T11:59:25.854061+0000","last_fullsized":"2024-09-14T11:59:25.854061+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-14T11:59:25.853968+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-14T11:59:25.853968+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.853968+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:16.886940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":348,"num_read_kb":313,"num_write":345,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'893","reported_seq":2637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.605858+0000","last_change":"2024-09-14T11:59:00.605777+0000","last_active":"2024-09-14T11:59:00.605858+0000","last_peered":"2024-09-14T11:59:00.605858+0000","last_clean":"2024-09-14T11:59:00.605858+0000","last_became_active":"2024-09-14T11:15:34.330110+0000","last_became_peered":"2024-09-14T11:15:34.330110+0000","last_unstale":"2024-09-14T11:59:00.605858+0000","last_undegraded":"2024-09-14T11:59:00.605858+0000","last_fullsized":"2024-09-14T11:59:00.605858+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'893","last_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_deep_scrub":"262'893","last_deep_scrub_stamp":"2024-09-14T11:59:00.605689+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.605689+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":800,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:06.292394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3931,"num_write":1179,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'214","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.779435+0000","last_change":"2024-09-14T11:58:56.779368+0000","last_active":"2024-09-14T11:58:56.779435+0000","last_peered":"2024-09-14T11:58:56.779435+0000","last_clean":"2024-09-14T11:58:56.779435+0000","last_became_active":"2024-09-14T11:15:32.321708+0000","last_became_peered":"2024-09-14T11:15:32.321708+0000","last_unstale":"2024-09-14T11:58:56.779435+0000","last_undegraded":"2024-09-14T11:58:56.779435+0000","last_fullsized":"2024-09-14T11:58:56.779435+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'214","last_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_deep_scrub":"262'214","last_deep_scrub_stamp":"2024-09-14T11:58:56.779283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.779283+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:05.019231+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3146072,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":7241,"num_write":969,"num_write_kb":37670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.671249+0000","last_change":"2024-09-14T11:58:52.671195+0000","last_active":"2024-09-14T11:58:52.671249+0000","last_peered":"2024-09-14T11:58:52.671249+0000","last_clean":"2024-09-14T11:58:52.671249+0000","last_became_active":"2024-09-14T11:15:21.065761+0000","last_became_peered":"2024-09-14T11:15:21.065761+0000","last_unstale":"2024-09-14T11:58:52.671249+0000","last_undegraded":"2024-09-14T11:58:52.671249+0000","last_fullsized":"2024-09-14T11:58:52.671249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:52.671120+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.671120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:36.505369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059697999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.404792+0000","last_change":"2024-09-14T11:59:11.404674+0000","last_active":"2024-09-14T11:59:11.404792+0000","last_peered":"2024-09-14T11:59:11.404792+0000","last_clean":"2024-09-14T11:59:11.404792+0000","last_became_active":"2024-09-14T11:15:36.327240+0000","last_became_peered":"2024-09-14T11:15:36.327240+0000","last_unstale":"2024-09-14T11:59:11.404792+0000","last_undegraded":"2024-09-14T11:59:11.404792+0000","last_fullsized":"2024-09-14T11:59:11.404792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.404575+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.404575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:53.428957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'278","reported_seq":937,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.375942+0000","last_change":"2024-09-14T11:59:15.375871+0000","last_active":"2024-09-14T11:59:15.375942+0000","last_peered":"2024-09-14T11:59:15.375942+0000","last_clean":"2024-09-14T11:59:15.375942+0000","last_became_active":"2024-09-14T11:15:38.332885+0000","last_became_peered":"2024-09-14T11:15:38.332885+0000","last_unstale":"2024-09-14T11:59:15.375942+0000","last_undegraded":"2024-09-14T11:59:15.375942+0000","last_fullsized":"2024-09-14T11:59:15.375942+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'278","last_scrub_stamp":"2024-09-14T11:59:15.375762+0000","last_deep_scrub":"262'278","last_deep_scrub_stamp":"2024-09-14T11:59:15.375762+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.375762+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:58.310749+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16117,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":365,"num_read_kb":486,"num_write":204,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.010139+0000","last_change":"2024-09-14T11:59:24.010050+0000","last_active":"2024-09-14T11:59:24.010139+0000","last_peered":"2024-09-14T11:59:24.010139+0000","last_clean":"2024-09-14T11:59:24.010139+0000","last_became_active":"2024-09-14T11:15:40.348517+0000","last_became_peered":"2024-09-14T11:15:40.348517+0000","last_unstale":"2024-09-14T11:59:24.010139+0000","last_undegraded":"2024-09-14T11:59:24.010139+0000","last_fullsized":"2024-09-14T11:59:24.010139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.009956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.009956+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.009956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:37.498313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'174","reported_seq":671,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.614163+0000","last_change":"2024-09-14T11:59:35.614163+0000","last_active":"2024-09-14T11:59:35.614163+0000","last_peered":"2024-09-14T11:59:35.614163+0000","last_clean":"2024-09-14T11:59:35.614163+0000","last_became_active":"2024-09-14T11:15:42.354076+0000","last_became_peered":"2024-09-14T11:15:42.354076+0000","last_unstale":"2024-09-14T11:59:35.614163+0000","last_undegraded":"2024-09-14T11:59:35.614163+0000","last_fullsized":"2024-09-14T11:59:35.614163+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'174","last_scrub_stamp":"2024-09-14T11:59:35.614051+0000","last_deep_scrub":"262'174","last_deep_scrub_stamp":"2024-09-14T11:59:35.614051+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.614051+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:29.097052+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":146,"num_write":405,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'774","reported_seq":2195,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.277548+0000","last_change":"2024-09-14T11:59:02.277485+0000","last_active":"2024-09-14T11:59:02.277548+0000","last_peered":"2024-09-14T11:59:02.277548+0000","last_clean":"2024-09-14T11:59:02.277548+0000","last_became_active":"2024-09-14T11:15:34.328069+0000","last_became_peered":"2024-09-14T11:15:34.328069+0000","last_unstale":"2024-09-14T11:59:02.277548+0000","last_undegraded":"2024-09-14T11:59:02.277548+0000","last_fullsized":"2024-09-14T11:59:02.277548+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'774","last_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_deep_scrub":"262'774","last_deep_scrub_stamp":"2024-09-14T11:59:02.277389+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.277389+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:34.730626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3295,"num_write":1051,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'268","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.656930+0000","last_change":"2024-09-14T11:58:55.656880+0000","last_active":"2024-09-14T11:58:55.656930+0000","last_peered":"2024-09-14T11:58:55.656930+0000","last_clean":"2024-09-14T11:58:55.656930+0000","last_became_active":"2024-09-14T11:15:32.309628+0000","last_became_peered":"2024-09-14T11:15:32.309628+0000","last_unstale":"2024-09-14T11:58:55.656930+0000","last_undegraded":"2024-09-14T11:58:55.656930+0000","last_fullsized":"2024-09-14T11:58:55.656930+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'268","last_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_deep_scrub":"262'268","last_deep_scrub_stamp":"2024-09-14T11:58:55.656804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.656804+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.470057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":40043,"num_write":1045,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.713853+0000","last_change":"2024-09-14T11:58:55.713779+0000","last_active":"2024-09-14T11:58:55.713853+0000","last_peered":"2024-09-14T11:58:55.713853+0000","last_clean":"2024-09-14T11:58:55.713853+0000","last_became_active":"2024-09-14T11:15:21.066338+0000","last_became_peered":"2024-09-14T11:15:21.066338+0000","last_unstale":"2024-09-14T11:58:55.713853+0000","last_undegraded":"2024-09-14T11:58:55.713853+0000","last_fullsized":"2024-09-14T11:58:55.713853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.713672+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.713672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:50.890524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047525900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"262'5","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.148314+0000","last_change":"2024-09-14T11:59:08.148251+0000","last_active":"2024-09-14T11:59:08.148314+0000","last_peered":"2024-09-14T11:59:08.148314+0000","last_clean":"2024-09-14T11:59:08.148314+0000","last_became_active":"2024-09-14T11:15:36.327616+0000","last_became_peered":"2024-09-14T11:15:36.327616+0000","last_unstale":"2024-09-14T11:59:08.148314+0000","last_undegraded":"2024-09-14T11:59:08.148314+0000","last_fullsized":"2024-09-14T11:59:08.148314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T11:59:08.148173+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.148173+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:01.374450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'175","reported_seq":740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.609529+0000","last_change":"2024-09-14T11:59:12.609466+0000","last_active":"2024-09-14T11:59:12.609529+0000","last_peered":"2024-09-14T11:59:12.609529+0000","last_clean":"2024-09-14T11:59:12.609529+0000","last_became_active":"2024-09-14T11:15:38.327056+0000","last_became_peered":"2024-09-14T11:15:38.327056+0000","last_unstale":"2024-09-14T11:59:12.609529+0000","last_undegraded":"2024-09-14T11:59:12.609529+0000","last_fullsized":"2024-09-14T11:59:12.609529+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'175","last_scrub_stamp":"2024-09-14T11:59:12.609349+0000","last_deep_scrub":"262'175","last_deep_scrub_stamp":"2024-09-14T11:59:12.609349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.609349+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:57.156455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":213,"num_write":180,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'800","reported_seq":4709,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.850116+0000","last_change":"2024-09-14T11:59:21.850044+0000","last_active":"2024-09-14T11:59:21.850116+0000","last_peered":"2024-09-14T11:59:21.850116+0000","last_clean":"2024-09-14T11:59:21.850116+0000","last_became_active":"2024-09-14T11:15:40.336828+0000","last_became_peered":"2024-09-14T11:15:40.336828+0000","last_unstale":"2024-09-14T11:59:21.850116+0000","last_undegraded":"2024-09-14T11:59:21.850116+0000","last_fullsized":"2024-09-14T11:59:21.850116+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'800","last_scrub_stamp":"2024-09-14T11:59:21.849956+0000","last_deep_scrub":"262'800","last_deep_scrub_stamp":"2024-09-14T11:59:21.849956+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.849956+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:50.151179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'134","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.987423+0000","last_change":"2024-09-14T11:59:30.987423+0000","last_active":"2024-09-14T11:59:30.987423+0000","last_peered":"2024-09-14T11:59:30.987423+0000","last_clean":"2024-09-14T11:59:30.987423+0000","last_became_active":"2024-09-14T11:15:42.348888+0000","last_became_peered":"2024-09-14T11:15:42.348888+0000","last_unstale":"2024-09-14T11:59:30.987423+0000","last_undegraded":"2024-09-14T11:59:30.987423+0000","last_fullsized":"2024-09-14T11:59:30.987423+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-14T11:59:30.987323+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-14T11:59:30.987323+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.987323+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:35.943996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":180,"num_write":367,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'892","reported_seq":2481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.989934+0000","last_change":"2024-09-14T11:59:10.989877+0000","last_active":"2024-09-14T11:59:10.989934+0000","last_peered":"2024-09-14T11:59:10.989934+0000","last_clean":"2024-09-14T11:59:10.989934+0000","last_became_active":"2024-09-14T11:15:34.333758+0000","last_became_peered":"2024-09-14T11:15:34.333758+0000","last_unstale":"2024-09-14T11:59:10.989934+0000","last_undegraded":"2024-09-14T11:59:10.989934+0000","last_fullsized":"2024-09-14T11:59:10.989934+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'892","last_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_deep_scrub":"262'892","last_deep_scrub_stamp":"2024-09-14T11:59:10.989791+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.989791+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:39.808429+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4254,"num_read_kb":3802,"num_write":1232,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'247","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.849696+0000","last_change":"2024-09-14T11:58:54.849696+0000","last_active":"2024-09-14T11:58:54.849696+0000","last_peered":"2024-09-14T11:58:54.849696+0000","last_clean":"2024-09-14T11:58:54.849696+0000","last_became_active":"2024-09-14T11:15:32.315376+0000","last_became_peered":"2024-09-14T11:15:32.315376+0000","last_unstale":"2024-09-14T11:58:54.849696+0000","last_undegraded":"2024-09-14T11:58:54.849696+0000","last_fullsized":"2024-09-14T11:58:54.849696+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:54.849617+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.849617+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:59.404448+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460231,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":25317,"num_write":1130,"num_write_kb":50497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.648824+0000","last_change":"2024-09-14T11:58:53.648824+0000","last_active":"2024-09-14T11:58:53.648824+0000","last_peered":"2024-09-14T11:58:53.648824+0000","last_clean":"2024-09-14T11:58:53.648824+0000","last_became_active":"2024-09-14T11:15:21.066518+0000","last_became_peered":"2024-09-14T11:15:21.066518+0000","last_unstale":"2024-09-14T11:58:53.648824+0000","last_undegraded":"2024-09-14T11:58:53.648824+0000","last_fullsized":"2024-09-14T11:58:53.648824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:53.648747+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.648747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:10.973858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055630299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.094595+0000","last_change":"2024-09-14T11:59:15.094514+0000","last_active":"2024-09-14T11:59:15.094595+0000","last_peered":"2024-09-14T11:59:15.094595+0000","last_clean":"2024-09-14T11:59:15.094595+0000","last_became_active":"2024-09-14T11:15:36.330632+0000","last_became_peered":"2024-09-14T11:15:36.330632+0000","last_unstale":"2024-09-14T11:59:15.094595+0000","last_undegraded":"2024-09-14T11:59:15.094595+0000","last_fullsized":"2024-09-14T11:59:15.094595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.094426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.094426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.094426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:27.096812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'117","reported_seq":653,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.038533+0000","last_change":"2024-09-14T11:59:18.038476+0000","last_active":"2024-09-14T11:59:18.038533+0000","last_peered":"2024-09-14T11:59:18.038533+0000","last_clean":"2024-09-14T11:59:18.038533+0000","last_became_active":"2024-09-14T11:15:38.336759+0000","last_became_peered":"2024-09-14T11:15:38.336759+0000","last_unstale":"2024-09-14T11:59:18.038533+0000","last_undegraded":"2024-09-14T11:59:18.038533+0000","last_fullsized":"2024-09-14T11:59:18.038533+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-14T11:59:18.038350+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-14T11:59:18.038350+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.038350+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.051109+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":88,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'813","reported_seq":2440,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.969645+0000","last_change":"2024-09-14T11:59:25.969585+0000","last_active":"2024-09-14T11:59:25.969645+0000","last_peered":"2024-09-14T11:59:25.969645+0000","last_clean":"2024-09-14T11:59:25.969645+0000","last_became_active":"2024-09-14T11:15:40.353530+0000","last_became_peered":"2024-09-14T11:15:40.353530+0000","last_unstale":"2024-09-14T11:59:25.969645+0000","last_undegraded":"2024-09-14T11:59:25.969645+0000","last_fullsized":"2024-09-14T11:59:25.969645+0000","mapping_epoch":32,"log_start":"262'800","ondisk_log_start":"262'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'813","last_scrub_stamp":"2024-09-14T11:59:25.969495+0000","last_deep_scrub":"262'813","last_deep_scrub_stamp":"2024-09-14T11:59:25.969495+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.969495+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:30.507066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'287","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.424508+0000","last_change":"2024-09-14T11:59:26.424508+0000","last_active":"2024-09-14T11:59:26.424508+0000","last_peered":"2024-09-14T11:59:26.424508+0000","last_clean":"2024-09-14T11:59:26.424508+0000","last_became_active":"2024-09-14T11:15:42.348323+0000","last_became_peered":"2024-09-14T11:15:42.348323+0000","last_unstale":"2024-09-14T11:59:26.424508+0000","last_undegraded":"2024-09-14T11:59:26.424508+0000","last_fullsized":"2024-09-14T11:59:26.424508+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'287","last_scrub_stamp":"2024-09-14T11:59:26.424403+0000","last_deep_scrub":"262'287","last_deep_scrub_stamp":"2024-09-14T11:59:26.424403+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.424403+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:31.538298+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":393,"num_read_kb":378,"num_write":611,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'405","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.182110+0000","last_change":"2024-09-14T11:58:59.182039+0000","last_active":"2024-09-14T11:58:59.182110+0000","last_peered":"2024-09-14T11:58:59.182110+0000","last_clean":"2024-09-14T11:58:59.182110+0000","last_became_active":"2024-09-14T11:15:34.326715+0000","last_became_peered":"2024-09-14T11:15:34.326715+0000","last_unstale":"2024-09-14T11:58:59.182110+0000","last_undegraded":"2024-09-14T11:58:59.182110+0000","last_fullsized":"2024-09-14T11:58:59.182110+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'405","last_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_deep_scrub":"262'405","last_deep_scrub_stamp":"2024-09-14T11:58:59.181953+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.181953+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:02.301110+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2129,"num_read_kb":2042,"num_write":435,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'220","reported_seq":847,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.306793+0000","last_change":"2024-09-14T11:58:53.306687+0000","last_active":"2024-09-14T11:58:53.306793+0000","last_peered":"2024-09-14T11:58:53.306793+0000","last_clean":"2024-09-14T11:58:53.306793+0000","last_became_active":"2024-09-14T11:15:32.314318+0000","last_became_peered":"2024-09-14T11:15:32.314318+0000","last_unstale":"2024-09-14T11:58:53.306793+0000","last_undegraded":"2024-09-14T11:58:53.306793+0000","last_fullsized":"2024-09-14T11:58:53.306793+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-14T11:58:53.306580+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.306580+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.561679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":11363,"num_write":1017,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.267522+0000","last_change":"2024-09-14T11:58:55.267522+0000","last_active":"2024-09-14T11:58:55.267522+0000","last_peered":"2024-09-14T11:58:55.267522+0000","last_clean":"2024-09-14T11:58:55.267522+0000","last_became_active":"2024-09-14T11:15:21.066539+0000","last_became_peered":"2024-09-14T11:15:21.066539+0000","last_unstale":"2024-09-14T11:58:55.267522+0000","last_undegraded":"2024-09-14T11:58:55.267522+0000","last_fullsized":"2024-09-14T11:58:55.267522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.267441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.267441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:53.067234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053013500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.911560+0000","last_change":"2024-09-14T11:59:13.911455+0000","last_active":"2024-09-14T11:59:13.911560+0000","last_peered":"2024-09-14T11:59:13.911560+0000","last_clean":"2024-09-14T11:59:13.911560+0000","last_became_active":"2024-09-14T11:15:36.330772+0000","last_became_peered":"2024-09-14T11:15:36.330772+0000","last_unstale":"2024-09-14T11:59:13.911560+0000","last_undegraded":"2024-09-14T11:59:13.911560+0000","last_fullsized":"2024-09-14T11:59:13.911560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.911349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.911349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.911349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:57.497967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'312","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.958336+0000","last_change":"2024-09-14T11:59:15.958245+0000","last_active":"2024-09-14T11:59:15.958336+0000","last_peered":"2024-09-14T11:59:15.958336+0000","last_clean":"2024-09-14T11:59:15.958336+0000","last_became_active":"2024-09-14T11:15:38.337040+0000","last_became_peered":"2024-09-14T11:15:38.337040+0000","last_unstale":"2024-09-14T11:59:15.958336+0000","last_undegraded":"2024-09-14T11:59:15.958336+0000","last_fullsized":"2024-09-14T11:59:15.958336+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'312","last_scrub_stamp":"2024-09-14T11:59:15.958147+0000","last_deep_scrub":"262'312","last_deep_scrub_stamp":"2024-09-14T11:59:15.958147+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.958147+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:20.078226+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":677,"num_write":230,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.940845+0000","last_change":"2024-09-14T11:59:26.940781+0000","last_active":"2024-09-14T11:59:26.940845+0000","last_peered":"2024-09-14T11:59:26.940845+0000","last_clean":"2024-09-14T11:59:26.940845+0000","last_became_active":"2024-09-14T11:15:40.348990+0000","last_became_peered":"2024-09-14T11:15:40.348990+0000","last_unstale":"2024-09-14T11:59:26.940845+0000","last_undegraded":"2024-09-14T11:59:26.940845+0000","last_fullsized":"2024-09-14T11:59:26.940845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:26.940679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:26.940679+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.940679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:03.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'138","reported_seq":629,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.818284+0000","last_change":"2024-09-14T11:59:26.818284+0000","last_active":"2024-09-14T11:59:26.818284+0000","last_peered":"2024-09-14T11:59:26.818284+0000","last_clean":"2024-09-14T11:59:26.818284+0000","last_became_active":"2024-09-14T11:15:42.351463+0000","last_became_peered":"2024-09-14T11:15:42.351463+0000","last_unstale":"2024-09-14T11:59:26.818284+0000","last_undegraded":"2024-09-14T11:59:26.818284+0000","last_fullsized":"2024-09-14T11:59:26.818284+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'138","last_scrub_stamp":"2024-09-14T11:59:26.818190+0000","last_deep_scrub":"262'138","last_deep_scrub_stamp":"2024-09-14T11:59:26.818190+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.818190+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:40.337971+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":830,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":345,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'147","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.573600+0000","last_change":"2024-09-14T11:59:30.573600+0000","last_active":"2024-09-14T11:59:30.573600+0000","last_peered":"2024-09-14T11:59:30.573600+0000","last_clean":"2024-09-14T11:59:30.573600+0000","last_became_active":"2024-09-14T11:15:42.348010+0000","last_became_peered":"2024-09-14T11:15:42.348010+0000","last_unstale":"2024-09-14T11:59:30.573600+0000","last_undegraded":"2024-09-14T11:59:30.573600+0000","last_fullsized":"2024-09-14T11:59:30.573600+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-14T11:59:30.573508+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-14T11:59:30.573508+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.573508+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:59.632163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":203,"num_write":323,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'566","reported_seq":2437,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.169676+0000","last_change":"2024-09-14T11:59:04.169611+0000","last_active":"2024-09-14T11:59:04.169676+0000","last_peered":"2024-09-14T11:59:04.169676+0000","last_clean":"2024-09-14T11:59:04.169676+0000","last_became_active":"2024-09-14T11:15:34.318852+0000","last_became_peered":"2024-09-14T11:15:34.318852+0000","last_unstale":"2024-09-14T11:59:04.169676+0000","last_undegraded":"2024-09-14T11:59:04.169676+0000","last_fullsized":"2024-09-14T11:59:04.169676+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'566","last_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_deep_scrub":"262'566","last_deep_scrub_stamp":"2024-09-14T11:59:04.169517+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.169517+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:42.390726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3330,"num_read_kb":3132,"num_write":678,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'204","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.091206+0000","last_change":"2024-09-14T11:58:57.091134+0000","last_active":"2024-09-14T11:58:57.091206+0000","last_peered":"2024-09-14T11:58:57.091206+0000","last_clean":"2024-09-14T11:58:57.091206+0000","last_became_active":"2024-09-14T11:15:32.311463+0000","last_became_peered":"2024-09-14T11:15:32.311463+0000","last_unstale":"2024-09-14T11:58:57.091206+0000","last_undegraded":"2024-09-14T11:58:57.091206+0000","last_fullsized":"2024-09-14T11:58:57.091206+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.091049+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.091049+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:22.628478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":511,"num_read_kb":19870,"num_write":904,"num_write_kb":28874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.621566+0000","last_change":"2024-09-14T11:59:09.621484+0000","last_active":"2024-09-14T11:59:09.621566+0000","last_peered":"2024-09-14T11:59:09.621566+0000","last_clean":"2024-09-14T11:59:09.621566+0000","last_became_active":"2024-09-14T11:15:36.334601+0000","last_became_peered":"2024-09-14T11:15:36.334601+0000","last_unstale":"2024-09-14T11:59:09.621566+0000","last_undegraded":"2024-09-14T11:59:09.621566+0000","last_fullsized":"2024-09-14T11:59:09.621566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.621385+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.621385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:21.637776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'162","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.015910+0000","last_change":"2024-09-14T11:59:21.015768+0000","last_active":"2024-09-14T11:59:21.015910+0000","last_peered":"2024-09-14T11:59:21.015910+0000","last_clean":"2024-09-14T11:59:21.015910+0000","last_became_active":"2024-09-14T11:15:38.334388+0000","last_became_peered":"2024-09-14T11:15:38.334388+0000","last_unstale":"2024-09-14T11:59:21.015910+0000","last_undegraded":"2024-09-14T11:59:21.015910+0000","last_fullsized":"2024-09-14T11:59:21.015910+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-14T11:59:21.015653+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-14T11:59:21.015653+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.015653+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:32.632601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":194,"num_read_kb":267,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.981461+0000","last_change":"2024-09-14T11:59:28.981394+0000","last_active":"2024-09-14T11:59:28.981461+0000","last_peered":"2024-09-14T11:59:28.981461+0000","last_clean":"2024-09-14T11:59:28.981461+0000","last_became_active":"2024-09-14T11:15:40.348091+0000","last_became_peered":"2024-09-14T11:15:40.348091+0000","last_unstale":"2024-09-14T11:59:28.981461+0000","last_undegraded":"2024-09-14T11:59:28.981461+0000","last_fullsized":"2024-09-14T11:59:28.981461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:28.981308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:28.981308+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.981308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:52.423936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'157","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.997195+0000","last_change":"2024-09-14T11:59:35.997065+0000","last_active":"2024-09-14T11:59:35.997195+0000","last_peered":"2024-09-14T11:59:35.997195+0000","last_clean":"2024-09-14T11:59:35.997195+0000","last_became_active":"2024-09-14T11:15:42.351506+0000","last_became_peered":"2024-09-14T11:15:42.351506+0000","last_unstale":"2024-09-14T11:59:35.997195+0000","last_undegraded":"2024-09-14T11:59:35.997195+0000","last_fullsized":"2024-09-14T11:59:35.997195+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'157","last_scrub_stamp":"2024-09-14T11:59:35.996972+0000","last_deep_scrub":"262'157","last_deep_scrub_stamp":"2024-09-14T11:59:35.996972+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.996972+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:51.564966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":327,"num_read_kb":275,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'1372","reported_seq":3016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.656428+0000","last_change":"2024-09-14T11:59:06.656353+0000","last_active":"2024-09-14T11:59:06.656428+0000","last_peered":"2024-09-14T11:59:06.656428+0000","last_clean":"2024-09-14T11:59:06.656428+0000","last_became_active":"2024-09-14T11:15:34.329532+0000","last_became_peered":"2024-09-14T11:15:34.329532+0000","last_unstale":"2024-09-14T11:59:06.656428+0000","last_undegraded":"2024-09-14T11:59:06.656428+0000","last_fullsized":"2024-09-14T11:59:06.656428+0000","mapping_epoch":26,"log_start":"262'1300","ondisk_log_start":"262'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1372","last_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_deep_scrub":"262'1372","last_deep_scrub_stamp":"2024-09-14T11:59:06.656260+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.656260+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":1300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:59.071627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6224,"num_read_kb":5414,"num_write":1940,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'177","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.826463+0000","last_change":"2024-09-14T11:59:02.826361+0000","last_active":"2024-09-14T11:59:02.826463+0000","last_peered":"2024-09-14T11:59:02.826463+0000","last_clean":"2024-09-14T11:59:02.826463+0000","last_became_active":"2024-09-14T11:15:32.321247+0000","last_became_peered":"2024-09-14T11:15:32.321247+0000","last_unstale":"2024-09-14T11:59:02.826463+0000","last_undegraded":"2024-09-14T11:59:02.826463+0000","last_fullsized":"2024-09-14T11:59:02.826463+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'177","last_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_deep_scrub":"262'177","last_deep_scrub_stamp":"2024-09-14T11:59:02.826225+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.826225+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:54.230672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":363,"num_read_kb":34037,"num_write":744,"num_write_kb":49129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.913502+0000","last_change":"2024-09-14T11:59:16.913452+0000","last_active":"2024-09-14T11:59:16.913502+0000","last_peered":"2024-09-14T11:59:16.913502+0000","last_clean":"2024-09-14T11:59:16.913502+0000","last_became_active":"2024-09-14T11:15:36.330593+0000","last_became_peered":"2024-09-14T11:15:36.330593+0000","last_unstale":"2024-09-14T11:59:16.913502+0000","last_undegraded":"2024-09-14T11:59:16.913502+0000","last_fullsized":"2024-09-14T11:59:16.913502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.913365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.913365+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.913365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:59.099290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'46","reported_seq":546,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.402891+0000","last_change":"2024-09-14T11:59:16.402834+0000","last_active":"2024-09-14T11:59:16.402891+0000","last_peered":"2024-09-14T11:59:16.402891+0000","last_clean":"2024-09-14T11:59:16.402891+0000","last_became_active":"2024-09-14T11:15:38.332052+0000","last_became_peered":"2024-09-14T11:15:38.332052+0000","last_unstale":"2024-09-14T11:59:16.402891+0000","last_undegraded":"2024-09-14T11:59:16.402891+0000","last_fullsized":"2024-09-14T11:59:16.402891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-14T11:59:16.402762+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-14T11:59:16.402762+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.402762+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:11.461190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.050510+0000","last_change":"2024-09-14T11:59:23.050407+0000","last_active":"2024-09-14T11:59:23.050510+0000","last_peered":"2024-09-14T11:59:23.050510+0000","last_clean":"2024-09-14T11:59:23.050510+0000","last_became_active":"2024-09-14T11:15:40.343912+0000","last_became_peered":"2024-09-14T11:15:40.343912+0000","last_unstale":"2024-09-14T11:59:23.050510+0000","last_undegraded":"2024-09-14T11:59:23.050510+0000","last_fullsized":"2024-09-14T11:59:23.050510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.050311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.050311+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.050311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:36.878476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'217","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.543879+0000","last_change":"2024-09-14T11:59:29.543879+0000","last_active":"2024-09-14T11:59:29.543879+0000","last_peered":"2024-09-14T11:59:29.543879+0000","last_clean":"2024-09-14T11:59:29.543879+0000","last_became_active":"2024-09-14T11:15:42.348414+0000","last_became_peered":"2024-09-14T11:15:42.348414+0000","last_unstale":"2024-09-14T11:59:29.543879+0000","last_undegraded":"2024-09-14T11:59:29.543879+0000","last_fullsized":"2024-09-14T11:59:29.543879+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:29.543784+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:29.543784+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.543784+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:15.150493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":314,"num_read_kb":304,"num_write":459,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'457","reported_seq":2000,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.857974+0000","last_change":"2024-09-14T11:59:03.857852+0000","last_active":"2024-09-14T11:59:03.857974+0000","last_peered":"2024-09-14T11:59:03.857974+0000","last_clean":"2024-09-14T11:59:03.857974+0000","last_became_active":"2024-09-14T11:15:34.321764+0000","last_became_peered":"2024-09-14T11:15:34.321764+0000","last_unstale":"2024-09-14T11:59:03.857974+0000","last_undegraded":"2024-09-14T11:59:03.857974+0000","last_fullsized":"2024-09-14T11:59:03.857974+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'457","last_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_deep_scrub":"262'457","last_deep_scrub_stamp":"2024-09-14T11:59:03.857750+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.857750+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:10.626306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2377,"num_read_kb":2229,"num_write":531,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'357","reported_seq":1010,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.206349+0000","last_change":"2024-09-14T11:59:23.206298+0000","last_active":"2024-09-14T11:59:23.206349+0000","last_peered":"2024-09-14T11:59:23.206349+0000","last_clean":"2024-09-14T11:59:23.206349+0000","last_became_active":"2024-09-14T11:16:07.496944+0000","last_became_peered":"2024-09-14T11:16:07.496944+0000","last_unstale":"2024-09-14T11:59:23.206349+0000","last_undegraded":"2024-09-14T11:59:23.206349+0000","last_fullsized":"2024-09-14T11:59:23.206349+0000","mapping_epoch":37,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'357","last_scrub_stamp":"2024-09-14T11:59:23.206216+0000","last_deep_scrub":"262'357","last_deep_scrub_stamp":"2024-09-14T11:59:23.206216+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.206216+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:29.712357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":986,"num_read_kb":18905,"num_write":1307,"num_write_kb":47640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.991561+0000","last_change":"2024-09-14T11:59:14.991490+0000","last_active":"2024-09-14T11:59:14.991561+0000","last_peered":"2024-09-14T11:59:14.991561+0000","last_clean":"2024-09-14T11:59:14.991561+0000","last_became_active":"2024-09-14T11:15:36.338803+0000","last_became_peered":"2024-09-14T11:15:36.338803+0000","last_unstale":"2024-09-14T11:59:14.991561+0000","last_undegraded":"2024-09-14T11:59:14.991561+0000","last_fullsized":"2024-09-14T11:59:14.991561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.991406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.991406+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.991406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.178425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'164","reported_seq":756,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.010455+0000","last_change":"2024-09-14T11:59:23.010383+0000","last_active":"2024-09-14T11:59:23.010455+0000","last_peered":"2024-09-14T11:59:23.010455+0000","last_clean":"2024-09-14T11:59:23.010455+0000","last_became_active":"2024-09-14T11:15:38.334290+0000","last_became_peered":"2024-09-14T11:15:38.334290+0000","last_unstale":"2024-09-14T11:59:23.010455+0000","last_undegraded":"2024-09-14T11:59:23.010455+0000","last_fullsized":"2024-09-14T11:59:23.010455+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'164","last_scrub_stamp":"2024-09-14T11:59:23.010289+0000","last_deep_scrub":"262'164","last_deep_scrub_stamp":"2024-09-14T11:59:23.010289+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.010289+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:06.750831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":270,"num_write":114,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.138394+0000","last_change":"2024-09-14T11:59:14.138330+0000","last_active":"2024-09-14T11:59:14.138394+0000","last_peered":"2024-09-14T11:59:14.138394+0000","last_clean":"2024-09-14T11:59:14.138394+0000","last_became_active":"2024-09-14T11:15:40.342420+0000","last_became_peered":"2024-09-14T11:15:40.342420+0000","last_unstale":"2024-09-14T11:59:14.138394+0000","last_undegraded":"2024-09-14T11:59:14.138394+0000","last_fullsized":"2024-09-14T11:59:14.138394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.138251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.138251+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.138251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:56.076443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'117","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.929825+0000","last_change":"2024-09-14T11:59:29.929825+0000","last_active":"2024-09-14T11:59:29.929825+0000","last_peered":"2024-09-14T11:59:29.929825+0000","last_clean":"2024-09-14T11:59:29.929825+0000","last_became_active":"2024-09-14T11:15:42.348591+0000","last_became_peered":"2024-09-14T11:15:42.348591+0000","last_unstale":"2024-09-14T11:59:29.929825+0000","last_undegraded":"2024-09-14T11:59:29.929825+0000","last_fullsized":"2024-09-14T11:59:29.929825+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-14T11:59:29.929714+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-14T11:59:29.929714+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.929714+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:47.615152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'812","reported_seq":2491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.010485+0000","last_change":"2024-09-14T11:59:12.010369+0000","last_active":"2024-09-14T11:59:12.010485+0000","last_peered":"2024-09-14T11:59:12.010485+0000","last_clean":"2024-09-14T11:59:12.010485+0000","last_became_active":"2024-09-14T11:15:34.332565+0000","last_became_peered":"2024-09-14T11:15:34.332565+0000","last_unstale":"2024-09-14T11:59:12.010485+0000","last_undegraded":"2024-09-14T11:59:12.010485+0000","last_fullsized":"2024-09-14T11:59:12.010485+0000","mapping_epoch":26,"log_start":"262'801","ondisk_log_start":"262'801","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'812","last_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_deep_scrub":"262'812","last_deep_scrub_stamp":"2024-09-14T11:59:12.010264+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.010264+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:55.948418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4104,"num_read_kb":3732,"num_write":1074,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'266","reported_seq":880,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.277392+0000","last_change":"2024-09-14T11:58:55.277324+0000","last_active":"2024-09-14T11:58:55.277392+0000","last_peered":"2024-09-14T11:58:55.277392+0000","last_clean":"2024-09-14T11:58:55.277392+0000","last_became_active":"2024-09-14T11:15:32.313265+0000","last_became_peered":"2024-09-14T11:15:32.313265+0000","last_unstale":"2024-09-14T11:58:55.277392+0000","last_undegraded":"2024-09-14T11:58:55.277392+0000","last_fullsized":"2024-09-14T11:58:55.277392+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'266","last_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_deep_scrub":"262'266","last_deep_scrub_stamp":"2024-09-14T11:58:55.277222+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.277222+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:42.232250+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730159,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":14443,"num_write":1155,"num_write_kb":60214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.121793+0000","last_change":"2024-09-14T11:59:10.121731+0000","last_active":"2024-09-14T11:59:10.121793+0000","last_peered":"2024-09-14T11:59:10.121793+0000","last_clean":"2024-09-14T11:59:10.121793+0000","last_became_active":"2024-09-14T11:15:36.330469+0000","last_became_peered":"2024-09-14T11:15:36.330469+0000","last_unstale":"2024-09-14T11:59:10.121793+0000","last_undegraded":"2024-09-14T11:59:10.121793+0000","last_fullsized":"2024-09-14T11:59:10.121793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.121629+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.121629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:35.666450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'140","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.942449+0000","last_change":"2024-09-14T11:59:19.942378+0000","last_active":"2024-09-14T11:59:19.942449+0000","last_peered":"2024-09-14T11:59:19.942449+0000","last_clean":"2024-09-14T11:59:19.942449+0000","last_became_active":"2024-09-14T11:15:38.338404+0000","last_became_peered":"2024-09-14T11:15:38.338404+0000","last_unstale":"2024-09-14T11:59:19.942449+0000","last_undegraded":"2024-09-14T11:59:19.942449+0000","last_fullsized":"2024-09-14T11:59:19.942449+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-14T11:59:19.942291+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-14T11:59:19.942291+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.942291+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:17.318683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44743,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":353,"num_write":106,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.437873+0000","last_change":"2024-09-14T11:59:23.437817+0000","last_active":"2024-09-14T11:59:23.437873+0000","last_peered":"2024-09-14T11:59:23.437873+0000","last_clean":"2024-09-14T11:59:23.437873+0000","last_became_active":"2024-09-14T11:15:40.351544+0000","last_became_peered":"2024-09-14T11:15:40.351544+0000","last_unstale":"2024-09-14T11:59:23.437873+0000","last_undegraded":"2024-09-14T11:59:23.437873+0000","last_fullsized":"2024-09-14T11:59:23.437873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.437727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.437727+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.437727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:36.382250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'852","reported_seq":2480,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.204861+0000","last_change":"2024-09-14T11:59:05.204800+0000","last_active":"2024-09-14T11:59:05.204861+0000","last_peered":"2024-09-14T11:59:05.204861+0000","last_clean":"2024-09-14T11:59:05.204861+0000","last_became_active":"2024-09-14T11:15:34.326702+0000","last_became_peered":"2024-09-14T11:15:34.326702+0000","last_unstale":"2024-09-14T11:59:05.204861+0000","last_undegraded":"2024-09-14T11:59:05.204861+0000","last_fullsized":"2024-09-14T11:59:05.204861+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:05.204698+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.204698+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:33.564491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4068,"num_read_kb":3660,"num_write":1122,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'204","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.874744+0000","last_change":"2024-09-14T11:58:57.874630+0000","last_active":"2024-09-14T11:58:57.874744+0000","last_peered":"2024-09-14T11:58:57.874744+0000","last_clean":"2024-09-14T11:58:57.874744+0000","last_became_active":"2024-09-14T11:15:32.318458+0000","last_became_peered":"2024-09-14T11:15:32.318458+0000","last_unstale":"2024-09-14T11:58:57.874744+0000","last_undegraded":"2024-09-14T11:58:57.874744+0000","last_fullsized":"2024-09-14T11:58:57.874744+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-14T11:58:57.874491+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.874491+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:32.927288+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":38166,"num_write":911,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.378276+0000","last_change":"2024-09-14T11:59:13.378224+0000","last_active":"2024-09-14T11:59:13.378276+0000","last_peered":"2024-09-14T11:59:13.378276+0000","last_clean":"2024-09-14T11:59:13.378276+0000","last_became_active":"2024-09-14T11:15:36.334124+0000","last_became_peered":"2024-09-14T11:15:36.334124+0000","last_unstale":"2024-09-14T11:59:13.378276+0000","last_undegraded":"2024-09-14T11:59:13.378276+0000","last_fullsized":"2024-09-14T11:59:13.378276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.378137+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.378137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:53.165338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'203","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.597243+0000","last_change":"2024-09-14T11:59:14.597243+0000","last_active":"2024-09-14T11:59:14.597243+0000","last_peered":"2024-09-14T11:59:14.597243+0000","last_clean":"2024-09-14T11:59:14.597243+0000","last_became_active":"2024-09-14T11:15:38.334554+0000","last_became_peered":"2024-09-14T11:15:38.334554+0000","last_unstale":"2024-09-14T11:59:14.597243+0000","last_undegraded":"2024-09-14T11:59:14.597243+0000","last_fullsized":"2024-09-14T11:59:14.597243+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-14T11:59:14.597139+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-14T11:59:14.597139+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.597139+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:21.520459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14688,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":397,"num_write":180,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.884004+0000","last_change":"2024-09-14T11:59:23.884004+0000","last_active":"2024-09-14T11:59:23.884004+0000","last_peered":"2024-09-14T11:59:23.884004+0000","last_clean":"2024-09-14T11:59:23.884004+0000","last_became_active":"2024-09-14T11:15:40.348402+0000","last_became_peered":"2024-09-14T11:15:40.348402+0000","last_unstale":"2024-09-14T11:59:23.884004+0000","last_undegraded":"2024-09-14T11:59:23.884004+0000","last_fullsized":"2024-09-14T11:59:23.884004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.883920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.883920+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.883920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:02.477946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'162","reported_seq":681,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.005106+0000","last_change":"2024-09-14T11:59:34.005005+0000","last_active":"2024-09-14T11:59:34.005106+0000","last_peered":"2024-09-14T11:59:34.005106+0000","last_clean":"2024-09-14T11:59:34.005106+0000","last_became_active":"2024-09-14T11:15:42.351982+0000","last_became_peered":"2024-09-14T11:15:42.351982+0000","last_unstale":"2024-09-14T11:59:34.005106+0000","last_undegraded":"2024-09-14T11:59:34.005106+0000","last_fullsized":"2024-09-14T11:59:34.005106+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'162","last_scrub_stamp":"2024-09-14T11:59:34.004895+0000","last_deep_scrub":"262'162","last_deep_scrub_stamp":"2024-09-14T11:59:34.004895+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.004895+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:16.336948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":241,"num_write":374,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'451","reported_seq":2005,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.337630+0000","last_change":"2024-09-14T11:59:06.337559+0000","last_active":"2024-09-14T11:59:06.337630+0000","last_peered":"2024-09-14T11:59:06.337630+0000","last_clean":"2024-09-14T11:59:06.337630+0000","last_became_active":"2024-09-14T11:15:34.318563+0000","last_became_peered":"2024-09-14T11:15:34.318563+0000","last_unstale":"2024-09-14T11:59:06.337630+0000","last_undegraded":"2024-09-14T11:59:06.337630+0000","last_fullsized":"2024-09-14T11:59:06.337630+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'451","last_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_deep_scrub":"262'451","last_deep_scrub_stamp":"2024-09-14T11:59:06.337474+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.337474+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:21.970696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2376,"num_read_kb":2234,"num_write":510,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'228","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.646609+0000","last_change":"2024-09-14T11:58:56.646544+0000","last_active":"2024-09-14T11:58:56.646609+0000","last_peered":"2024-09-14T11:58:56.646609+0000","last_clean":"2024-09-14T11:58:56.646609+0000","last_became_active":"2024-09-14T11:15:32.311907+0000","last_became_peered":"2024-09-14T11:15:32.311907+0000","last_unstale":"2024-09-14T11:58:56.646609+0000","last_undegraded":"2024-09-14T11:58:56.646609+0000","last_fullsized":"2024-09-14T11:58:56.646609+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'228","last_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_deep_scrub":"262'228","last_deep_scrub_stamp":"2024-09-14T11:58:56.646441+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.646441+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:26.476328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":613,"num_read_kb":11802,"num_write":1015,"num_write_kb":16104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.110861+0000","last_change":"2024-09-14T11:59:09.110795+0000","last_active":"2024-09-14T11:59:09.110861+0000","last_peered":"2024-09-14T11:59:09.110861+0000","last_clean":"2024-09-14T11:59:09.110861+0000","last_became_active":"2024-09-14T11:15:36.330630+0000","last_became_peered":"2024-09-14T11:15:36.330630+0000","last_unstale":"2024-09-14T11:59:09.110861+0000","last_undegraded":"2024-09-14T11:59:09.110861+0000","last_fullsized":"2024-09-14T11:59:09.110861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.110702+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.110702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:37.995238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'165","reported_seq":744,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.021469+0000","last_change":"2024-09-14T11:59:22.021469+0000","last_active":"2024-09-14T11:59:22.021469+0000","last_peered":"2024-09-14T11:59:22.021469+0000","last_clean":"2024-09-14T11:59:22.021469+0000","last_became_active":"2024-09-14T11:15:38.341139+0000","last_became_peered":"2024-09-14T11:15:38.341139+0000","last_unstale":"2024-09-14T11:59:22.021469+0000","last_undegraded":"2024-09-14T11:59:22.021469+0000","last_fullsized":"2024-09-14T11:59:22.021469+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-14T11:59:22.021375+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-14T11:59:22.021375+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.021375+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:46.273089+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":272,"num_write":132,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.584120+0000","last_change":"2024-09-14T11:59:16.584120+0000","last_active":"2024-09-14T11:59:16.584120+0000","last_peered":"2024-09-14T11:59:16.584120+0000","last_clean":"2024-09-14T11:59:16.584120+0000","last_became_active":"2024-09-14T11:15:40.346578+0000","last_became_peered":"2024-09-14T11:15:40.346578+0000","last_unstale":"2024-09-14T11:59:16.584120+0000","last_undegraded":"2024-09-14T11:59:16.584120+0000","last_fullsized":"2024-09-14T11:59:16.584120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.584048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.584048+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.584048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:32.202317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'263","reported_seq":1135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.058321+0000","last_change":"2024-09-14T11:59:19.058263+0000","last_active":"2024-09-14T11:59:19.058321+0000","last_peered":"2024-09-14T11:59:19.058321+0000","last_clean":"2024-09-14T11:59:19.058321+0000","last_became_active":"2024-09-14T11:15:42.347411+0000","last_became_peered":"2024-09-14T11:15:42.347411+0000","last_unstale":"2024-09-14T11:59:19.058321+0000","last_undegraded":"2024-09-14T11:59:19.058321+0000","last_fullsized":"2024-09-14T11:59:19.058321+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-14T11:59:19.058169+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-14T11:59:19.058169+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.058169+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:10.548056+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":635,"num_write":661,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'852","reported_seq":2428,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.986861+0000","last_change":"2024-09-14T11:59:07.986861+0000","last_active":"2024-09-14T11:59:07.986861+0000","last_peered":"2024-09-14T11:59:07.986861+0000","last_clean":"2024-09-14T11:59:07.986861+0000","last_became_active":"2024-09-14T11:15:34.327507+0000","last_became_peered":"2024-09-14T11:15:34.327507+0000","last_unstale":"2024-09-14T11:59:07.986861+0000","last_undegraded":"2024-09-14T11:59:07.986861+0000","last_fullsized":"2024-09-14T11:59:07.986861+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'852","last_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_deep_scrub":"262'852","last_deep_scrub_stamp":"2024-09-14T11:59:07.986754+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.986754+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:08.810573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4112,"num_read_kb":3673,"num_write":1153,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'197","reported_seq":803,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.093051+0000","last_change":"2024-09-14T11:58:56.093051+0000","last_active":"2024-09-14T11:58:56.093051+0000","last_peered":"2024-09-14T11:58:56.093051+0000","last_clean":"2024-09-14T11:58:56.093051+0000","last_became_active":"2024-09-14T11:15:32.311050+0000","last_became_peered":"2024-09-14T11:15:32.311050+0000","last_unstale":"2024-09-14T11:58:56.093051+0000","last_undegraded":"2024-09-14T11:58:56.093051+0000","last_fullsized":"2024-09-14T11:58:56.093051+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-14T11:58:56.092935+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.092935+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.174953+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":504,"num_read_kb":4524,"num_write":914,"num_write_kb":35210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.987803+0000","last_change":"2024-09-14T11:59:24.987803+0000","last_active":"2024-09-14T11:59:24.987803+0000","last_peered":"2024-09-14T11:59:24.987803+0000","last_clean":"2024-09-14T11:59:24.987803+0000","last_became_active":"2024-09-14T11:15:36.329667+0000","last_became_peered":"2024-09-14T11:15:36.329667+0000","last_unstale":"2024-09-14T11:59:24.987803+0000","last_undegraded":"2024-09-14T11:59:24.987803+0000","last_fullsized":"2024-09-14T11:59:24.987803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.987710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.987710+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.987710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:45.341975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'136","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.019921+0000","last_change":"2024-09-14T11:59:25.019921+0000","last_active":"2024-09-14T11:59:25.019921+0000","last_peered":"2024-09-14T11:59:25.019921+0000","last_clean":"2024-09-14T11:59:25.019921+0000","last_became_active":"2024-09-14T11:15:38.336577+0000","last_became_peered":"2024-09-14T11:15:38.336577+0000","last_unstale":"2024-09-14T11:59:25.019921+0000","last_undegraded":"2024-09-14T11:59:25.019921+0000","last_fullsized":"2024-09-14T11:59:25.019921+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'136","last_scrub_stamp":"2024-09-14T11:59:25.019830+0000","last_deep_scrub":"262'136","last_deep_scrub_stamp":"2024-09-14T11:59:25.019830+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.019830+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:22.545522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":266,"num_write":100,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.537455+0000","last_change":"2024-09-14T11:59:17.537358+0000","last_active":"2024-09-14T11:59:17.537455+0000","last_peered":"2024-09-14T11:59:17.537455+0000","last_clean":"2024-09-14T11:59:17.537455+0000","last_became_active":"2024-09-14T11:15:40.349469+0000","last_became_peered":"2024-09-14T11:15:40.349469+0000","last_unstale":"2024-09-14T11:59:17.537455+0000","last_undegraded":"2024-09-14T11:59:17.537455+0000","last_fullsized":"2024-09-14T11:59:17.537455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.537163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.537163+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.537163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:38.017897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'148","reported_seq":647,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.841878+0000","last_change":"2024-09-14T11:59:27.841819+0000","last_active":"2024-09-14T11:59:27.841878+0000","last_peered":"2024-09-14T11:59:27.841878+0000","last_clean":"2024-09-14T11:59:27.841878+0000","last_became_active":"2024-09-14T11:15:42.348195+0000","last_became_peered":"2024-09-14T11:15:42.348195+0000","last_unstale":"2024-09-14T11:59:27.841878+0000","last_undegraded":"2024-09-14T11:59:27.841878+0000","last_fullsized":"2024-09-14T11:59:27.841878+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-14T11:59:27.841705+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-14T11:59:27.841705+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.841705+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:58.669872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":185,"num_read_kb":167,"num_write":353,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'428","reported_seq":1978,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.288212+0000","last_change":"2024-09-14T11:58:57.288212+0000","last_active":"2024-09-14T11:58:57.288212+0000","last_peered":"2024-09-14T11:58:57.288212+0000","last_clean":"2024-09-14T11:58:57.288212+0000","last_became_active":"2024-09-14T11:16:07.518236+0000","last_became_peered":"2024-09-14T11:16:07.518236+0000","last_unstale":"2024-09-14T11:58:57.288212+0000","last_undegraded":"2024-09-14T11:58:57.288212+0000","last_fullsized":"2024-09-14T11:58:57.288212+0000","mapping_epoch":37,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'428","last_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_deep_scrub":"262'428","last_deep_scrub_stamp":"2024-09-14T11:58:57.288124+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.288124+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:39.134746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2358,"num_read_kb":2223,"num_write":496,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'224","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.269287+0000","last_change":"2024-09-14T11:58:56.269287+0000","last_active":"2024-09-14T11:58:56.269287+0000","last_peered":"2024-09-14T11:58:56.269287+0000","last_clean":"2024-09-14T11:58:56.269287+0000","last_became_active":"2024-09-14T11:15:32.310431+0000","last_became_peered":"2024-09-14T11:15:32.310431+0000","last_unstale":"2024-09-14T11:58:56.269287+0000","last_undegraded":"2024-09-14T11:58:56.269287+0000","last_fullsized":"2024-09-14T11:58:56.269287+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'224","last_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_deep_scrub":"262'224","last_deep_scrub_stamp":"2024-09-14T11:58:56.269178+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.269178+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.507042+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":12620,"num_write":955,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.640793+0000","last_change":"2024-09-14T11:59:11.640793+0000","last_active":"2024-09-14T11:59:11.640793+0000","last_peered":"2024-09-14T11:59:11.640793+0000","last_clean":"2024-09-14T11:59:11.640793+0000","last_became_active":"2024-09-14T11:15:36.330275+0000","last_became_peered":"2024-09-14T11:15:36.330275+0000","last_unstale":"2024-09-14T11:59:11.640793+0000","last_undegraded":"2024-09-14T11:59:11.640793+0000","last_fullsized":"2024-09-14T11:59:11.640793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.640690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.640690+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.640690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:43.026373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'105","reported_seq":626,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.046790+0000","last_change":"2024-09-14T11:59:22.046732+0000","last_active":"2024-09-14T11:59:22.046790+0000","last_peered":"2024-09-14T11:59:22.046790+0000","last_clean":"2024-09-14T11:59:22.046790+0000","last_became_active":"2024-09-14T11:15:38.335463+0000","last_became_peered":"2024-09-14T11:15:38.335463+0000","last_unstale":"2024-09-14T11:59:22.046790+0000","last_undegraded":"2024-09-14T11:59:22.046790+0000","last_fullsized":"2024-09-14T11:59:22.046790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'105","last_scrub_stamp":"2024-09-14T11:59:22.046632+0000","last_deep_scrub":"262'105","last_deep_scrub_stamp":"2024-09-14T11:59:22.046632+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.046632+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:39.768126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":79,"num_write":68,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'769","reported_seq":2189,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.053730+0000","last_change":"2024-09-14T11:59:17.053667+0000","last_active":"2024-09-14T11:59:17.053730+0000","last_peered":"2024-09-14T11:59:17.053730+0000","last_clean":"2024-09-14T11:59:17.053730+0000","last_became_active":"2024-09-14T11:15:40.346175+0000","last_became_peered":"2024-09-14T11:15:40.346175+0000","last_unstale":"2024-09-14T11:59:17.053730+0000","last_undegraded":"2024-09-14T11:59:17.053730+0000","last_fullsized":"2024-09-14T11:59:17.053730+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'769","last_scrub_stamp":"2024-09-14T11:59:17.053591+0000","last_deep_scrub":"262'769","last_deep_scrub_stamp":"2024-09-14T11:59:17.053591+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.053591+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:45.573158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'118","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.047559+0000","last_change":"2024-09-14T11:59:26.047452+0000","last_active":"2024-09-14T11:59:26.047559+0000","last_peered":"2024-09-14T11:59:26.047559+0000","last_clean":"2024-09-14T11:59:26.047559+0000","last_became_active":"2024-09-14T11:15:42.349982+0000","last_became_peered":"2024-09-14T11:15:42.349982+0000","last_unstale":"2024-09-14T11:59:26.047559+0000","last_undegraded":"2024-09-14T11:59:26.047559+0000","last_fullsized":"2024-09-14T11:59:26.047559+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-14T11:59:26.047364+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-14T11:59:26.047364+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.047364+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:04.775167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":121,"num_write":305,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'895","reported_seq":2475,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.225811+0000","last_change":"2024-09-14T11:59:07.225811+0000","last_active":"2024-09-14T11:59:07.225811+0000","last_peered":"2024-09-14T11:59:07.225811+0000","last_clean":"2024-09-14T11:59:07.225811+0000","last_became_active":"2024-09-14T11:15:34.321556+0000","last_became_peered":"2024-09-14T11:15:34.321556+0000","last_unstale":"2024-09-14T11:59:07.225811+0000","last_undegraded":"2024-09-14T11:59:07.225811+0000","last_fullsized":"2024-09-14T11:59:07.225811+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'895","last_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_deep_scrub":"262'895","last_deep_scrub_stamp":"2024-09-14T11:59:07.225717+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.225717+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:52.394209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6818,"num_read_kb":6373,"num_write":1422,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'218","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.793958+0000","last_change":"2024-09-14T11:58:57.793958+0000","last_active":"2024-09-14T11:58:57.793958+0000","last_peered":"2024-09-14T11:58:57.793958+0000","last_clean":"2024-09-14T11:58:57.793958+0000","last_became_active":"2024-09-14T11:15:32.310090+0000","last_became_peered":"2024-09-14T11:15:32.310090+0000","last_unstale":"2024-09-14T11:58:57.793958+0000","last_undegraded":"2024-09-14T11:58:57.793958+0000","last_fullsized":"2024-09-14T11:58:57.793958+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-14T11:58:57.793829+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.793829+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:47.418639+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":930,"num_read_kb":28634,"num_write":971,"num_write_kb":32198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.937493+0000","last_change":"2024-09-14T11:59:16.937493+0000","last_active":"2024-09-14T11:59:16.937493+0000","last_peered":"2024-09-14T11:59:16.937493+0000","last_clean":"2024-09-14T11:59:16.937493+0000","last_became_active":"2024-09-14T11:15:36.334470+0000","last_became_peered":"2024-09-14T11:15:36.334470+0000","last_unstale":"2024-09-14T11:59:16.937493+0000","last_undegraded":"2024-09-14T11:59:16.937493+0000","last_fullsized":"2024-09-14T11:59:16.937493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.937391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.937391+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.937391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:57.487607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'163","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.844530+0000","last_change":"2024-09-14T11:59:22.844530+0000","last_active":"2024-09-14T11:59:22.844530+0000","last_peered":"2024-09-14T11:59:22.844530+0000","last_clean":"2024-09-14T11:59:22.844530+0000","last_became_active":"2024-09-14T11:15:38.332774+0000","last_became_peered":"2024-09-14T11:15:38.332774+0000","last_unstale":"2024-09-14T11:59:22.844530+0000","last_undegraded":"2024-09-14T11:59:22.844530+0000","last_fullsized":"2024-09-14T11:59:22.844530+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'163","last_scrub_stamp":"2024-09-14T11:59:22.844408+0000","last_deep_scrub":"262'163","last_deep_scrub_stamp":"2024-09-14T11:59:22.844408+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.844408+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.099842+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7170,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":208,"num_read_kb":287,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":485,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.475465+0000","last_change":"2024-09-14T11:59:24.475465+0000","last_active":"2024-09-14T11:59:24.475465+0000","last_peered":"2024-09-14T11:59:24.475465+0000","last_clean":"2024-09-14T11:59:24.475465+0000","last_became_active":"2024-09-14T11:15:40.345104+0000","last_became_peered":"2024-09-14T11:15:40.345104+0000","last_unstale":"2024-09-14T11:59:24.475465+0000","last_undegraded":"2024-09-14T11:59:24.475465+0000","last_fullsized":"2024-09-14T11:59:24.475465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.475369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.475369+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.475369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:08.026060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'107","reported_seq":613,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.067092+0000","last_change":"2024-09-14T11:59:29.067092+0000","last_active":"2024-09-14T11:59:29.067092+0000","last_peered":"2024-09-14T11:59:29.067092+0000","last_clean":"2024-09-14T11:59:29.067092+0000","last_became_active":"2024-09-14T11:15:42.354421+0000","last_became_peered":"2024-09-14T11:15:42.354421+0000","last_unstale":"2024-09-14T11:59:29.067092+0000","last_undegraded":"2024-09-14T11:59:29.067092+0000","last_fullsized":"2024-09-14T11:59:29.067092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'107","last_scrub_stamp":"2024-09-14T11:59:29.066989+0000","last_deep_scrub":"262'107","last_deep_scrub_stamp":"2024-09-14T11:59:29.066989+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.066989+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:05.501581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":139,"num_write":253,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'660","reported_seq":2531,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.203014+0000","last_change":"2024-09-14T11:59:06.203014+0000","last_active":"2024-09-14T11:59:06.203014+0000","last_peered":"2024-09-14T11:59:06.203014+0000","last_clean":"2024-09-14T11:59:06.203014+0000","last_became_active":"2024-09-14T11:15:34.319658+0000","last_became_peered":"2024-09-14T11:15:34.319658+0000","last_unstale":"2024-09-14T11:59:06.203014+0000","last_undegraded":"2024-09-14T11:59:06.203014+0000","last_fullsized":"2024-09-14T11:59:06.203014+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'660","last_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_deep_scrub":"262'660","last_deep_scrub_stamp":"2024-09-14T11:59:06.202929+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.202929+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:52.793955+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3747,"num_read_kb":3453,"num_write":878,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3256,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'201","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.792801+0000","last_change":"2024-09-14T11:58:59.792801+0000","last_active":"2024-09-14T11:58:59.792801+0000","last_peered":"2024-09-14T11:58:59.792801+0000","last_clean":"2024-09-14T11:58:59.792801+0000","last_became_active":"2024-09-14T11:15:32.311026+0000","last_became_peered":"2024-09-14T11:15:32.311026+0000","last_unstale":"2024-09-14T11:58:59.792801+0000","last_undegraded":"2024-09-14T11:58:59.792801+0000","last_fullsized":"2024-09-14T11:58:59.792801+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'201","last_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_deep_scrub":"262'201","last_deep_scrub_stamp":"2024-09-14T11:58:59.792678+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.792678+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:48.220393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":24057,"num_write":879,"num_write_kb":42900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.753252+0000","last_change":"2024-09-14T11:59:17.753252+0000","last_active":"2024-09-14T11:59:17.753252+0000","last_peered":"2024-09-14T11:59:17.753252+0000","last_clean":"2024-09-14T11:59:17.753252+0000","last_became_active":"2024-09-14T11:15:36.323387+0000","last_became_peered":"2024-09-14T11:15:36.323387+0000","last_unstale":"2024-09-14T11:59:17.753252+0000","last_undegraded":"2024-09-14T11:59:17.753252+0000","last_fullsized":"2024-09-14T11:59:17.753252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.753121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.753121+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.753121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:23.129023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'151","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.396500+0000","last_change":"2024-09-14T11:59:18.396500+0000","last_active":"2024-09-14T11:59:18.396500+0000","last_peered":"2024-09-14T11:59:18.396500+0000","last_clean":"2024-09-14T11:59:18.396500+0000","last_became_active":"2024-09-14T11:15:38.332299+0000","last_became_peered":"2024-09-14T11:15:38.332299+0000","last_unstale":"2024-09-14T11:59:18.396500+0000","last_undegraded":"2024-09-14T11:59:18.396500+0000","last_fullsized":"2024-09-14T11:59:18.396500+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'151","last_scrub_stamp":"2024-09-14T11:59:18.396392+0000","last_deep_scrub":"262'151","last_deep_scrub_stamp":"2024-09-14T11:59:18.396392+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.396392+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:50.867281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":267,"num_write":100,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.094453+0000","last_change":"2024-09-14T11:59:15.094399+0000","last_active":"2024-09-14T11:59:15.094453+0000","last_peered":"2024-09-14T11:59:15.094453+0000","last_clean":"2024-09-14T11:59:15.094453+0000","last_became_active":"2024-09-14T11:15:40.344304+0000","last_became_peered":"2024-09-14T11:15:40.344304+0000","last_unstale":"2024-09-14T11:59:15.094453+0000","last_undegraded":"2024-09-14T11:59:15.094453+0000","last_fullsized":"2024-09-14T11:59:15.094453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.094317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.094317+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.094317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:47.776493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'142","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.012932+0000","last_change":"2024-09-14T11:59:33.012932+0000","last_active":"2024-09-14T11:59:33.012932+0000","last_peered":"2024-09-14T11:59:33.012932+0000","last_clean":"2024-09-14T11:59:33.012932+0000","last_became_active":"2024-09-14T11:15:42.348128+0000","last_became_peered":"2024-09-14T11:15:42.348128+0000","last_unstale":"2024-09-14T11:59:33.012932+0000","last_undegraded":"2024-09-14T11:59:33.012932+0000","last_fullsized":"2024-09-14T11:59:33.012932+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-14T11:59:33.012838+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-14T11:59:33.012838+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.012838+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:43.338371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":167,"num_write":343,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'748","reported_seq":2367,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.939963+0000","last_change":"2024-09-14T11:59:05.939875+0000","last_active":"2024-09-14T11:59:05.939963+0000","last_peered":"2024-09-14T11:59:05.939963+0000","last_clean":"2024-09-14T11:59:05.939963+0000","last_became_active":"2024-09-14T11:15:34.323017+0000","last_became_peered":"2024-09-14T11:15:34.323017+0000","last_unstale":"2024-09-14T11:59:05.939963+0000","last_undegraded":"2024-09-14T11:59:05.939963+0000","last_fullsized":"2024-09-14T11:59:05.939963+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'748","last_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_deep_scrub":"262'748","last_deep_scrub_stamp":"2024-09-14T11:59:05.939748+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.939748+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:27.001770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3714,"num_read_kb":3380,"num_write":952,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'247","reported_seq":1007,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.848986+0000","last_change":"2024-09-14T11:58:58.848888+0000","last_active":"2024-09-14T11:58:58.848986+0000","last_peered":"2024-09-14T11:58:58.848986+0000","last_clean":"2024-09-14T11:58:58.848986+0000","last_became_active":"2024-09-14T11:15:32.313665+0000","last_became_peered":"2024-09-14T11:15:32.313665+0000","last_unstale":"2024-09-14T11:58:58.848986+0000","last_undegraded":"2024-09-14T11:58:58.848986+0000","last_fullsized":"2024-09-14T11:58:58.848986+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'247","last_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_deep_scrub":"262'247","last_deep_scrub_stamp":"2024-09-14T11:58:58.848767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.848767+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.657561+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":149417,"num_write":1050,"num_write_kb":49071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.027336+0000","last_change":"2024-09-14T11:59:17.027336+0000","last_active":"2024-09-14T11:59:17.027336+0000","last_peered":"2024-09-14T11:59:17.027336+0000","last_clean":"2024-09-14T11:59:17.027336+0000","last_became_active":"2024-09-14T11:15:36.334074+0000","last_became_peered":"2024-09-14T11:15:36.334074+0000","last_unstale":"2024-09-14T11:59:17.027336+0000","last_undegraded":"2024-09-14T11:59:17.027336+0000","last_fullsized":"2024-09-14T11:59:17.027336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.027224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.027224+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.027224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:18.134951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'100","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.017978+0000","last_change":"2024-09-14T11:59:24.017978+0000","last_active":"2024-09-14T11:59:24.017978+0000","last_peered":"2024-09-14T11:59:24.017978+0000","last_clean":"2024-09-14T11:59:24.017978+0000","last_became_active":"2024-09-14T11:15:38.339429+0000","last_became_peered":"2024-09-14T11:15:38.339429+0000","last_unstale":"2024-09-14T11:59:24.017978+0000","last_undegraded":"2024-09-14T11:59:24.017978+0000","last_fullsized":"2024-09-14T11:59:24.017978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-14T11:59:24.017891+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-14T11:59:24.017891+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.017891+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:45.397131+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8817,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":183,"num_write":56,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.982762+0000","last_change":"2024-09-14T11:59:25.982762+0000","last_active":"2024-09-14T11:59:25.982762+0000","last_peered":"2024-09-14T11:59:25.982762+0000","last_clean":"2024-09-14T11:59:25.982762+0000","last_became_active":"2024-09-14T11:15:40.345675+0000","last_became_peered":"2024-09-14T11:15:40.345675+0000","last_unstale":"2024-09-14T11:59:25.982762+0000","last_undegraded":"2024-09-14T11:59:25.982762+0000","last_fullsized":"2024-09-14T11:59:25.982762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.982662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.982662+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.982662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:16.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'157","reported_seq":1264,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.038615+0000","last_change":"2024-09-14T11:59:28.038615+0000","last_active":"2024-09-14T11:59:28.038615+0000","last_peered":"2024-09-14T11:59:28.038615+0000","last_clean":"2024-09-14T11:59:28.038615+0000","last_became_active":"2024-09-14T11:15:42.353883+0000","last_became_peered":"2024-09-14T11:15:42.353883+0000","last_unstale":"2024-09-14T11:59:28.038615+0000","last_undegraded":"2024-09-14T11:59:28.038615+0000","last_fullsized":"2024-09-14T11:59:28.038615+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'157","last_scrub_stamp":"2024-09-14T11:59:28.038525+0000","last_deep_scrub":"262'157","last_deep_scrub_stamp":"2024-09-14T11:59:28.038525+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.038525+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:28.806077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":818,"num_read_kb":804,"num_write":364,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'448","reported_seq":1947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.209413+0000","last_change":"2024-09-14T11:59:05.209413+0000","last_active":"2024-09-14T11:59:05.209413+0000","last_peered":"2024-09-14T11:59:05.209413+0000","last_clean":"2024-09-14T11:59:05.209413+0000","last_became_active":"2024-09-14T11:15:34.319904+0000","last_became_peered":"2024-09-14T11:15:34.319904+0000","last_unstale":"2024-09-14T11:59:05.209413+0000","last_undegraded":"2024-09-14T11:59:05.209413+0000","last_fullsized":"2024-09-14T11:59:05.209413+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'448","last_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_deep_scrub":"262'448","last_deep_scrub_stamp":"2024-09-14T11:59:05.209323+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.209323+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.492011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2437,"num_read_kb":2289,"num_write":577,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'212","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.268719+0000","last_change":"2024-09-14T11:58:57.268656+0000","last_active":"2024-09-14T11:58:57.268719+0000","last_peered":"2024-09-14T11:58:57.268719+0000","last_clean":"2024-09-14T11:58:57.268719+0000","last_became_active":"2024-09-14T11:15:32.314485+0000","last_became_peered":"2024-09-14T11:15:32.314485+0000","last_unstale":"2024-09-14T11:58:57.268719+0000","last_undegraded":"2024-09-14T11:58:57.268719+0000","last_fullsized":"2024-09-14T11:58:57.268719+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-14T11:58:57.268554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.268554+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:41.545725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":36694,"num_write":987,"num_write_kb":31479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.609596+0000","last_change":"2024-09-14T11:59:10.609493+0000","last_active":"2024-09-14T11:59:10.609596+0000","last_peered":"2024-09-14T11:59:10.609596+0000","last_clean":"2024-09-14T11:59:10.609596+0000","last_became_active":"2024-09-14T11:15:36.333983+0000","last_became_peered":"2024-09-14T11:15:36.333983+0000","last_unstale":"2024-09-14T11:59:10.609596+0000","last_undegraded":"2024-09-14T11:59:10.609596+0000","last_fullsized":"2024-09-14T11:59:10.609596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T11:59:10.609353+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.609353+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.175042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'153","reported_seq":735,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.009705+0000","last_change":"2024-09-14T11:59:21.009705+0000","last_active":"2024-09-14T11:59:21.009705+0000","last_peered":"2024-09-14T11:59:21.009705+0000","last_clean":"2024-09-14T11:59:21.009705+0000","last_became_active":"2024-09-14T11:15:38.340446+0000","last_became_peered":"2024-09-14T11:15:38.340446+0000","last_unstale":"2024-09-14T11:59:21.009705+0000","last_undegraded":"2024-09-14T11:59:21.009705+0000","last_fullsized":"2024-09-14T11:59:21.009705+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'153","last_scrub_stamp":"2024-09-14T11:59:21.009610+0000","last_deep_scrub":"262'153","last_deep_scrub_stamp":"2024-09-14T11:59:21.009610+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.009610+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:05.738105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":283,"num_write":116,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.464785+0000","last_change":"2024-09-14T11:59:25.464785+0000","last_active":"2024-09-14T11:59:25.464785+0000","last_peered":"2024-09-14T11:59:25.464785+0000","last_clean":"2024-09-14T11:59:25.464785+0000","last_became_active":"2024-09-14T11:15:40.344847+0000","last_became_peered":"2024-09-14T11:15:40.344847+0000","last_unstale":"2024-09-14T11:59:25.464785+0000","last_undegraded":"2024-09-14T11:59:25.464785+0000","last_fullsized":"2024-09-14T11:59:25.464785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:25.464686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:25.464686+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.464686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:35.385135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'96","reported_seq":582,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.005869+0000","last_change":"2024-09-14T11:59:28.005809+0000","last_active":"2024-09-14T11:59:28.005869+0000","last_peered":"2024-09-14T11:59:28.005869+0000","last_clean":"2024-09-14T11:59:28.005869+0000","last_became_active":"2024-09-14T11:15:42.354271+0000","last_became_peered":"2024-09-14T11:15:42.354271+0000","last_unstale":"2024-09-14T11:59:28.005869+0000","last_undegraded":"2024-09-14T11:59:28.005869+0000","last_fullsized":"2024-09-14T11:59:28.005869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'96","last_scrub_stamp":"2024-09-14T11:59:28.005725+0000","last_deep_scrub":"262'96","last_deep_scrub_stamp":"2024-09-14T11:59:28.005725+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.005725+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:05.667233+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":65,"num_write":209,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'423","reported_seq":1881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.669190+0000","last_change":"2024-09-14T11:59:07.669190+0000","last_active":"2024-09-14T11:59:07.669190+0000","last_peered":"2024-09-14T11:59:07.669190+0000","last_clean":"2024-09-14T11:59:07.669190+0000","last_became_active":"2024-09-14T11:15:34.325925+0000","last_became_peered":"2024-09-14T11:15:34.325925+0000","last_unstale":"2024-09-14T11:59:07.669190+0000","last_undegraded":"2024-09-14T11:59:07.669190+0000","last_fullsized":"2024-09-14T11:59:07.669190+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'423","last_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_deep_scrub":"262'423","last_deep_scrub_stamp":"2024-09-14T11:59:07.669106+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.669106+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:58.372550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2100,"num_read_kb":1981,"num_write":468,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.260315+0000","last_change":"2024-09-14T11:58:59.260260+0000","last_active":"2024-09-14T11:58:59.260315+0000","last_peered":"2024-09-14T11:58:59.260315+0000","last_clean":"2024-09-14T11:58:59.260315+0000","last_became_active":"2024-09-14T11:15:32.317514+0000","last_became_peered":"2024-09-14T11:15:32.317514+0000","last_unstale":"2024-09-14T11:58:59.260315+0000","last_undegraded":"2024-09-14T11:58:59.260315+0000","last_fullsized":"2024-09-14T11:58:59.260315+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-14T11:58:59.260175+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.260175+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:36.438178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":66072,"num_write":894,"num_write_kb":20041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'841","reported_seq":2356,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.610576+0000","last_change":"2024-09-14T11:59:05.610576+0000","last_active":"2024-09-14T11:59:05.610576+0000","last_peered":"2024-09-14T11:59:05.610576+0000","last_clean":"2024-09-14T11:59:05.610576+0000","last_became_active":"2024-09-14T11:15:34.326342+0000","last_became_peered":"2024-09-14T11:15:34.326342+0000","last_unstale":"2024-09-14T11:59:05.610576+0000","last_undegraded":"2024-09-14T11:59:05.610576+0000","last_fullsized":"2024-09-14T11:59:05.610576+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'841","last_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_deep_scrub":"262'841","last_deep_scrub_stamp":"2024-09-14T11:59:05.610487+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.610487+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:37.527850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3873,"num_read_kb":3464,"num_write":1103,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'213","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.279743+0000","last_change":"2024-09-14T11:58:56.279698+0000","last_active":"2024-09-14T11:58:56.279743+0000","last_peered":"2024-09-14T11:58:56.279743+0000","last_clean":"2024-09-14T11:58:56.279743+0000","last_became_active":"2024-09-14T11:16:07.388626+0000","last_became_peered":"2024-09-14T11:16:07.388626+0000","last_unstale":"2024-09-14T11:58:56.279743+0000","last_undegraded":"2024-09-14T11:58:56.279743+0000","last_fullsized":"2024-09-14T11:58:56.279743+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-14T11:58:56.279629+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.279629+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:33.552917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":448,"num_read_kb":30107,"num_write":970,"num_write_kb":46702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'540","reported_seq":2215,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.796673+0000","last_change":"2024-09-14T11:59:13.796673+0000","last_active":"2024-09-14T11:59:13.796673+0000","last_peered":"2024-09-14T11:59:13.796673+0000","last_clean":"2024-09-14T11:59:13.796673+0000","last_became_active":"2024-09-14T11:15:34.326837+0000","last_became_peered":"2024-09-14T11:15:34.326837+0000","last_unstale":"2024-09-14T11:59:13.796673+0000","last_undegraded":"2024-09-14T11:59:13.796673+0000","last_fullsized":"2024-09-14T11:59:13.796673+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'540","last_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_deep_scrub":"262'540","last_deep_scrub_stamp":"2024-09-14T11:59:13.796567+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.796567+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:48.630324+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2769,"num_read_kb":2594,"num_write":635,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'185","reported_seq":774,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.767529+0000","last_change":"2024-09-14T11:58:58.767475+0000","last_active":"2024-09-14T11:58:58.767529+0000","last_peered":"2024-09-14T11:58:58.767529+0000","last_clean":"2024-09-14T11:58:58.767529+0000","last_became_active":"2024-09-14T11:15:32.320712+0000","last_became_peered":"2024-09-14T11:15:32.320712+0000","last_unstale":"2024-09-14T11:58:58.767529+0000","last_undegraded":"2024-09-14T11:58:58.767529+0000","last_fullsized":"2024-09-14T11:58:58.767529+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-14T11:58:58.767391+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.767391+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:27.127746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":397,"num_read_kb":13678,"num_write":826,"num_write_kb":26700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'689","reported_seq":2137,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.570572+0000","last_change":"2024-09-14T11:59:04.570572+0000","last_active":"2024-09-14T11:59:04.570572+0000","last_peered":"2024-09-14T11:59:04.570572+0000","last_clean":"2024-09-14T11:59:04.570572+0000","last_became_active":"2024-09-14T11:15:34.326089+0000","last_became_peered":"2024-09-14T11:15:34.326089+0000","last_unstale":"2024-09-14T11:59:04.570572+0000","last_undegraded":"2024-09-14T11:59:04.570572+0000","last_fullsized":"2024-09-14T11:59:04.570572+0000","mapping_epoch":26,"log_start":"262'600","ondisk_log_start":"262'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'689","last_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_deep_scrub":"262'689","last_deep_scrub_stamp":"2024-09-14T11:59:04.570481+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.570481+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":600,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:50.385676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3331,"num_read_kb":3018,"num_write":892,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'226","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.251393+0000","last_change":"2024-09-14T11:58:58.251319+0000","last_active":"2024-09-14T11:58:58.251393+0000","last_peered":"2024-09-14T11:58:58.251393+0000","last_clean":"2024-09-14T11:58:58.251393+0000","last_became_active":"2024-09-14T11:15:32.315888+0000","last_became_peered":"2024-09-14T11:15:32.315888+0000","last_unstale":"2024-09-14T11:58:58.251393+0000","last_undegraded":"2024-09-14T11:58:58.251393+0000","last_fullsized":"2024-09-14T11:58:58.251393+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-14T11:58:58.251228+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.251228+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:43.426816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":673,"num_read_kb":8461,"num_write":1067,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'578","reported_seq":2184,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.873360+0000","last_change":"2024-09-14T11:59:14.873290+0000","last_active":"2024-09-14T11:59:14.873360+0000","last_peered":"2024-09-14T11:59:14.873360+0000","last_clean":"2024-09-14T11:59:14.873360+0000","last_became_active":"2024-09-14T11:15:34.321588+0000","last_became_peered":"2024-09-14T11:15:34.321588+0000","last_unstale":"2024-09-14T11:59:14.873360+0000","last_undegraded":"2024-09-14T11:59:14.873360+0000","last_fullsized":"2024-09-14T11:59:14.873360+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'578","last_scrub_stamp":"2024-09-14T11:59:14.873200+0000","last_deep_scrub":"262'578","last_deep_scrub_stamp":"2024-09-14T11:59:14.873200+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.873200+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.941909+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2975,"num_read_kb":2735,"num_write":736,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'263","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.887387+0000","last_change":"2024-09-14T11:58:59.887387+0000","last_active":"2024-09-14T11:58:59.887387+0000","last_peered":"2024-09-14T11:58:59.887387+0000","last_clean":"2024-09-14T11:58:59.887387+0000","last_became_active":"2024-09-14T11:15:32.318442+0000","last_became_peered":"2024-09-14T11:15:32.318442+0000","last_unstale":"2024-09-14T11:58:59.887387+0000","last_undegraded":"2024-09-14T11:58:59.887387+0000","last_fullsized":"2024-09-14T11:58:59.887387+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-14T11:58:59.887284+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.887284+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:57.682098+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":625,"num_read_kb":65552,"num_write":1161,"num_write_kb":51675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'1211","reported_seq":2823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.196603+0000","last_change":"2024-09-14T11:59:10.196538+0000","last_active":"2024-09-14T11:59:10.196603+0000","last_peered":"2024-09-14T11:59:10.196603+0000","last_clean":"2024-09-14T11:59:10.196603+0000","last_became_active":"2024-09-14T11:15:34.321597+0000","last_became_peered":"2024-09-14T11:15:34.321597+0000","last_unstale":"2024-09-14T11:59:10.196603+0000","last_undegraded":"2024-09-14T11:59:10.196603+0000","last_fullsized":"2024-09-14T11:59:10.196603+0000","mapping_epoch":26,"log_start":"262'1100","ondisk_log_start":"262'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1211","last_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_deep_scrub":"262'1211","last_deep_scrub_stamp":"2024-09-14T11:59:10.196453+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.196453+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":1100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:27.768853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5495,"num_read_kb":4842,"num_write":1646,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'200","reported_seq":824,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.627940+0000","last_change":"2024-09-14T11:58:57.627940+0000","last_active":"2024-09-14T11:58:57.627940+0000","last_peered":"2024-09-14T11:58:57.627940+0000","last_clean":"2024-09-14T11:58:57.627940+0000","last_became_active":"2024-09-14T11:15:32.314993+0000","last_became_peered":"2024-09-14T11:15:32.314993+0000","last_unstale":"2024-09-14T11:58:57.627940+0000","last_undegraded":"2024-09-14T11:58:57.627940+0000","last_fullsized":"2024-09-14T11:58:57.627940+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-14T11:58:57.627846+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.627846+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:24.951020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":515,"num_read_kb":18867,"num_write":899,"num_write_kb":26796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'490","reported_seq":2147,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.977350+0000","last_change":"2024-09-14T11:59:09.977291+0000","last_active":"2024-09-14T11:59:09.977350+0000","last_peered":"2024-09-14T11:59:09.977350+0000","last_clean":"2024-09-14T11:59:09.977350+0000","last_became_active":"2024-09-14T11:15:34.331271+0000","last_became_peered":"2024-09-14T11:15:34.331271+0000","last_unstale":"2024-09-14T11:59:09.977350+0000","last_undegraded":"2024-09-14T11:59:09.977350+0000","last_fullsized":"2024-09-14T11:59:09.977350+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'490","last_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_deep_scrub":"262'490","last_deep_scrub_stamp":"2024-09-14T11:59:09.977199+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.977199+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.685268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2545,"num_write":577,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'183","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.292435+0000","last_change":"2024-09-14T11:58:57.292435+0000","last_active":"2024-09-14T11:58:57.292435+0000","last_peered":"2024-09-14T11:58:57.292435+0000","last_clean":"2024-09-14T11:58:57.292435+0000","last_became_active":"2024-09-14T11:15:32.316704+0000","last_became_peered":"2024-09-14T11:15:32.316704+0000","last_unstale":"2024-09-14T11:58:57.292435+0000","last_undegraded":"2024-09-14T11:58:57.292435+0000","last_fullsized":"2024-09-14T11:58:57.292435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'183","last_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_deep_scrub":"262'183","last_deep_scrub_stamp":"2024-09-14T11:58:57.292341+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.292341+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:17.394532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":3776,"num_write":815,"num_write_kb":21313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'443","reported_seq":1981,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.158496+0000","last_change":"2024-09-14T11:59:06.158439+0000","last_active":"2024-09-14T11:59:06.158496+0000","last_peered":"2024-09-14T11:59:06.158496+0000","last_clean":"2024-09-14T11:59:06.158496+0000","last_became_active":"2024-09-14T11:15:34.320366+0000","last_became_peered":"2024-09-14T11:15:34.320366+0000","last_unstale":"2024-09-14T11:59:06.158496+0000","last_undegraded":"2024-09-14T11:59:06.158496+0000","last_fullsized":"2024-09-14T11:59:06.158496+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'443","last_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_deep_scrub":"262'443","last_deep_scrub_stamp":"2024-09-14T11:59:06.158355+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.158355+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:22.012200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2373,"num_read_kb":2236,"num_write":504,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'273","reported_seq":930,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.844697+0000","last_change":"2024-09-14T11:59:00.844697+0000","last_active":"2024-09-14T11:59:00.844697+0000","last_peered":"2024-09-14T11:59:00.844697+0000","last_clean":"2024-09-14T11:59:00.844697+0000","last_became_active":"2024-09-14T11:15:32.313438+0000","last_became_peered":"2024-09-14T11:15:32.313438+0000","last_unstale":"2024-09-14T11:59:00.844697+0000","last_undegraded":"2024-09-14T11:59:00.844697+0000","last_fullsized":"2024-09-14T11:59:00.844697+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'273","last_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_deep_scrub":"262'273","last_deep_scrub_stamp":"2024-09-14T11:59:00.844576+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.844576+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:17.221784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":36414,"num_write":1104,"num_write_kb":41116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'493","reported_seq":2016,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.415412+0000","last_change":"2024-09-14T11:59:08.415356+0000","last_active":"2024-09-14T11:59:08.415412+0000","last_peered":"2024-09-14T11:59:08.415412+0000","last_clean":"2024-09-14T11:59:08.415412+0000","last_became_active":"2024-09-14T11:15:34.326608+0000","last_became_peered":"2024-09-14T11:15:34.326608+0000","last_unstale":"2024-09-14T11:59:08.415412+0000","last_undegraded":"2024-09-14T11:59:08.415412+0000","last_fullsized":"2024-09-14T11:59:08.415412+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'493","last_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_deep_scrub":"262'493","last_deep_scrub_stamp":"2024-09-14T11:59:08.415265+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.415265+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:13.317609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2497,"num_write":604,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'284","reported_seq":939,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.837101+0000","last_change":"2024-09-14T11:59:00.836991+0000","last_active":"2024-09-14T11:59:00.837101+0000","last_peered":"2024-09-14T11:59:00.837101+0000","last_clean":"2024-09-14T11:59:00.837101+0000","last_became_active":"2024-09-14T11:15:32.313873+0000","last_became_peered":"2024-09-14T11:15:32.313873+0000","last_unstale":"2024-09-14T11:59:00.837101+0000","last_undegraded":"2024-09-14T11:59:00.837101+0000","last_fullsized":"2024-09-14T11:59:00.837101+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'284","last_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_deep_scrub":"262'284","last_deep_scrub_stamp":"2024-09-14T11:59:00.836878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.836878+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:32.971543+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":728,"num_read_kb":57965,"num_write":1175,"num_write_kb":26758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'750","reported_seq":2332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.237893+0000","last_change":"2024-09-14T11:59:09.237837+0000","last_active":"2024-09-14T11:59:09.237893+0000","last_peered":"2024-09-14T11:59:09.237893+0000","last_clean":"2024-09-14T11:59:09.237893+0000","last_became_active":"2024-09-14T11:15:34.315191+0000","last_became_peered":"2024-09-14T11:15:34.315191+0000","last_unstale":"2024-09-14T11:59:09.237893+0000","last_undegraded":"2024-09-14T11:59:09.237893+0000","last_fullsized":"2024-09-14T11:59:09.237893+0000","mapping_epoch":26,"log_start":"262'700","ondisk_log_start":"262'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'750","last_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_deep_scrub":"262'750","last_deep_scrub_stamp":"2024-09-14T11:59:09.237718+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.237718+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:11.504189+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3673,"num_read_kb":3339,"num_write":976,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'205","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.894568+0000","last_change":"2024-09-14T11:59:01.894568+0000","last_active":"2024-09-14T11:59:01.894568+0000","last_peered":"2024-09-14T11:59:01.894568+0000","last_clean":"2024-09-14T11:59:01.894568+0000","last_became_active":"2024-09-14T11:15:32.314620+0000","last_became_peered":"2024-09-14T11:15:32.314620+0000","last_unstale":"2024-09-14T11:59:01.894568+0000","last_undegraded":"2024-09-14T11:59:01.894568+0000","last_fullsized":"2024-09-14T11:59:01.894568+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-14T11:59:01.894440+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.894440+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:58.772928+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":27346,"num_write":953,"num_write_kb":25498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'500","reported_seq":2202,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.278891+0000","last_change":"2024-09-14T11:58:58.278891+0000","last_active":"2024-09-14T11:58:58.278891+0000","last_peered":"2024-09-14T11:58:58.278891+0000","last_clean":"2024-09-14T11:58:58.278891+0000","last_became_active":"2024-09-14T11:15:34.318733+0000","last_became_peered":"2024-09-14T11:15:34.318733+0000","last_unstale":"2024-09-14T11:58:58.278891+0000","last_undegraded":"2024-09-14T11:58:58.278891+0000","last_fullsized":"2024-09-14T11:58:58.278891+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'500","last_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_deep_scrub":"262'500","last_deep_scrub_stamp":"2024-09-14T11:58:58.278804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.278804+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:28.836107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2634,"num_read_kb":2495,"num_write":587,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'219","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.804411+0000","last_change":"2024-09-14T11:59:01.804411+0000","last_active":"2024-09-14T11:59:01.804411+0000","last_peered":"2024-09-14T11:59:01.804411+0000","last_clean":"2024-09-14T11:59:01.804411+0000","last_became_active":"2024-09-14T11:15:32.322321+0000","last_became_peered":"2024-09-14T11:15:32.322321+0000","last_unstale":"2024-09-14T11:59:01.804411+0000","last_undegraded":"2024-09-14T11:59:01.804411+0000","last_fullsized":"2024-09-14T11:59:01.804411+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'219","last_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_deep_scrub":"262'219","last_deep_scrub_stamp":"2024-09-14T11:59:01.804299+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.804299+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:14.419727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":6791,"num_write":1023,"num_write_kb":36487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'1092","reported_seq":2586,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.266010+0000","last_change":"2024-09-14T11:59:08.266010+0000","last_active":"2024-09-14T11:59:08.266010+0000","last_peered":"2024-09-14T11:59:08.266010+0000","last_clean":"2024-09-14T11:59:08.266010+0000","last_became_active":"2024-09-14T11:15:34.321890+0000","last_became_peered":"2024-09-14T11:15:34.321890+0000","last_unstale":"2024-09-14T11:59:08.266010+0000","last_undegraded":"2024-09-14T11:59:08.266010+0000","last_fullsized":"2024-09-14T11:59:08.266010+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1092","last_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_deep_scrub":"262'1092","last_deep_scrub_stamp":"2024-09-14T11:59:08.265911+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.265911+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:12.673036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4978,"num_read_kb":4406,"num_write":1492,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'198","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.255530+0000","last_change":"2024-09-14T11:58:59.255530+0000","last_active":"2024-09-14T11:58:59.255530+0000","last_peered":"2024-09-14T11:58:59.255530+0000","last_clean":"2024-09-14T11:58:59.255530+0000","last_became_active":"2024-09-14T11:15:32.309796+0000","last_became_peered":"2024-09-14T11:15:32.309796+0000","last_unstale":"2024-09-14T11:58:59.255530+0000","last_undegraded":"2024-09-14T11:58:59.255530+0000","last_fullsized":"2024-09-14T11:58:59.255530+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-14T11:58:59.255428+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.255428+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.960737+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":8671,"num_write":968,"num_write_kb":22444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'891","reported_seq":2805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.966742+0000","last_change":"2024-09-14T11:59:09.966742+0000","last_active":"2024-09-14T11:59:09.966742+0000","last_peered":"2024-09-14T11:59:09.966742+0000","last_clean":"2024-09-14T11:59:09.966742+0000","last_became_active":"2024-09-14T11:15:34.324456+0000","last_became_peered":"2024-09-14T11:15:34.324456+0000","last_unstale":"2024-09-14T11:59:09.966742+0000","last_undegraded":"2024-09-14T11:59:09.966742+0000","last_fullsized":"2024-09-14T11:59:09.966742+0000","mapping_epoch":26,"log_start":"262'800","ondisk_log_start":"262'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'891","last_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_deep_scrub":"262'891","last_deep_scrub_stamp":"2024-09-14T11:59:09.966645+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.966645+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.534651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4503,"num_read_kb":4115,"num_write":1142,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2267,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'217","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.223498+0000","last_change":"2024-09-14T11:59:00.223498+0000","last_active":"2024-09-14T11:59:00.223498+0000","last_peered":"2024-09-14T11:59:00.223498+0000","last_clean":"2024-09-14T11:59:00.223498+0000","last_became_active":"2024-09-14T11:15:32.318469+0000","last_became_peered":"2024-09-14T11:15:32.318469+0000","last_unstale":"2024-09-14T11:59:00.223498+0000","last_undegraded":"2024-09-14T11:59:00.223498+0000","last_fullsized":"2024-09-14T11:59:00.223498+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'217","last_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_deep_scrub":"262'217","last_deep_scrub_stamp":"2024-09-14T11:59:00.223379+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.223379+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:54.749010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":9098,"num_write":1061,"num_write_kb":34426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'510","reported_seq":2083,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.374724+0000","last_change":"2024-09-14T11:59:07.374724+0000","last_active":"2024-09-14T11:59:07.374724+0000","last_peered":"2024-09-14T11:59:07.374724+0000","last_clean":"2024-09-14T11:59:07.374724+0000","last_became_active":"2024-09-14T11:15:34.332443+0000","last_became_peered":"2024-09-14T11:15:34.332443+0000","last_unstale":"2024-09-14T11:59:07.374724+0000","last_undegraded":"2024-09-14T11:59:07.374724+0000","last_fullsized":"2024-09-14T11:59:07.374724+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'510","last_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_deep_scrub":"262'510","last_deep_scrub_stamp":"2024-09-14T11:59:07.374631+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.374631+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:49.746178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2662,"num_read_kb":2469,"num_write":643,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'229","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.873293+0000","last_change":"2024-09-14T11:59:03.873293+0000","last_active":"2024-09-14T11:59:03.873293+0000","last_peered":"2024-09-14T11:59:03.873293+0000","last_clean":"2024-09-14T11:59:03.873293+0000","last_became_active":"2024-09-14T11:15:32.312296+0000","last_became_peered":"2024-09-14T11:15:32.312296+0000","last_unstale":"2024-09-14T11:59:03.873293+0000","last_undegraded":"2024-09-14T11:59:03.873293+0000","last_fullsized":"2024-09-14T11:59:03.873293+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-14T11:59:03.873191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.873191+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:41.942314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":2234,"num_write":1097,"num_write_kb":14516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'1088","reported_seq":2862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.960382+0000","last_change":"2024-09-14T11:59:12.960382+0000","last_active":"2024-09-14T11:59:12.960382+0000","last_peered":"2024-09-14T11:59:12.960382+0000","last_clean":"2024-09-14T11:59:12.960382+0000","last_became_active":"2024-09-14T11:15:34.327786+0000","last_became_peered":"2024-09-14T11:15:34.327786+0000","last_unstale":"2024-09-14T11:59:12.960382+0000","last_undegraded":"2024-09-14T11:59:12.960382+0000","last_fullsized":"2024-09-14T11:59:12.960382+0000","mapping_epoch":26,"log_start":"262'1000","ondisk_log_start":"262'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'1088","last_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_deep_scrub":"262'1088","last_deep_scrub_stamp":"2024-09-14T11:59:12.960278+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.960278+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":1000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:21.372173+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5439,"num_read_kb":4830,"num_write":1639,"num_write_kb":810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'210","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.309962+0000","last_change":"2024-09-14T11:59:06.309896+0000","last_active":"2024-09-14T11:59:06.309962+0000","last_peered":"2024-09-14T11:59:06.309962+0000","last_clean":"2024-09-14T11:59:06.309962+0000","last_became_active":"2024-09-14T11:15:32.311623+0000","last_became_peered":"2024-09-14T11:15:32.311623+0000","last_unstale":"2024-09-14T11:59:06.309962+0000","last_undegraded":"2024-09-14T11:59:06.309962+0000","last_fullsized":"2024-09-14T11:59:06.309962+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-14T11:59:06.309806+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.309806+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:19.118262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":34303,"num_write":987,"num_write_kb":37859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'475","reported_seq":2031,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.917735+0000","last_change":"2024-09-14T11:59:08.917735+0000","last_active":"2024-09-14T11:59:08.917735+0000","last_peered":"2024-09-14T11:59:08.917735+0000","last_clean":"2024-09-14T11:59:08.917735+0000","last_became_active":"2024-09-14T11:15:34.327648+0000","last_became_peered":"2024-09-14T11:15:34.327648+0000","last_unstale":"2024-09-14T11:59:08.917735+0000","last_undegraded":"2024-09-14T11:59:08.917735+0000","last_fullsized":"2024-09-14T11:59:08.917735+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'475","last_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_deep_scrub":"262'475","last_deep_scrub_stamp":"2024-09-14T11:59:08.917635+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.917635+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:56.114023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2794,"num_read_kb":2629,"num_write":639,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'254","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.828459+0000","last_change":"2024-09-14T11:59:02.828398+0000","last_active":"2024-09-14T11:59:02.828459+0000","last_peered":"2024-09-14T11:59:02.828459+0000","last_clean":"2024-09-14T11:59:02.828459+0000","last_became_active":"2024-09-14T11:15:32.317918+0000","last_became_peered":"2024-09-14T11:15:32.317918+0000","last_unstale":"2024-09-14T11:59:02.828459+0000","last_undegraded":"2024-09-14T11:59:02.828459+0000","last_fullsized":"2024-09-14T11:59:02.828459+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'254","last_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_deep_scrub":"262'254","last_deep_scrub_stamp":"2024-09-14T11:59:02.828297+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.828297+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:11.803512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":43532,"num_write":1122,"num_write_kb":25172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'188","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.832354+0000","last_change":"2024-09-14T11:59:03.832260+0000","last_active":"2024-09-14T11:59:03.832354+0000","last_peered":"2024-09-14T11:59:03.832354+0000","last_clean":"2024-09-14T11:59:03.832354+0000","last_became_active":"2024-09-14T11:15:32.312735+0000","last_became_peered":"2024-09-14T11:15:32.312735+0000","last_unstale":"2024-09-14T11:59:03.832354+0000","last_undegraded":"2024-09-14T11:59:03.832354+0000","last_fullsized":"2024-09-14T11:59:03.832354+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-14T11:59:03.832145+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.832145+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:54.524505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":29604,"num_write":903,"num_write_kb":26823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'414","reported_seq":1890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.403282+0000","last_change":"2024-09-14T11:59:09.403282+0000","last_active":"2024-09-14T11:59:09.403282+0000","last_peered":"2024-09-14T11:59:09.403282+0000","last_clean":"2024-09-14T11:59:09.403282+0000","last_became_active":"2024-09-14T11:15:34.328382+0000","last_became_peered":"2024-09-14T11:15:34.328382+0000","last_unstale":"2024-09-14T11:59:09.403282+0000","last_undegraded":"2024-09-14T11:59:09.403282+0000","last_fullsized":"2024-09-14T11:59:09.403282+0000","mapping_epoch":26,"log_start":"262'400","ondisk_log_start":"262'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'414","last_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_deep_scrub":"262'414","last_deep_scrub_stamp":"2024-09-14T11:59:09.403191+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.403191+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:28.990413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2197,"num_read_kb":2073,"num_write":469,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'282","reported_seq":1063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.669713+0000","last_change":"2024-09-14T11:58:58.669653+0000","last_active":"2024-09-14T11:58:58.669713+0000","last_peered":"2024-09-14T11:58:58.669713+0000","last_clean":"2024-09-14T11:58:58.669713+0000","last_became_active":"2024-09-14T11:15:32.312483+0000","last_became_peered":"2024-09-14T11:15:32.312483+0000","last_unstale":"2024-09-14T11:58:58.669713+0000","last_undegraded":"2024-09-14T11:58:58.669713+0000","last_fullsized":"2024-09-14T11:58:58.669713+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-14T11:58:58.669555+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.669555+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:27.928077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1009,"num_read_kb":66938,"num_write":1373,"num_write_kb":38496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'577","reported_seq":2183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.874845+0000","last_change":"2024-09-14T11:59:09.874845+0000","last_active":"2024-09-14T11:59:09.874845+0000","last_peered":"2024-09-14T11:59:09.874845+0000","last_clean":"2024-09-14T11:59:09.874845+0000","last_became_active":"2024-09-14T11:15:34.325886+0000","last_became_peered":"2024-09-14T11:15:34.325886+0000","last_unstale":"2024-09-14T11:59:09.874845+0000","last_undegraded":"2024-09-14T11:59:09.874845+0000","last_fullsized":"2024-09-14T11:59:09.874845+0000","mapping_epoch":26,"log_start":"262'500","ondisk_log_start":"262'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'577","last_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_deep_scrub":"262'577","last_deep_scrub_stamp":"2024-09-14T11:59:09.874761+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.874761+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:07.437905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2970,"num_read_kb":2718,"num_write":712,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":455,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10840,"num_read_kb":9066,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":999,"ondisk_log_size":999,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15151,"num_read_kb":14811,"num_write":17054,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2626,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1765,"ondisk_log_size":1765,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":377666,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8331,"num_read_kb":10588,"num_write":5619,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701918,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1802,"ondisk_log_size":1802,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220172,"num_read_kb":201455,"num_write":55877,"num_write_kb":19068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35729,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4129,"ondisk_log_size":4129,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42836797,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38922,"num_read_kb":2111716,"num_write":64484,"num_write_kb":2168012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86687744,"data_stored":85673594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4000,"ondisk_log_size":4000,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":180487,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":169164,"num_write":186,"num_write_kb":125118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509985,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":233200,"kb_used_data":13216,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94138640,"statfs":{"total":96636764160,"available":96397967360,"internally_reserved":0,"allocated":13533184,"data_stored":11861887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509985,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229032,"kb_used_data":9048,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94142808,"statfs":{"total":96636764160,"available":96402235392,"internally_reserved":0,"allocated":9265152,"data_stored":7716819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509986,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105944,"kb_used_data":12360,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94265896,"statfs":{"total":96636764160,"available":96528277504,"internally_reserved":0,"allocated":12656640,"data_stored":10956578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509985,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97660,"kb_used_data":17900,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94274180,"statfs":{"total":96636764160,"available":96536760320,"internally_reserved":0,"allocated":18329600,"data_stored":16701023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509987,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248296,"kb_used_data":18584,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123544,"statfs":{"total":96636764160,"available":96382509056,"internally_reserved":0,"allocated":19030016,"data_stored":17385395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509985,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75936,"kb_used_data":8656,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94295904,"statfs":{"total":96636764160,"available":96559005696,"internally_reserved":0,"allocated":8863744,"data_stored":7316623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509983,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252032,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94119808,"statfs":{"total":96636764160,"available":96378683392,"internally_reserved":0,"allocated":22855680,"data_stored":21154199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575392,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137572,"kb_used_data":12052,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94234268,"statfs":{"total":96636764160,"available":96495890432,"internally_reserved":0,"allocated":12341248,"data_stored":10776464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":18434939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8728576,"data_stored":8650845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5275648,"data_stored":5190678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15388672,"data_stored":15257314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14575710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8986624,"data_stored":8830204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5656576,"data_stored":5589626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9293824,"data_stored":9144278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:00:17.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T12:00:17.870 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T12:00:17.870 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T12:00:17.870 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T12:00:17.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:17.920 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T12:00:17.920 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T12:00:17.920 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:17.961 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T12:00:17.962 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T12:00:17.962 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.004 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T12:00:18.004 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T12:00:18.005 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.054 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T12:00:18.054 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T12:00:18.055 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.102 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T12:00:18.102 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T12:00:18.102 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.149 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T12:00:18.150 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T12:00:18.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.195 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T12:00:18.196 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T12:00:18.196 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.242 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T12:00:18.242 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T12:00:18.243 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T12:00:18.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.267 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T12:00:18.268 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T12:00:18.268 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.298 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T12:00:18.298 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T12:00:18.298 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T12:00:18.299 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.323 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T12:00:18.323 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T12:00:18.323 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.376 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T12:00:18.376 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T12:00:18.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:18.388 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T12:00:18.389 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T12:00:18.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T12:00:18.459 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T12:00:18.460 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T12:00:18.705 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T12:00:18.706 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T12:00:18.837 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T12:00:18.837 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T12:00:18.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T12:00:18.926 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T12:00:19.018 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T12:00:19.019 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T12:00:19.250 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T12:00:19.250 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T12:00:19.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T12:00:19.343 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T12:00:19.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T12:00:19.423 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T12:00:19.498 INFO:tasks.ceph:Archiving mon data... 2024-09-14T12:00:19.499 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/data/mon.a.tgz 2024-09-14T12:00:19.499 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-14T12:00:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.bTGtVbJhMv 2024-09-14T12:00:19.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bTGtVbJhMv 2024-09-14T12:00:19.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.bTGtVbJhMv 2024-09-14T12:00:19.838 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.bTGtVbJhMv is 468KB 2024-09-14T12:00:19.934 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.bTGtVbJhMv 2024-09-14T12:00:19.963 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/data/mon.c.tgz 2024-09-14T12:00:19.964 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-14T12:00:20.032 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.I6Ucp1KS6h 2024-09-14T12:00:20.032 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.I6Ucp1KS6h 2024-09-14T12:00:20.225 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.I6Ucp1KS6h 2024-09-14T12:00:20.336 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.I6Ucp1KS6h is 491KB 2024-09-14T12:00:20.418 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.I6Ucp1KS6h 2024-09-14T12:00:20.446 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/data/mon.b.tgz 2024-09-14T12:00:20.447 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-14T12:00:20.481 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.KvAse8KKKZ 2024-09-14T12:00:20.481 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.KvAse8KKKZ 2024-09-14T12:00:20.721 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.KvAse8KKKZ 2024-09-14T12:00:20.832 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.KvAse8KKKZ is 491KB 2024-09-14T12:00:20.930 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.KvAse8KKKZ 2024-09-14T12:00:20.959 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T12:00:20.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:00:20.961 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:00:21.073 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:00:21.104 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:00:21.105 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T12:00:21.106 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/remote/smithi007/crash 2024-09-14T12:00:21.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:00:21.153 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/remote/smithi189/crash 2024-09-14T12:00:21.154 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:00:21.192 INFO:tasks.ceph:Compressing logs... 2024-09-14T12:00:21.192 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:00:21.198 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:00:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T12:00:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186570.log 2024-09-14T12:00:21.284 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32863.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33138.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32863.log.gz 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33094.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.33138.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33138.log.gz 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr: --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.33094.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33094.log.gz 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32995.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33050.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32995.log.gz 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.33050.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T12:00:21.285 INFO:teuthology.orchestra.run.smithi189.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33050.log.gz 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33182.log 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.33182.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33182.log.gz 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32907.log 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32907.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32951.log 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32907.log.gz 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.32951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32951.log.gz 2024-09-14T12:00:21.286 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:00:21.348 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2024-09-14T12:00:21.348 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.186570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163475.log 2024-09-14T12:00:21.348 INFO:teuthology.orchestra.run.smithi007.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.186570.log.gz/var/log/ceph/ceph-client.admin.39119.log: 2024-09-14T12:00:21.348 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gz -5 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.90350.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.163475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105075.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.163475.log.gz 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.90350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125103.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190887.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.125103.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105075.log.gz 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158693.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.125103.log.gz 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156926.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190887.log.gz 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190335.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.90350.log.gz 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.158693.log.gz 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156926.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26714.log 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.156926.log.gz 2024-09-14T12:00:21.349 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187230.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190335.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.tmp-client.admin.26714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42030.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26714.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120390.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.187230.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.42030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190565.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42030.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.120390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113911.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.120390.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190565.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146896.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.113911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57123.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113911.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.146896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119801.log 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.146896.log.gz 2024-09-14T12:00:21.350 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38757.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57123.log.gz 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.119801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59551.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119801.log.gz 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40173.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38757.log.gz 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109199.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59551.log.gz 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.40173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160482.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40173.log.gz 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.109199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190427.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.109199.log.gz 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.160482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87405.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190427.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160482.log.gz -5 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.190427.log.gz 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.71420.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.87405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161660.log 2024-09-14T12:00:21.351 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.87405.log.gz 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179106.log 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.71420.log.gz 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100952.log 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.161660.log.gz 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.179106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79159.log 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.179106.log.gz 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62373.log 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100952.log.gz 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107431.log 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79159.log.gz 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118623.log 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62373.log.gz 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135705.log 2024-09-14T12:00:21.352 INFO:teuthology.orchestra.run.smithi007.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.107431.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.118623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185981.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.118623.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.135705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114500.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.185981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112144.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135705.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.185981.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.114500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165879.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.114500.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.112144.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.112144.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136883.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.165879.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73700.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.136883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54178.log 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.136883.log.gz 2024-09-14T12:00:21.353 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190795.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54178.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.73700.log.gz 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190795.log.gz 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.54178.log.gz 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115089.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48192.log: /var/log/ceph/ceph-client.admin.115089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64543.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115089.log.gz 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159872.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162249.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64543.log: /var/log/ceph/ceph-client.admin.159872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117445.log 0.0% 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159872.log.gz 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98007.log 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162249.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.64543.log.gz 2024-09-14T12:00:21.354 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77094.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.117445.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162249.log.gz 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.117445.log.gz 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187915.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.98007.log.gz 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.77094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38348.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187915.log.gz 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39397.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38348.log.gz 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122157.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86816.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39397.log.gz 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.122157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39073.log 2024-09-14T12:00:21.355 INFO:teuthology.orchestra.run.smithi007.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122157.log.gz 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.86816.log: /var/log/ceph/ceph-client.admin.39073.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39073.log.gz 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86816.log.gz 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.165290.log 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39487.log: 92.1% 0.0% -- replaced with /var/log/ceph/ceph-client.0.77094.log.gz -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187939.log 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.165290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164064.log 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.165290.log.gz 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59527.log 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.187939.log.gz 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153392.log 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.164064.log.gz 2024-09-14T12:00:21.356 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177888.log 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59527.log.gz 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162838.log 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.153392.log: /var/log/ceph/ceph-client.0.177888.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.153392.log.gz 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose 80.3% -- replaced with /var/log/ceph/ceph-client.0.177888.log.gz 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.132171.log 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72519.log 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162838.log.gz 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.132171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89761.log 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52411.log 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% 80.9% -- replaced with /var/log/ceph/ceph-client.admin.132171.log.gz -- replaced with /var/log/ceph/ceph-client.admin.72519.log.gz 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.89761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51822.log 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89761.log.gz 2024-09-14T12:00:21.357 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177279.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52411.log: /var/log/ceph/ceph-client.admin.51822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110377.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.52411.log.gz 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.51822.log.gz 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.177279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62291.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.177279.log.gz 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38091.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.110377.log: /var/log/ceph/ceph-client.admin.62291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159893.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62291.log.gz 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110377.log.gz 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105664.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38091.log.gz 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103897.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.159893.log.gz 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113322.log 2024-09-14T12:00:21.358 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105664.log: gzip -5 --verbose -- 81.6% /var/log/ceph/ceph-client.admin.144540.log -- replaced with /var/log/ceph/ceph-client.admin.105664.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103897.log: /var/log/ceph/ceph-client.admin.113322.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103897.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37877.log 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.144540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33238.log 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.144540.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61941.log 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37877.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50007.log 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33238.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130404.log 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113322.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.61941.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190473.log 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50007.log.gz 2024-09-14T12:00:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.130404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58349.log 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.130404.log.gz 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190473.log.gz 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77703.log 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76250.log 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58349.log: /var/log/ceph/ceph-client.0.77703.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.58349.log.gz 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126870.log 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.77703.log.gz 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.76250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80337.log 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose 84.0% -- -- replaced with /var/log/ceph/ceph-client.0.76250.log.gz /var/log/ceph/ceph-client.0.178497.log 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.126870.log: /var/log/ceph/ceph-client.admin.80337.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.126870.log.gz 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37831.log 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.80337.log.gz 2024-09-14T12:00:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.178497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38082.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37831.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.178497.log.gz 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39027.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37831.log.gz 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68894.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38082.log.gz 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39027.log.gz 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162862.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112733.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68894.log: /var/log/ceph/ceph-client.admin.162862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80926.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162862.log.gz 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.112733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51185.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112733.log.gz 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152787.log 2024-09-14T12:00:21.361 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85049.log 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80926.log.gz 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51185.log.gz 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.152787.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr: 85.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38084.log 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.152787.log.gz 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.68894.log.gz 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.85049.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188635.log 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85049.log.gz 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.38084.log: --verbose -- /var/log/ceph/ceph-client.admin.191025.log 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38084.log.gz 2024-09-14T12:00:21.362 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.188635.log: gzip -5 --verbose 80.6% -- replaced with /var/log/ceph/ceph-client.0.188635.log.gz 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.67656.log 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.191025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191025.log.gz 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62063.log 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38090.log 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62063.log: 51.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162886.log 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62063.log.gz 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127459.log 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38090.log.gz 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.162886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38359.log 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.162886.log.gz 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.127459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176668.log 2024-09-14T12:00:21.364 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67656.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.38359.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38359.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.58938.log 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.176668.log: 80.3%gzip -- replaced with /var/log/ceph/ceph-client.0.176668.log.gz -5 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38455.log 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58938.log: /var/log/ceph/ceph-client.admin.38455.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.127459.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr: 85.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97418.log 0.0% 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38455.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58938.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51233.log 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44915.log: /var/log/ceph/ceph-client.admin.97418.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93884.log 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.97418.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189340.log 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.93884.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.51233.log.gz 2024-09-14T12:00:21.365 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47014.log 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.93884.log.gz 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.189340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40818.log 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92117.log 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.40818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116856.log 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.40818.log.gz 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.92117.log: --verbose -- /var/log/ceph/ceph-client.admin.38826.log 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.116856.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92117.log.gz 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116856.log.gz 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38826.log: 0.0% 91.5% -- replaced with /var/log/ceph/ceph-client.admin.38826.log.gz -- replaced with /var/log/ceph/ceph-client.0.189340.log.gz 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121568.log 2024-09-14T12:00:21.366 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.33143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176059.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.121568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155748.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.176059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149253.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.176059.log.gz 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.155748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37591.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.155748.log.gz 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.149253.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.143362.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149253.log.gz/var/log/ceph/ceph-client.admin.37591.log: 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37591.log.gz 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191164.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.121568.log.gz 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146307.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.143362.log: /var/log/ceph/ceph-client.admin.191164.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.143362.log.gz 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191164.log.gz 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110966.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50596.log 2024-09-14T12:00:21.367 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.146307.log: /var/log/ceph/ceph-client.admin.110966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174812.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.110966.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78569.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50596.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.174812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87994.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78569.log: gzip -5 --verbose -- 82.3% -- replaced with /var/log/ceph/ceph-client.admin.78569.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.151609.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.146307.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.87994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38087.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.87994.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.151609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39533.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.151609.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38087.log: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.174812.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38087.log.gz 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43236.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39533.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.39533.log.gz /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T12:00:21.368 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171323.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.43236.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43236.log.gz 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101541.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.171323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120979.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101541.log: gzip 92.5% -- replaced with /var/log/ceph/ceph-client.admin.171323.log.gz 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99774.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101541.log.gz 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.120979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61651.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.120979.log.gz 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158104.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.99774.log.gz 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61651.log: gzip -5 --verbose 60.6% -- /var/log/ceph/ceph-client.admin.106253.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61651.log.gz 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.158104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187842.log 2024-09-14T12:00:21.369 INFO:teuthology.orchestra.run.smithi007.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.158104.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73108.log 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.106253.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187842.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187842.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.92706.log 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62437.log 94.2% 83.8% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73108.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.92706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83871.log 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.92706.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187182.log 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.83871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63328.log 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.83871.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187182.log.gz 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191211.log 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53589.log 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi007.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.63328.log.gz/var/log/ceph/ceph-client.admin.191211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128637.log 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191211.log.gz 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190979.log 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.128637.log: 85.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190657.log 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53589.log.gz 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.128637.log.gz 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38753.log 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190979.log.gz 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140417.log 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190657.log.gz 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38753.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38753.log.gz 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-mon.c.log 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.140417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179715.log 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140417.log.gz 2024-09-14T12:00:21.371 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69513.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.179715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138650.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.179715.log.gz/var/log/ceph/ceph-client.admin.69513.log: 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128048.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182760.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.128048.log: /var/log/ceph/ceph-client.admin.138650.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.128048.log.gz 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138650.log.gz 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69513.log.gz 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102130.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.182760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135116.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.182760.log.gz 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74881.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.102130.log.gz 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129226.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.135116.log: /var/log/ceph/ceph-client.admin.74881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109788.log 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr: 81.4%/var/log/ceph/ceph-client.admin.129226.log: -- replaced with /var/log/ceph/ceph-client.admin.135116.log.gz 81.7% -- replaced with /var/log/ceph/ceph-client.admin.74881.log.gz 2024-09-14T12:00:21.372 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129226.log.gz 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.133349.log 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.109788.log: gzip -5 --verbose -- 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109788.log.gz 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.139828.log 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.133349.log: gzip -5 --verbose -- 82.2% -- replaced with /var/log/ceph/ceph-client.admin.133349.log.gz 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.0.181542.log 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.139828.log: gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.139828.log.gz 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.75472.log 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.181542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41427.log 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.181542.log.gz 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75472.log: 24.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38363.log 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75472.log.gz 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.41427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180324.log 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41427.log.gz 2024-09-14T12:00:21.373 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173902.log 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38363.log: /var/log/ceph/ceph-client.0.180324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79748.log 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38363.log.gz 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.180324.log.gz 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95062.log 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173902.log.gz 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79748.log: gzip -5 --verbose 81.2% -- replaced with /var/log/ceph/ceph-client.admin.79748.log.gz 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.133938.log 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.95062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122747.log 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95062.log.gz/var/log/ceph/ceph-client.admin.133938.log: 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98596.log 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62437.log.gz 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38362.log 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98596.log: /var/log/ceph/ceph-client.admin.122747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190519.log 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38362.log: 86.1% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38362.log.gz 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133938.log.gz 2024-09-14T12:00:21.374 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122747.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48781.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190519.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190519.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65162.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98596.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48781.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145129.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47603.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.145129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37785.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145129.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37785.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.47603.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37785.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93295.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129815.log 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2024-09-14T12:00:21.375 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.93295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172686.log 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.129815.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.93295.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.129815.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111555.log 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175420.log 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172686.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.111555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57760.log 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0%/var/log/ceph/ceph-client.admin.175420.log: -- replaced with /var/log/ceph/ceph-client.admin.111555.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.175420.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65162.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68275.log 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170715.log 85.0% -- replaced with /var/log/ceph/ceph-client.admin.57760.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88583.log 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170715.log.gz 2024-09-14T12:00:21.376 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.88583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149842.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38756.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88583.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184587.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.149842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136294.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149842.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.184587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96829.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.136294.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.184587.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.136294.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191118.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190151.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96829.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.191118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191118.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99185.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190151.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190151.log.gz 2024-09-14T12:00:21.377 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37680.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.2.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99185.log.gz 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38825.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37680.log.gz 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38800.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38825.log.gz 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38664.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38800.log.gz 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190749.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38664.log.gz 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75641.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190749.log.gz 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62567.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.75641.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.75641.log.gz 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161071.log 2024-09-14T12:00:21.378 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62567.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.62567.log.gz 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123336.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.161071.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.161071.log.gz 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81515.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.123336.log: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68275.log.gz 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123336.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70134.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.81515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38827.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.81515.log.gz 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191257.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38827.log.gz 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170107.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.191257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191257.log.gz 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172078.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.170107.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70134.log.gz 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62503.log 2024-09-14T12:00:21.379 INFO:teuthology.orchestra.run.smithi007.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170107.log.gz 2024-09-14T12:00:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.172078.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T12:00:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62503.log: 53.8% -- replaced with /var/log/ceph/ceph-client.admin.62503.log.gz 2024-09-14T12:00:21.380 INFO:teuthology.orchestra.run.smithi007.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172078.log.gz 2024-09-14T12:00:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39556.log 2024-09-14T12:00:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104486.log 2024-09-14T12:00:21.380 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.39556.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.39556.log.gz 2024-09-14T12:00:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57147.log 2024-09-14T12:00:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104486.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104486.log.gz 2024-09-14T12:00:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191071.log 2024-09-14T12:00:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57147.log.gz 2024-09-14T12:00:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187890.log 2024-09-14T12:00:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.191071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191071.log.gz 2024-09-14T12:00:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187866.log 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187890.log.gz 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137472.log 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187866.log.gz 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157515.log 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.137472.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.137472.log.gz 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39443.log 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.157515.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157515.log.gz 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54767.log 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39443.log.gz 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85638.log 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54767.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.54767.log.gz 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90939.log 2024-09-14T12:00:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.85638.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.85638.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.90939.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.90939.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190105.log 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.log: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167914.log 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190105.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38456.log 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.167914.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.167914.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187206.log 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38456.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65788.log 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187206.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T12:00:21.438 INFO:teuthology.orchestra.run.smithi007.stderr: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145718.log 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154570.log 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65788.log: /var/log/ceph/ceph-client.admin.145718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102719.log 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145718.log.gz 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.154570.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.154570.log.gz 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164677.log 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100363.log 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102719.log: /var/log/ceph/ceph-client.admin.164677.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102719.log.gz 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164677.log.gz 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148075.log 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190289.log 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100363.log: /var/log/ceph/ceph-client.admin.148075.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100363.log.gz 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.148075.log.gz 2024-09-14T12:00:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125692.log 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187160.log 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190289.log.gz 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.125692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147485.log 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr: 93.1% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125692.log.gz 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65788.log.gz 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187160.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.187160.log.gz 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190243.log 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.147485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95651.log 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.147485.log.gz/var/log/ceph/ceph-client.admin.190243.log: 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190243.log.gz 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180933.log 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.95651.log: gzip -5 --verbose/var/log/ceph/ceph-client.0.180933.log: -- /var/log/ceph/ceph-client.admin.156337.log 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.95651.log.gz 2024-09-14T12:00:21.440 INFO:teuthology.orchestra.run.smithi007.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.180933.log.gz 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141595.log 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.156337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82104.log 85.2% -- replaced with /var/log/ceph/ceph-client.admin.156337.log.gz 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.141595.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.141595.log.gz 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.115678.log 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.82104.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.82104.log.gz 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.38085.log 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.115678.log: gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115678.log.gz 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.134527.log 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38085.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190381.log 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38085.log.gz 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.134527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169499.log 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.134527.log.gz 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152198.log 2024-09-14T12:00:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190381.log: /var/log/ceph/ceph-client.admin.169499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190381.log.gz 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63214.log 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187820.log 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.152198.log: /var/log/ceph/ceph-client.admin.63214.log: 20.8% -- replaced with /var/log/ceph/ceph-client.admin.63214.log.gz 94.1% -- replaced with /var/log/ceph/ceph-client.admin.169499.log.gz 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118034.log 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.187820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164701.log 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.187820.log.gz 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.118034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148664.log 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.152198.log.gz 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118034.log.gz 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124514.log 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155159.log 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.164701.log.gz/var/log/ceph/ceph-client.admin.148664.log: 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.124514.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.148664.log.gzgzip -5 --verbose 84.9% -- replaced with /var/log/ceph/ceph-client.admin.124514.log.gz 2024-09-14T12:00:21.442 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.91528.log 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.155159.log: gzip -5 --verbose -- 85.4% /var/log/ceph/ceph-client.admin.60753.log 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155159.log.gz 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.91528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89172.log 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.91528.log.gz 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164653.log 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60753.log: /var/log/ceph/ceph-client.admin.89172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139239.log 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.60753.log.gz 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89172.log.gz 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.164653.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141006.log 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164653.log.gz 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.139239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190197.log 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.139239.log.gz 2024-09-14T12:00:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82693.log 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.141006.log: /var/log/ceph/ceph-client.admin.190197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190611.log 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190197.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr: 81.9%/var/log/ceph/ceph-client.admin.82693.log: -- replaced with /var/log/ceph/ceph-client.admin.141006.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.82693.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130993.log 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.190611.log: -- /var/log/ceph/ceph-client.admin.131582.log 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190611.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.130993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74290.log 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.130993.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.131582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116267.log 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.131582.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.74290.log: -- /var/log/ceph/ceph-client.0.183369.log 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.116267.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.74290.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116267.log.gz 2024-09-14T12:00:21.444 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.190841.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.183369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86227.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.183369.log.gz 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190841.log.gz 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60164.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.86227.log: gzip 81.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.53000.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86227.log.gz 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106842.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53000.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.60164.log.gz 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103308.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.53000.log.gz 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106842.log: /var/log/ceph/ceph-client.admin.103308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167265.log 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/rgw.ceph.client.0.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103308.log.gz 2024-09-14T12:00:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63917.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.167265.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.167265.log.gz 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.106842.log.gz 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76960.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108020.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76960.log: 47.1% -- replaced with /var/log/ceph/ceph-client.admin.76960.log.gz 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126281.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108020.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.108020.log.gz 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55356.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.126281.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.126281.log.gz 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48805.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55356.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.55356.log.gz 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37655.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48805.log.gz 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108610.log 2024-09-14T12:00:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37655.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108610.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108610.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.32805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56534.log 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48829.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84460.log 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56534.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.56534.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168522.log 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.84460.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.84460.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119212.log 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.168522.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168522.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142184.log 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.119212.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119212.log.gz 2024-09-14T12:00:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38458.log 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.142184.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.142184.log.gz 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38458.log.gz 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59575.log 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45510.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.63917.log.gz 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38459.log 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59575.log: -- /var/log/ceph/ceph-client.admin.70753.log 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.59575.log.gz 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37739.log 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38459.log.gz 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96240.log 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37739.log.gz 2024-09-14T12:00:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159282.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96240.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.96240.log.gz 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63148.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.159282.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.159282.log.gz 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63148.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.63148.log.gz 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143951.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.70753.log.gz 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66408.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.143951.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183978.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143951.log.gz 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132760.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.183978.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.183978.log.gz 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182151.log 2024-09-14T12:00:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.132760.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132760.log.gz 2024-09-14T12:00:21.450 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94473.log 2024-09-14T12:00:21.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.182151.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.182151.log.gz 2024-09-14T12:00:21.450 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153981.log 2024-09-14T12:00:21.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.94473.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.94473.log.gz 2024-09-14T12:00:21.450 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123925.log 2024-09-14T12:00:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.153981.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.153981.log.gz 2024-09-14T12:00:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 92.9% -- replaced with /var/log/ceph/ceph-client.admin.66408.log.gz 2024-09-14T12:00:21.462 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67028.log 2024-09-14T12:00:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142773.log 2024-09-14T12:00:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67028.log: /var/log/ceph/ceph-client.admin.123925.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123925.log.gz 2024-09-14T12:00:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T12:00:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.142773.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.142773.log.gz 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55945.log 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.3.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67028.log.gz 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38088.log 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55945.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.55945.log.gz 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42633.log 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.38088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38088.log.gz 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46425.log 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.42633.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42633.log.gz 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173294.log 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46425.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.46425.log.gz 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37498.log 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.173294.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173294.log.gz 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83282.log 2024-09-14T12:00:21.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.37498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37498.log.gz 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151020.log 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.83282.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.83282.log.gz 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138061.log 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.151020.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.151020.log.gz 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190933.log 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.138061.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.138061.log.gz 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51209.log 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190933.log.gz 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190703.log 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51209.log.gz 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150431.log 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.190703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190703.log.gz 2024-09-14T12:00:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.150431.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.150431.log.gz 2024-09-14T12:00:21.718 INFO:teuthology.orchestra.run.smithi189.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T12:00:22.003 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T12:00:22.146 INFO:teuthology.orchestra.run.smithi007.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T12:00:22.951 INFO:teuthology.orchestra.run.smithi007.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T12:00:24.748 INFO:teuthology.orchestra.run.smithi007.stderr: 93.7% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T12:00:27.803 INFO:teuthology.orchestra.run.smithi007.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T12:00:29.459 INFO:teuthology.orchestra.run.smithi189.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T12:00:29.907 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T12:00:30.243 INFO:teuthology.orchestra.run.smithi189.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T12:00:31.094 INFO:teuthology.orchestra.run.smithi189.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T12:00:36.153 INFO:teuthology.orchestra.run.smithi007.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T12:00:37.747 INFO:teuthology.orchestra.run.smithi189.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T12:00:37.749 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-14T12:00:37.749 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m16.488s 2024-09-14T12:00:37.749 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m42.976s 2024-09-14T12:00:37.749 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m1.601s 2024-09-14T12:00:42.727 INFO:teuthology.orchestra.run.smithi007.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T12:00:42.729 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-14T12:00:42.730 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m21.505s 2024-09-14T12:00:42.730 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m55.593s 2024-09-14T12:00:42.730 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m2.063s 2024-09-14T12:00:42.730 INFO:tasks.ceph:Archiving logs... 2024-09-14T12:00:42.730 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/remote/smithi007/log 2024-09-14T12:00:42.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:00:49.991 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/remote/smithi189/log 2024-09-14T12:00:49.992 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:00:55.991 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T12:00:56.001 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T12:00:56.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:00:56.004 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:00:56.112 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T12:00:56.123 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T12:00:56.123 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:00:56.126 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:00:56.156 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:00:56.157 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:00:56.161 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:00:56.161 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-14T12:00:56.161 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 +2022us[+2016us] +/- 44ms 2024-09-14T12:00:56.161 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 25 +2764us[+2758us] +/- 59ms 2024-09-14T12:00:56.161 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -10ms[ -10ms] +/- 103ms 2024-09-14T12:00:56.161 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:00:56.163 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:00:56.163 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-14T12:00:56.163 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +2018us[+1970us] +/- 43ms 2024-09-14T12:00:56.163 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 +2751us[+2751us] +/- 59ms 2024-09-14T12:00:56.163 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -10ms[ -10ms] +/- 103ms 2024-09-14T12:00:56.163 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:00:56.163 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T12:00:56.173 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T12:00:56.174 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T12:00:56.183 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:00:56.292 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:00:56.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:00:56.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:56.414 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:00:56.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:56.457 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T12:00:56.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T12:00:56.478 INFO:teuthology.task.internal:Duration was 3172.727530 seconds 2024-09-14T12:00:56.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T12:00:56.487 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T12:00:56.488 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:00:56.490 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:00:56.544 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:00:56.549 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:00:56.738 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T12:00:56.739 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-14T12:00:56.739 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:00:56.774 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-14T12:00:56.775 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:00:56.817 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T12:00:56.817 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:00:56.820 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:00:56.898 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T12:00:56.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:00:56.901 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:00:57.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T12:00:57.062 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T12:00:57.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:00:57.103 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:00:57.142 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T12:00:57.154 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:57.157 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:57.192 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-14T12:00:57.220 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-14T12:00:57.270 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:57.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:57.299 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:57.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:57.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T12:00:57.350 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T12:00:57.351 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/remote/smithi007 2024-09-14T12:00:57.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:00:57.401 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904172/remote/smithi189 2024-09-14T12:00:57.402 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:00:57.447 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T12:00:57.447 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:00:57.450 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:00:57.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T12:00:57.525 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T12:00:57.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T12:00:57.535 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T12:00:57.536 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:00:57.538 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:00:57.564 INFO:teuthology.orchestra.run.smithi007.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:00 /home/ubuntu/cephtest 2024-09-14T12:00:57.580 INFO:teuthology.orchestra.run.smithi189.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:00 /home/ubuntu/cephtest 2024-09-14T12:00:57.581 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T12:00:57.592 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T12:00:57.639 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3172.7275297641754 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T12:00:57.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T12:00:57.726 INFO:teuthology.run:pass